One continuous, compact course in English. Move from foundations to data, software, local models, agents, and safe operations without getting lost in catalogues.
The interface holds a conversation; the model processes the context it receives.
By the end you can
Distinguish model, conversation, and external memory
Recognize what happens when context fills up
A chat organizes messages and may add files, search, or memory. The model only computes a response from the effective input of that call; it does not remember all your conversations by itself.
The context window has a limit. As instructions, documents, and replies accumulate, the application must trim, summarize, or retrieve only what matters. Every strategy can lose information.
Always check which information is sent, what persists outside the model, and which part comes from a connected tool.
RAG splits documents, builds representations for retrieval, and supplies relevant passages to the model. It does not turn incorrect documents into truth.
A citation should locate the document and passage supporting the answer.
Practice
Design ten questions: eight answerable and two out of scope.
Evidence
Questions, retrieved passages, answers, and abstentions.
Move from an idea to maintainable software without surrendering repository control.
13 / 28Editorial status: Periodic review
Specify before generating
Problem, user, data, states, and acceptance.
By the end you can
Create a small specification
Reduce rework
Define who uses the product, which problem it solves, which data it touches, and which states it must show. Include loading, empty, error, and success.
Build one small end-to-end path first; expand after testing it.
Ollama simplifies local execution, but the model still consumes storage, RAM, or VRAM. Do not expose the service to the Internet without authentication and controls.
Record version, exact model, quantization, and hardware so the test is reproducible.
Practice
Run a small model and measure time to first response and memory use.
Local can reduce data egress and variable cost, but adds hardware and maintenance. An API can offer greater capability, but introduces dependency, external processing, and usage cost.
A hybrid design uses policy to decide which tasks and data may use each route.
Practice
Create a decision matrix for three real tasks.
Evidence
Criteria, weights, decision, and change condition.
Size hardware for a measured task, not a universal promise.
By the end you can
Relate RAM, VRAM, quantization, and context
Design a test before buying hardware
Model weights, quantization, context cache, and other processes compete for memory. A model loading does not mean it responds at the latency you need.
NVIDIA, AMD, and Apple Silicon have different acceleration and compatibility paths. Verify the exact tool, operating system, and model in official sources.
Test with your prompts and measure peak memory, time to first token, and sustained speed. Include the worst context you will actually use.
Model call, tool, MCP, RAG, and agent add different capabilities.
By the end you can
Identify which component decides each step
Stop before adding unnecessary autonomy
A model call generates from supplied context. A tool executes a bounded function. MCP standardizes how that capability is discovered and invoked. RAG retrieves evidence. An agent can choose the next step.
Build all five steps with the same case so the comparison remains valid. Keep code in control of permissions, steps, citations, and stopping.
Do not add a loop when a deterministic workflow solves the problem. Every step must justify its new capability and new risk.
Operate useful systems and prove learning with evidence.
25 / 28Editorial status: Frequent review
Evals, logs, and observability
You cannot improve what you cannot reconstruct.
By the end you can
Define evaluation cases
Log useful traces without leaking data
Evaluate quality before deployment and monitor failures afterward. Retain minimized input, version, tools, latency, cost, and outcome where appropriate.
Logs are sensitive data too: apply access control, retention, and redaction.
Practice
Create ten evals and a trace schema for one feature.
Evidence
Baseline results, threshold, and three explained failures.
Find failures in a controlled, reproducible, and ethical way.
By the end you can
Design an adversarial test matrix
Prioritize mitigations by impact and reproducibility
Red teaming is not about collecting jailbreaks. Start from the threat model and cover privacy, secrets, instructions in documents, tool abuse, consumption, and harms relevant to the use case.
Run tests only in an authorized environment, with fictional data and no impact on third parties. Record input, configuration, output, severity, and reproducibility.
A mitigation should become code, permissions, filtering, evaluation, or human process and prove it does not break legitimate cases.