项目 starter 未实现各阶段前会一直测试失败,需按 stage 逐步实现;不同项目对运行时版本有要求,如 Python 3.10+、Node.js 22.18+、Rust;grader 需在仓库根目录执行,且部分项目还需 Python 3 配合。
ai-engineering-from-scratch
rohitg00MIT活跃维护从零手写实现 AI 工程核心组件的实战课程,覆盖智能体、大模型、计算机视觉与深度学习,边学边构建可交付的项目。
Learn AI Engineering! Learn it. Build it. Ship it for others.
python3 scripts/project_test.py retrieval-evaluation-lab --init learning-artifacts/retrieval-evaluation-labREADME 未说明
从零实现模型内部、检索管线与 Agent 运行时的开源 AI 工程课程,边写代码边验证
从零手写实现 AI 工程核心组件的实战课程,覆盖智能体、大模型、计算机视觉与深度学习,边学边构建可交付的项目。
核心能力
- 542 节课、20 个阶段,覆盖 Python/TypeScript/Rust/Julia
- 实现模型内部、检索管线与 Agent 运行时并保留评测结果
- 三个带分阶段 starter 和本地 grader 的项目挑战
- 提供梯度下降等可交互实验,可调学习率观察收敛
- 支持在网站、编码 Agent 或本地代码三种方式学习
容易踩的坑
- v2026.11.2Edition 2026.11.2: Lessons in Five Languages最新正式版2026-11-09 · 2026-11-09 19:13 UTC
Read each lesson in the language you use at work. This edition adds TypeScript ports to most lessons, and Rust, Julia and Go ports to the lessons where each of those languages is the right tool.
Start learning · Catalog · Interviews
Lessons in five languages
Language Lessons Where Python 534 Every lesson with code TypeScript 397 Most lessons, from math foundations to the capstones Rust 46 Tokenizers, retrieval, constrained decoding, serving schedulers, KV cache, binary analysis Julia 45 Numerical math, statistics, signal processing, small networks Go 16 MCP and A2A servers, gateways, auth, worker pools, durable execution, telemetry - Every port uses only the standard library of its language and keeps the functions and demos of the Python file.
- A lesson gets a Rust, Julia or Go port only when a practitioner would pick that language for the problem. Reinforcement learning, classical ML and torch-based lessons stay in Python.
- The language chips on each lesson page and the Lang column in the README show which ports a lesson has.
- CI compiles and runs every port on each pull request:
tsc --strict,rustc -D warnings, Julia, andgofmt,go vetandgo run. - Review of the ports also found and fixed bugs in the Python files, for example the tokenizer fallback for non-Latin text, out-of-range reads in the ELF and PE readers, and the code runner status in the capstone.
Site
- Lesson code blocks are rendered once at build time with Shiki.
- Search now indexes the body text of each lesson, not only the titles.
- Level-4 headings render as headings and show in the table of contents.
- Tabs, overlays and failed requests no longer leave the site in a broken state.
- llms.txt has one discovery section after the summary.
- Mermaid diagrams in the README are readable in dark mode.
Lessons and interviews
- The interview bank is now built by a generator on main.
- Lesson claims that the interview reviews found wrong are corrected.
- Better quiz distractors in phase 10 lessons 06 and 07.
- Phase 13 lesson 45 treats a clang that does not match the fixture the same as a missing clang.
Thanks to @eshitakundu and @viwe-monai for their contributions in this edition.
Full changelog: https://github.com/rohitg00/ai-engineering-from-scratch/compare/v2026.11.1...v2026.11.2
- v2026.11.1Edition 2026.11.1: Interview Bank and Incident Scenarios2026-11-03 · 2026-11-03 18:16 UTC
查看更新说明
Practise for AI engineering interviews against the course itself. This edition adds an interview bank of 482 questions and 60 measured incident scenarios, a mock interview skill, and code blocks rendered at build time.
Interviews · Scenarios · Skills · Start learning

Interview bank
- 482 questions in 23 cards, from math and classical ML to inference serving, agents, protocols, sandboxes and system design.
- Each question shows the prompt first and folds the answer, so you answer before you read. A short answer, a full answer, follow-ups from L1 to L4, and the wrong answers that interviewers hear.
- Every answer links to the lesson or manual section that teaches it. Every number in an answer comes from a file in the repository.
- 7 role paths pick the cards for a role, such as inference engineer or applied AI engineer.
Incident scenarios
- 60 scenarios built from real runs on the L4 and the GB10 in the SGLang, vLLM and Miles manuals.
- Each one gives the situation and the evidence, step by step: logs, metrics and configs, byte for byte from the run. Then the walkthrough, the resolution, and the wrong turns people take.
Mock interviews with an agent
The new
interview-prepskill runs a mock interview in your coding agent.- It asks one question or one scenario and waits for your answer. It never shows part of the answer first.
- It grades your answer against the bank, asks follow-ups one at a time, and sends each gap to the lesson that teaches it.
- It keeps a record of your sessions in
INTERVIEW-LEARNING.md.
Site
- Code blocks on practice pages, cheat sheets and manuals are rendered once at build time with Shiki. Terminal blocks copy only the commands, and output blocks have no Copy button.
- New Miles RL cheat sheet.
Fixes
- Review fixes across the interview answers, checked against their lessons: optimizer and schedule edge cases, attention and tokenizer code, cache pricing, eval statistics, and protocol and sandbox details.
- The generated interview indexes are now built on main after each merge, so contributions to the bank no longer conflict with each other.
Full changelog: https://github.com/rohitg00/ai-engineering-from-scratch/compare/v2026.10.5...v2026.11.1
- v2026.10.5Edition 2026.10.5: Lesson Screen, vLLM 101, and Miles 1012026-10-29 · 2026-10-29 15:07 UTC
查看更新说明
Learn beside your terminal, read two new hardware manuals, and practise every lesson. This edition adds the lesson screen for agent tutors, vLLM 101 and Miles 101, 47 practice tasks, and two new inside-the-machine pages.
Start learning · Skills · Manuals · Practice
Lesson screen for agent tutors
The new
lesson-screenskill opens a browser tab next to the terminal while a tutor teaches.- It shows the lesson's own interactive figures, code traces with values from a real run, and clickable predictions.
- The tutor can build a figure for the lesson while it teaches: a blueprint, a mechanism, an isometric machine, or a 3D model. It checks each build with screenshots before it shows it.
- After the tutor's quiz, a practice page gives a brief with key-term cards, a timed drill, spaced review at 1, 3, 7, and 16 days, and links to go deeper.
- Clicks are hints for the tutor. They never count as quiz answers or evidence. The certification tutors use the screen in Lesson mode only.
All six lesson tutors offer it. Without a local browser, they give the lesson page instead.
Manuals
- vLLM 101 and Miles 101 are published, next to SGLang 101, with measured, clock-locked GPU results and hardware-specific cover plates.
- SGLang 101 has 168 audited claims checked and corrected, research caveats, and new sweep configs.
- Manuals use their own words instead of quotes, pin evidence links to the built commit, and are easier for search engines and AI agents to find.
Practice and machines
- 47 practice tasks across implement, research, train, and lab kinds.
- Inside a Decompiler and Inside an LLM serving GPU machines, graded reverse-engineering labs, and step-synced lesson machines.
Site
- The navbar has a System, Light, and Dark theme menu in place of the old N/D switch. System follows your OS live.
- The catalog shows lesson numbers and done checkboxes.
- Quizzes are placed once per lesson. Highlights and read-aloud controls no longer overlap on phones and tablets.
Fixes
- Source errors corrected across phases 00 to 19, with phase 12 cheat sheets synced.
- Apple Silicon (MPS) device support across lessons. Thanks @Jayantkhandebharad.
- Stale translations repaired, and reviewed translations protected.
- Tutor skill lesson counts match the catalog.
Full changelog: https://github.com/rohitg00/ai-engineering-from-scratch/compare/v2026.10.4...v2026.10.5
- v2026.10.4Edition 2026.10.4: Highlights, Cheat Sheets, and SGLang2026-10-19 · 2026-10-19 08:42 UTC
查看更新说明
Highlight what matters, keep notes beside the text, and carry a compact reference into your next build. This edition adds a reading workspace, 154 cheat sheets, and the ready edition of SGLang 101.
Start learning · Cheat sheets · SGLang 101
Highlights and notes
Select text in a lesson or manual, choose one of four colors, and add a note. Open My Highlights to search, filter, jump back to a passage, or manage several highlights together.
- Export Markdown for your notes or JSON for backup and import.
- Move highlights between devices with a sync file or share link.
- Review uncertain matches when a passage changes.
- Use the same tools on mobile, in light and dark themes, and with forced colors.
Highlights stay in your browser. Use an export or share link to move them elsewhere.



154 cheat sheets
Find commands, formulas, diagrams, defaults, and troubleshooting notes across all 542 lessons, four manuals, and 78 projects. Browse 12 tracks or search by topic, task, command, or term. Follow a source link when you need the full explanation.
The complete collection is attached as aiefs-cheatsheets.pdf.


SGLang 101 is ready
Serve a model, size its KV cache, measure the concurrency knee, and decide when to split work across GPUs. The manual covers SGLang 0.5.22 in 28 sections plus six reference sections, with 63 figures and a cover plate.
The examples distinguish measured results from code defaults and reported claims. This edition includes Apple Silicon, GB10, cooled L4, and Miles rollout evidence, including CUDA graphs, attention backends, and three training seeds.
Read it online or download aiefs-manual-sglang-101.pdf below.
More in this edition
- A beginner guide and 142 exercise hints across 34 lessons in Phases 0 and 1.
- Project selection by role and lesson search inside phase dialogs.
- Reverse Engineering 101 updated for rea 6.7.0.
- Improved article navigation on smaller screens and a clean roadmap URL.
- Fixes for links containing parentheses, PDF math rendering, and deployment bundles.
Downloads
All six English books are included in PDF and EPUB. The four manual PDFs cover A2A, Docker Sandboxes, Reverse Engineering, and SGLang. The complete cheat-sheet PDF and six preview images are also attached.
Thanks to our contributors
Thank you to @Abhishek-1337 for lesson search in phase dialogs, @AkshayKathiriya and @dajiaohuang for fixes to links containing parentheses, and @ALANDVO for adding lesson summary cheat-sheet support. Thanks also to everyone who reported problems, reviewed changes, and helped improve the course.
[Full changelog](https://github.com/rohitg00/ai-engineering-from-scratch/compare/v2026.10.3...v2026
- v2026.10.3Edition 2026.10.32026-10-15 · 2026-10-15 04:29 UTC
查看更新说明
Edition 2026.10.3 adds a reverse engineering track, a third manual, and LaTeX math in the lessons. The curriculum grows from 523 to 542 lessons across 20 phases.
Learn reverse engineering
Fourteen new Phase 13 lessons teach how to read a compiled program you built yourself, from file bytes to evidence-backed pseudocode (#597).
- The lessons cover program anatomy (ELF, Mach-O, PE), disassembly and control-flow graphs, lifting to IR and SSA, calling conventions on System V, Windows x64 and AArch64, compiler idioms, linking and stripped binaries, data and type recovery, dynamic analysis, bytecode formats (Python, JVM, .NET, WebAssembly), binary diffing and symbolic execution, and a ground-truth scorecard for AI-assisted analysis.
- Each lesson runs real tools on its own fixtures: llvm-objdump, Ghidra, radare2, rizin, angr, lldb, LIEF, javap and wasm-objdump, among others.
- Two graded projects:
binary-inspector(6 stages, 91 tests) andmini-decompiler(8 stages, 105 tests), from an ELF loader to structured C that recompiles and compares equal. - A focused learning path and the
learn-reverse-engineeringtutor skill take a learner through the 14 lessons in order.
Read Reverse Engineering 101
Reverse Engineering 101 teaches rea (
rea-agents6.5.0) with the Ghidra 12.1.4 provider, from the firstrea doctorto an agent that keeps an evidence ledger over MCP. It has 26 sections in 8 parts, six reference sections, and 37 figures. The PDF is attached below asaiefs-manual-reverse-engineering-101.pdf(#601).- Every listing comes from a recorded run of the real CLI and MCP server.
capture/run.py --checkcaptures again and compares 65 files. - Every target is a fixture program written for the manual.
Read the math
- Lesson formulas render with LaTeX through KaTeX on the site, and as math on GitHub (#598). Formulas use only macros that GitHub allows, and CI checks that (#599).
New lessons and projects
- Five lessons fill gaps in the curriculum, and broken links are repaired (#584).
- Half the project roadmap is complete, with two new validated projects (#565).
- The architecture calculator in lesson 10/14 reads
head_dim, tied heads, and sliding-window layers (#511).
Site
- Lessons and their translations are rendered on the server, so crawlers and readers without JavaScript get the full text (#570).
- Glossary terms have their own pages, and each phase has a hub page (#574).
- Every page has its own social card (#576) and a crawlable favicon (#581).
- Inside an AI Agent is an interactive machine that shows each step of an agent run (#590).
- A /skills page lists the course skills, with five new figure and manual skills (#593).
- On wide screens, the lesson breadcrumb stays below the lesson (#600).
Contributors
Thank you to everyone who contributed to this edition:
- @FenjuFu fixed the architecture calculator in lesson 10/14 (#511)
Sponsors
Thank you to SerpApi for supporting the curriculum. SerpApi provides a Web Search API for AI apps, available in Markdown and JSON.
Books and manuals
All six English volumes are rebuilt as EPUB and PDF files from this edition's source and attached below, with the A2A 101, Docker Sandboxes and Docker Agent 101, and Reverse Engineering 101 manuals beside them. Interactive figures, graded quizzes, and runnable labs remain accessible through each chapter's online links. The website and README book links continue to use the latest release assets.
用户点评
登录用户的真实使用记录,可按版本和硬件筛选还没有人点评。第一个说出真实体验的人最有价值。
Implement model internals, retrieval pipelines, and agent runtimes. Test them, inspect failures, and keep the code and evaluation results.
Start learning · Choose a path · Try a lab · Build a project · Browse the curriculum
Free, open source, MIT. Learn on the website, with a coding agent, or by running local code.
542 lessons. 20 phases. Python, TypeScript, Rust, Julia.
Sponsors
Learning paths
| Route | Starting lesson |
|---|---|
| Model foundations | Setup and tooling |
| LLM systems | Prompt engineering |
| Agents and delivery | The agent loop |
Compare career paths · Prerequisites and study time
Gradient descent
Twenty starting points follow gradient descent on a quadratic loss. The graph shows their positions and mean loss after each update.
Adjust the learning rate in the lesson · Compare GD, momentum, and Adam in code
Projects
Three projects with staged starters, reference implementations, and local graders. Run commands from the repository root after setup. Starters fail until you implement the stages.
A candidate improves mean NDCG while one query ranks its most relevant evidence lower. Build a query-by-query comparison that reports the regression and can fail a release check.
Use Python 3.10+. Review RAG and model evaluation. Implement ranking validation, precision and recall, rank-sensitive metrics, then system comparison.
python3 scripts/project_test.py retrieval-evaluation-lab \
--init learning-artifacts/retrieval-evaluation-lab
python3 scripts/project_test.py retrieval-evaluation-lab \
--stage 1 --path learning-artifacts/retrieval-evaluation-lab --strict
python3 scripts/project_test.py retrieval-evaluation-lab \
--all --path learning-artifacts/retrieval-evaluation-lab --strict
Keep: a reproducible comparison with per-query deltas and the judgments used to score them. Metrics describe those judgments; they do not establish answer correctness.
Start the project · Inspect the reference · Run on your own inputs
A supplied trace still takes 100 ms, but total token usage rises by 200 and one span starts failing. Separate overlapping child work from parent execution time, then produce a report that exposes the change.
Use Node.js 22.18+ and Python 3 for the grader. Implement JSONL parsing, parent validation, interval arithmetic, then an inspectable timeline.
python3 scripts/project_test.py agent-trace-debugger \
--init learning-artifacts/agent-trace-debugger
python3 scripts/project_test.py agent-trace-debugger \
--stage 1 --path learning-artifacts/agent-trace-debugger --strict
python3 scripts/project_test.py agent-trace-debugger \
--all --path learning-artifacts/agent-trace-debugger --strict
Keep: the input trace, an HTML timeline, and a JSON regression report. Preserve exclusive per-span token counts so parent and child usage are not counted twice.
Start the project · Inspect the reference · Explore timing interactively
A write changes after review, or an approval is replayed. Validate the call envelope, check the caller's role and path, then consume an approval bound to the exact request and content.
Use Rust and Python 3.10+. Review tool schema design and security boundaries. The caller application supplies identity; the model proposes an operation.
python3 scripts/project_test.py tool-call-firewall \
--init learning-artifacts/tool-call-firewall
python3 scripts/project_test.py tool-call-firewall \
--stage 1 --path learning-artifacts/tool-call-firewall --strict
python3 scripts/project_test.py tool-call-firewall \
--all --path learning-artifacts/tool-call-firewall --strict
Keep: an audit receipt showing the requested operation and the policy decision. Approvals are single-use within one invocation; this project does not provide persistent authorization or an operating-system sandbox.
Start the project · Inspect the reference · Explore approval boundaries
Browse all projects · Career practice guide
Choose how to learn
On the website
Open any completed lesson on aiengineeringfromscratch.com or expand a phase under Contents. No setup, no cloning.
With an AI tutor
If Node.js, npx, and a skill-capable coding agent are already installed, your coding agent can become your tutor. A repository clone is not needed to install or read the tutor. Runnable focused-path labs need python3. Agent Skills host labs also need a selected host and a writable user or project skill scope.
npx skills add rohitg00/ai-engineering-from-scratch
Choose the host and scope when the installer asks. Use start-learning in Codex, /start-learning in Claude Code, or ask your host to use the skill by name.
Check the local requirements first:
node --version
npx --version
python3 --version
skills writes to the host and scope selected during installation, such as
.claude/skills/, .cursor/skills/, .codex/skills/, or another supported
skills folder. Verify that the selected host discovers that exact destination.
Invocation syntax belongs to the host, not to the portable SKILL.md format:
| Host | Start the course | Start Model Context Protocol (MCP) | Start Agent Skills | Run a phase quiz |
|---|---|---|---|---|
| Codex | start-learning, or choose it from /skills | learn-mcp, or choose it from /skills | learn-agent-skills, or choose it from /skills | check-understanding 13, or choose it from /skills |
| Claude Code | /start-learning | /learn-mcp | /learn-agent-skills | /check-understanding 13 |
| Other compatible hosts | Use start-learning to begin the course. | Use learn-mcp to start the Model Context Protocol (MCP) path. | Use learn-agent-skills to start the Agent Skills Engineering path. | Use check-understanding to quiz me on Phase 13. |
A ten-question placement quiz maps what you already know to a starting phase and
saves a personalized study plan to LEARNING.md. From there, the learn skill
teaches one lesson per session: concept, math, code, quiz. It streams lessons
straight from this repo, and the course-guide skill jumps you to the exact
lesson that covers anything you are stuck on. In Codex, invoke these skills with
learn and course-guide; in Claude Code, use /learn and /course-guide;
in other compatible hosts, ask to use the skill by name.
Only want Model Context Protocol (MCP)? Use the MCP invocation for your host. It creates
MCP-LEARNING.md and follows one 17-lesson route through stateless
requests, transports, bidirectional work, security, reliability, registry
governance, and conformance evidence. The exact order and checkpoints live in
the Model Context Protocol (MCP) manifest.
Only want Agent Skills? Use the Agent Skills invocation for your host. It
creates AGENT-SKILLS-LEARNING.md and follows one coherent five-lesson route:
contract, discovery, invocation, sandbox boundaries, then release evals and
real-host portability. Start on the web with the
Agent Skills path.
The installer lists the hosts it can configure and asks where to install. If
you do not have Node.js, npx, python3, a supported host, or a writable
scope yet, use the website or read docs/en.md manually. That path teaches the
concepts, but real-host discovery, invocation, script, and uninstall evidence
remains pending until the preflight is available. Read the lessons at
aiengineeringfromscratch.com.
The learning skills
| Skill | What it does |
|---|---|
start-learning | One-time onboarding: why you're learning, placement quiz, personalized plan saved to LEARNING.md. |
learn | The tutor loop. Warm-up recall, then the next lesson taught interactively, then its quiz; records progress and a review queue. |
course-guide | Topic router. "Where do I learn attention?" or "my loss is NaN" → the exact lessons, with links. |
learn-mcp | Focused Model Context Protocol (MCP) tutor. Creates MCP-LEARNING.md, follows the 17-lesson manifest, and records wire, security, reliability, and conformance evidence. |
learn-agent-skills | Focused Agent Skills tutor. Creates AGENT-SKILLS-LEARNING.md, teaches lessons 22, 24, 25, 26, and 27, and records real-host evidence. |
learn-reverse-engineering | Focused Reverse Engineering tutor. Creates REVERSE-ENGINEERING-LEARNING.md, teaches Phase 13 lessons 32 to 45 on programs you build yourself, and records lab evidence. |
claude-certification | Certification tutor. Chooses CCAO-F, CCDV-F, CCAR-F, or CCAR-P; teaches each lesson; runs labs; reviews artifacts; administers diagnostics and mocks; saves progress. |
mcpa-certification | MCPA tutor. Follows the 34-lesson mcpa-f route on the 2026-07-28 protocol; teaches each lesson; runs labs and the wire checker; administers the diagnostic and three mocks; saves progress. |
find-your-level | Ten-question placement quiz. Maps your knowledge to a starting phase and produces a personalized path with hour estimates. |
check-understanding <phase> | Per-phase quiz, eight questions, with feedback and specific lessons to review. Use the Codex, Claude Code, or natural-language form in the invocation table above. |
Run local code
git clone https://github.com/rohitg00/ai-engineering-from-scratch.git
cd ai-engineering-from-scratch
python3 phases/00-setup-and-tooling/01-dev-environment/code/verify.py --route beginner
python3 phases/01-math-foundations/01-linear-algebra-intuition/code/vectors.py
The preflight separates requirements needed now from tools needed later. Every
required failure includes the detected reason and a corrective command. The
vectors.py command is a dependency-free lesson and ends by showing that a matrix
times a vector is the operation inside a neural network layer. Save that
terminal output as your first evidence.
Use every lesson the same way
- Read
docs/en.mdand explain the core idea in your own words. - Type and build the important code instead of treating the code block as decoration.
- Run the lesson command from the repository root, the directory containing
README.mdandphases/. - Keep evidence: the command, working directory, exit code, meaningful output, and the artifact you changed or produced.
- Continue only when you can explain the output and make one small change without guessing.
Commands in lesson pages are paths from the repository root unless the lesson explicitly says to change directories. If a lesson offers several languages, run the implementation for the language you are learning.
Choose a learning path
You do not need to scan 542 lessons before beginning. Pick one goal. Each link opens the same curriculum on GitHub or the website, and both versions use the same lesson code.
| Your goal | Learn on GitHub | Learn on the website |
|---|---|---|
| I am new and want the complete foundation | Phase 0: Setup and Tooling | Dev Environment |
| I know Python and want math plus ML foundations | Phase 1: Math Foundations | Linear Algebra Intuition |
| I want to build production LLM applications | Phase 11: LLM Engineering | Prompt Engineering |
| I want to build agents | Phase 14: Agent Engineering | The Agent Loop |
| I want to use coding agents on real repositories | Agent-Assisted Engineering path | Agent-Assisted Engineering |
| I want to shape the right build before implementation | Product Judgment and Delivery path | Product Judgment and Delivery |
Not sure where you fit? Use the start-learning placement tutor
or the website prerequisites guide.
Compare four core domains and six career routes in the AI Engineering Learning Paths.
| Your goal | Learn on GitHub | Learn on the website |
|---|---|---|
| I want to build with Model Context Protocol (MCP) | Model Context Protocol (MCP) route | Model Context Protocol (MCP) path |
| I want to write and ship Agent Skills | Focused Agent Skills route | Agent Skills path |
| I want to read compiled programs | Reverse Engineering route | Reverse Engineering path |
Prerequisites
- You can write code (any language; Python helps).
- You want to understand how AI actually works, not just call APIs.
Where to start
| Background | Start at | Estimated time |
|---|---|---|
| New to programming and AI | Phase 0 — Setup | ~306 hours |
| Know Python, new to ML | Phase 1 — Math Foundations | ~270 hours |
| Know ML, new to deep learning | Phase 3 — Deep Learning Core | ~200 hours |
| Know deep learning, want LLMs and agents | Phase 10 — LLMs from Scratch | ~100 hours |
| Senior engineer, only want agent engineering | Phase 14 — Agent Engineering | ~60 hours |
| Only want to build production MCP systems | Model Context Protocol (MCP) path | ~23 hours 15 min |
| Only want to build production Agent Skills | Agent Skills Engineering path | ~9.5 hours |
| Only want to learn reverse engineering | Reverse Engineering path | ~32.5 hours |
The shape of the curriculum
Twenty phases stack on top of each other. Math is the floor. Agents and production are the roof. Skip ahead if you already know the lower layers, but don't skip and then wonder why something at the top is breaking.
%%{init: {'theme':'base','themeVariables':{'primaryColor':'#fafaf5','primaryTextColor':'#1a1a1a','primaryBorderColor':'#3553ff','lineColor':'#3553ff','fontFamily':'JetBrains Mono','fontSize':'12px'}}}%%
flowchart TB
P0["Phase 0 — Setup & Tooling"] --> P1["Phase 1 — Math Foundations"]
P1 --> P2["Phase 2 — ML Fundamentals"]
P2 --> P3["Phase 3 — Deep Learning Core"]
P3 --> P4["Phase 4 — Vision"]
P3 --> P5["Phase 5 — NLP"]
P3 --> P6["Phase 6 — Speech & Audio"]
P3 --> P9["Phase 9 — RL"]
P5 --> P7["Phase 7 — Transformers"]
P7 --> P8["Phase 8 — GenAI"]
P7 --> P10["Phase 10 — LLMs from Scratch"]
P10 --> P11["Phase 11 — LLM Engineering"]
P10 --> P12["Phase 12 — Multimodal"]
P11 --> P13["Phase 13 — Tools & Protocols"]
P13 --> P14["Phase 14 — Agent Engineering"]
P14 --> P15["Phase 15 — Autonomous Systems"]
P15 --> P16["Phase 16 — Multi-Agent & Swarms"]
P14 --> P17["Phase 17 — Infrastructure & Production"]
P15 --> P18["Phase 18 — Ethics & Alignment"]
P16 --> P19["Phase 19 — Capstone Projects"]
P17 --> P19
P18 --> P19
classDef phase fill:#fafaf5,stroke:#3553ff,color:#1a1a1a
class P0,P1,P2,P3,P4,P5,P6,P7,P8,P9,P10,P11,P12,P13,P14,P15,P16,P17,P18,P19 phase
Contents
Twenty phases. Click any phase to expand its lesson list.
Phase 0: Setup & Tooling 13 lessons
Get your environment ready for everything that follows.
| # | Lesson | Type | Lang |
|---|---|---|---|
| 01 | Dev Environment | Build | Python, TypeScript, Rust |
| 02 | Git & Collaboration | Learn | — |
| 03 | GPU Setup & Cloud | Build | Python |
| 04 | APIs & Keys | Build | Python, TypeScript |
| 05 | Jupyter Notebooks | Build | Python |
| 06 | Python Environments | Build | Shell |
| 07 | Docker for AI | Build | Docker |
| 08 | Editor Setup | Build | — |
| 09 | Data Management | Build | Python |
| 10 | Terminal & Shell | Learn | — |
| 11 | Linux for AI | Learn | — |
| 12 | Debugging & Profiling | Build | Python |
| 13 | Python for AI Engineering | Build | Python |
| # | Lesson | Type | Lang |
|---|---|---|---|
| 01 | What Is Machine Learning | Learn | Python |
| 02 | Linear Regression from Scratch | Build | Python, Rust, Julia |
| 03 | Logistic Regression & Classification | Build | Python, Rust, Julia |
| 04 | Decision Trees & Random Forests | Build | Python |
| 05 | Support Vector Machines | Build | Python, Julia |
| 06 | KNN & Distance Metrics | Build | Python |
| 07 | Unsupervised Learning: K-Means, DBSCAN | Build | Python |
| 08 | Feature Engineering & Selection | Build | Python |
| 09 | Model Evaluation: Metrics, Cross-Validation | Build | Python, Julia |
| 10 | Bias, Variance & the Learning Curve | Learn | Python |
| 11 | Ensemble Methods: Boosting, Bagging, Stacking | Build | Python |
| 12 | Hyperparameter Tuning | Build | Python |
| 13 | ML Pipelines & Experiment Tracking | Build | Python |
| 14 | Naive Bayes | Build | Python |
| 15 | Time Series Fundamentals | Build | Python |
| 16 | Anomaly Detection | Build | Python |
| 17 | Handling Imbalanced Data | Build | Python |
| 18 | Feature Selection | Build | Python |
| 19 | ML System Design — From Problem to Deployed Model | Build | Python |
| 20 | Monitoring Models in Production — Data Drift and Concept Drift | Build | Python |
| 21 | Feature Stores and Training-Serving Skew | Build | Python |
| # | Lesson | Type | Lang |
|---|---|---|---|
| 01 | The Perceptron: Where It All Started | Build | Python, Rust, Julia |
| 02 | Multi-Layer Networks & Forward Pass | Build | Python |
| 03 | Backpropagation from Scratch | Build | Python, Rust, Julia |
| 04 | Activation Functions: ReLU, Sigmoid, GELU & Why | Build | Python, Julia |
| 05 | Loss Functions: MSE, Cross-Entropy, Contrastive | Build | Python, Julia |
| 06 | Optimizers: SGD, Momentum, Adam, AdamW | Build | Python |
| 07 | Regularization: Dropout, Weight Decay, BatchNorm | Build | Python |
| 08 | Weight Initialization & Training Stability | Build | Python |
| 09 | Learning Rate Schedules & Warmup | Build | Python |
| 10 | Build Your Own Mini Framework | Build | Python |
| 11 | Introduction to PyTorch | Build | Python |
| 12 | Introduction to JAX | Build | Python |
| 13 | Debugging Neural Networks | Build | Python |
| # | Lesson | Type | Lang |
|---|---|---|---|
| 01 | Audio Fundamentals: Waveforms, Sampling, FFT | Learn | Python |
| 02 | Spectrograms, Mel Scale & Audio Features | Build | Python |
| 03 | Audio Classification | Build | Python |
| 04 | Speech Recognition (ASR) | Build | Python |
| 05 | Whisper: Architecture & Fine-Tuning | Build | Python |
| 06 | Speaker Recognition & Verification | Build | Python |
| 07 | Text-to-Speech (TTS) | Build | Python |
| 08 | Voice Cloning & Voice Conversion | Build | Python |
| 09 | Music Generation | Build | Python |
| 10 | Audio-Language Models | Build | Python |
| 11 | Real-Time Audio Processing | Build | Python, Rust |
| 12 | Build a Voice Assistant Pipeline | Build | Python |
| 13 | Neural Audio Codecs — EnCodec, SNAC, Mimi, DAC | Learn | Python |
| 14 | Voice Activity Detection & Turn-Taking | Build | Python |
| 15 | Streaming Speech-to-Speech — Moshi, Hibiki | Learn | Python |
| 16 | Voice Anti-Spoofing & Audio Watermarking | Build | Python |
| 17 | Audio Evaluation — WER, MOS, MMAU, Leaderboards | Learn | Python |
| # | Lesson | Type | Lang |
|---|---|---|---|
| 01 | Why Transformers: The Problems with RNNs | Learn | Python, Julia |
| 02 | Self-Attention from Scratch | Build | Python, Rust, Julia |
| 03 | Multi-Head Attention | Build | Python, Rust |
| 04 | Positional Encoding: Sinusoidal, RoPE, ALiBi | Build | Python, Rust, Julia |
| 05 | The Full Transformer: Encoder + Decoder | Build | Python, Julia |
| 06 | BERT — Masked Language Modeling | Build | Python |
| 07 | GPT — Causal Language Modeling | Build | Python |
| 08 | T5, BART — Encoder-Decoder Models | Learn | Python |
| 09 | Vision Transformers (ViT) | Build | Python |
| 10 | Audio Transformers — Whisper Architecture | Learn | Python |
| 11 | Mixture of Experts (MoE) | Build | Python |
| 12 | KV Cache, Flash Attention & Inference Optimization | Build | Python |
| 13 | Scaling Laws | Learn | Python |
| 14 | Build a Transformer from Scratch | Build | Python |
| 15 | Attention Variants — Sliding Window, Sparse, Differential | Build | Python |
| 16 | Speculative Decoding — Draft, Verify, Repeat | Build | Python |
| # | Lesson | Type | Lang |
|---|---|---|---|
| 01 | Generative Models: Taxonomy & History | Learn | Python |
| 02 | Autoencoders & VAE | Build | Python |
| 03 | GANs: Generator vs Discriminator | Build | Python |
| 04 | Conditional GANs & Pix2Pix | Build | Python |
| 05 | StyleGAN | Build | Python |
| 06 | Diffusion Models — DDPM from Scratch | Build | Python |
| 07 | Latent Diffusion & Stable Diffusion | Build | Python |
| 08 | ControlNet, LoRA & Conditioning | Build | Python |
| 09 | Inpainting, Outpainting & Editing | Build | Python |
| 10 | Video Generation | Build | Python |
| 11 | Audio Generation | Build | Python |
| 12 | 3D Generation | Build | Python |
| 13 | Flow Matching & Rectified Flows | Build | Python |
| 14 | Evaluation: FID, CLIP Score | Build | Python |
| 19 | Visual Autoregressive Modeling (VAR): Next-Scale Prediction | Build | Python |
| # | Lesson | Type | Lang |
|---|---|---|---|
| 01 | MDPs, States, Actions & Rewards | Learn | Python |
| 02 | Dynamic Programming | Build | Python |
| 03 | Monte Carlo Methods | Build | Python |
| 04 | Q-Learning, SARSA | Build | Python |
| 05 | Deep Q-Networks (DQN) | Build | Python |
| 06 | Policy Gradients — REINFORCE | Build | Python |
| 07 | Actor-Critic — A2C, A3C | Build | Python |
| 08 | PPO | Build | Python |
| 09 | Reward Modeling & RLHF | Build | Python |
| 10 | Multi-Agent RL | Build | Python |
| 11 | Sim-to-Real Transfer | Build | Python |
| 12 | RL for Games | Build | Python |
| # | Lesson | Type | Lang |
|---|---|---|---|
| 01 | Prompt Engineering: Techniques & Patterns | Build | Python, TypeScript |
| 02 | Few-Shot, CoT, Tree-of-Thought | Build | Python |
| 03 | Structured Outputs | Build | Python, TypeScript |
| 04 | Embeddings & Vector Representations | Build | Python, TypeScript |
| 05 | Context Engineering | Build | Python, TypeScript |
| 06 | RAG: Retrieval-Augmented Generation | Build | Python, TypeScript |
| 07 | Advanced RAG: Chunking, Reranking | Build | Python |
| 08 | Fine-Tuning with LoRA & QLoRA | Build | Python |
| 09 | Function Calling & Tool Use | Build | Python, TypeScript |
| 10 | Evaluation & Testing | Build | Python |
| 11 | Caching, Rate Limiting & Cost | Build | Python |
| 12 | Guardrails & Safety | Build | Python, TypeScript |
| 13 | Building a Production LLM App | Build | Python |
| 14 | Model Context Protocol (MCP) | Build | Python |
| 15 | Prompt Caching & Context Caching | Build | Python |
| 16 | Agent State Machines — Graphs, Nodes, Checkpoints | Build | Python |
| 17 | Agent Framework Tradeoffs | Learn | Python |
| # | Lesson | Type | Lang |
|---|---|---|---|
| 01 | The Tool Interface | Learn | Python, TypeScript |
| 02 | Function Calling Deep Dive | Build | Python |
| 03 | Parallel and Streaming Tool Calls | Build | Python |
| 04 | Structured Output | Build | Python |
| 05 | Tool Schema Design | Learn | Python |
| 06 | MCP Fundamentals: Stateless Requests and JSON-RPC | Learn | Python |
| 07 | Building an MCP Server: Stateless Python and TypeScript | Build | Python, TypeScript |
| 08 | Building an MCP Client: Discovery, Routing, and Dual-Era Fallback | Build | Python |
| 09 | MCP Transports: stdio and Stateless Streamable HTTP | Learn | Python |
| 10 | MCP Resources and Prompts: Addressable Context for Stateless Servers | Build | Python |
| 11 | MCP Model Input: Sampling Migration and Stateless MRTR | Build | Python |
| 12 | Explicit Scope and Stateless Elicitation | Build | Python |
| 13 | MCP Tasks Extension: Durable Work on a Stateless Core | Build | Python |
| 14 | MCP Apps on the Stateless Protocol | Build | Python |
| 15 | [MCP Security: Poisoned Metadata, Routing, and MRTR S |