AI Engineering from Scratch
Curated by AI Engineering from Scratch • Added 2026-06-25
Build production AI systems from first principles across 500+ free lessons
AI Engineering from Scratch provides 523 open-source, hands-on lessons teaching you how to build tokenizers, embedding models, vector search indexes, LLM agent frameworks, and evaluation harnesses from fundamental first principles.

- ✓Building byte-pair encoding (BPE) tokenizers and dense vector embedding spaces from scratch
- ✓Implementing vector similarity search algorithms (HNSW, cosine indexes) without black-box databases
- ✓Constructing autonomous LLM agent execution loops, tool calling protocols, and state graphs
- ✓Designing statistical evaluation pipelines and synthetic benchmarks to measure hallucination rates
- ★523 comprehensive free lessons
- ★Zero black-box abstractions
- ★Production-grade system architectures
Add the Learnlists badge to your website
Show visitors that AI Engineering from Scratch is curated and listed on Learnlists. Paste the embed code on your landing page, docs, or footer to drive verified social proof.
Select Style
Pick Standard or Compact in Light or Dark.
Copy Snippet
Includes automatic attribution & canonical link.
Paste into HTML
Compatible with React, Astro, WordPress, Webflow.
Related in AI & Machine Learning
Other vetted resources in this discipline

TrenTorch
Build machine learning frameworks from scratch by hand

Fanout
Mapped technical learning across AI research, systems, and ML math

Inference Engineering
Deep-dive technical guide to LLM inference optimization & runtime mechanics
