Back to Playlists
Spelled-Out AI: Building GPT From Scratch

Spelled-Out AI: Building GPT From Scratch

Build neural networks and large language models like GPT from scratch. This 'spelled-out' coding journey demystifies complex AI, providing a fundamental, hands-on understanding of how modern AI systems are built.

ai-ml
·8 videos·14:36:56

Videos in this playlist

1
The spelled-out intro to neural networks and backpropagation: building micrograd2:25:52

The spelled-out intro to neural networks and backpropagation: building micrograd

Andrej Karpathy

17 segments·15 key terms
2
The spelled-out intro to language modeling: building makemore1:57:45

The spelled-out intro to language modeling: building makemore

Andrej Karpathy

15 segments·15 key terms
3
Building makemore Part 2: MLP1:15:40

Building makemore Part 2: MLP

Andrej Karpathy

9 segments·11 key terms
4
Building makemore Part 3: Activations & Gradients, BatchNorm1:55:58

Building makemore Part 3: Activations & Gradients, BatchNorm

Andrej Karpathy

15 segments·15 key terms
5
Building makemore Part 4: Becoming a Backprop Ninja1:55:24

Building makemore Part 4: Becoming a Backprop Ninja

Andrej Karpathy

15 segments·15 key terms
6
Building makemore Part 5: Building a WaveNet56:22

Building makemore Part 5: Building a WaveNet

Andrej Karpathy

6 segments·8 key terms
7
Let's build GPT: from scratch, in code, spelled out.1:56:20

Let's build GPT: from scratch, in code, spelled out.

Andrej Karpathy

15 segments·15 key terms
8
Let's build the GPT Tokenizer2:13:35

Let's build the GPT Tokenizer

Andrej Karpathy

14 segments·15 key terms