The spelled-out intro to language modeling: building makemore
Andrej Karpathy · 2 HN recommendations
Video Q&A
Ask AI to explain this scene or summarize the whole video. When an answer includes timestamps, select one to jump to that moment.
Try asking: What is the speaker explaining here?
Google sign-in is required. Review the maximum credit cost before confirming.
Andrej Karpathy builds a bigram character-level language model from scratch, introducing torch.Tensor and the framework of training, sampling and loss evaluation. It is the first step toward a GPT-style Transformer in his makemore series.
Why HN recommends it: HN recommends it as a long but worthwhile way to demystify how language models work technically.
“It's long (2h), but well worth the time if anyone is curious about the technical workings of LLMs.” Read on HN ↗