How language models work
Tokens, training and prediction: what happens inside a chatbot when it answers.
23tutors
7teachers
1free to start
$3 to $12per paid lesson
How language models work tutors
23 tutors
Embeddings: meaning as numbers
Embeddings: meaning as numbers
See how words and documents become vectors, and why similar meanings end up close together52 lessonsSampleBastian Weber$6From pretrained model to helpful assistantFrom pretrained model to helpful assistant
Learn how instruction tuning, preference training and system prompts turn a predictor into an assistant51 lessonsSampleBastian Weber$9The attention formula, step by stepThe attention formula, step by step
Work through queries, keys, values and softmax by hand until the transformer equation makes sense48 lessonsSampleBastian Weber$9Training versus inference, clearlyTraining versus inference, clearly
Learn what happens when a model is trained, what happens when you use it, and why it matters46 lessonsSampleBastian Weber$5Interpretability: looking inside neural networksInterpretability: looking inside neural networks
Learn how researchers try to understand what happens inside models, and what we still cannot see39 lessonsSampleBao Tran$12Scaling laws and where AI progress comes fromScaling laws and where AI progress comes from
Understand how compute, data and model size drive progress, and the debates about what comes next33 lessonsSampleBenedict Asante$10Reading AI benchmarks and research claimsReading AI benchmarks and research claims
Judge leaderboards, benchmark scores and model comparisons with a researcher's critical eye19 lessonsSampleBruno Azevedo$9Multimodal models: text, images and sound togetherMultimodal models: text, images and sound together
See how one model can read images, hear audio and write text, and where it still stumblesBenedict Asante$6Attention without the mathsAttention without the maths
Understand how transformers let each word look at the others, explained with pictures and storiesBastian Weber$5Why some models are fast: efficiency tricks insideWhy some models are fast: efficiency tricks inside
Learn the techniques that make models faster and cheaper: from mixture of experts to KV cachingBenedict Asante$11What an AI answer really costsWhat an AI answer really costs
Understand the compute, tokens and money behind AI answers and why prices vary so muchBenedict Asante$5Teachers who teach How language models work
They wrote the lesson plans these tutors follow.