Build a Robot Brain, One Block at a Time
Stack blocks, make them wider, and watch a robot brain grow to millions of parameters in this simple beginner guide.
Subject · 6 posts
Stack blocks, make them wider, and watch a robot brain grow to millions of parameters in this simple beginner guide.
A friendly, no maths look at how a language model builds sentences by guessing one likely next word at a time, with a tiny game to try.
A friendly guide to embeddings, where computers place each word as a point so that words with similar meanings sit close together.
A friendly look at how a state space model like Mamba keeps one small memory and updates it as words stream by, trading perfect recall for speed.
A gentle beginner guide to softmax, the little step that turns a model's raw scores into a pie of chances that adds up to a whole.
A gentle, playful look at attention, the simple idea that lets a computer figure out which words in a sentence belong together.