neural networks

Send the Poets Home: Expert Pruning, a Student Model, and When to Pick Each

A bank rents the biggest MoE around, salary day brings a thousand customers, and the team learns what to prune, why Bangla breaks, and when to teach a student.

Mixture of Experts03

Meet Your One Brain Cell

Learn how a single pretend brain cell weighs its inputs and lights up, the simplest idea behind every neural network.

Watch a Tiny Network Learn a Pattern

Press Train and watch a small network of cells learn a pattern one cell cannot, a gentle first look at neural networks and backpropagation.

The Slowest Kid Problem: How a Super Captain Solves MoE's Biggest Headache

Why a mixture-of-experts layer runs at the speed of its busiest expert, how to measure it, and when predictive prefetching actually helps.

Mixture of Experts02

From One Brain to Many: Understanding Mixture of Experts (MoE) Like You're 12

How sparse mixture-of-experts really works: per-token routing, top-k gating, load balancing, and the memory bill you pay for the compute you save.

Mixture of Experts01