Jun 2022From Chaos to Focus: Understanding Transformers & AttentionAttention and the transformer block from first principles, plus what changed by 2026: pre-norm, RMSNorm, RoPE, grouped-query attention and the KV cache.