protein language models

What ESM-2 Learned That Letter-Counting Couldn't

A 650-million-parameter protein language model, what its embeddings really encode, and why twenty lines of letter counting still beat it on 13-residue peptides.

Machine Learning for Biology03