RoBERTa

Encoder models pull over a billion downloads a month. Decoder models pull 397 million. The AI conversation and the download counter are describing ...

Feature extraction, fill-mask, token classification — the classic NLP tasks still have a job. Here's when a small model beats a frontier API.

Large language models grew out of linguistics — so why aren't linguists in the room where they're built?