Evals
These are our own internal evaluations, open-sourced. Each one measures our workload, so it probably isn’t the right benchmark for yours, but the code and data are public if you want to fork one and tailor it.
- Live ScriptBench Our script-writer benchmark: objective measures (length, repetition, losing the middle, stock phrases, TTS format), an LLM judge, a censorship gate, informal verdicts and the live leaderboard.
- Leaderboard on Hugging Face ↗ A mirror of the ScriptBench leaderboard.
- Model chronicle dataset ↗ A few aired scripts from every model that has written the show, from Gemini 2.5 Flash onwards.
- Transcripts explorer ↗ Filter the full transcript corpus by date, script model and category.
- PodBench ↗ Not ours: Tencent’s public benchmark for podcast script generation (ACL 2026), the closest one to ScriptBench.