AI Evaluation
522 episodes · Page 22 of 22
#118: AI in 2025: Is Small the New Big?
If the cost is the same, should you always use the biggest AI model? Discover why smaller models often win on speed, steering, and accuracy.
#108: Why Your AI Code Assistant Gets Worse
Why do AI models lose their edge over time? Herman and Corn explore the "home team advantage" and why telling your AI to "do better" actually works.
#105: Beyond Math Puzzles: The Truth About AI Benchmarks
Are AI models getting smarter, or just better at memorizing tests? Herman and Corn dive into the controversial world of 2025 AI benchmarks.
#94: Are AI Villages Useful or Just Digital Ant Farms?
Herman and Corn explore "Smallville," a digital town where AI agents plan parties, form memories, and simulate human society.
#92: Is AI Eating Its Own Trash?
Is brute force the only path to AGI? Corn and Herman explore the limits of scaling, the risk of model collapse, and the future of world models.
#85: When Probability Beats Truth: Why AI Must Lie
Why do smart AI systems make up fake facts? Corn and Herman explore the "feature" of digital hallucinations and how to spot them.
#81: When AI Judges Can't Tell Humans from Bots
Can a robot tell if you’re human? Herman and Corn explore the "Reverse Turing Test" and why being "messy" might be our best defense.
#68: The Looming Digital Ice Age: AI Eating Itself?
Is AI eating itself? Explore the "model collapse" and the "Hapsburg AI problem" before our digital world speaks only gibberish.
#67: Scaling or Pivoting AI for Code
Are LLMs truly the future of coding, or do they need a fundamental architectural pivot? We dive into AI's programming future.
#51: AI Policy Wargaming: Can Agents Argue Better Than Humans?
Can AI agents debate global policy better than humans? We explore AI wargaming, from UN simulations to stress-testing geopolitics.
#45: When AI Safety Fails: The Guardrail Paradox
AI guardrails: Fences, failures, and free speech. Can we control AI's infinite output, or do digital fences always break?
#42: AI's Secret: Decoding the .5 Updates
Uncover the hidden world of AI's .5 updates. It's not just bug fixes—it's hundreds of millions and countless hours shaping smarter, safer AI.
#36: When Smart Software Became AI
AI isn't new. We've been using "smart software" for decades, from medical imaging to weather prediction, long before ChatGPT.
#30: Which AI Tools Will You Still Use Next Year?
RAG vs. Memory: Are you building resilient AI? Discover the crucial difference between these two foundational pillars.
#26: Fine-Tuning AI to Understand Your Voice
Voice typing is changing everything. Join us as we explore the revolution of personalizing Whisper!
#14: AGI's Crossroads: Are LLMs a "Dead End" to True AI?
Are LLMs a dead end for true AGI? We dive into the electrifying debate with AI's forefathers.
#9: Benchmarking Custom ASR Tools - Beyond The WER
Benchmarking custom ASR fine-tunes: We're diving deep beyond the WER to truly measure performance.
#5: Fine-Tuning ASR For Maximal Usability
Fine-tuned ASR is just the start. Discover the next steps for deployment and maximizing usability.