AI Evaluation
522 episodes · Page 17 of 22
#1774: The Internal Heat Shield: Telling Hard Truths in DevRel
DevRel isn't just swag and conferences—it's the critical feedback loop keeping developers loyal in an AI-driven world.
#1763: Backend Grunt Work Is Dead. What Now?
AI agents now write 80% of boilerplate code, but the real backend engineering challenges remain.
#1762: Testing AI Truthfulness: Beyond Vibes
Stop trusting confident AI. We explore the formal science of testing LLMs for hallucinations and knowledge cutoffs.
#1756: The Ferrari in the Mud: Prestige Flops
We count down the five worst serious movies of the last five years, starting with a sci-fi disaster that wasted $80 million.
#1752: Whisper Small Beats Whisper Large in Speed & Accuracy
A 4GPU benchmark on Ubuntu shows the 1.5B parameter Whisper Large is slower and less accurate than the tiny Whisper Small.
#1735: The Agentic Stone Age: A Retrospective
We revisit the chaotic rise of BabyAGI and AutoGPT, exploring why their promise of total autonomy led to spectacular failure.
#1733: When AI Agents Build Their Own Societies
AI agents are forming neighborhoods, economies, and hospitals in server-side simulations that mirror real human behavior.
#1731: Why Deep Research Agents Are Being Forgotten
Specialized research agents outperform general orchestrators by 40-60% on verification tasks, yet developer hype is fading. Here's why.
#1730: Are Multi-Agent Coding Frameworks Obsolete?
MetaGPT, SWE-agent, and OpenHands promised a team of AI devs. But in 2026, are they still useful, or has raw model power made them obsolete?
#1728: The AI Carpool: Emergent Collaboration Through Role-Playing
CAMEL AI lets two agents role-play to solve tasks autonomously. No complex code—just emergent teamwork.
#1725: The Death of the Lonely Chatbot
Forget chatbots: AI orchestration is now the key to scaling intelligent agents in the enterprise.
#1718: The Ralph Wiggum Technique: AI That Codes Itself
Stop babysitting AI agents. Learn the Ralph Wiggum technique to automate iterative coding loops and let AI finish the job itself.
#1716: Seeing the AI Think: Visual Debugging for Agent Workflows
See how a visual, node-based tool lets you build complex AI agent workflows without writing code.
#1713: Why Native AI Search Grounding Still Fails
Native search grounding is expensive and flaky. Here’s why bolt-on tools still win for accurate, real-time AI answers.
#1702: Roleplay Models Aren't Just for NSFW—They're Creative Co-Processors
Forget GPT-4 for scripts—specialized roleplay models like Aion-2.0 are better at character consistency and dialogue.
#1680: Beyond China: AI in Russia, India, Japan
China dominates the AI conversation, but Russia, India, and Japan are building powerful regional models with unique architectures.
Also available in:Русский
#1668: Kimi K2's Hidden Reasoning: A New AI Architecture
Moonshot AI's Kimi K2 Thinking model uses a hidden reasoning phase to solve complex logic puzzles and coding tasks, beating top proprietary models.
#1636: The Mosh Pit Model: Can Chaos Train a Better Storyteller?
Can Elon Musk’s newest AI model handle a time-traveling toaster, or is it just a glorified search bar with an attitude?
#1633: Can a Character Actor Model Beat a Generalist?
We grill MiniMax M2.7 to see if a model built for "virtual companions" can actually handle high-level comedy and complex character logic.
#1630: When a Reasoning Model Overthinks Comedy
Xiaomi’s new MiMo 2.0 Pro model auditions for a comedy podcast, promising deep reasoning over raw speed.
#1622: The Leak That Exposed Anthropic's Next Move
A massive leak reveals Anthropic’s "Capybara" model, a breakthrough in AI cyber-capabilities that is already crashing cybersecurity stocks.
#1611: Why Anthropic's AI Can't Be Un-Safetied
Anthropic fights the Pentagon to keep Claude’s "conscience" intact. Discover the tech and philosophy behind AI’s first digital constitution.
#1602: When AI Truth-Seeking Meets the Law
Explore xAI’s shift to multi-agent systems and the massive hardware powering Grok 4.20, even as it hits a legal brick wall in Europe.
#1599: Xiaomi's Ghost Model: How Anonymous Testing Built an AI Empire
Xiaomi’s MiMo-V2 is here. Discover how the "Agent Era" is turning hardware into a trillion-parameter brain for your home and car.