AI Evaluation
522 episodes · Page 8 of 22
#4722: Why Manuals Are Terrible (And How AI Can Fix Them)
Why appliance manuals are 22 pages of warnings and car manuals actually work — and how AI can break the cycle.
#4720: Compass vs. Warning Sign: Prompting for Long-Term AI
How positive and negative instructions reshape AI behavior differently — and why "preserve this" beats "fix this" in system prompts.
#4712: Codex vs Claude Code: The Real Agentic Coding Showdown
Benchmarks, model variants, and MCP setups — which coding agent actually wins where it matters?
#4711: When AI Agents Need a Compliance Checkbox
ISO 42001 is coming for your agentic pipeline. Small businesses need to know what's heading their way.
#4710: ISO 42001: The New Rulebook for AI Accountability
How the first certifiable AI management standard works, what it actually certifies, and why "AI compliance" is now its own profession.
#4699: The Hidden Engine: What Makes Claude Code Tick
Is it the model or the harness? We break down the invisible scaffolding that turns LLMs into real agents.
#4696: Why AI Over-Explains Simple Tasks
Why does AI turn a simple request into a 24-page document? We explore the training biases and architectural limits behind AI's tendency to over-del...
#4682: When Context Windows Grow: What Survives?
If context windows jump to 10M tokens, which AI engineering practices survive? We separate load-bearing architecture from temporary scaffolding.
#4670: Why AI Weights Are Indecipherable
Can you actually read an AI model's weights like a book? We explore why the answer is mostly no — and what researchers are doing about it.
#4668: Why Podcast AI Voices Sound Too Perfect
We dig into why AI podcast voices sound too clean—and how TTS is learning to stumble, overlap, and interrupt convincingly.
#4619: The Token Trap: Why AI Context Windows Confuse Everyone
Token counts are everywhere, but they don't tell you what AI can actually do. Here's what should replace them.
#4589: The Answer Reflex: Why AI Models Can't Follow Instructions
DeepSeek passes a simple test that stumps GPT and Claude. Why can't Western models stay in character?
#4570: One Negative Prompt Beat a Dozen Positives — Here's Why
Why one blunt "don't" outperformed a dozen careful "do's" — and how to structure your system prompts for maximum compliance.
#4505: What DeepSeek's Training Data Reveals About Model Voice
Why Chinese AI models trained on 60% English still produce dialogue that feels distinctively different.
#4490: Right to Repair: History, Hype, and Hard Limits
From John Deere tractors to iPhone batteries — the real history, genuine commitments, and where repair advocates overreach.
#4477: Structuring Raw Voice Prompts at Scale
How to decompose messy voice dictation into clean, routable components for AI workflows.
#4444: Testing the Unpredictable: QA for Agentic AI
How QA adapts when your AI system gives different answers to the same question every time.
#4415: Why Your Phone Scan Fails (and How to Fix It)
AI scanners are amazing—until they fail on glare or white paper. Here's how to fix it with stuff you already own.
#4340: Building an AI Tutor That Teaches You to Code Without Writing It For You
How to build an AI tutor that assigns projects, reviews code, and remembers what you've learned — without writing your code for you.
#4338: The Hidden Skill Most AI Models Still Fail At
Why do even top AI models still accidentally paste your questions into the output? A deep dive into a missing benchmark.
#4313: Did You Really Build That App? AI Imposter Syndrome
You built a working app with AI in a weekend. So why does it feel like you don't deserve to charge for it?
#4312: Why Speech-to-Text Still Fails at Its Own Name
When OpenAI's Whisper misheard its own name as "Wispr," it revealed why 95% word accuracy still isn't good enough.
#4304: Rhetoric for Interviews and Pitches
Three persuasion techniques from political speech, applied ethically to job interviews and client pitches.
#4274: Fixing Loop-Damaged Podcasts with AI and FFmpeg
Can an AI agent detect repeated audio, generate FFmpeg commands, and overwrite files in cloud storage without breaking RSS?