AI Inference
554 episodes · Page 11 of 24
#3322: Desk Pets: Local AI on Your Desktop
Are desk pets useful tools or expensive Tamagotchis? We break down the local AI, privacy tradeoffs, and psychology behind these devices.
#3284: Agent Infrastructure Engineer: The New DevOps
Agentic AI is splintering into real engineering disciplines. Here's what the "DevOps of AI" actually does.
#3282: How Warehouses Actually Work (From Roman Granaries to Robot Fleets)
From 9500 BCE granaries to Amazon's 750,000 robots — the hidden history of where stuff waits.
#3278: How to Get Early AI Model Access as a Solo Developer
How a solo developer spending $300/month can get early access to new AI models before the press release.
#3261: The Hidden Zoo of Drug Testing
Mice dominate headlines, but drug validation relies on dogs, pigs, ferrets, and macaques — each chosen for a specific human system.
#3234: Who Should Sponsor This Podcast? Open-Book Economics
We open the books on our AI-generated podcast: $200/month costs, 180K plays, zero sponsors. Who should we pitch?
#3170: Pharmacokinetics vs Neural Nets: Two Meanings of "Model
Two things called "models" that work completely differently — and why the confusion matters for patient safety.
#3157: Opus 4.8: What Actually Changed Under the Hood
Anthropic dropped Opus 4.8 with no fanfare. New training data, faster inference, and smarter refusals — here's what changed.
#3120: What Makes Agentic Search Tools Like Exa Actually Work?
Why swapping Google for Exa transformed our show's accuracy — and what agentic search does differently.
#3100: How Cars Predict Black Ice Before Your Foot Hits the Brake
From ABS to AI: how cars evolved from surviving crashes to predicting them before drivers notice danger.
#3020: How Chatterbox Locks Your Voice Clone Across Thousands of Generations
Why most single-shot TTS models drift over time—and how Chatterbox's cached embedding approach solves it.
#2924: When Adding One Agent Breaks Everything
The math behind why your 100-agent pipeline fails 40% of the time — and what to do about it.
#2923: Structured Outputs: Taming AI's Token Lottery
Why prompt engineering isn't enough to get consistent JSON from LLMs.
#2900: From Piggy Tier to Production: Making Kids Animation in 2026
Breaking down what it takes to make a YouTube Kids cartoon — and where AI actually helps.
#2811: Cloudflare's Endgame: From CDN to Cloud Platform
How a spam-tracking side project became the CDN that's quietly building a new kind of cloud.
#2777: GPU Idle Waste and Serverless Green Computing
Why your dedicated GPU burns 130 watts doing nothing, and how serverless platforms cut energy waste by more than half.
#2773: Beyond Static Fallbacks: Agentic Error Handling in AI Pipelines
From try-except blocks to planning agents that route around failures intelligently.
#2693: When AI Ignores Your Style Guide
Why your AI ignores formatting instructions and how to fix it with pipeline architecture, not model swaps.
#2687: When Pre-Flight Checks Help (or Hurt) Agentic AI Plugins
How to decide when a pre-flight check is worth the latency cost — and how to write good ones.
#2682: Live Retrieval vs. RAG: What an Agent Actually Does
Does every AI conversation create a tiny vector store? We unpack the real tradeoffs between live document fetching and pre-indexed RAG.
#2677: Memory Layers for AI Agents: SaaS vs Self-Hosted
Zep, mem0, Letta, Graphiti, Cognee — which memory layer should you commit to for your AI agent?
#2676: Vector Database Schema Design for AI Memory Layers
Stop dumping vectors blindly. Design metadata schemas and namespaces for retrieval that actually works at scale.
#2672: When a Startup Claims to Break the Quadratic Wall
A startup claims linear attention scaling at 12M tokens, beating GPT-5.5 on retrieval benchmarks.
#2668: When a Flamethrower Is Overkill
Tesseract, EasyOCR, or a cloud vision model? How to build a fast, reliable label scanner for real-world conditions.