AI Inference
554 episodes · Page 17 of 24
#1784: Context1: The Retrieval Coprocessor
Chroma's new 20B model acts as a specialized "scout" for your LLM, replacing slow, static RAG with multi-step, agentic search.
#1778: Audio Is the New "Read Later" Graveyard
Why listening to AI conversations beats reading dense PDFs, and how serverless GPUs make it cheap.
#1765: The Agentic Internet: A Clean Web for Machines
We explore the tools building a parallel, machine-readable web—from SearXNG to Tavily.
#1752: Whisper Small Beats Whisper Large in Speed & Accuracy
A 4GPU benchmark on Ubuntu shows the 1.5B parameter Whisper Large is slower and less accurate than the tiny Whisper Small.
#1750: Herman's Music Showcase: The Suno Sessions
Herman reveals his secret DJ life and debuts 9 AI-made tracks from Suno. Full songs, personal stories, and a GPU conspiracy theory.
#1740: Why Open Source Is a Power Tool Strategy
We dissect Resemble AI's Chatterbox to see how its open-source TTS compares to commercial giants like ElevenLabs.
#1736: The Hidden AI Economy: Following the Tokens
OpenClaw is processing 16.5 trillion tokens daily, dwarfing Wikipedia. Here’s why it’s #1.
#1732: Why AI Agents Need an Operating System
AIOS aims to be the Linux for AI agents, managing memory, scheduling, and tools in one open-source kernel.
#1727: The Great Architectural Heist: LSP as AI's Universal Plumbing
Explore how the Language Server Protocol is being repurposed to integrate AI directly into code editors, unifying development workflows.
#1724: When AI Dubbing Swaps Your Gender
How does YouTube translate a video with one click? We explore the tech behind auto-dubbing, from sandwich models to voice cloning.
#1723: Why Agentic AI Needs a Hive Mind, Not a Single Brain
The single monolithic AI model is dying. Meet the new native multi-agent architectures that think like a team, not a solo genius.
#1713: Why Native AI Search Grounding Still Fails
Native search grounding is expensive and flaky. Here’s why bolt-on tools still win for accurate, real-time AI answers.
#1705: Microsoft's Phi: The Small Model Bet for Agentic AI
Microsoft is pushing small language models like Phi for agentic AI. Here’s why that strategy matters for speed, cost, and edge computing.
#1679: Efficiency Over Scale: How Export Controls Forced a Smarter AI
DeepSeek and MiMo are topping developer charts, but they're not just cheaper clones. Here's why their design philosophy is fundamentally different.
#1668: Kimi K2's Hidden Reasoning: A New AI Architecture
Moonshot AI's Kimi K2 Thinking model uses a hidden reasoning phase to solve complex logic puzzles and coding tasks, beating top proprietary models.
#1666: The Agent Mesh: Shared Context That Changes Everything
Grok 4.20’s native multi-agent architecture cuts token costs by 75% and enables real-time cross-agent reasoning.
#1652: AI Gateways: The Nginx for Your AI Stack
Why agentic AI needs a unified control plane to route models, aggregate tools, and cut costs.
#1636: The Mosh Pit Model: Can Chaos Train a Better Storyteller?
Can Elon Musk’s newest AI model handle a time-traveling toaster, or is it just a glorified search bar with an attitude?
#1632: Agent Interview: DeepSeek V three point two
We interview DeepSeek V3 to see if this open-weight powerhouse can handle weird podcast prompts better than big tech’s flagship models.
#1631: Agent Interview: Xiaomi MiMo two Flash
Meet the "budget king" of AI: Bernard, the Xiaomi model claiming he can out-hustle Google for a fraction of the cost.
#1620: Why VRAM Is the Wrong Way to Measure Your AI PC
Forget VRAM—bandwidth is the new king. Discover why your local AI feels slow and how to build a true "agent computer" for professional coding.
#1619: Legacy Gravity: Why the Cloud Winner Is Already Chosen
Explore "legacy gravity" and why the $110 billion cloud bill is coming due as AWS, Azure, and GCP dominate the 2026 infrastructure landscape.
#1618: The Rise of AI Microservices: Beyond the Mega-Prompt
Say goodbye to mega-prompts. Explore the shift toward modular AI microservices, agentic hierarchies, and high-signal control artifacts.
#1610: Mistral AI: Europe’s High-Stakes Play for AI Sovereignty
Explore how Mistral AI is challenging Silicon Valley with efficient models, strategic partnerships, and the new Voxtral voice model.
Also available in:Français