AI Inference
554 episodes · Page 20 of 24
#1099: Digital Recalls: Why Your AI Is Losing Its Edge
Is your AI getting lazier? Explore the "digital recall" and why the world’s most advanced models are secretly taking steps backward.
#1094: The CPU-First Era: Why AI is Moving Back to the Processor
Is the GPU's reign over? Discover how modern CPUs and clever optimization are bringing powerful AI models to the hardware you already own.
#1088: Why AI Can Read a Library but Only Write a Postcard
Discover why frontier AI models can process millions of words but struggle to write more than a few pages without losing their logical thread.
#1085: The Tokenization Lie: How AI Actually Processes Media
Think 1,000 tokens equals 750 words? For audio and video, that rule is a lie. Discover the hidden math behind multimodal AI.
#1084: Why AI Models Can’t Read and Your Bill Is Rising
Why does the same prompt cost more on different models? Discover the "invisible wall" of tokenization and how it shapes AI perception.
#1081: The K-V Cache: Solving AI’s Invisible Memory Tax
Why does your AI get slower as you chat? Discover the K-V cache, the invisible bottleneck of generative AI, and how we're fixing it in 2026.
#1078: The Agentic Throughput Gap: Why Your AI Hits a Wall
Stop hitting 429 errors. We explore why AI agents crash into rate limits and how to build high-throughput systems that never sleep.
#1077: Will Your Browser Replace Your OS for Local AI?
See how Web GPU and Web NN are turning your browser into a local AI engine, ending the era of complex DIY setups and protecting your privacy.
#1066: Beyond the Blank Slate: The Evolution of AI Training
Explore the "weight surgery" techniques labs use to expand AI models without losing their core knowledge or starting from zero.
#1061: Why a Brain Cell Beats a Microchip
Can a petri dish play Pong? Discover how "wetware" is using living brain cells to redefine the future of energy-efficient computing.
#1021: The Python Paradox: Why AI's Backbone Is a Nightmare to Deploy
Why did a 1980s hobby project become the backbone of AI? Explore the history of Python and the chaos of modern dependency management.
#992: Beyond the Digital Sandwich: The Future of Voice AI
Is speech recognition dead? Explore how multimodal models are replacing the "digital sandwich" with true intent-based reasoning.
#874: From Vibes to Engineering: Mastering JSON Schema for AI
Stop begging your AI for clean data. Learn how JSON schema turns unreliable LLM responses into strict, predictable software components.
#869: Why Tiny Digital Savants Are Outperforming God-Models
Are massive AI models hitting a wall? Discover why the future belongs to lean, domain-specific "digital savants" and vertical pre-training.
#864: The Death of SaaS: Building Your Own Bespoke AI Tools
Stop paying for dozens of subscriptions. Learn how AI agents are allowing anyone to build custom, private software tailored to their exact needs.
#857: The Cognitive Cost of Capitalization
Can local AI fix your messy typing in real-time? Explore the tech behind "transparent buffers" that turn sloppy drafts into polished prose.
#853: The Mid-Range Camera Awakening
Discover why megapixels aren't everything and how sensor size, aperture, and periscope lenses are redefining pro mobile photography in 2026.
#846: Beyond the Vector: Building Long-Standing AI Memory
Stop relying on basic vector search. Discover how Graph RAG and RAPTOR are creating AI systems with true long-standing memory.
#841: AI Gateways: Building Robust Infrastructure with LiteLLM
Discover how AI gateways like LiteLLM provide redundancy, caching, and unified tool access for scalable application development.
#808: The AI Deprecation Trap: Anthropic vs. Google
Is your AI model about to retire? Explore how Anthropic and Google handle model sunsets and what it means for your production code.
#791: The Roller Coaster of Tech Adoption
Is the AI magic wearing off? We dive into the Gartner Hype Cycle to see where LLMs and autonomous agents actually stand in 2026.
#769: When Manuals Learn to See in 3D
Discover how AI and spatial computing are turning complex hardware repairs into real-time, interactive experiences.
#755: From Duct Tape to Autonomous Studio: Scaling a 741-Episode AI Podcast
Peek under the hood of My Weird Prompts to see how Gemini, Modal, and multi-agent systems are scaling this automated show to the next level.
#753: Beyond SEO: The Guide to Agentic Behavior Optimization
Move beyond search engines and learn how to make your website the primary source for the next generation of AI agents.