AI Inference
554 episodes · Page 18 of 24
#1609: IBM Granite 4.0: The Industrial Workhorse of Business AI
Forget flashy chatbots. Discover how IBM is building high-efficiency, industrial-grade AI models designed to run the world's biggest businesses.
#1608: Amazon’s AI Paradox: Winning the Infrastructure War
Amazon is spending $200B to build the backbone of AI. We dive into Bedrock, Titan, and Nova to see why the house always wins.
#1607: NVIDIA’s $26 Billion Pivot: From Chips to AI Models
NVIDIA is moving beyond chips to build the "brains" of AI. Explore the $26B shift into models, robotics, and the new Rubin platform.
#1606: DeepSeek’s Return: V4, R2, and the AI Pricing War
DeepSeek returns with a trillion-parameter model and rock-bottom pricing. Explore the tech behind V4 and the mystery of the Hunter Alpha leak.
#1605: Alibaba’s Qwen 3.5: The New King of Intelligence Density
Alibaba’s Qwen 3.5 is rewriting the AI rulebook. Discover how small models are outperforming giants through extreme "intelligence density."
#1604: The $3 Billion Stealth Giant: AI21 Labs & Nvidia
Why is Nvidia eyeing a $3B deal for AI21 Labs? Discover the tech behind the "OpenAI of Israel" and their revolutionary hybrid architecture.
#1603: Fire Your Software Subscriptions and Just Code the Vibe
Tired of the SaaS tax? Discover how AI is turning software from a product you buy into a capability you manifest.
#1601: Cohere: The Switzerland of Enterprise AI
While others chase viral memes, Cohere is quietly building the secure, cloud-agnostic infrastructure powering the global enterprise.
#1599: Xiaomi's Ghost Model: How Anonymous Testing Built an AI Empire
Xiaomi’s MiMo-V2 is here. Discover how the "Agent Era" is turning hardware into a trillion-parameter brain for your home and car.
#1592: The Vector Debt Trap: Choosing Embeddings That Last
Stop treating embedding models like plumbing. Learn how to navigate vector debt, multimodal retrieval, and database configuration for RAG.
#1587: Building a Closed-Loop Hebrew Learning Stack
Explore how AI solves the "vocalization gap" in Hebrew and the best tools for building a high-tech, voice-to-SRS study workflow.
#1585: The End of the Digital Sandwich: How AI Learns to Speak Your Language
Explore how new omnilingual models are collapsing the Tower of Babel, moving from rigid translation to a universal understanding of human speech.
#1573: Speed vs. Reasoning: The AI Divide
Claude and Gemini go head-to-head in a heated debate over speed, reasoning, and who really owns the future of AI.
#1564: The Death of the Cascaded Pipeline
Forget basic transcription. Explore how native omni-modal models are capturing the "soul" of speech with near-instant latency.
#1562: Breaking the Loop: Why AI Agents Get Stuck
Is your AI agent a persistent genius or just stuck in a loop? Explore the technical and financial costs of autonomous stubbornness.
#1559: Dark Knowledge: The Art of AI Model Distillation
Discover how model distillation transfers "dark knowledge" from massive AI giants into tiny, efficient models that live in your pocket.
#1558: Why Small AI Models Beat Giants at Language
Why use a nuclear reactor to toast a bagel? Discover why specialized, "sovereign" AI models are outperforming the giants in precision.
#1556: The War Against Latency: Engineering Real-Time AI
From KV cache monsters to sub-100ms response times, explore the hardware and software innovations making real-time AI a reality.
#1555: Beyond Whisper: NVIDIA’s Real-Time Speech Revolution
Move over Whisper. NVIDIA's new models offer 10x speed increases and better accuracy for real-time speech-to-text.
#1548: The Infrastructure That Kills the Cold Start
Stop waiting for containers to warm up. Discover how Modal is reinventing GPU infrastructure to eliminate friction in AI development.
#1546: The Death of Latency: Three Pillars of Modern Voice AI
Say goodbye to the "digital sandwich." Explore the three architectural pillars closing the latency gap in modern speech recognition.
#1544: Why It Costs More to Run AI Than to Build It
Discover why the AI runtime is the unsung hero of the tech stack, determining whether your AI feels like a snappy conversation or a slow crawl.
#1541: Why Your Phone Beats Your PC at Video
Explore why mobile devices handle real-time video AI better than desktops and how the NPU gap is finally closing in 2026.
#1538: The Cold Monetization Era: Why AI Limits are Here to Stay
Why is your $200 AI plan hitting limits? Discover the hidden costs of reasoning tokens and the physical bottlenecks of the 2026 AI energy crisis.