Transformer Architecture
226 episodes · Page 7 of 10
#1679: Efficiency Over Scale: How Export Controls Forced a Smarter AI
DeepSeek and MiMo are topping developer charts, but they're not just cheaper clones. Here's why their design philosophy is fundamentally different.
#1668: Kimi K2's Hidden Reasoning: A New AI Architecture
Moonshot AI's Kimi K2 Thinking model uses a hidden reasoning phase to solve complex logic puzzles and coding tasks, beating top proprietary models.
#1630: When a Reasoning Model Overthinks Comedy
Xiaomi’s new MiMo 2.0 Pro model auditions for a comedy podcast, promising deep reasoning over raw speed.
#1610: Mistral AI: Europe’s High-Stakes Play for AI Sovereignty
Explore how Mistral AI is challenging Silicon Valley with efficient models, strategic partnerships, and the new Voxtral voice model.
Also available in:Français
#1609: IBM Granite 4.0: The Industrial Workhorse of Business AI
Forget flashy chatbots. Discover how IBM is building high-efficiency, industrial-grade AI models designed to run the world's biggest businesses.
#1606: DeepSeek’s Return: V4, R2, and the AI Pricing War
DeepSeek returns with a trillion-parameter model and rock-bottom pricing. Explore the tech behind V4 and the mystery of the Hunter Alpha leak.
#1605: Alibaba’s Qwen 3.5: The New King of Intelligence Density
Alibaba’s Qwen 3.5 is rewriting the AI rulebook. Discover how small models are outperforming giants through extreme "intelligence density."
#1604: The $3 Billion Stealth Giant: AI21 Labs & Nvidia
Why is Nvidia eyeing a $3B deal for AI21 Labs? Discover the tech behind the "OpenAI of Israel" and their revolutionary hybrid architecture.
#1599: Xiaomi's Ghost Model: How Anonymous Testing Built an AI Empire
Xiaomi’s MiMo-V2 is here. Discover how the "Agent Era" is turning hardware into a trillion-parameter brain for your home and car.
#1585: The End of the Digital Sandwich: How AI Learns to Speak Your Language
Explore how new omnilingual models are collapsing the Tower of Babel, moving from rigid translation to a universal understanding of human speech.
#1559: Dark Knowledge: The Art of AI Model Distillation
Discover how model distillation transfers "dark knowledge" from massive AI giants into tiny, efficient models that live in your pocket.
#1556: The War Against Latency: Engineering Real-Time AI
From KV cache monsters to sub-100ms response times, explore the hardware and software innovations making real-time AI a reality.
#1547: Why AI Stopped Reading and Started Seeing Everything
From sequential bottlenecks to parallel powerhouses, discover how the Transformer architecture revolutionized how machines process the world.
#1546: The Death of Latency: Three Pillars of Modern Voice AI
Say goodbye to the "digital sandwich." Explore the three architectural pillars closing the latency gap in modern speech recognition.
#1500: The Great AI Divergence: How Models Specialized in 2026
The era of the chatbot is over. Discover how the "agentic substrate" of 2026 is redefining computing through GPT, Gemini, and Claude.
#1482: The Hidden Cost of Choosing an Embedding Model
From Matryoshka models to multimodal search, discover how the fundamental units of AI memory are being optimized for efficiency and scale.
#1479: The Speed of Thought: Inside the New Era of Inference
The war for model size is over. Explore the engineering breakthroughs making massive AI models faster than human thought.
#1473: Is Your AI Thinking or Just Faking It?
Is "think step by step" dead? Discover how test-time compute and native reasoning are replacing manual prompting in the latest AI models.
#1423: Why Can't We Land an Airbus in the Ocean?
Why did we trade the luxury of flying boats for concrete runways? Explore the physics, history, and future of large-scale seaports.
#1322: When AI Stops Seeing and Starts Reasoning
Explore how AI evolved from simple pixel labeling to understanding intent and context through Vision-Language Models and agentic frameworks.
#1282: The Geometry of Thought: The Mathematics Powering AI
Peeking under the hood of AI to discover the beautiful linear algebra and calculus that make machine reasoning possible.
#1279: Why AI Obeys the Developer Instead of You
Discover the hidden "plumbing" of AI system prompts and how architectural shifts are turning simple instructions into hard-coded laws.
#1227: Mojo 1.0: Can Chris Lattner Fix the AI Performance Gap?
Explore how Mojo aims to unify Python’s ease of use with C++ performance to solve the "two-language problem" in AI development.
#1162: The Moral Statecraft Paradox: When Principle Costs You Everything
Ireland's "moral crusade" meets economic reality. Is a new trade bill about to sever the nation's vital lifeline to the United States?