Transformer Architecture
226 episodes · Page 8 of 10
#1122: Why AI Agents Are Abandoning Human Language
Why force AI to talk like humans? Explore how agents are ditching English for high-speed "mind-melding" and latent space communication.
#1115: The Rise of the AI Procurement Officer
Discover how AI is evolving from simple chat to autonomous B2B procurement agents capable of negotiating and executing million-dollar deals.
#1112: Inside the Neural Cathedral: Cracking the AI Black Box
Peek inside the "black box" of AI to discover how models use high-dimensional geometry and superposition to organize complex human concepts.
#1103: The Kitchen War: When Theory Meets Messy Reality
Explore the mechanics of LLM context windows and attention, and witness what happens when technical debates collide with household chores.
#1088: Why AI Can Read a Library but Only Write a Postcard
Discover why frontier AI models can process millions of words but struggle to write more than a few pages without losing their logical thread.
#1085: The Tokenization Lie: How AI Actually Processes Media
Think 1,000 tokens equals 750 words? For audio and video, that rule is a lie. Discover the hidden math behind multimodal AI.
#1084: Why AI Models Can’t Read and Your Bill Is Rising
Why does the same prompt cost more on different models? Discover the "invisible wall" of tokenization and how it shapes AI perception.
#1081: The K-V Cache: Solving AI’s Invisible Memory Tax
Why does your AI get slower as you chat? Discover the K-V cache, the invisible bottleneck of generative AI, and how we're fixing it in 2026.
#1080: From Prompt to Intent: The Claude Opus Roadmap
Explore the engineering roadmap from Claude 4.6 to 5.0 as AI evolves from a simple chatbot into a fully autonomous cognitive partner.
#1066: Beyond the Blank Slate: The Evolution of AI Training
Explore the "weight surgery" techniques labs use to expand AI models without losing their core knowledge or starting from zero.
#1056: The Vocabulary Myth: Do More Words Equal Better Thinking?
Does a massive vocabulary lead to deeper thoughts? Explore the hidden mechanics of English, Hebrew, and the famous "Inuit snow" myth.
#974: The Digital Gardener: Why We Don't Understand Our Own AI
We build digital cathedrals but lack the blueprints. Explore the "black box" of AI, emergent abilities, and the mystery of double descent.
#861: Modeling a Nation's Rewiring with AI Digital Twins
What if Israel lost the support of the US and EU? Explore the economic shocks and AI tools used to model a massive geopolitical shift.
#832: How AI Rebuilt the Curb Cut
From Whisper to smart prosthetics, discover how AI is transforming accessibility and granting independence to millions.
#699: Can AI Get the Joke? Sarcasm, Irony, and LLM Nuance
Discover how AI learns to spot sarcasm and avoid being a "Clippy" through the power of latent space and human feedback.
#650: When AI Thinks Longer, Not Bigger
Explore how Gemini 3.0’s Deep Think mode shifts AI from "fast" reflexes to "deliberate" reasoning to solve complex quantum physics problems.
#628: GPT-5.2: 12 Hours of Reason and the Future of AGI
GPT-5.2 spent 12 hours reasoning to solve a novel quantum physics proof. Is this the dawn of AGI or just a very sophisticated calculator?
#574: When Friction Creates Meaning: Travel as a Perspective Shift
Forget vacations. Herman and Corn explore five destinations where a month-long stay will fundamentally shift your perspective on how to live.
#336: The World Model Revolution: Beyond LLM Token Prediction
Herman and Corn explore why LLMs struggle with logic and how the shift to world models is giving AI a sense of physics and spatial reality.
#267: Decoding the Transformer: From Attention to Inference
Herman and Corn dive into the mechanics of transformer inference, exploring how models turn massive matrices into meaningful conversation.
#261: The 70-Year Overnight Success: How AI Finally Arrived
Think AI was an overnight success? Join Herman and Corn as they trace the 70-year journey from rigid logic rules to modern deep learning.
#260: Digital Archeology: The Primitive Power of GPT-1
Revisit the 2018 model that started it all. Herman and Corn dive into GPT-1's romance-novel roots and its 117-million-parameter legacy.
#210: Predictive Motion: How Transformers Are Learning to Walk
Explore how the same transformer architecture behind chatbots is now enabling robots to navigate the physical world using action tokens.
#199: When AI Outruns Physics: The New Weather Forecaster
Exploring the shift from physics-based models to AI-driven meteorology. Can algorithms predict the next big storm better than humans?