Transformer Architecture
226 episodes · Page 9 of 10
#196: Why Your Irish Accent Sounds American
Herman and Corn dive into the mechanics of neural text-to-speech, exploring how AI masters human prosody and the "average voice" accent problem.
#182: The Quadratic Bottleneck: Why AI Needs New Architectures
Is the transformer’s reign ending? Herman and Corn explore Mamba, x-LSTM, and the architectures solving AI's massive memory problem.
#181: Why Your AI Is Finally Stopping to Think
Discover how AI shifted from instant reflexes to deep reflection through inference-time compute and hidden reasoning steps.
#176: What Are AI Weights, Really?
What actually happens inside an AI model? Corn and Herman break down the numerical "valves" and "knobs" that power modern intelligence.
#170: How PyTorch Beat TensorFlow and Became AI's Backbone
Discover why PyTorch is the "oxygen" of AI. Herman and Corn explore its history, the magic of Autograd, and the move to the PyTorch Foundation.
#135: Is OCR Dead? How Vision AI Is Redefining Text Extraction
Are specialized OCR tools obsolete? Herman and Corn explore how Vision Language Models are revolutionizing the way we turn images into data.
#133: When Quantum Computing Becomes Accessible
Discover how quantum computing is transforming AI from brute-force scaling to surgical precision in this deep dive into the 2026 tech landscape.
#132: How AI Learns to See Time as a Dimension
Discover how spatial-temporal tokenization and 3D world modeling are revolutionizing real-time video-to-video AI interaction.
#126: The Cocktail Party Problem: Why AI Forgets
Why do AI models "lose the plot" after a few thousand words? Discover the mechanics of attention and the innovations solving context window limits.
#122: The Comeback of RNNs: Why Old Tech Still Matters
Herman and Corn pull back the curtain on AI to explain the mathematical "plumbing" of neural networks and the future of machine learning.
#117: From Keywords to Vectors: How AI Decodes Meaning
Why can AI write poetry but struggle to find a file? Explore the history and math of semantic understanding with Herman and Corn.
#116: How AI Deciphers Your Typo-Ridden Prompts
Ever wonder why AI understands your messy typos? Explore how models "denoise" chaotic input through tokenization and semantic context.
#111: Beyond Transformers: Solving the AI Memory Crisis
Why does AI forget your conversation every time you hit enter? Herman and Corn dive into the "stateless" nature of LLMs and the future of memory.
#107: The $5.5 Million Breakthrough: DeepSeek’s AI Disruption
Discover how DeepSeek-V3 is disrupting the AI market with massive cost savings and technical innovations like Multi-Head Latent Attention.
#92: Is AI Eating Its Own Trash?
Is brute force the only path to AGI? Corn and Herman explore the limits of scaling, the risk of model collapse, and the future of world models.
#85: When Probability Beats Truth: Why AI Must Lie
Why do smart AI systems make up fake facts? Corn and Herman explore the "feature" of digital hallucinations and how to spot them.
#82: The Accidental AI Engine
From video game dragons to digital brains: Herman and Corn explain why your graphics card is the secret engine behind the AI boom.
#67: Scaling or Pivoting AI for Code
Are LLMs truly the future of coding, or do they need a fundamental architectural pivot? We dive into AI's programming future.
#64: How AI Learns to See, Hear, and Think Together
AI is evolving beyond text, learning to see, hear, and understand our world. Discover the future of human-AI interaction!
#56: The Thought Experiment Nobody Runs
Building an AI model from scratch? It's a brutal reality of trillions of tokens and millions in GPUs. Discover the hidden costs of modern AI.
#55: Running Video AI at Home: The Real Technical Challenge
Video AI: Hype vs. Reality. Can your GPU handle it? We dive into the technical challenges of running video AI at home.
#54: How AI Unifies Images, Audio, and Text
Omnimodal AI: How do models process images, audio, video, and text all at once? Discover the engineering behind AI that accepts anything.
#53: Instructional vs. Conversational AI: The Distinction Nobody Talks About
Instructional vs. conversational AI: a crucial distinction reshaping how AI is built. Discover why it matters for the future of AI development.
#46: Pixels, Prompts & Pseudo-Text: AI's Word Problem
AI paints stunning images, but can't spell "cat." Why do advanced models struggle with simple text? Dive into AI's weird word problem!