← AI Inference

AI Inference

554 episodes · Page 22 of 24

#210: Predictive Motion: How Transformers Are Learning to Walk

Explore how the same transformer architecture behind chatbots is now enabling robots to navigate the physical world using action tokens.

transformer-architectureai-inferencecomputer-visiontraining-dataai-evaluation

#199: When AI Outruns Physics: The New Weather Forecaster

Exploring the shift from physics-based models to AI-driven meteorology. Can algorithms predict the next big storm better than humans?

ai-inferencetransformer-architectureweather-and-atmospheretraining-data

#182: The Quadratic Bottleneck: Why AI Needs New Architectures

Is the transformer’s reign ending? Herman and Corn explore Mamba, x-LSTM, and the architectures solving AI's massive memory problem.

transformer-architecturecontext-and-memoryai-inferencetraining-data

#181: Why Your AI Is Finally Stopping to Think

Discover how AI shifted from instant reflexes to deep reflection through inference-time compute and hidden reasoning steps.

ai-inferencetransformer-architectureai-evaluationcontext-and-memoryreasoning-models

#171: From Digital Fortresses to Machine-Digestible Sites

Stop fighting the crawlers and start feeding them. Learn how llms.txt and structured metadata are defining the new era of AI Optimization.

ragmodel-context-protocolcontext-and-memoryai-inference

#170: How PyTorch Beat TensorFlow and Became AI's Backbone

Discover why PyTorch is the "oxygen" of AI. Herman and Corn explore its history, the magic of Autograd, and the move to the PyTorch Foundation.

ai-inferencetransformer-architectureopen-sourcehistory-of-technologytraining-data

#154: From Apps to Agents: Building Your Digital Workforce

Move beyond simple prompts. Explore the architecture, autonomy, and fiscal guardrails of the next generation of AI agentic workflows.

multi-agent-systemsai-coding-assistantsworkflow-automationai-inferencelocal-ai

#142: Breaking the Voice Wall: The Future of Native Speech AI

Explore why native speech-to-speech AI is 20x more expensive than text pipelines and how "semantic VAD" is solving the awkward silence problem.

speech-recognitiontext-to-speechai-inferencegpusai-coding-assistants

#136: The Ghost in the Machine: Why AI Voices Hallucinate

Why does your AI suddenly start shouting or whispering like Darth Vader? Herman and Corn dive into the glitchy world of TTS hallucinations.

text-to-speechhallucinationsai-inferencespeech-recognition

#133: When Quantum Computing Becomes Accessible

Discover how quantum computing is transforming AI from brute-force scaling to surgical precision in this deep dive into the 2026 tech landscape.

gpusai-inferencetransformer-architecturecontext-and-memorycloud-computing

#132: How AI Learns to See Time as a Dimension

Discover how spatial-temporal tokenization and 3D world modeling are revolutionizing real-time video-to-video AI interaction.

transformer-architecturecomputer-visiongenerative-mediaai-inferencecontext-and-memory

#130: How to Spot Gamed Benchmarks in Chinese AI

Are Chinese AI models actually beating the West, or just gaming the system? Herman and Corn dive into the reality of modern AI benchmarks.

ai-evaluationtraining-datahallucinationsai-inference

#126: The Cocktail Party Problem: Why AI Forgets

Why do AI models "lose the plot" after a few thousand words? Discover the mechanics of attention and the innovations solving context window limits.

transformer-architecturecontext-and-memoryai-inferencelocal-ai

#122: The Comeback of RNNs: Why Old Tech Still Matters

Herman and Corn pull back the curtain on AI to explain the mathematical "plumbing" of neural networks and the future of machine learning.

transformer-architecturetraining-dataai-inferencelocal-ai

#120: Silencing the Siren: Real-Time AI Noise Reduction

How do phones remove sirens and crying babies in real time? Explore the neural networks and hardware making crystal-clear audio possible.

speech-recognitionai-inferencelocal-aigpus

#118: AI in 2025: Is Small the New Big?

If the cost is the same, should you always use the biggest AI model? Discover why smaller models often win on speed, steering, and accuracy.

ai-inferencegpuslocal-aiai-evaluation

#111: Beyond Transformers: Solving the AI Memory Crisis

Why does AI forget your conversation every time you hit enter? Herman and Corn dive into the "stateless" nature of LLMs and the future of memory.

context-and-memorytransformer-architectureai-inferenceai-coding-assistants

#110: Why Agentic AI Needs More VRAM Than You Think

Learn how to build a high-performance local AI server for agentic coding, from dual-GPU PC builds to the power of Mac's unified memory.

ai-coding-assistantslocal-aigpuscontext-and-memoryai-inference

#109: Beating Context Bloat with Dynamic Dictionaries

Tired of AI mishearing brand names? Learn how to build efficient custom dictionaries for Gemini 1.5 without breaking the bank.

speech-recognitionai-inferencecontext-and-memorylocal-ai

#108: Why Your AI Code Assistant Gets Worse

Why do AI models lose their edge over time? Herman and Corn explore the "home team advantage" and why telling your AI to "do better" actually works.

ai-coding-assistantsai-evaluationprompt-engineeringcontext-and-memoryai-inference

#107: The $5.5 Million Breakthrough: DeepSeek’s AI Disruption

Discover how DeepSeek-V3 is disrupting the AI market with massive cost savings and technical innovations like Multi-Head Latent Attention.

ai-inferenceopen-sourcegpustransformer-architecturemarket-competition

#92: Is AI Eating Its Own Trash?

Is brute force the only path to AGI? Corn and Herman explore the limits of scaling, the risk of model collapse, and the future of world models.

training-dataai-evaluationhallucinationsai-inferencetransformer-architecture

#88: Why Won't My AI Talk to Me First?

Why is AI always waiting for us? Herman and Corn explore the technical and social hurdles of proactive AI and the "vending machine" model.

ai-alignmentcontext-and-memorylocal-aiai-inference

#87: Why Big Tech Gives Away AI for Free

Why are tech giants spending millions on AI just to give it away? Herman and Corn dive into the strategic chess game of open-source models.

open-sourcetraining-dataai-inferencelocal-ai