AI Inference
554 episodes · Page 19 of 24
#1501: The AI Long Tail: How Small Models Outsmart the Giants
Discover why 31B models are outperforming GPT-5.4 in reasoning and how the AI "long tail" provides the key to local sovereignty and accuracy.
#1500: The Great AI Divergence: How Models Specialized in 2026
The era of the chatbot is over. Discover how the "agentic substrate" of 2026 is redefining computing through GPT, Gemini, and Claude.
#1483: The Recall-Per-Dollar Era: Mastering Vector Database Tuning
Stop burning money on unoptimized vector searches. We dive into HNSW tuning, distance metrics, and the vital "recall-per-dollar" metric.
#1482: The Hidden Cost of Choosing an Embedding Model
From Matryoshka models to multimodal search, discover how the fundamental units of AI memory are being optimized for efficiency and scale.
#1479: The Speed of Thought: Inside the New Era of Inference
The war for model size is over. Explore the engineering breakthroughs making massive AI models faster than human thought.
#1473: Is Your AI Thinking or Just Faking It?
Is "think step by step" dead? Discover how test-time compute and native reasoning are replacing manual prompting in the latest AI models.
#1471: The Cursor Incident: Why Chinese AI Models are Winning
The Cursor leak revealed a shocking truth: Western AI dominance is fading. Discover the Chinese labs rewriting the rules of code and efficiency.
#1329: High-Stakes Hubs vs. Remote Runways: A Pilot's Mastery
Exploring the cognitive load of busy hubs versus the technical skill required to land on the short, rocky runways of the Greek islands.
#1283: Is Your AI Thinking Too Much?
Stop building Rube Goldberg machines. Learn why autonomous AI agents might be the highest-interest technical debt in your stack.
#1282: The Geometry of Thought: The Mathematics Powering AI
Peeking under the hood of AI to discover the beautiful linear algebra and calculus that make machine reasoning possible.
#1242: Why AI Is Rewiring the Internet's Plumbing
Forget the "cloud" metaphor. Explore the massive physical pipes, Tier-1 providers, and new fiber tech powering the 2026 AI revolution.
#1227: Mojo 1.0: Can Chris Lattner Fix the AI Performance Gap?
Explore how Mojo aims to unify Python’s ease of use with C++ performance to solve the "two-language problem" in AI development.
#1224: Cracking the CUDA Code: NVIDIA’s Software Dominance
Discover why NVIDIA’s CUDA is the oxygen of the AI industry and how tools like OpenAI’s Triton are finally challenging its 20-year software moat.
#1219: Beyond the Vibes: Mastering Structured AI Outputs
Stop begging your AI for JSON. Learn how constrained decoding and strict schemas are turning "vibes" into reliable systems architecture.
#1218: The Architectural Divide Between Batch and Live Speech
Why does voice typing feel so clunky compared to recording a memo? We explore the technical hurdles of real-time AI transcription.
#1216: AI Wearables: Local Sovereignty vs. The Subscription Trap
Discover the trade-offs between sleek AI subscriptions and open-source sovereignty. Can local processing save your data from the cloud?
#1212: The Postgres Vector Revolution: Killing the Sprawl
Is your tech stack a sprawling suburb of microservices? Discover why a 40-year-old database is winning the AI infrastructure war.
#1170: The Frozen Backend Paradox: Modern Static Architecture
Explore the "frozen backend" paradox and how modern static sites use build-time logic and sharded search to mimic complex dynamic applications.
#1124: The Database Explosion: Why One Size No Longer Fits All
From vector stores to edge computing, discover why the world now has over 1,000 databases and why Postgres isn't always the answer.
#1123: When One Database Isn't Enough
Can Postgres 18 finally replace the data warehouse? We dive into data gravity, columnar storage, and the physics of scaling in the AI age.
#1122: Why AI Agents Are Abandoning Human Language
Why force AI to talk like humans? Explore how agents are ditching English for high-speed "mind-melding" and latent space communication.
#1113: The Ghost Company: The High Cost of AI Agent Bureaucracy
Can a company run entirely on AI? Explore the hidden costs and "agentic bureaucracy" of building autonomous agent hierarchies.
#1109: The T-FLOP Trap: Measuring the Power of Modern AI
Are teraflops the "horsepower" of AI, or just a marketing gimmick? Explore why raw compute speed isn't the whole story in the race for AI power.
#1103: The Kitchen War: When Theory Meets Messy Reality
Explore the mechanics of LLM context windows and attention, and witness what happens when technical debates collide with household chores.