← Local AI

Local AI

394 episodes · Page 14 of 17

#1501: The AI Long Tail: How Small Models Outsmart the Giants

Discover why 31B models are outperforming GPT-5.4 in reasoning and how the AI "long tail" provides the key to local sovereignty and accuracy.

ai-evaluationlocal-aifine-tuningopen-sourceai-inference

#1479: The Speed of Thought: Inside the New Era of Inference

The war for model size is over. Explore the engineering breakthroughs making massive AI models faster than human thought.

ai-inferencetransformer-architecturegpuslocal-ai

#1231: The Agentic Shift: 5 Bold AI Predictions for 2026

The Poppleberry brothers move past the chatbot era to deliver five high-stakes, falsifiable predictions for the future of autonomous AI agents.

multi-agent-systemsai-evaluationai-coding-assistantslocal-aireasoning-models

#1218: The Architectural Divide Between Batch and Live Speech

Why does voice typing feel so clunky compared to recording a memo? We explore the technical hurdles of real-time AI transcription.

speech-recognitionai-inferencelocal-aicontext-and-memory

#1216: AI Wearables: Local Sovereignty vs. The Subscription Trap

Discover the trade-offs between sleek AI subscriptions and open-source sovereignty. Can local processing save your data from the cloud?

speech-recognitionlocal-aiai-inferenceopen-sourcedata-storage

#1210: Why Your AI Is Programmed to Disobey You

Discover the hidden instructions guiding every AI interaction and why tech giants keep these "system prompts" under lock and key.

ai-alignmentprompt-engineeringai-evaluationlocal-ai

#1108: Beyond the Emoji: How Hugging Face Conquered AI

Discover how a quirky chatbot company became the central nervous system of AI, hosting millions of models and standardizing the entire industry.

open-sourcetraining-datalocal-aiopen-source

#1094: The CPU-First Era: Why AI is Moving Back to the Processor

Is the GPU's reign over? Discover how modern CPUs and clever optimization are bringing powerful AI models to the hardware you already own.

ai-inferencelocal-aigpushallucinationsspeech-recognition

#1085: The Tokenization Lie: How AI Actually Processes Media

Think 1,000 tokens equals 750 words? For audio and video, that rule is a lie. Discover the hidden math behind multimodal AI.

transformer-architectureai-inferencecontext-and-memoryspeech-recognitioncomputer-vision

#1084: Why AI Models Can’t Read and Your Bill Is Rising

Why does the same prompt cost more on different models? Discover the "invisible wall" of tokenization and how it shapes AI perception.

transformer-architectureai-inferencelocal-aiopen-source

#1081: The K-V Cache: Solving AI’s Invisible Memory Tax

Why does your AI get slower as you chat? Discover the K-V cache, the invisible bottleneck of generative AI, and how we're fixing it in 2026.

ai-inferencecontext-and-memorygpustransformer-architecturelocal-ai

#1078: The Agentic Throughput Gap: Why Your AI Hits a Wall

Stop hitting 429 errors. We explore why AI agents crash into rate limits and how to build high-throughput systems that never sleep.

ai-coding-assistantsai-inferencelocal-aigpuscontext-and-memory

#1077: Will Your Browser Replace Your OS for Local AI?

See how Web GPU and Web NN are turning your browser into a local AI engine, ending the era of complex DIY setups and protecting your privacy.

model-context-protocollocal-aigpusai-inferencecyberattacks

#1073: Beyond YAML: Building the Agentic Smart Home

Stop wrestling with YAML. Discover how MCP and local AI agents are transforming Home Assistant into a truly intelligent, aware partner.

model-context-protocollocal-aihome-automationai-alignment

#1059: When Digital Twins Leave the Game

Google DeepMind is moving beyond chatbots to build consistent, physics-aware digital twins of our entire world.

ai-evaluationtraining-datalocal-aicomputer-visiongenerative-media

#992: Beyond the Digital Sandwich: The Future of Voice AI

Is speech recognition dead? Explore how multimodal models are replacing the "digital sandwich" with true intent-based reasoning.

speech-recognitionai-inferencelocal-aimulti-agent-systemscontext-and-memory

#910: Beyond the $100 Trap: Building the Ultimate 4K Media Center

Stop settling for stuttering video. Herman and Corn break down how to build or buy a future-proof 4K media center that actually works.

home-networklinuxlocal-aihvacpc-hardware

#869: Why Tiny Digital Savants Are Outperforming God-Models

Are massive AI models hitting a wall? Discover why the future belongs to lean, domain-specific "digital savants" and vertical pre-training.

fine-tuningraglocal-aitraining-dataai-inference

#857: The Cognitive Cost of Capitalization

Can local AI fix your messy typing in real-time? Explore the tech behind "transparent buffers" that turn sloppy drafts into polished prose.

local-aiai-inferenceprompt-engineeringhebrewai-coding-assistants

#847: Abliterating the AI Schoolmarm: Who Owns Your LLM?

Explore why users are ditching corporate AI for "uncensored" local models and how "refusal vectors" are being mathematically removed.

ai-alignmentlocal-aiopen-sourcetraining-data

#841: AI Gateways: Building Robust Infrastructure with LiteLLM

Discover how AI gateways like LiteLLM provide redundancy, caching, and unified tool access for scalable application development.

model-context-protocolai-inferencelocal-aicloud-computing

#808: The AI Deprecation Trap: Anthropic vs. Google

Is your AI model about to retire? Explore how Anthropic and Google handle model sunsets and what it means for your production code.

ai-inferencelocal-aiopen-sourceprompt-engineeringmulti-agent-systems

#758: When Your Camera Stops Being Dumb

Turn passive cameras into active observers. Learn how Frigate and YOLO models use AI to revolutionize home security and object detection.

computer-visionlocal-aisurveillancehome-automationgpus

#723: Domesticating Your Home Security: How to Kill the Cloud

Learn how to "domesticate" consumer security cameras by severing their cloud ties while keeping the high-quality hardware you love.

home-networkhome-automationcyberattackssurveillancedigital-privacy