Local AI
394 episodes · Page 12 of 17
#2041: The "MPEG Moment" for AI: Llamafile & Native Models
Why are we squeezing massive cloud models onto desktops? Meet the "native" AI revolution.
#2040: The Rebellion Against Big Tech's AI Lock-In
Why run LLMs locally? We break down Ollama, llama.cpp, vLLM, and llamafile—and when to use each.
#2038: UI-First vs Architecture-First: Choosing Your AI Agent
LobeHub vs. Dify vs. n8n: We break down the chaotic landscape of local AI agents to find the right "brain" for your workflow.
#2027: The Missing Photoshop for Words
Why is editing text with AI so clunky? We explore the "TITO" paradigm—using small, local models for fast, private text transformation.
#2019: Local AI vs Cloud AI: The Agent Identity Crisis
Your desktop is becoming a life support system for AI agents. We explore the sharp trade-offs between local-first and cloud-native architectures.
#2017: The Art of Squeezing AI Models onto Your GPU
Those cryptic letters on Hugging Face actually map how much brain power you trade for speed.
#2016: Andrej Karpathy: The Bob Ross of Deep Learning
Why the most influential AI mind prefers a blank text file to proprietary black boxes.
#1986: Desk Robots: Privacy, Power, or Annoyance?
These AI companions sit on your desk, watching your posture and listening in—so how do they protect your privacy while actually being useful?
#1964: The Three Layers That Make AR Finally Work
See a 3D arrow pointing to the exact bolt you need, or read a street sign in real-time translation.
#1952: Why We Built a 24/7 AI Radio Station
We turned our 1800-episode archive into a continuous AI-powered radio stream. Here’s the tech stack and the philosophy behind it.
#1943: The Invisible Math Shrinking AI Models
LZMA, Zstandard, and Brotli are shrinking massive AI models, but how do they actually work?
#1940: Why Google's 31B Model Fits in Your GPU
Google just dropped Gemma four, and its 31-billion-parameter size is a masterclass in hardware-aware AI design.
#1905: How VCs Verify AI Startups Without Stealing Code
From the "No-NDA Paradox" to AWS bill forensics, here’s how investors separate real AI from Raspberry Pis in fancy cases.
#1851: AI Toasters and Poetic Gym Coaches: Why We’re Drowning in Useless AI
From smart toasters that need Wi-Fi to email rewriters that sound like corporate robots, here are the most baffling AI features we’ve seen.
#1834: Owning Your AI Memory: The Data Exit Strategy
Why your AI remembers your coffee order but forgets your son’s name—and how to build a portable, federated memory layer you actually own.
#1827: Can AI Rewrite a Human Career Path?
We fed our producer's resume to Gemini 1.5 Flash to see if an AI can plot a better career path than he has.
#1820: Renting vs. Owning GPUs: The Break-Even Math
Is it cheaper to rent serverless GPUs or buy your own hardware? We break down the math on utilization, depreciation, and hidden costs.
#1814: Firefox vs. Chrome in 2026: The Privacy vs. AI Trade-off
Chrome dominates with 68% market share, but Firefox holds its ground with a privacy-first approach. We compare their 2026 performance, AI features,...
#1809: The TTS Developer's Dilemma: Size vs. Speed
Stop guessing. We break down the critical trade-offs between model size, latency, and sample rate for production-ready voice apps.
#1808: The Architecture That Made AI Voices Run on a Raspberry Pi
How a model the size of a tweet outperforms billion-dollar giants in the race for perfect AI speech.
#1806: Why Mac Minis Are Eating AI's Hardware Race
Apple Silicon's unified memory is crushing traditional GPUs for local LLMs. Here's why the M4 Mac Mini is the new king of affordable AI hardware.
#1784: Context1: The Retrieval Coprocessor
Chroma's new 20B model acts as a specialized "scout" for your LLM, replacing slow, static RAG with multi-step, agentic search.
#1764: Your Repo as a Knowledge Base
How to give AI agents instant memory of your entire project—without cloud costs or complex infrastructure.
#1754: From Ollama to Agentic CLIs: The Rise of the AI Harness
Explore the evolution from local LLMs to modern agentic CLIs, focusing on the "harness" that gives models context, tools, and autonomy.