Local AI
394 episodes · Page 9 of 17
#4970: Labels vs. Book Covers: Structured Extraction Tradeoffs
General vision models vs. purpose-built pipelines for extracting data from messy real-world labels and covers.
#4967: AI Gateways: Worth the Middleware Tax?
When does an AI gateway's overhead justify its features? We break down the tradeoffs.
#4966: Local vs Cloud: Running Hugging Face Models
Hugging Face's compatibility tracker, cache management, and the real difference between Inference Endpoints and the direct API.
#4920: Local Dictation on Android: The Real Bottlenecks
Why on-device speech-to-text on Android hits a wall at 30 seconds — and what silicon actually matters.
#4919: Parakeet vs Whisper: On-Device Dictation Showdown
NVIDIA Parakeet beats Whisper on phone dictation despite having more parameters. Here's why architecture matters more than model size.
#4832: Your AI Memory Should Be Markdown Files
Why your AI project memory should live in Git-tracked Markdown files, not a proprietary platform.
#4822: Cloud-Local AI Hybrid: Does It Actually Work?
Can you pair Claude's reasoning with a local Qwen 7B for savings? The gap is wider than you think.
#4789: How LLMs Actually Know When to Stop
Three layers of stop signals, from EOS tokens to context limits — and why none of them really "know" when to stop.
#4778: SSH MCP and Tailscale: Docker Migration Guide
How to configure Tailscale for Docker containers when migrating from public IPs to tailnet addresses.
#4760: Context Window Management: Cutoff vs. Compaction
Trailing cutoff or auto-compaction? How to manage Claude Code's context window without losing critical information.
#4717: Building a Home Whisper Server: The Full Spec
Daniel wants a dedicated home server for Whisper dictation. Here's the exact build — GPU, RAM, storage, and runtime — to make it work.
#4670: Why AI Weights Are Indecipherable
Can you actually read an AI model's weights like a book? We explore why the answer is mostly no — and what researchers are doing about it.
#4605: Why Chatterbox Still Leads Open-Source TTS
We break down the architecture of Chatterbox, the open-source TTS model powering this podcast, and why it remains state of the art.
#4492: What Makes a Container Robot-Ready?
The hidden specs that turn a plastic box into something a robot can pick, read, and move at industrial speed.
#4458: How Headroom Compresses Agent Context Without Breaking Outputs
A deep dive into Headroom's content-aware compression pipeline that promises 20-95% token savings without changing agent answers.
#4455: Borrowing a GPU Over Your Home Network
Can you use your desktop's AMD GPU from a laptop as if it were local? We explore the real options.
#4415: Why Your Phone Scan Fails (and How to Fix It)
AI scanners are amazing—until they fail on glare or white paper. Here's how to fix it with stuff you already own.
#4374: How AI Agents Finally Made the Terminal Accessible
How Claude Code removes the memory tax that kept neurodivergent users from living in the terminal.
#4181: From Phone Typing to Direct Agent: Fixing Headless Server AI Access
ChatGPT saved his OS, but the copy-paste bottleneck from phone to server took hours. Here's how to fix it.
#4068: How to Build a Go Image Pipeline for Your Inventory App
Stop treating your inventory app like a photo dump. Here's how to build a smart image pipeline in Go.
#3995: Can Your Phone Upscale Photos Without the Cloud?
Local upscaling on phones is here — but which approach actually works?
#3888: Stitch Like a Pro: City Panoramas on Android
Turn your phone into a virtual medium-format camera with manual RAW stitching for gallery-worthy cityscape prints.
#3800: How AI Hallucinates Better Pixels: Upscaling Explained
The difference between interpolation and super-resolution, and why every upscaled image is a collaboration with training data.
#3718: AI Babysitters Already Exist—What We Learned
Tens of thousands of Chinese families already use robot babysitters. What actually happened, and what's next?