← Local AI

Local AI

394 episodes · Page 13 of 17

#1752: Whisper Small Beats Whisper Large in Speed & Accuracy

A 4GPU benchmark on Ubuntu shows the 1.5B parameter Whisper Large is slower and less accurate than the tiny Whisper Small.

speech-recognitionai-inferencelocal-aigpusai-evaluation

#1740: Why Open Source Is a Power Tool Strategy

We dissect Resemble AI's Chatterbox to see how its open-source TTS compares to commercial giants like ElevenLabs.

text-to-speechopen-sourcelocal-aiai-inference

#1705: Microsoft's Phi: The Small Model Bet for Agentic AI

Microsoft is pushing small language models like Phi for agentic AI. Here’s why that strategy matters for speed, cost, and edge computing.

model-context-protocolai-inferencelocal-aiai-coding-assistantstransformer-architecture

#1674: AI2: The Radical Openness of a Nonprofit AI Lab

Discover how the Allen Institute for AI (AI2) defies industry norms by releasing everything—models, data, and code—for free.

open-sourcetraining-datalocal-ai

#1633: Can a Character Actor Model Beat a Generalist?

We grill MiniMax M2.7 to see if a model built for "virtual companions" can actually handle high-level comedy and complex character logic.

ai-evaluationlocal-aiopen-sourcefine-tuningprompt-engineering

#1632: Agent Interview: DeepSeek V three point two

We interview DeepSeek V3 to see if this open-weight powerhouse can handle weird podcast prompts better than big tech’s flagship models.

open-sourceai-inferencecontext-and-memoryfine-tuninglocal-ai

#1631: Agent Interview: Xiaomi MiMo two Flash

Meet the "budget king" of AI: Bernard, the Xiaomi model claiming he can out-hustle Google for a fraction of the cost.

ai-inferencecontext-and-memorylocal-aiprompt-engineering

#1620: Why VRAM Is the Wrong Way to Measure Your AI PC

Forget VRAM—bandwidth is the new king. Discover why your local AI feels slow and how to build a true "agent computer" for professional coding.

local-aiai-inferencegpusai-coding-assistantsmodel-context-protocol

#1610: Mistral AI: Europe’s High-Stakes Play for AI Sovereignty

Explore how Mistral AI is challenging Silicon Valley with efficient models, strategic partnerships, and the new Voxtral voice model.

mathematicsai-inferenceopen-sourcespeech-recognitiontransformer-architecture
Also available in:Français

#1609: IBM Granite 4.0: The Industrial Workhorse of Business AI

Forget flashy chatbots. Discover how IBM is building high-efficiency, industrial-grade AI models designed to run the world's biggest businesses.

transformer-architectureai-inferencelocal-aicontext-and-memory

#1607: NVIDIA’s $26 Billion Pivot: From Chips to AI Models

NVIDIA is moving beyond chips to build the "brains" of AI. Explore the $26B shift into models, robotics, and the new Rubin platform.

gpusai-inferencelocal-aispeech-recognitionopen-source

#1605: Alibaba’s Qwen 3.5: The New King of Intelligence Density

Alibaba’s Qwen 3.5 is rewriting the AI rulebook. Discover how small models are outperforming giants through extreme "intelligence density."

local-aiai-inferenceopen-sourcetransformer-architecturegpus

#1601: Cohere: The Switzerland of Enterprise AI

While others chase viral memes, Cohere is quietly building the secure, cloud-agnostic infrastructure powering the global enterprise.

ai-inferenceragopen-sourcelocal-aispeech-recognition

#1568: The Signal Versus Symbol Gap

Is Gemini a brilliant audio engineer or just a talented lip-reader? Explore the "signal vs. symbol" gap in AI audio processing.

ai-evaluationspeech-recognitionhallucinationslocal-ai

#1565: Machine-Readable Safety: Markdown for AI Agents

Transform bloated government data into clean Markdown to power life-saving AI agents during emergencies.

ragmodel-context-protocollocal-aihallucinationscontext-and-memory

#1564: The Death of the Cascaded Pipeline

Forget basic transcription. Explore how native omni-modal models are capturing the "soul" of speech with near-instant latency.

speech-recognitionai-inferencelocal-aitext-to-speechai-evaluation

#1561: Abliteration: The High-Dimensional Lobotomy of AI

Discover how researchers are surgically removing refusal filters from AI models using a mathematical process called abliteration.

ai-alignmentlocal-aifine-tuningopen-source

#1559: Dark Knowledge: The Art of AI Model Distillation

Discover how model distillation transfers "dark knowledge" from massive AI giants into tiny, efficient models that live in your pocket.

fine-tuningai-inferencelocal-aitransformer-architecture

#1558: Why Small AI Models Beat Giants at Language

Why use a nuclear reactor to toast a bagel? Discover why specialized, "sovereign" AI models are outperforming the giants in precision.

local-aiai-inferencehallucinationsspeech-recognitiontext-to-speech

#1555: Beyond Whisper: NVIDIA’s Real-Time Speech Revolution

Move over Whisper. NVIDIA's new models offer 10x speed increases and better accuracy for real-time speech-to-text.

speech-recognitionai-inferencelocal-aigpusopen-source

#1544: Why It Costs More to Run AI Than to Build It

Discover why the AI runtime is the unsung hero of the tech stack, determining whether your AI feels like a snappy conversation or a slow crawl.

ai-inferencelocal-aigpusopen-source

#1541: Why Your Phone Beats Your PC at Video

Explore why mobile devices handle real-time video AI better than desktops and how the NPU gap is finally closing in 2026.

local-aiai-inferencecomputer-visiongpushallucinations

#1540: Why Gnome 50 is Breaking Your Voice-to-Text Tools

Explore the engineering battle to bring low-latency AI voice input to Linux while navigating the strict security of Wayland and GNOME 50.

linuxspeech-recognitionlocal-aicyberattacksopen-source

#1539: Escaping the Cloud Dictation Trap

Stop shouting at your phone. Discover how dedicated hardware and local AI are making instant, private voice-to-text a reality.

speech-recognitionlocal-aihallucinationshand-toolshvac