Local AI

Running AI on personal hardware

14 episodes

GPU Scaling: The "Go Wide or Go Tall" Dilemma

Should you use a fleet of cheap GPUs or one powerhouse? Learn the math behind serverless GPU costs, cold starts, and batching efficiency.

serverless-gpugpu-scalingmemory-bandwidth

Digital Vaults: The Mainstream Rise of Air-Gapped AI

Discover why air-gapping is going mainstream in 2026 and how organizations are securing local AI models using "digital vaults."

air-gappingai securitycybersecuritydigital vaultslocal llms

Building the Ultimate Local AI Inference Server

Learn how to build a high-performance local AI server for agentic coding, from dual-GPU PC builds to the power of Mac's unified memory.

local-aigpu-accelerationai-agents

Why GPUs Are the Kings of the AI Revolution

From video game dragons to digital brains: Herman and Corn explain why your graphics card is the secret engine behind the AI boom.

gpu-accelerationlarge-language-modelsparallel-computing

The Future of Local AI: Stable Diffusion vs. The New Guard

Is Stable Diffusion becoming a relic? Corn and Herman debate the rise of Flux, the privacy of local AI, and the future of open-source generation.

stable diffusionlocal aigenerative aiopen sourceflux ai

Running Video AI at Home: The Real Technical Challenge

Video AI: Hype vs. Reality. Can your GPU handle it? We dive into the technical challenges of running video AI at home.

video-generationgpu-accelerationlocal-ai

Local AI Unlocked: The Power of Quantization

Unlock powerful AI on your device! We demystify quantization, the ingenious trick making local AI a reality.

large-language-modelsquantizationlocal-ai

Unlocking Local AI: Privacy, Creativity & Compliance

Local AI: privacy, creativity, and compliance. Discover why keeping AI close to home is more than a trend.

local aiPrivacycompliancecreativitydata privacy

AI Supercomputers: On Your Desk, Not Just The Cloud

AI supercomputers are landing on your desk! Discover why local AI is indispensable for enterprises facing API costs, latency, and privacy.

ai supercomputerslocal aiedge computingai inferenceai training

Red Team vs. Green: Local AI Hardware Wars

NVIDIA's CUDA rules AI, leaving AMD users battling a "green wall." Explore the hardware wars and thorny paths forward.

large-language-modelsgpu-accelerationhardware-acceleration

AMD AI: Taming Environments with Conda & Docker

Tired of AI environment headaches on AMD? We demystify Conda, Docker, and host environments to unlock your GPU's full potential.

gpu-accelerationdockerdependency-management

GPU Brains: CUDA, ROCm, & The AI Software Stack

Unraveling how GPUs power AI. We dive into CUDA, ROCm, and the software stack that makes it all think.

gpu-accelerationparallel-computingsoftware-stack

Cloud Render Superpowers: Local Edit, Remote Muscle

Unleash cloud superpowers! Edit locally, render remotely with AI-accelerated GPUs like NVIDIA A100s.

gpu-accelerationcloud-computingremote-rendering

Local STT For AMD GPU Owners

AMD GPU? No problem! Dive into local AI adventures like on-device speech to text.

speech-recognitiongpu-accelerationlocal-ai