#context-window
39 episodes
#4699: The Hidden Engine: What Makes Claude Code Tick
Is it the model or the harness? We break down the invisible scaffolding that turns LLMs into real agents.
#4682: When Context Windows Grow: What Survives?
If context windows jump to 10M tokens, which AI engineering practices survive? We separate load-bearing architecture from temporary scaffolding.
#4619: The Token Trap: Why AI Context Windows Confuse Everyone
Token counts are everywhere, but they don't tell you what AI can actually do. Here's what should replace them.
#4604: When Sub-Agents Overwhelm the Orchestrator
Daniel's inventory system hit a wall when parallel sub-agents flooded the orchestrator's context window. We break down the math and the fix.
#4584: Directing Context Loss: Smart Compaction Prompts
Learn how to steer Claude Code's context compaction with targeted instructions — turning a lossy default into a directed operation.
#4458: How Headroom Compresses Agent Context Without Breaking Outputs
A deep dive into Headroom's content-aware compression pipeline that promises 20-95% token savings without changing agent answers.
#4316: How to Build Memory That Survives AI Sessions
Why AI agents forget between sessions — and how to fix it with markdown files instead of black-box memory.
#4314: The Hidden Layer Shaping Every AI Chat
Context windows are huge now, but relevance is the real bottleneck. How middleware decides what your AI actually sees.
#4296: Auto-Splitting AI Threads: Smarter Context Management
How to build a system that automatically detects topic shifts and routes messages to the right thread.
#3816: How to Stop AI Scripts From Falling Apart
Why long-form AI generation breaks down and how hierarchical memory fixes it.
#2684: When Agent Skills Collide: Context Windows & Plugin Design
How to handle overlapping agent skills and whether context windows will ever make the problem go away.
#2683: MCP vs Agent Skills: Context Wars
When 12M token windows arrive, do MCP servers or agent skills win? Plus: federated access for agent teams.
#2674: Why Your Agent's Context Window Is Getting Eaten Before You Start
Stop shipping the whole toolbox to every session. A bridge plugin pattern that fetches skills on demand instead.
#2672: When a Startup Claims to Break the Quadratic Wall
A startup claims linear attention scaling at 12M tokens, beating GPT-5.5 on retrieval benchmarks.
#2638: How to Build Disposable AI Agents at Runtime
Create ephemeral AI agents that answer questions about specific items, then vanish. No persistent configuration needed.
#2634: The Two-Stage Pipeline for Persistent User Memory
How to extract durable personal context from raw prompts and build a self-healing memory layer for AI systems.
#2551: How Progressive Disclosure Saves MCP from Token Bloat
Why dumping all tool schemas into context breaks accuracy — and three implementations that fix it.
#2406: Why Million-Token Context Windows Can't Handle 3 Reasoning Steps
Needle-in-a-haystack is dead. Here's what actually measures whether models can think across long documents.
#2366: Why LLMs Forget the Middle of Long Conversations
Why do large language models struggle with the middle of long conversations? Explore the science behind attention dilution and practical fixes.
#2353: Evaluating Enterprise AI: Palmyra X5
Explore Palmyra X5, Writer’s flagship AI model designed for enterprise workloads, featuring a million-token context window and agentic capabilities.
#2312: When Bigger Context Windows Aren't Better
Exploring the real-world impact of massive context windows in AI models, from academic research to codebase analysis.
#2205: When AI Coding Agents Forget: Five Approaches to Context Rot
As coding agents handle longer sessions, they accumulate noise and lose crucial information. Five competing frameworks are solving this differently...
#2164: Why Bigger Context Windows Don't Fix Attention
Frontier models have million-token context windows, but attention degrades well before you hit the limit. New research reveals why bigger isn't bet...
#2062: How Transformers Learn Word Order: From Sine Waves to RoPE
Transformers can’t see word order by default. Here’s how positional encoding fixes that—from sine waves to RoPE and massive context windows.