A100

Discussed in 3 episodes

Episodes

#5411: Fine-Tuning at 4-Bit vs 16-Bit: What It Really Costs

QLoRA cuts fine-tuning VRAM 15x and cost up to 85% — but you pay in training time, quality, and safety alignment.

Sep 21
#5830: Serving Your Own Fine-Tuned Model in the Cloud

You fine-tuned an open-weight model. Now how does anyone actually talk to it? Dedicated GPUs vs serverless inference, and the math that decides it.

Oct 10
#5408: When Small NLP Models Beat the LLM

Feature extraction, fill-mask, token classification — the classic NLP tasks still have a job. Here's when a small model beats a frontier API.

Sep 21