NVIDIA H200

GPU from Nvidia, based on the NVIDIA Hoppe architecture and designed to expand both graphical and computational capabilities

Discussed in 2 episodes Wikidata (Q132291601) →

Episodes

#5830: Serving Your Own Fine-Tuned Model in the Cloud

You fine-tuned an open-weight model. Now how does anyone actually talk to it? Dedicated GPUs vs serverless inference, and the math that decides it.

Oct 10
#5804: Text Classifiers: Local Models vs Always-On Endpoints

A specialist classifier costs $5.70 per million messages. A general LLM costs $142. So why is the obvious product so hard to find?

Oct 9