https://widgita.xyz/tags/llm/Recent content in Llm on WidgitaHugoen-usSun, 19 Apr 2026 00:00:00 +0000https://widgita.xyz/posts/2026/04/how-much-will-serving-this-llm-actually-cost/Sun, 19 Apr 2026 00:00:00 +0000https://widgita.xyz/posts/2026/04/how-much-will-serving-this-llm-actually-cost/<p>The question I get asked most often when someone wants to ship an LLM-powered feature is, basically, &ldquo;okay but what&rsquo;s this going to cost?&rdquo; And the honest answer is <em>it depends on a lot of things you haven&rsquo;t decided yet</em>: which model, what precision, how many tokens per request, how many requests per second at peak, whether you self-host or pay an API provider per token, and whether you can tolerate the cold-start of a serverless GPU. Most of those have order-of-magnitude effects, so a back-of-envelope number can be off by 10x in either direction.</p>