Computer Science
Training the model is the one-time cost. Answering your question is the bill that never stops
3 Sept 2026 · 9 min read
Everyone quotes the electricity a model burned during training. For anything widely used, that is the smaller number. Here is what a GPU is actually doing, why memory rather than arithmetic is usually the limit, and why published per-query energy figures differ by a factor of a hundred.
Read more →