Nolege News

Tag

#inference

Every article tagged “inference”.

1 article

Training the model is the one-time cost. Answering your question is the bill that never stops

Computer Science

Training the model is the one-time cost. Answering your question is the bill that never stops

3 Sept 2026 · 9 min read

Everyone quotes the electricity a model burned during training. For anything widely used, that is the smaller number. Here is what a GPU is actually doing, why memory rather than arithmetic is usually the limit, and why published per-query energy figures differ by a factor of a hundred.

Read more →

Get the science, minus the hype

Clear, occasional updates on nanotech, materials and research. No spam, unsubscribe anytime.