ML for Web Devs4 min read
Tokens, context windows, and why your bill is what it is
The unit of billing for language models is not the request or the word. Once you understand tokens and how a context window fills up, the invoice stops being a surprise.