Note · On Substack
Tokens per second tells you how fast the model is talking, not whether it got the job done. We optimized the proxy and forgot the point
Read the original Note on SubstackRecurring ideas
Related concepts
- model
- token
A selection from the original Note. Read it in context on Substack.