Note · On Substack

Tokens per second tells you how fast the model is talking, not whether it got the job done. We optimized the proxy and forgot the point

Read the original Note on Substack

Recurring ideas

Related concepts

  • model
  • token

A selection from the original Note. Read it in context on Substack.

Connected thoughts

All ideas →