Performance
Streaming
Sending a model's answer token by token as it is generated, so users see text appear live instead of waiting for the whole thing.
In practice
The typewriter effect in chat apps is streaming.
Related terms
See what your tokens really cost
Track usage and spend across every model and platform, free.
Image: Mathias Reding on Pexels. Definition free to reuse under CC BY 4.0.