Cost & billing concept illustration

Cost & billing

Batch API

A mode where you submit many requests at once for processing within hours instead of instantly, usually at a large discount.

In practice

Run an overnight batch job to classify a million records at half price.

Related terms

See what your tokens really cost

Track usage and spend across every model and platform, free.

Image: RDNE Stock project on Pexels. Definition free to reuse under CC BY 4.0.