Training & tuning
Pretraining
The first, largest training phase, where a model learns general language patterns from a massive text corpus before any task-specific tuning.
In practice
Pretraining produces a base model that later gets fine-tuned to follow instructions.
Related terms
See what your tokens really cost
Track usage and spend across every model and platform, free.
Image: panumas nikhomkhai on Pexels. Definition free to reuse under CC BY 4.0.