Decoding & sampling

Top-p

Q: What does top-p stand for?

top-p stands for Top-p. A setting that limits word choice to the smallest set of options whose combined probability passes a threshold p. Another way to tune randomness.

top-p

A setting that limits word choice to the smallest set of options whose combined probability passes a threshold p. Another way to tune randomness.

In practice

top-p 0.1 keeps only the most likely words, making output very predictable.

Related terms

Temperature Top-k

See what your tokens really cost

Track usage and spend across every model and platform, free.

Start tracking free See the AI Cost Index

Image: Codioful on Pexels. Definition free to reuse under CC BY 4.0.