Capabilities & limits
Reranking
A second pass that reorders retrieved results by how relevant they really are, so only the best context goes into the prompt. Improves RAG quality and trims wasted tokens.
In practice
A reranker pushes the one truly relevant doc above ten loosely-related ones.
Related terms
See what your tokens really cost
Track usage and spend across every model and platform, free.
Image: Steve A Johnson on Pexels. Definition free to reuse under CC BY 4.0.