429 earlier than it
expects.
Rank API limits
What an evaluation costs
Each evaluation contains three paired-model repetitions (six generator samples), but credits are
deducted per successful scoring evaluation — not per repetition and not per model call.
A 20-asset batch where every asset carries copy context can cost up to 40 evaluations. That is
two thirds of your per-minute allowance in a single request.
Reading usage from the response
scoring_evaluations and credits_remaining rather than counting requests.
Pairwise billing
The Pairwise API is accounted separately and reportspairwise_evaluations on its own.
Close-pair refinement inside the Rank API is reported under
summary.close_pair_refinement; Rank API credit and rate accounting is based on scoring
evaluations.
Handling 429
429 responses carry a Retry-After header. Honour it instead of retrying on a fixed
interval — there is a worked backoff implementation in the
agent loop guide.