Skip to main content
Unlisted page
This page is unlisted. Search engines will not index it, and only users having a direct link can access it.

Create custom evaluation

POST 
/models/custom_eval/create_new_eval

Creates a new custom evaluation definition with a natural-language scoring prompt. The prompt defines the criteria by which the judge model will compare outputs (e.g. 'Which response is more concise and accurate?'). Once created, start a run with Start custom evaluation.

Request​

Responses​

OK