Skip to main content

Create custom evaluation

POST 
/models/custom_eval/create_new_eval

Creates a new custom evaluation definition with a natural-language scoring prompt. The prompt defines the criteria by which the judge model will compare outputs (e.g. 'Which response is more concise and accurate?'). Once created, start a run with Start custom evaluation.

Request​

Responses​

OK