Create evaluations

Evaluations are automatically created by the Chat endpoint. The model output is what is evaluated, with the request used as context.

If a callback is provided, the evaluation is passed to that function, and inference is not affected.

If no callback is provided, and stream is true, then the evaluation is available on the last chunk.

If no callback is provided and stream is false or none, then the evaluation can be found on the completion response.

Evaluate Response

application_id
integer

The Maitai identifier for the application.

session_id
string

A unique identifier for the session, passed in from the Chat endpoint.

request_id
integer

The identifier of the evaluated Chat Completion request.

evaluation_results
array

A list of individual Sentinel’s results

evaluation_request_id
string

The unique identifier for the evaluation request.