Skip to main content
Microsoft Foundry
Sign in
View as Markdown
View as Markdown
Evaluators

List latest evaluator versions

GET
/evaluators

Lists the latest version of each evaluator.

Query Parameters
typestringoptional
Filter evaluators by type. Possible values: 'all', 'custom', 'builtin'.
all
limitintegeroptionaldefault: 20
A limit on the number of objects to be returned. Limit can range between 1 and 100, and the default is 20.
Responses
valueEvaluatorVersion[]required
The EvaluatorVersion items on this page
display_namestring
Display Name for evaluator. It helps to find the evaluator easily in AI Foundry. It does not need to be unique.
metadataobject
Metadata about the evaluator
evaluator_typeenumrequired
The type of the evaluator
builtincustom
categoriesenum[]required
The categories of the evaluator
qualitysafetyagents
supported_evaluation_levelsenum[]
Evaluation levels this evaluator supports (e.g., turn, conversation). When omitted on create, the service defaults to ["turn"]. On update, omitting this field leaves it unchanged; an empty list is rejected. Custom code-based evaluators support only turn; custom prompt-based evaluators support exactly one level (turn or conversation).
turnconversation
definitioncode | prompt | rubric | endpointrequired
Base evaluator configuration with discriminator
generation_artifactsEvaluatorGenerationArtifacts
Service-managed provenance artifacts produced by an evaluator generation job. Present only on EvaluatorVersion resources created via the generation pipeline. The combined-JSONL Foundry Dataset is read-only and resolves to a versioned dataset in a service-reserved namespace.
generation_job_idstring
Read-only provenance link back to the EvaluatorGenerationJob that produced this version. Present only on evaluator versions created via the generation pipeline; absent for manually-created versions and unaffected by subsequent PATCH calls.
warningsenum[]
Categories of warnings surfaced on this generated evaluator version. Present only on versions created via an EvaluatorGenerationJob when the paired job produced non-empty warnings. Absent (treat as no warnings) when the version is not from generation, when the paired job was clean, or when a subsequent PATCH to definition cleared the paired job's advisories. Follow generation_job_id to fetch the detailed warning payloads.
input_quality
created_bystringrequired
Creator of the evaluator
created_atstringrequired
Creation date/time of the evaluator
modified_atstringrequired
Last modified date/time of the evaluator
idstring
Asset ID, a unique identifier for the asset
namestringrequired
The name of the resource
versionstringrequired
The version of the resource
nextLinkstring
The link to the next page of items