• Original Model Card
• vLLM Documentation

Chat Completions API

Send Request

curl <AZUREML_ENDPOINT_URL> \
    -X POST \
    -H "Authorization: Bearer <AZUREML_TOKEN>" \
    -H "Content-Type: application/json" \
    -d '{"model":"ServiceNow-AI/AprielGuard","messages":[{"role":"user","content":"What is Deep Learning?"}]}'

Supported Parameters

• model (string): Model ID used to generate the response, in this case since only a single model is deployed within the same endpoint you can either set it to ServiceNow-AI/AprielGuard or leave it blank instead.
• messages (array): A list of messages comprising the conversation so far. Depending on the model you use, different message types (modalities) are supported, like text, images, and audio.

Example payload

{
  "model": "ServiceNow-AI/AprielGuard",
  "messages": [
    {"role":"user","content":"What is Deep Learning?"}
  ],
  "max_completion_tokens": 256,
  "temperature": 0.6
}