• Original Model Card
• vLLM Documentation

Chat Completions API

Send Request

curl <AZUREML_ENDPOINT_URL> \
    -X POST \
    -H "Authorization: Bearer <AZUREML_TOKEN>" \
    -H "Content-Type: application/json" \
    -d '{"model":"ibm-granite/granite-4.1-30b","messages":[{"role":"user","content":"What is Deep Learning?"}]}'

Supported Parameters

• model (string): Model ID used to generate the response, in this case since only a single model is deployed within the same endpoint you can either set it to ibm-granite/granite-4.1-30b or leave it blank instead.
• messages (array): A list of messages comprising the conversation so far. Depending on the model you use, different message types (modalities) are supported, like text, images, and audio.

Example payload

{
  "model": "ibm-granite/granite-4.1-30b",
  "messages": [
    {"role":"user","content":"What is Deep Learning?"}
  ],
  "max_completion_tokens": 256,
  "temperature": 0.6
}