• Original Model Card
• vLLM Documentation

Chat Completions API

Send Request

curl <AZUREML_ENDPOINT_URL> \\
    -X POST \\
    -H "Authorization: Bearer <AZUREML_TOKEN>" \\
    -H "Content-Type: application/json" \\
    -d '{"model":"wave-on-discord/silly-v0.2","messages":[{"role":"user","content":"What is Deep Learning?"}]}'

Supported Parameters

• model (string): Model ID used to generate the response, in this case since only a single model is deployed within the same endpoint you can either set it to wave-on-discord/silly-v0.2 or leave it blank instead.
• messages (array): A list of messages comprising the conversation so far. Depending on the model you use, different message types (modalities) are supported, like text, images, and audio.

Example payload

{
  "model": "wave-on-discord/silly-v0.2",
  "messages": [
    {"role":"user","content":"What is Deep Learning?"}
  ],
  "max_completion_tokens": 256,
  "temperature": 0.6
}