Skip to main content
POST
/
llm
LLM
curl --request POST \
  --url https://dream-gateway.livepeer.cloud/llm \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '
{
  "messages": [
    {
      "role": "<string>",
      "content": "<string>"
    }
  ],
  "model": "",
  "temperature": 0.7,
  "max_tokens": 256,
  "top_p": 1,
  "top_k": -1,
  "stream": false
}
'
{
  "id": "<string>",
  "model": "<string>",
  "created": 123,
  "usage": {
    "prompt_tokens": 123,
    "completion_tokens": 123,
    "total_tokens": 123
  },
  "choices": [
    {
      "index": 123,
      "finish_reason": "",
      "delta": {
        "role": "<string>",
        "content": "<string>"
      },
      "message": {
        "role": "<string>",
        "content": "<string>"
      }
    }
  ]
}

Authorizations

​
Authorization
string
header
required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Body

application/json
​
messages
LLMMessage · object[]
required
​
model
string
default:""
​
temperature
number
default:0.7
​
max_tokens
integer
default:256
​
top_p
number
default:1
​
top_k
integer
default:-1
​
stream
boolean
default:false

Response

Successful Response

​
id
string
required
​
model
string
required
​
created
integer
required
​
usage
LLMTokenUsage · object
required
​
choices
LLMChoice · object[]
required