Create Chat Completion (Stream)

Given a prompt, the model will return one or more predicted completions, and can also return the probabilities of alternative tokens at each position. Create a completion for the provided prompt and parameters Official Documentation: https://platform.openai.com/docs/api-reference/chat/create

Endpoint

POST http://v98store.com/v1/chat/completions

cURL Command

curl -X POST 'http://v98store.com/v1/chat/completions' \ -H 'Content-Type: application/json' \ -H 'Authorization: Bearer YOUR_TOKEN' \ -d '{ "model": "gpt-4o", "max_tokens": 1000, "messages": [ { "role": "system", "content": "You are a helpful assistant." }, { "role": "user", "content": "Hello" } ], "temperature": 1, "stream": true, "stream_options": { "include_usage": true } }'

Parameters

Request Body

Example

{
  "model": "gpt-4o",
  "max_tokens": 1000,
  "messages": [
    {
      "role": "system",
      "content": "You are a helpful assistant."
    },
    {
      "role": "user",
      "content": "Hello"
    }
  ],
  "temperature": 1,
  "stream": true,
  "stream_options": {
    "include_usage": true
  }
}

Responses

200 -

Example

{
  "id": "chatcmpl-123",
  "object": "chat.completion",
  "created": 1677652288,
  "choices": [
    {
      "index": 0,
      "message": {
        "role": "assistant",
        "content": "\n\nHello there, how may I assist you today?"
      },
      "finish_reason": "stop"
    }
  ],
  "usage": {
    "prompt_tokens": 9,
    "completion_tokens": 12,
    "total_tokens": 21
  }
}