Documentation | Chat › Completions

API Reference

Chat

ChatResource

Chat

Completions

ChatResource.CompletionsResource

Methods

client.chat.completions.create() ->

CompletionCreateResponse

post/v5/chat/completions

Chat Completions

client.chat.completions.models() ->

CompletionModelsResponse

get/v5/chat/completions/models

Chat Completions

Parameters

ending_before: Optional[str]

limit: Optional[int]

(maximum: 1000, minimum: 1, default: 100)

model_vendor: Optional[Literal["openai", "cohere", "vertex_ai", "anthropic", "azure", "gemini", "launch", "llmengine", "model_zoo", "bedrock", "xai"]]

"openai"

"cohere"

"vertex_ai"

"anthropic"

"azure"

"gemini"

"launch"

"llmengine"

"model_zoo"

"bedrock"

"xai"

sort_order: Optional[Literal["asc", "desc"]]

(default: "asc")

"asc"

"desc"

starting_after: Optional[str]

Returns

class CompletionModelsResponse:

items: List[

ModelDefinition

]

object: Optional[Optional[Literal["list"]]]

(default: "list")

Request example

import os
from scale_gp_beta import SGPClient

client = SGPClient(
    api_key=os.environ.get("SGP_API_KEY"),  # This is the default and can be omitted
)
response = client.chat.completions.models()
print(response.items)

200Example

{
  "items": [
    {
      "model_name": "model_name",
      "model_type": "generic",
      "model_vendor": "openai"
    }
  ],
  "object": "list"
}

Domain types

class ChatCompletion: ...

class ChatCompletionChunk: ...

class ModelDefinition: ...