Documentation | Chat › Completions

Chat

ChatResource

Chat

Completions

ChatResource.CompletionsResource

Methods

client.chat.completions.models() ->

CompletionModelsResponse

get/v5/chat/completions/models

List Chat Completion Models

Parameters

ending_before: Optional[str]

limit: Optional[int]

(maximum: 10000, minimum: 1, default: 100)

model_vendor: Optional[

InferenceModelVendor

]

sort_by: Optional[str]

sort_order: Optional[

SortOrder

]

starting_after: Optional[str]

Returns

class CompletionModelsResponse:

items: List[

ModelDefinition

]

object: Optional[Literal["list"]]

(default: "list")

Request example

import os
from scale_gp_beta import SGPClient

client = SGPClient(
    api_key=os.environ.get("SGP_API_KEY"),  # This is the default and can be omitted
)
response = client.chat.completions.models()
print(response.items)

200Example

{
  "items": [
    {
      "model_name": "model_name",
      "model_type": "generic",
      "model_vendor": "openai",
      "model_availability": "unknown"
    }
  ],
  "object": "list"
}

client.chat.completions.create() ->

CompletionCreateResponse

post/v5/chat/completions

Chat Completions

Domain types

class ChatCompletion: ...

class ChatCompletionChunk: ...

class ChatCompletionTokenLogprob: ...

class ChoiceLogprobs: ...

Log probability information for the choice.

CompletionCreateResponse

class CompletionModelsResponse: ...

Literal["openai", "cohere", "vertex_ai", "anthropic", "azure", "gemini", "launch", "llmengine", "model_zoo", "bedrock", "xai", "fireworks_ai"]

class ModelDefinition: ...

Literal["asc", "desc"]