Description

Evaluation Ids

Metadata

Name

Row Identifiers

Group Id

Ending Before

Evaluation Id

Include Deleted

Limit

Sort By

Sort Order

Starting After

Views

Account Id

Created At

Deleted At

Members

Evaluation Created At

Evaluation Group Id

Evaluation Name

Evaluation Tags

Object

Column Name

identity

$shared

Shared

cancel

create

list

logs

retrieve

build_cancel_response

build_create_response

build_list_response

build_retrieve_response

stream_chunk

build

Build

chat

models

chat_completion

chat_completion_chunk

completion_create_response

completion_models_response

model_definition

completions

Completions

Chat

completion

decrypt

decrypt_by_name

delete

retrieve_by_name

update

credential

credential_delete_response

credential_secret

credentials

Credentials

batch_create

dataset_item

dataset_item_batch_create_response

dataset_item_delete_response

dataset_items

Dataset Items

dataset

dataset_delete_response

datasets

Datasets

evaluation_dashboard

evaluation_dashboards

evaluation_dashboard_widget

evaluation_dashboard_widget_result

evaluation_dashboard_widget_with_result

widgets

Widgets

Evaluation Dashboards

evaluation_groups

Create

Soft-delete an evaluation group and cascade to members, row identifiers, and charts

Delete

List all evaluation groups for the current account

List

Full update of evaluation group. All fields are replaced with provided values. Omitted optional fields are cleared.

replace

Replace

Get a single evaluation group by ID

Retrieve

Partial update of evaluation group attributes (name, description, tags, metadata). Members cannot be modified via PATCH.

Update

evaluation_group

Evaluation Group

EvaluationGroupsResource

Evaluation Groups

EvaluationGroups

export

component

container

evaluation_item

evaluation_item_export

evaluation_items

Evaluation Items

filter

retrieve_schema

evaluation

evaluation_schema_response

evaluation_task

item_locator

item_locator_template

evaluations

Evaluations

import_from_cloud

Import files from existing blob storage in cloud (batch operation)

file

file_delete_response

file_import_from_cloud_response

files

content_retrieve_response

content

Content

Files

inference_create_response

inference_response

inference_response_chunk

inference

Inference

inference_model

model_delete_response

Models

question

questions

Questions

response

response_create_response

responses

Responses

approval_status

assessment_type

span_assessment

span_assessment_delete_response

span_assessments

Span Assessments

batch

search

upsert_batch

span

span_batch_response

span_status

span_type

span_upsert_batch_response

spans

Spans

configure

count

drop

query

upsert

embedding_config_base

embedding_config_models_api

text_content

vector_store

vector_store_count_response

vector_store_delete_response

vector_store_drop_response

vector_store_query_response

vector_store_upsert_response

vector_stores

vector_list_response

vector_retrieve_response

vectors

Vectors

Vector Stores

APIKeyHeader

API Key Header

import os
from scale_gp_beta import SGPClient

client = SGPClient(
    api_key=os.environ.get("SGP_API_KEY"),  # This is the default and can be omitted
)
evaluation_group = client.evaluation_groups.create(
    evaluation_ids=["string"],
    name="name",
)
print(evaluation_group.id)

import os
from scale_gp_beta import SGPClient

client = SGPClient(
    api_key=os.environ.get("SGP_API_KEY"),  # This is the default and can be omitted
)
evaluation_group = client.evaluation_groups.delete(
    "group_id",
)
print(evaluation_group.id)

import os
from scale_gp_beta import SGPClient

client = SGPClient(
    api_key=os.environ.get("SGP_API_KEY"),  # This is the default and can be omitted
)
page = client.evaluation_groups.list()
page = page.items[0]
print(page.id)

import os
from scale_gp_beta import SGPClient

client = SGPClient(
    api_key=os.environ.get("SGP_API_KEY"),  # This is the default and can be omitted
)
evaluation_group = client.evaluation_groups.replace(
    group_id="group_id",
)
print(evaluation_group.id)

import os
from scale_gp_beta import SGPClient

client = SGPClient(
    api_key=os.environ.get("SGP_API_KEY"),  # This is the default and can be omitted
)
evaluation_group = client.evaluation_groups.retrieve(
    group_id="group_id",
)
print(evaluation_group.id)

import os
from scale_gp_beta import SGPClient

client = SGPClient(
    api_key=os.environ.get("SGP_API_KEY"),  # This is the default and can be omitted
)
evaluation_group = client.evaluation_groups.update(
    group_id="group_id",
)
print(evaluation_group.id)