Evaluation Items

EvaluationItemsResource

Methods

retrieve(, ) ->
get/v5/evaluation-items/{evaluation_item_id}

Retrieve a single evaluation item by its ID within the caller's account.

By default only non-archived items are returned; pass include_archived=true to also retrieve an item that has been archived. The response merges the item's cached task results into its data field and exposes a task_errors map keyed by task alias, so a task that failed on this item surfaces as an entry there rather than as a request error. Use this to inspect one item's input data and per-task results; to page through many items, use the list endpoint instead. The request fails if no item with the given ID exists in the caller's account.

list() -> SyncCursorPage[]
get/v5/evaluation-items

Return a paginated list of evaluation items belonging to the caller's account.

Pass evaluation_id to restrict the results to a single evaluation's items. The completion_status filter selects items by whether any of their tasks errored: failed returns only items that have task errors, passed returns only items with no task errors, and all (or omitting the parameter) returns every item. Archived items are excluded unless include_archived=true. Each returned item has its cached task results merged into data and its errors exposed in task_errors, identically to the single-item endpoint.

export() ->
post/v5/evaluation-items/export

Export all evaluation items for a single evaluation as a downloadable file.

The evaluation is specified by evaluation_id in the request body. export_format selects CSV, JSON, or JSONL; for CSV the per-item data and files fields are flattened into individual columns and metric-like result columns are expanded. export_method controls delivery: direct returns the file contents inline in the response, while signed_url uploads the file to object storage and returns a pre-signed download URL. Requesting signed_url in an environment where object storage is not configured fails with a 501, so use direct there instead. Set include_archived=true to include archived items in the export. This endpoint reads items only and does not modify the evaluation.

Parameters
evaluation_id: str

The ID of the evaluation to export items from.

export_format: Optional[]

The format of the exported evaluation items. json returns a single JSON array, while jsonl returns one JSON object per line.

export_method: Optional[]

The method for exporting evaluation items. signed_url returns a pre-signed URL, while direct returns the raw content.

include_archived: Optional[]

If true, include archived evaluation items in the export.

Returns
filename: str

The name of the exported file

content: Optional[str]

The raw file content as bytes, used when direct download is enabled

signed_url: Optional[str]

Pre-signed URL to download the file from object storage, if applicable

Request example
200Example

Domain types

class Component: ...
class Container: ...
class EvaluationItem: ...
class EvaluationItemExport: ...

Response model for exporting evaluation items. This class represents the response when users export evaluation items. It contains either a signed URL to download the exported data from object storage, or the actual content bytes when direct download is used (in environments where object storage is not configured).

Literal["json", "jsonl", "csv"]
Literal["signed_url", "direct"]
class TaskError: ...