Evaluation Dashboards

EvaluationDashboardsResource

Methods

create() ->
post/v5/evaluation-dashboards

Create a new evaluation dashboard for an evaluation or evaluation group

list() -> SyncCursorPage[]
get/v5/evaluation-dashboards

List dashboards filtered by evaluation_id, evaluation_group_id, tags, creators, or search

retrieve(, ) ->
get/v5/evaluation-dashboards/{dashboard_id}

Get a single evaluation dashboard by ID

update(, ) ->
patch/v5/evaluation-dashboards/{dashboard_id}

Partially update dashboard metadata (name, description, widget_order)

delete() ->
delete/v5/evaluation-dashboards/{dashboard_id}

Soft delete an evaluation dashboard

Domain types

class EvaluationDashboard: ...

EvaluationDashboardsResource.WidgetsResource

Methods

create(, ) ->
post/v5/evaluation-dashboards/{dashboard_id}/widgets

Create a new widget, add it to the dashboard, and compute its results

update(, ) ->
patch/v5/evaluation-dashboards/{dashboard_id}/widgets/{widget_id}

Update a widget and compute its results. If the widget is only used by this dashboard, it is updated in place. If shared across multiple dashboards, a copy is created.

Parameters
dashboard_id: str
widget_id: str
config: Optional[Dict[str, ]]

Chart-specific display configuration

query: Optional[]

Structured query AST for metric computation (SeriesQuery or MetricQuery)

class QuerySeriesQuery: ...

Query that returns a series of records (used for table/bar/histogram widgets).

Used for widget types: table, bar, histogram. Returns: {"type": "series", "data": [...]}

Example SQL equivalent: SELECT category, AVG(score) as avg_score, COUNT(*) as count FROM evaluation_items WHERE score > 0.5 AND category = 'test' GROUP BY category ORDER BY avg_score DESC LIMIT 100

class QueryMetricQuery: ...

Query that returns a single metric value (used for metric widgets).

Used for widget type: metric. Enforces exactly 1 aggregation in select. Returns: {"type": "metric", "data": ...}

Example SQL equivalent: SELECT AVG(score) as average_score FROM evaluation_items

title: Optional[str]
(maxLength: 256, minLength: 1)

Widget title

Returns
id: str

Unique identifier of the widget

account_id: str

Account that owns this widget

created_at:
(format: date-time)

When the widget was created

title: str

Widget title

type: Literal["bar", "histogram", "metric", "table", "markdown", "heading"]

Widget type

config: Optional[Dict[str, ]]

Display configuration

object: Optional[Literal["evaluation_widget"]]
(default: "evaluation_widget")
query: Optional[]

Structured query AST for computation (SeriesQuery or MetricQuery)

result: Optional[]

Computed result for this widget

Request example
200Example
delete(, )
delete/v5/evaluation-dashboards/{dashboard_id}/widgets/{widget_id}

Remove a widget from the dashboard (does not delete the widget)

Domain types

class EvaluationDashboardWidget: ...
class EvaluationDashboardWidgetResult: ...
class EvaluationDashboardWidgetWithResult: ...

Response model for widget creation - includes widget and computed result