Project rubrics and Auto Judgement are live. Review queue is ready

P0 Workflow

Projects

Dashboard

Workspace metrics across all projects, or focus on a single project.

Projects

Select an evaluation workspace to open its console, standards, and operations.

New Project

Rubrics

Manage shared standards and project-scoped rubrics across the whole workspace.

Shared Templates

Start from a shared template, adjust it, then save it as a project rubric.

Platform Trace Import

Preview native upstream payloads against the internal sample contract before writing data.

native -> sample
No import preview yet

Sample Pool

Filter imported samples, inspect normalized trace coverage, then create annotation batches.

0 selected
Add sample
00:00 / 00:00

Batch Progress

Annotation, finalization, and sync progress for each batch in the selected project.

Auto Judgement

Automatic judgement runs in parallel with human annotation under the same rubric version.

Label Templates

Annotation layouts available when creating a batch. Every template renders the batch rubric; only the layout differs.

Create Annotator Group

Group members can pull tasks from any batch bound to the group.

Annotator Groups

Global groups and their members, usable by any project's batches.

Issue Account

Create a person's account and optionally grant a global role.

Accounts

People accounts, their status, and global role. System service accounts are managed internally.

Batch Exports

Export a batch's finalized samples with the full annotation trail. Projects are columns; each card is a batch.