Evaluation Ops
Projects
Dashboard
Workspace metrics across all projects, or focus on a single project.
Projects
Select an evaluation workspace to open its console, standards, and operations.
Rubrics
Manage global evaluation standards across the whole workspace.
New Rubric
Rubric Questions
Edit the normalized questions parsed from the imported JSON.
Import Rubric from JSON
Paste a complete rubric object generated from the schema guide. The imported rubric is saved as a draft.
Sample Pool
Filter imported samples, inspect normalized trace coverage, then create annotation batches.
Import Samples
Fetch or preview upstream payloads against the internal sample contract before writing data.
Batch Builder
Configure a batch from the selected samples.
Batch Progress
Annotation, finalization, and sync progress for each batch in the selected project.
Auto Judgement
Automatic judgement runs in parallel with human annotation under the same rubric version.
Label Templates
Annotation layouts available when creating a batch. Every template renders the batch rubric; only the layout differs.
Annotator Groups
Global groups and their members, usable by any project's batches.
Create Annotator Group
Group members can pull tasks from any batch bound to the group.
Accounts
People accounts grouped by global role, with their status. System service accounts are managed internally.
Batch Exports
Export finalized samples from this project's batches with the full annotation trail.