Skip to main content

​
What is a User Group?

A User Group organizes users and metrics within an organization to streamline human evaluation workflows. User Groups serve two key purposes:
  1. Assigning evaluators: Group users who should review and annotate AI outputs for specific metrics.
  2. Scoping metrics: Link metrics to groups so that only users in those groups see pending evaluations for those metrics.
When a Human Evaluation metric is linked to a user group, only users in that group will see pending evaluations for that metric in the Human Evaluations page of the dashboard.

​
Managing User Groups

User groups can be managed in two places:
  • Dashboard: Navigate to an organization’s Groups tab to create, edit, and delete groups. From metric and user detail pages, you can also assign and unassign groups.
  • SDK: Use the galtea.user_groups service for programmatic management. See the Human Evaluation tutorial for a step-by-step guide.

​
SDK Integration

User Group SDK API

Create, list, update, and delete user groups programmatically. Link and unlink users and metrics.

​
User Group Properties

​
id
string
Unique identifier for the user group.
​
organization_id
string
The organization this group belongs to.
​
name
string
required
Name of the user group.
​
type
string
required
Type of user group. Currently only EVALUATOR is supported.
​
description
string
Description of the group’s purpose.
​
user_ids
list[string]
IDs of users in this group.
​
metric_ids
list[string]
IDs of metrics linked to this group.

Human Evaluation Tutorial

Step-by-step guide to the full annotation workflow with screenshots.

User Group SDK API

Programmatic management of user groups.