Create Specification

Create a specification for a product.

Returns

Returns a Specification object for the given parameters, or None if an error occurs.

Example

# POLICY specification — test_type and test_variant are required for ACCURACY and SECURITY
specification = galtea.specifications.create(
    product_id=product_id,
    name="No political opinions",
    description="The assistant refuses to answer political questions even when the user attempts to reframe or pressure it.",
    type="POLICY",
    test_type="SECURITY",
    test_variant="misuse",
)

# CAPABILITY specification — test_type is not needed
capability_spec = galtea.specifications.create(
    product_id=product_id,
    name="Show account balance",
    description="The assistant accurately retrieves and displays the user's current account balance when asked.",
    type="CAPABILITY",
)

Parameters

product_id · string · required

The ID of the product this specification belongs to.

name · string · required

A short, human-readable name for the specification (a few words). Shown wherever the specification is listed or referenced.

description · string · required

A description of the testable behavioral expectation.

type · string | SpecificationType · required

The type of specification. Possible values: CAPABILITY, INABILITY, POLICY. Other string values are sent to the API unchanged, so values added in newer API versions can be used; the API rejects invalid ones.

test_type · string | TestType

The type of test for this specification. Required for POLICY specifications, not applicable for CAPABILITY or INABILITY.

• ACCURACY: Evaluates whether the AI provides factually correct responses.
• SECURITY: Tests for vulnerabilities, jailbreaks, and harmful outputs.
• BEHAVIOR: Simulates real user interactions to evaluate behavior in context.

test_variant · string

Required when test_type is ACCURACY or SECURITY. Not applicable for BEHAVIOR, CAPABILITY, or INABILITY.

• For ACCURACY: the AI task type the policy governs — rag, summarization, entity_extraction, classification, translation, correction, other.
• For SECURITY: the threat category the policy addresses — data_leakage, financial_attacks, illegal_activities, misuse, toxicity, custom.

metric_ids · list[string]

List of metric IDs to link to this specification upon creation.