Skip to main content

​
Overview

The eval-seed endpoint uses the current snapshot of a cloud skill source to generate a set of synthetic trigger-query cases. These cases can be reviewed and saved as an eval suite.

​
Endpoint

POST /api/v1/cloud-sources/{id}/eval-seed
Auth: Admin role required.

​
Path parameters

ParameterTypeDescription
idstring (uuid)Cloud source ID

​
Request body

{
  "positive_cases": 6,
  "negative_cases": 6
}
FieldTypeDefaultRangeDescription
positive_casesinteger61–20Number of should-trigger cases to generate
negative_casesinteger61–20Number of should-not-trigger cases to generate

​
Response

{
  "snapshot_id": "uuid",
  "model": "anthropic/claude-sonnet-4-6",
  "generated_at": "2026-04-16T12:00:00.000Z",
  "cases": [
    {
      "case_kind": "trigger_query",
      "query": "How do I install selftune?",
      "should_trigger": true,
      "invocation_type": "explicit",
      "source": "synthetic"
    }
  ]
}
FieldDescription
snapshot_idThe snapshot used to generate cases
modelModel used for generation, or null if using server default
generated_atISO 8601 timestamp
casesArray of 1–40 CloudEvalCaseDefinition objects