Skip to main content
POST
/
v1
/
ai
/
eval
/
prompt-sets
Create an eval prompt set
curl --request POST \
  --url https://{instance}.omniapp.co/api/v1/ai/eval/prompt-sets \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '
{
  "model_id": "880e8400-e29b-41d4-a716-446655440003",
  "name": "Orders regression",
  "slug": "orders-regression",
  "description": "Regression suite for the orders topic",
  "prompts": []
}
'
{
  "prompt_set": {
    "created_at": "2025-01-15T10:00:00.000Z",
    "description": "Regression suite for the orders topic",
    "id": "550e8400-e29b-41d4-a716-446655440000",
    "is_archived": false,
    "model_id": "880e8400-e29b-41d4-a716-446655440003",
    "name": "Orders regression",
    "prompts": [
      {
        "created_at": "2025-01-15T10:00:00.000Z",
        "expectation": "The top product by revenue should be Aniseed Syrup.",
        "id": "770e8400-e29b-41d4-a716-446655440002",
        "prompt_text": "What are the top 5 products by revenue?",
        "updated_at": "2025-01-15T10:00:00.000Z"
      }
    ],
    "slug": "orders-regression",
    "updated_at": "2025-01-15T10:00:00.000Z"
  }
}

Authorizations

​
Authorization
string
header
required

Can be either an Organization API Key or Personal Access Token (PAT).

Include in the Authorization header as: Bearer YOUR_TOKEN

Body

application/json
​
model_id
string<uuid>
required

The shared model this prompt set is bound to.

Example:

"880e8400-e29b-41d4-a716-446655440003"

​
name
string
required

Human-readable name for the prompt set. 255 characters or fewer.

Required string length: 1 - 255
Example:

"Orders regression"

​
slug
string
required

URL-safe identifier for the prompt set. Must be unique per model_id and match ^[a-z][a-z0-9-]*$. Max 255 characters.

Maximum string length: 255
Pattern: ^[a-z][a-z0-9-]*$
Example:

"orders-regression"

​
description
string | null

Optional human-readable description of the prompt set. Max 1024 characters.

Maximum string length: 1024
Example:

"Regression suite for the orders topic"

​
prompts
object[]

Initial prompts for the set. Defaults to an empty list. At most 25 prompts.

Maximum array length: 25

Response

Prompt set created successfully.

​
prompt_set
object
required