AI Eval commands - Omni CLI

Manage eval prompt sets and runs used to score AI quality against curated prompt suites. See the AI API documentation for more information.

omni ai-eval <command>

Command	Description
`prompt-sets-list`	List eval prompt sets
`prompt-sets-create`	Create an eval prompt set
`prompt-sets-get`	Get an eval prompt set
`prompt-sets-update`	Update an eval prompt set
`prompt-sets-archive`	Archive an eval prompt set
`prompt-sets-unarchive`	Restore an archived eval prompt set
`runs-list`	List eval runs
`runs-create`	Start an eval run
`runs-get`	Get an eval run
`runs-cancel`	Cancel an eval run
`runs-archive`	Archive an eval run
`runs-unarchive`	Restore an archived eval run

# Start an eval run against a prompt set
omni ai-eval runs-create --body '{"promptSetId":"<promptSetId>"}'

# View help for prompt-sets-create, including arguments and flag details
omni ai-eval prompt-sets-create --help

Every command in this group also accepts the global flags, including --token, --profile, --format, and --compact.

Getting started

Command groups

Reference

AI Eval commands - Omni CLI