AI Agent Quality Assurance
AI Agent Quality Assurance validates the output of any LLM or agent framework. POST a run log and get back a structured QA report: a token-cost audit (totals, per-step breakdown, and a bloat score to catch runaway prompts), configurable business-rule checks (field presence, regex, comparisons, JSONPath), and JSON-Schema conformance validation. A batch endpoint runs up to 100 checks in a single…
1 subscribers
6 endpoints
The in-depth APIMemo review for this API hasn't been published yet —
the data below comes straight from the public marketplace listing.
AI Agent Quality Assurance endpoints
| Method | Endpoint | Description |
|---|---|---|
| audit | ||
| POST |
audit_tokens_v1_audit_tokens_post /v1/audit/tokens |
Compute total tokens, a per-step cost breakdown, and a bloat score. |
| checks | ||
| POST |
check_rules_v1_check_rules_post /v1/check/rules |
Apply user-supplied rules to a run log and return any violations. |
| POST |
check_schema_v1_check_schema_post /v1/check/schema |
Validate the agent's output against a supplied JSON Schema. A well-formed but non-conforming output yields ``200`` with ``valid=False`` and per-error details; a malformed… |
| batch | ||
| POST |
run_batch_v1_batch_post /v1/batch |
Process up to 100 runs and return an aggregated failure summary. |
| meta | ||
| GET |
root__get / |
Lightweight landing payload pointing callers at the docs. |
| GET |
health_health_get /health |
Simple liveness probe. |
AI Agent Quality Assurance pricing
| Plan | Price | Rate limit | Quotas |
|---|---|---|---|
| BASIC | Free | — |
|
| PRO | $9 / month | — |
|
| ULTRA | $29 / month | — |
|
| MEGA | $99 / month | — |
|
