QAVE Docs

Getting Started

Setup → Assure → Calibration → Insights in QAVE Studio and the SDKs.

Getting Started & Studio Loop

1. Setup

  1. Create an account on Studio (/signup) and copy your API key from Settings.
  2. Install the SDK:
pip install "qurator[sdk]"
# or
npm install @qurator/sdk
  1. Optionally create a Knowledge Base on /knowledge and attach it to a rubric.

2. Assure

In Studio /assurance, use the unified composer:

  • Visual Builder — multi-turn + tool calls
  • Raw JSON Body — lossless evaluate payload
  • Live API / SDK Code — reactive snippets (batch JSONL is SDK-only)

Or call the API:

from qurator import Qurator

client = Qurator(api_key="YOUR_API_KEY")
result = client.evaluate(
    messages=[
        {"role": "user", "content": "What is your refund policy?"},
        {"role": "assistant", "content": "Full refunds within 30 days."},
    ],
    criteria=["Reward responses that state the refund window in days."],
    assurance_tier="flash",
)
print(result.score, result.explanation)

3. Calibration

Confirm or override verdicts in Studio. Progressive τ* stages unlock as you accumulate labeled examples. See Calibration & Examples.

4. Insights

Track pass rate, failure clusters, and tag slices on /insights. See Tags & Slicing.