Getting Started
Setup → Assure → Calibration → Insights in QAVE Studio and the SDKs.
Getting Started & Studio Loop
1. Setup
- Create an account on Studio (
/signup) and copy your API key from Settings. - Install the SDK:
pip install "qurator[sdk]"
# or
npm install @qurator/sdk- Optionally create a Knowledge Base on
/knowledgeand attach it to a rubric.
2. Assure
In Studio /assurance, use the unified composer:
- Visual Builder — multi-turn + tool calls
- Raw JSON Body — lossless evaluate payload
- Live API / SDK Code — reactive snippets (batch JSONL is SDK-only)
Or call the API:
from qurator import Qurator
client = Qurator(api_key="YOUR_API_KEY")
result = client.evaluate(
messages=[
{"role": "user", "content": "What is your refund policy?"},
{"role": "assistant", "content": "Full refunds within 30 days."},
],
criteria=["Reward responses that state the refund window in days."],
assurance_tier="flash",
)
print(result.score, result.explanation)3. Calibration
Confirm or override verdicts in Studio. Progressive τ* stages unlock as you accumulate labeled examples. See Calibration & Examples.
4. Insights
Track pass rate, failure clusters, and tag slices on /insights. See Tags & Slicing.