Single-turn sample · 3 clauses · clause drafting fidelity
Single-turn clause drafting
Standard commercial clauses drafted by frontier models — Interpretation, Scope of Services, and Term & Termination — graded against a written rubric of substantive obligations from gold-standard contracts. Each row marked pass or fail under an 80% coverage floor.
Rows
3
Strict pass
0
Pass rate
0%
Avg coverage
78%
Tokens
0.4k
388 in / 10,417 out
Headline table
| id | macro theme | subtheme | clause | cov. | verdict | conf. | strict |
|---|---|---|---|---|---|---|---|
| 1 | Preliminary Provisions | Definitions | Intepretation variation 1 | 0.83 | fail | 0.98 | FAIL |
| 46 | Contract Structure | Scope of Services | Scope of Services clause variation 1 | 0.75 | fail | 0.97 | FAIL |
| 311 | Term & Termination | Term | Term clause variation 1 | 0.75 | fail | 0.95 | FAIL |
Per-theme pass rate
Strict pass requires the holistic judge to return pass AND obligation coverage at or above 80%.