Independent expert ranks the same 20 cases. Never sees our output until after she submits.
Retrieval overlap
≥ 0.80
Set overlap of top-10 between Sarah and PoSoT.
Spearman ρ
≥ 0.70
Rank-order agreement.
Citation-chain completeness
= 1.00
Every claim traces back. No exceptions.
Reviewer time
≤ 30 min
The artifact is fast to verify.
3-of-4 = FAIL. No partial credit. No re-running the metric until it passes.
Reviewer UI: posot/validate/reviewer.html — built — demo live.