Validate

Independent expert ranks the same 20 cases. Never sees our output until after she submits.

Retrieval overlap

≥ 0.80

Set overlap of top-10 between Sarah and PoSoT.

Spearman ρ

≥ 0.70

Rank-order agreement.

Citation-chain completeness

= 1.00

Every claim traces back. No exceptions.

Reviewer time

≤ 30 min

The artifact is fast to verify.

3-of-4 = FAIL. No partial credit. No re-running the metric until it passes.

Reviewer UI: posot/validate/reviewer.html — built — demo live.