Frozen public-source campaign
Validate each task before it enters the benchmark.
Two qualified reviewers classify each prompt independently and write criterion packs. Matching ballots use a deterministic union; only disagreements reach a distinct third adjudicator. Source metadata and model outputs remain sealed during validation.
Frozen human campaign
Open a bounded review session
Public records use a stable pseudonym. Verified person uniqueness, qualifications, conflicts, and role admission remain private. Credentials stay in this tab only.
Evidence boundary180 human-written public-source candidates0 model calls · 0 Epicure calls · ranking disabled