Can Small Decision Models Verify Benchmarks? We Tested Two Against Three LLM Judges
Jev ranked defective MMLU questions about as well as Claude Sonnet 4.6 at one-sixtieth the cost, but no model was reliable enough to accept or reject items unreviewed.