Screen Before You Interpret: A Portable Validity Screen for Benchmark-Based LLM Confidence Signals
Summary
This work proposes a portable screen that first checks whether an LLM's confidence signal actually varies with correctness before using it for abstention, routing, and escalation decisions.
Why this matters
Covers LLM and benchmark · Relevant to this topic
Source: arXiv cs.AI · arxiv.org