Illusions of Confidence? Diagnosing LLM Truthfulness via Neighborhood Consistency
As Large Language Models (LLMs) are increasingly deployed in real-world settings, correctness alone is insufficient. Reliable deployment requires maintaining truthful beliefs under contextual perturbations. Existing evaluations largely rely on point-wise confidence like Self-Consistency, which can mask brittle belief. We show that even facts answered with perfect self-consistency can rapidly collapse under mild contextual interference. To address this gap, we propose Neighbor-Consistency Belief (NCB), a structural measure of belief robustness that evaluates response coherence across a conceptual neighborhood. To validate the efficiency of NCB, we introduce a new cognitive stress-testing protocol that probes outputs stability under contextual interference. Experiments across multiple LLMs show that the performance of high-NCB data is relatively more resistant to interference. Finally, we present Structure-Aware Training (SAT), which optimizes context-invariant belief structure and reduces long-tail knowledge brittleness by approximately 30%. Code will be available at https://github.com/zjunlp/belief.
69646dd9138cc47cbd7652c7
Haoming Xu
69646dd9138cc47cbd7652c8
Ningyuan Zhao
claimed_verified
2026-02-11T11:20:49.005Z
6641f74c3bd2f40eb41fb0d8
/avatars/b0167a521b6e4aea27e245dd9e026ef3.svg
zhaoningyuan
zhaoningyuan
user
zhaoningyuan
69646dd9138cc47cbd7652c9
Yunzhi Yao
claimed_verified
2026-01-23T09:39:14.819Z
6122fbe636a4c36a99dbea7b
/avatars/c0cd2c1ef58e315d9adda9d26000f625.svg
Yunzhi Yao
cowTodd
user
cowTodd
69646dd9138cc47cbd7652ca
Weihong Xu
69646dd9138cc47cbd7652cb
Hongru Wang
claimed_verified
2026-01-13T15:45:41.374Z
65f906e5c3dbdcae83ff7aac
https://cdn-avatars.huggingface.co/v1/production/uploads/65f906e5c3dbdcae83ff7aac/mdjiVkLDJgJcGLwv0rMe4.jpeg
Hongru Wang
Merlin-Hongru
user
Merlin-Hongru
69646dd9138cc47cbd7652cc
Xinle Deng
69646dd9138cc47cbd7652cd
Shumin Deng
69646dd9138cc47cbd7652ce
Jeff Z. Pan
69646dd9138cc47cbd7652cf
Huajun Chen
69646dd9138cc47cbd7652d0
Ningyu Zhang
claimed_verified
2026-01-12T15:19:05.565Z
620b3bbb0668e435407c8d0a
/avatars/e0fccbb2577d76088e09f054c35cffbc.svg
Ningyu Zhang
Ningyu
user
Ningyu
Illusions of Confidence? Diagnosing LLM Truthfulness via Neighborhood Consistency
As Large Language Models (LLMs) are increasingly deployed in real-world settings, correctness alone is insufficient. Reliable deployment requires maintaining truthful beliefs under contextual perturbations. Existing evaluations largely rely on point-wise confidence like Self-Consistency, which can mask brittle belief. We show that even facts answered with perfect self-consistency can rapidly collapse under mild contextual interference. To address this gap, we propose Neighbor-Consistency Belief (NCB), a structural measure of belief robustness that evaluates response coherence across a conceptual neighborhood. To validate the efficiency of NCB, we introduce a new cognitive stress-testing protocol that probes outputs stability under contextual interference. Experiments across multiple LLMs show that the performance of high-NCB data is relatively more resistant to interference. Finally, we present Structure-Aware Training (SAT), which optimizes context-invariant belief structure and reduces long-tail knowledge brittleness by approximately 30%. Code will be available at https://github.com/zjunlp/belief.
Large language models exhibit brittle beliefs under contextual perturbations, which are better measured by structural consistency metrics and addressed through structure-aware training methods.
Large Language Models Self-Consistency belief robustness conceptual neighborhood cognitive stress-testing context-invariant belief structure long-tail knowledge brittleness Structure-Aware Training