OpenNovelty: An LLM-powered Agentic System for Verifiable Scholarly Novelty Assessment
Evaluating novelty is critical yet challenging in peer review, as reviewers must assess submissions against a vast, rapidly evolving literature. This report presents OpenNovelty, an LLM-powered agentic system for transparent, evidence-based novelty analysis. The system operates through four phases: (1) extracting the core task and contribution claims to generate retrieval queries; (2) retrieving relevant prior work based on extracted queries via semantic search engine; (3) constructing a hierarchical taxonomy of core-task-related work and performing contribution-level full-text comparisons against each contribution; and (4) synthesizing all analyses into a structured novelty report with explicit citations and evidence snippets. Unlike naive LLM-based approaches, OpenNovelty grounds all assessments in retrieved real papers, ensuring verifiable judgments. We deploy our system on 500+ ICLR 2026 submissions with all reports publicly available on our website, and preliminary analysis suggests it can identify relevant prior work, including closely related papers that authors may overlook. OpenNovelty aims to empower the research community with a scalable tool that promotes fair, consistent, and evidence-backed peer review.
695c82ff6aa73bc11f091484
Ming Zhang
claimed_verified
2026-01-07T13:13:57.422Z
65b71c0582d38451342f7334
/avatars/f9763a0ac361c350e6c6732e23564567.svg
Ming Zhang
konglongge
user
konglongge
695c82ff6aa73bc11f091485
Kexin Tan
claimed_verified
2026-01-07T13:13:59.397Z
690d63edcc6c3170efc27e9b
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/RF94JXENf6gXymW3kHnYQ.jpeg
KT
undercurrent23
user
undercurrent23
695c82ff6aa73bc11f091486
Yueyuan Huang
695c82ff6aa73bc11f091487
Yujiong Shen
695c82ff6aa73bc11f091488
Chunchun Ma
695c82ff6aa73bc11f091489
Li Ju
695c82ff6aa73bc11f09148a
Xinran Zhang
695c82ff6aa73bc11f09148b
Yuhui Wang
695c82ff6aa73bc11f09148c
Wenqing Jing
695c82ff6aa73bc11f09148d
Jingyi Deng
695c82ff6aa73bc11f09148e
Huayu Sha
695c82ff6aa73bc11f09148f
Binze Hu
695c82ff6aa73bc11f091490
Jingqi Tong
claimed_verified
2026-03-19T13:05:34.363Z
64a7e7b2ef22f9c793e01454
/avatars/cd3706ffedbf68f58a8e53046008b7fb.svg
tongjingqi(SII)
tongjingqi
user
tongjingqi
695c82ff6aa73bc11f091491
Changhao Jiang
695c82ff6aa73bc11f091492
Yage Geng
695c82ff6aa73bc11f091493
Yuankai Ying
695c82ff6aa73bc11f091494
Yue Zhang
695c82ff6aa73bc11f091495
Zhangyue Yin
695c82ff6aa73bc11f091496
Zhiheng Xi
695c82ff6aa73bc11f091497
Shihan Dou
695c82ff6aa73bc11f091498
Tao Gui
695c82ff6aa73bc11f091499
Qi Zhang
695c82ff6aa73bc11f09149a
Xuanjing Huang
OpenNovelty: An LLM-powered Agentic System for Verifiable Scholarly Novelty Assessment
Evaluating novelty is critical yet challenging in peer review, as reviewers must assess submissions against a vast, rapidly evolving literature. This report presents OpenNovelty, an LLM-powered agentic system for transparent, evidence-based novelty analysis. The system operates through four phases: (1) extracting the core task and contribution claims to generate retrieval queries; (2) retrieving relevant prior work based on extracted queries via semantic search engine; (3) constructing a hierarchical taxonomy of core-task-related work and performing contribution-level full-text comparisons against each contribution; and (4) synthesizing all analyses into a structured novelty report with explicit citations and evidence snippets. Unlike naive LLM-based approaches, OpenNovelty grounds all assessments in retrieved real papers, ensuring verifiable judgments. We deploy our system on 500+ ICLR 2026 submissions with all reports publicly available on our website, and preliminary analysis suggests it can identify relevant prior work, including closely related papers that authors may overlook. OpenNovelty aims to empower the research community with a scalable tool that promotes fair, consistent, and evidence-backed peer review.
An LLM-powered agentic system for transparent, evidence-based novelty assessment in peer review that retrieves and analyzes prior work through semantic search and hierarchical taxonomy construction.
LLM-powered agentic system semantic search engine hierarchical taxonomy contribution-level full-text comparisons structured novelty report evidence-based assessment peer review