T2S-Bench & Structure-of-Thought: Benchmarking and Prompting Comprehensive Text-to-Structure Reasoning
Think about how human handles complex reading tasks: marking key points, inferring their relationships, and structuring information to guide understanding and responses. Likewise, can a large language model benefit from text structure to enhance text-processing performance? To explore it, in this work, we first introduce Structure of Thought (SoT), a prompting technique that explicitly guides models to construct intermediate text structures, consistently boosting performance across eight tasks and three model families. Building upon this insight, we present T2S-Bench, the first benchmark designed to evaluate and improve text-to-structure capabilities of models. T2S-Bench includes 1.8K samples across 6 scientific domains and 32 structural types, rigorously constructed to ensure accuracy, fairness, and quality. Evaluation on 45 mainstream models reveals substantial improvement potential: the average accuracy on the multi-hop reasoning task is only 52.1%, and even the most advanced model achieves 58.1% node accuracy in end-to-end extraction. Furthermore, on Qwen2.5-7B-Instruct, SoT alone yields an average +5.7% improvement across eight diverse text-processing tasks, and fine-tuning on T2S-Bench further increases this gain to +8.6%. These results highlight the value of explicit text structuring and the complementary contributions of SoT and T2S-Bench. Dataset and eval code have been released at https://t2s-bench.github.io/T2S-Bench-Page/.
69a906258b5b27c7ea9fa693
Qinsi Wang
admin_assigned
2026-03-05T10:24:07.910Z
66128e8b7e0e7a64652dbbdf
/avatars/b90f06e74c52286fd421c4d9bbbc2c9f.svg
Wang
Qinsi1
user
Qinsi1
69a906258b5b27c7ea9fa694
Hancheng Ye
69a906258b5b27c7ea9fa695
Jinhee Kim
claimed_verified
2026-03-06T13:56:40.023Z
68eab1ddacfa5cedce8b3424
/avatars/dea5fdd7e44f3525ea274c9d6a45f5b0.svg
Jinhee Kim
a2jinhee
user
a2jinhee
69a906258b5b27c7ea9fa696
Jinghan Ke
claimed_verified
2026-03-05T10:02:11.938Z
68aa1467759a11a9c65a9841
https://cdn-avatars.huggingface.co/v1/production/uploads/68aa1467759a11a9c65a9841/9Ex1R4gfZwlRN_U3loRNl.jpeg
Jinghan Ke
JinghanKe
user
JinghanKe
69a906258b5b27c7ea9fa697
Yifei Wang
69a906258b5b27c7ea9fa698
Martin Kuo
admin_assigned
2026-03-05T10:24:24.104Z
63291bf2ce50f12537506bf2
/avatars/f8b1374b3ae5a04a884c2b71578e78a1.svg
Martin Kuo
MartinKu
user
MartinKu
69a906258b5b27c7ea9fa699
Zishan Shao
admin_assigned
2026-03-05T10:24:30.288Z
677406dcceb0e3e5e7aa6de9
https://cdn-avatars.huggingface.co/v1/production/uploads/677406dcceb0e3e5e7aa6de9/UNkoJw-v_sgPthvESzb2U.jpeg
Zishan Shao
Zishan-Shao
user
Zishan-Shao
69a906258b5b27c7ea9fa69a
Dongting Li
69a906258b5b27c7ea9fa69b
Yueqian Lin
claimed_verified
2026-03-05T10:02:09.930Z
64b5198c25882acb62fb77ef
https://cdn-avatars.huggingface.co/v1/production/uploads/64b5198c25882acb62fb77ef/HX9pfMEPQlfjvSAgSLplY.png
Yueqian Lin
linyueqian
user
linyueqian
69a906258b5b27c7ea9fa69c
Ting Jiang
69a906258b5b27c7ea9fa69d
Chiyue Wei
admin_assigned
2026-03-05T10:24:47.710Z
6841ce30315097bd817126e8
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/5ufLhmxYHaBmoW0dDZ7Bk.png
Chiyue Wei
ChiyueWei
user
ChiyueWei
69a906258b5b27c7ea9fa69e
Qi Qian
69a906258b5b27c7ea9fa69f
Wei Wen
69a906258b5b27c7ea9fa6a0
Helen Li
admin_assigned
2026-03-05T10:24:54.034Z
686e37abaae137d2ea0d52d7
/avatars/e561bcfb4bd9c02df2a081b6a16417f8.svg
Helen Li
HelenLi0918
user
HelenLi0918
69a906258b5b27c7ea9fa6a1
Yiran Chen
T2S-Bench & Structure-of-Thought: Benchmarking and Prompting Comprehensive Text-to-Structure Reasoning
Think about how human handles complex reading tasks: marking key points, inferring their relationships, and structuring information to guide understanding and responses. Likewise, can a large language model benefit from text structure to enhance text-processing performance? To explore it, in this work, we first introduce Structure of Thought (SoT), a prompting technique that explicitly guides models to construct intermediate text structures, consistently boosting performance across eight tasks and three model families. Building upon this insight, we present T2S-Bench, the first benchmark designed to evaluate and improve text-to-structure capabilities of models. T2S-Bench includes 1.8K samples across 6 scientific domains and 32 structural types, rigorously constructed to ensure accuracy, fairness, and quality. Evaluation on 45 mainstream models reveals substantial improvement potential: the average accuracy on the multi-hop reasoning task is only 52.1%, and even the most advanced model achieves 58.1% node accuracy in end-to-end extraction. Furthermore, on Qwen2.5-7B-Instruct, SoT alone yields an average +5.7% improvement across eight diverse text-processing tasks, and fine-tuning on T2S-Bench further increases this gain to +8.6%. These results highlight the value of explicit text structuring and the complementary contributions of SoT and T2S-Bench. Dataset and eval code have been released at https://t2s-bench.github.io/T2S-Bench-Page/.
Structure of Thought prompting technique enhances language model performance by guiding explicit intermediate text structuring across diverse tasks, while T2S-Bench benchmark evaluates and improves text-to-structure capabilities with comprehensive scientific domain coverage.
Structure of Thought prompting technique text-to-structure capabilities multi-hop reasoning end-to-end extraction language model performance text processing tasks T2S-Bench scientific domains structural types