SWE-Lego: Pushing the Limits of Supervised Fine-tuning for Software Issue Resolving
We present SWE-Lego, a supervised fine-tuning (SFT) recipe designed to achieve state-ofthe-art performance in software engineering (SWE) issue resolving. In contrast to prevalent methods that rely on complex training paradigms (e.g., mid-training, SFT, reinforcement learning, and their combinations), we explore how to push the limits of a lightweight SFT-only approach for SWE tasks. SWE-Lego comprises three core building blocks, with key findings summarized as follows: 1) the SWE-Lego dataset, a collection of 32k highquality task instances and 18k validated trajectories, combining real and synthetic data to complement each other in both quality and quantity; 2) a refined SFT procedure with error masking and a difficulty-based curriculum, which demonstrably improves action quality and overall performance. Empirical results show that with these two building bricks alone,the SFT can push SWE-Lego models to state-of-the-art performance among open-source models of comparable size on SWE-bench Verified: SWE-Lego-Qwen3-8B reaches 42.2%, and SWE-Lego-Qwen3-32B attains 52.6%. 3) We further evaluate and improve test-time scaling (TTS) built upon the SFT foundation. Based on a well-trained verifier, SWE-Lego models can be significantly boosted--for example, 42.2% to 49.6% and 52.6% to 58.8% under TTS@16 for the 8B and 32B models, respectively.
695c7a8a6aa73bc11f091411
Chaofan Tao
claimed_verified
2026-01-07T09:27:37.648Z
60fc2fcca6bdebbe52dfdaf4
/avatars/1d59a7f33cb0df04678516f337e6b881.svg
Chaofan Tao
tcftrees
user
tcftrees
695c7a8a6aa73bc11f091412
Jierun Chen
claimed_verified
2026-01-07T09:27:31.750Z
65e0d0f417458030d05b5622
/avatars/bb35db227e946bc8dbfcba871f32730a.svg
Jierun Chen
JierunChen
user
JierunChen
695c7a8a6aa73bc11f091413
Yuxin Jiang
claimed_verified
2026-01-06T09:58:05.382Z
63c20105726f62e411fbe882
https://cdn-avatars.huggingface.co/v1/production/uploads/63c20105726f62e411fbe882/2UsU9O2psbDjJzz-sAmGH.jpeg
Yuxin Jiang
YuxinJiang
user
YuxinJiang
695c7a8a6aa73bc11f091414
Kaiqi Kou
695c7a8a6aa73bc11f091415
Shaowei Wang
695c7a8a6aa73bc11f091416
Ruoyu Wang
claimed_verified
2026-01-12T10:36:31.574Z
6458899acfd4a6e2bc005fd9
/avatars/b7b305a8baa3cf7683442e2a650306d6.svg
Ruoyu Wang
ruoyu001
user
ruoyu001
695c7a8a6aa73bc11f091417
Xiaohui Li
695c7a8a6aa73bc11f091418
Sidi Yang
695c7a8a6aa73bc11f091419
Yiming Du
claimed_verified
2026-01-07T09:27:33.795Z
68954ff742413a5846d9d80a
/avatars/1751b607a0a65ba63400d34487f3b75c.svg
ElvinDu
ElvinDu518
user
ElvinDu518
695c7a8a6aa73bc11f09141a
Jianbo Dai
claimed_verified
2026-01-09T08:36:42.643Z
61669c456916c52acd5a1aa3
https://cdn-avatars.huggingface.co/v1/production/uploads/61669c456916c52acd5a1aa3/HnZTwRaXgTeTG3ljO3ITb.jpeg
jianbo dai
jbd
user
jbd
695c7a8a6aa73bc11f09141b
Zhiming Mao
695c7a8a6aa73bc11f09141c
Xinyu Wang
695c7a8a6aa73bc11f09141d
Lifeng Shang
695c7a8a6aa73bc11f09141e
Haoli Bai
SWE-Lego: Pushing the Limits of Supervised Fine-tuning for Software Issue Resolving
We present SWE-Lego, a supervised fine-tuning (SFT) recipe designed to achieve state-ofthe-art performance in software engineering (SWE) issue resolving. In contrast to prevalent methods that rely on complex training paradigms (e.g., mid-training, SFT, reinforcement learning, and their combinations), we explore how to push the limits of a lightweight SFT-only approach for SWE tasks. SWE-Lego comprises three core building blocks, with key findings summarized as follows: 1) the SWE-Lego dataset, a collection of 32k highquality task instances and 18k validated trajectories, combining real and synthetic data to complement each other in both quality and quantity; 2) a refined SFT procedure with error masking and a difficulty-based curriculum, which demonstrably improves action quality and overall performance. Empirical results show that with these two building bricks alone,the SFT can push SWE-Lego models to state-of-the-art performance among open-source models of comparable size on SWE-bench Verified: SWE-Lego-Qwen3-8B reaches 42.2%, and SWE-Lego-Qwen3-32B attains 52.6%. 3) We further evaluate and improve test-time scaling (TTS) built upon the SFT foundation. Based on a well-trained verifier, SWE-Lego models can be significantly boosted--for example, 42.2% to 49.6% and 52.6% to 58.8% under TTS@16 for the 8B and 32B models, respectively.
SWE-Lego achieves state-of-the-art performance in software engineering task resolution through a lightweight supervised fine-tuning approach combined with a curated dataset and refined training procedures.
supervised fine-tuning SWE-bench Verified error masking difficulty-based curriculum test-time scaling verifier