CoVe: Training Interactive Tool-Use Agents via Constraint-Guided Verification
Developing multi-turn interactive tool-use agents is challenging because real-world user needs are often complex and ambiguous, yet agents must execute deterministic actions to satisfy them. To address this gap, we introduce CoVe (Constraint-Verification), a post-training data synthesis framework designed for training interactive tool-use agents while ensuring both data complexity and correctness. CoVe begins by defining explicit task constraints, which serve a dual role: they guide the generation of complex trajectories and act as deterministic verifiers for assessing trajectory quality. This enables the creation of high-quality training trajectories for supervised fine-tuning (SFT) and the derivation of accurate reward signals for reinforcement learning (RL). Our evaluation on the challenging τ^2-bench benchmark demonstrates the effectiveness of the framework. Notably, our compact CoVe-4B model achieves success rates of 43.0\% and 59.4\% in the Airline and Retail domains, respectively; its overall performance significantly outperforms strong baselines of similar scale and remains competitive with models up to 17times its size. These results indicate that CoVe provides an effective and efficient pathway for synthesizing training data for state-of-the-art interactive tool-use agents. To support future research, we open-source our code, trained model, and the full set of 12K high-quality trajectories used for training.
69a669dd663a122a7ce667aa
Jinpeng Chen
69a669dd663a122a7ce667ab
Cheng Gong
69a669dd663a122a7ce667ac
Hanbo Li
69a669dd663a122a7ce667ad
Ziru Liu
69a669dd663a122a7ce667ae
Zichen Tian
69a669dd663a122a7ce667af
Xinyu Fu
69a669dd663a122a7ce667b0
Shi Wu
69a669dd663a122a7ce667b1
Chenyang Zhang
69a669dd663a122a7ce667b2
Wu Zhang
69a669dd663a122a7ce667b3
Suiyun Zhang
69a669dd663a122a7ce667b4
Dandan Tu
69a669dd663a122a7ce667b5
Rui Liu
CoVe: Training Interactive Tool-Use Agents via Constraint-Guided Verification
Developing multi-turn interactive tool-use agents is challenging because real-world user needs are often complex and ambiguous, yet agents must execute deterministic actions to satisfy them. To address this gap, we introduce CoVe (Constraint-Verification), a post-training data synthesis framework designed for training interactive tool-use agents while ensuring both data complexity and correctness. CoVe begins by defining explicit task constraints, which serve a dual role: they guide the generation of complex trajectories and act as deterministic verifiers for assessing trajectory quality. This enables the creation of high-quality training trajectories for supervised fine-tuning (SFT) and the derivation of accurate reward signals for reinforcement learning (RL). Our evaluation on the challenging τ^2-bench benchmark demonstrates the effectiveness of the framework. Notably, our compact CoVe-4B model achieves success rates of 43.0\% and 59.4\% in the Airline and Retail domains, respectively; its overall performance significantly outperforms strong baselines of similar scale and remains competitive with models up to 17times its size. These results indicate that CoVe provides an effective and efficient pathway for synthesizing training data for state-of-the-art interactive tool-use agents. To support future research, we open-source our code, trained model, and the full set of 12K high-quality trajectories used for training.
CoVe is a post-training data synthesis framework that generates high-quality training trajectories for interactive tool-use agents by incorporating task constraints as verification mechanisms, achieving superior performance compared to baseline models.
post-training data synthesis supervised fine-tuning reinforcement learning task constraints trajectory generation constraint verification interactive tool-use agents τ²-bench benchmark CoVe-4B