MEMO: Memory-Augmented Model Context Optimization for Robust Multi-Turn Multi-Agent LLM Games
Multi-turn, multi-agent LLM game evaluations often exhibit substantial run-to-run variance. In long-horizon interactions, small early deviations compound across turns and are amplified by multi-agent coupling. This biases win rate estimates and makes rankings unreliable across repeated tournaments. Prompt choice worsens this further by producing different effective policies. We address both instability and underperformance with MEMO (Memory-augmented MOdel context optimization), a self-play framework that optimizes inference-time context by coupling retention and exploration. Retention maintains a persistent memory bank that stores structured insights from self-play trajectories and injects them as priors during later play. Exploration runs tournament-style prompt evolution with uncertainty-aware selection via TrueSkill, and uses prioritized replay to revisit rare and decisive states. Across five text-based games, MEMO raises mean win rate from 25.1% to 49.5% for GPT-4o-mini and from 20.9% to 44.3% for Qwen-2.5-7B-Instruct, using 2,000 self-play games per task. Run-to-run variance also drops, giving more stable rankings across prompt variations. These results suggest that multi-agent LLM game performance and robustness have substantial room for improvement through context optimization. MEMO achieves the largest gains in negotiation and imperfect-information games, while RL remains more effective in perfect-information settings.
69bad41bba2b62a5fb0b0afd
Yunfei Xie
69bad41bba2b62a5fb0b0afe
Kevin Wang
claimed_verified
2026-03-19T12:58:08.920Z
66b979d9088299999ab714b7
/avatars/28f941da791e51788a4d8e2321c00ded.svg
Kevin Wang
Huanyu123
user
Huanyu123
69bad41bba2b62a5fb0b0aff
Bobby Cheng
69bad41bba2b62a5fb0b0b00
Jianzhu Yao
69bad41bba2b62a5fb0b0b01
Zhizhou Sha
69bad41bba2b62a5fb0b0b02
Alexander Duffy
69bad41bba2b62a5fb0b0b03
Yihan Xi
69bad41bba2b62a5fb0b0b04
Hongyuan Mei
69bad41bba2b62a5fb0b0b05
Cheston Tan
69bad41bba2b62a5fb0b0b06
Chen Wei
69bad41bba2b62a5fb0b0b07
Pramod Viswanath
69bad41bba2b62a5fb0b0b08
Zhangyang Wang
MEMO: Memory-Augmented Model Context Optimization for Robust Multi-Turn Multi-Agent LLM Games
Multi-turn, multi-agent LLM game evaluations often exhibit substantial run-to-run variance. In long-horizon interactions, small early deviations compound across turns and are amplified by multi-agent coupling. This biases win rate estimates and makes rankings unreliable across repeated tournaments. Prompt choice worsens this further by producing different effective policies. We address both instability and underperformance with MEMO (Memory-augmented MOdel context optimization), a self-play framework that optimizes inference-time context by coupling retention and exploration. Retention maintains a persistent memory bank that stores structured insights from self-play trajectories and injects them as priors during later play. Exploration runs tournament-style prompt evolution with uncertainty-aware selection via TrueSkill, and uses prioritized replay to revisit rare and decisive states. Across five text-based games, MEMO raises mean win rate from 25.1% to 49.5% for GPT-4o-mini and from 20.9% to 44.3% for Qwen-2.5-7B-Instruct, using 2,000 self-play games per task. Run-to-run variance also drops, giving more stable rankings across prompt variations. These results suggest that multi-agent LLM game performance and robustness have substantial room for improvement through context optimization. MEMO achieves the largest gains in negotiation and imperfect-information games, while RL remains more effective in perfect-information settings.
MEMO, a memory-augmented model context optimization framework, improves multi-agent LLM game performance and stability through retained insights and exploratory prompt evolution with uncertainty-aware selection.
multi-agent LLM self-play context optimization memory bank retention exploration tournament-style prompt evolution TrueSkill prioritized replay win rate estimation run-to-run variance game performance