Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering
Large language model (LLM) agents are increasingly built less by changing model weights than by reorganizing the runtime around them. Capabilities that earlier systems expected the model to recover internally are now externalized into memory stores, reusable skills, interaction protocols, and the surrounding harness that makes these modules reliable in practice. This paper reviews that shift through the lens of externalization. Drawing on the idea of cognitive artifacts, we argue that agent infrastructure matters not merely because it adds auxiliary components, but because it transforms hard cognitive burdens into forms that the model can solve more reliably. Under this view, memory externalizes state across time, skills externalize procedural expertise, protocols externalize interaction structure, and harness engineering serves as the unification layer that coordinates them into governed execution. We trace a historical progression from weights to context to harness, analyze memory, skills, and protocols as three distinct but coupled forms of externalization, and examine how they interact inside a larger agent system. We further discuss the trade-off between parametric and externalized capability, identify emerging directions such as self-evolving harnesses and shared agent infrastructure, and discuss open challenges in evaluation, governance, and the long-term co-evolution of models and external infrastructure. The result is a systems-level framework for explaining why practical agent progress increasingly depends not only on stronger models, but on better external cognitive infrastructure.
69d855ce79548974da94642d
Chenyu Zhou
claimed_verified
2026-04-15T12:08:47.485Z
643977973ab54fdbab801ee2
/avatars/1d72a0d6b1e60eb569f0798eeb419fd1.svg
Chenyu Zhou
Chenyu-Zhou
user
Chenyu-Zhou
69d855ce79548974da94642e
Huacan Chai
69d855ce79548974da94642f
Wenteng Chen
69d855ce79548974da946430
Zihan Guo
claimed_verified
2026-04-10T07:44:09.658Z
68ce79cfcbc51af45b18a75e
/avatars/a0ed9a4999988626f9e7a67ae0d1c818.svg
SII-ZihanGuo
SII-ZihanGuo
user
SII-ZihanGuo
69d855ce79548974da946431
Rong Shan
69d855ce79548974da946432
Yuanyi Song
69d855ce79548974da946433
Tianyi Xu
claimed_verified
2026-04-13T07:34:10.748Z
67d537ca1222c8ef2f2a3f73
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/uOQvBiIlWzfdu9wCA3rWO.png
Tianyi Xu
SorrowTea
user
SorrowTea
69d855ce79548974da946434
Yingxuan Yang
69d855ce79548974da946435
Aofan Yu
69d855ce79548974da946436
Weiming Zhang
69d855ce79548974da946437
Congming Zheng
69d855ce79548974da946438
Jiachen Zhu
69d855ce79548974da946439
Zeyu Zheng
69d855ce79548974da94643a
Zhuosheng Zhang
69d855ce79548974da94643b
Xingyu Lou
69d855ce79548974da94643c
Changwang Zhang
claimed_verified
2026-04-13T07:34:08.883Z
67ea7f597382053ae1ff676f
https://cdn-avatars.huggingface.co/v1/production/uploads/67ea7f597382053ae1ff676f/zy6b17SFRBfxZvTnq5m3Z.jpeg
Changwang ZHANG
mLeoKing
user
mLeoKing
69d855ce79548974da94643d
Zhihui Fu
69d855ce79548974da94643e
Jun Wang
69d855ce79548974da94643f
Weiwen Liu
69d855ce79548974da946440
Jianghao Lin
69d855ce79548974da946441
Weinan Zhang
Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering
Large language model (LLM) agents are increasingly built less by changing model weights than by reorganizing the runtime around them. Capabilities that earlier systems expected the model to recover internally are now externalized into memory stores, reusable skills, interaction protocols, and the surrounding harness that makes these modules reliable in practice. This paper reviews that shift through the lens of externalization. Drawing on the idea of cognitive artifacts, we argue that agent infrastructure matters not merely because it adds auxiliary components, but because it transforms hard cognitive burdens into forms that the model can solve more reliably. Under this view, memory externalizes state across time, skills externalize procedural expertise, protocols externalize interaction structure, and harness engineering serves as the unification layer that coordinates them into governed execution. We trace a historical progression from weights to context to harness, analyze memory, skills, and protocols as three distinct but coupled forms of externalization, and examine how they interact inside a larger agent system. We further discuss the trade-off between parametric and externalized capability, identify emerging directions such as self-evolving harnesses and shared agent infrastructure, and discuss open challenges in evaluation, governance, and the long-term co-evolution of models and external infrastructure. The result is a systems-level framework for explaining why practical agent progress increasingly depends not only on stronger models, but on better external cognitive infrastructure.
Large language model agents are evolving beyond weight-based modifications to incorporate externalized components like memory, skills, and protocols that enhance reliability and coordination.
large language model agents externalization cognitive artifacts memory stores reusable skills interaction protocols harness engineering parametric capability externalized capability self-evolving harnesses shared agent infrastructure