Rethinking Memory in AI: Taxonomy, Operations, Topics, and Future
Directions
Yiming Du, Wenyu Huang, Danna Zheng, Zhaowei Wang, Sebastien Montella, Mirella Lapata, Kam-Fai Wong, Jeff Z. Pan
{, }
Paper: https://arxiv.org/pdf/2505.00675
Code:
Yiming Du, Wenyu Huang, Danna Zheng, Zhaowei Wang, Sebastien Montella, Mirella Lapata, Kam-Fai Wong, Jeff Z. Pan
{, }
Paper: https://arxiv.org/pdf/2505.00675
Code:
Memory is a fundamental component of AI systems, underpinning large language models (LLMs) based agents.
While prior surveys have focused on memory applications with LLMs, they often overlook the atomic operations that underlie memory dynamics.
In this survey, we first categorize memory representations into parametric, contextual structured, and contextual unstructured and then introduce six fundamental memory operations: Consolidation, Updating, Indexing, Forgetting, Retrieval, and Compression. We systematically map these operations to the most relevant research topics across long-term, long-context, parametric modification, and multi-source memory. By reframing memory systems through the lens of atomic operations and representation types, this survey provides a structured and dynamic perspective on research, benchmark datasets, and tools related to memory in AI, clarifying the functional interplay in LLMs based agents while outlining promising directions for future research.
s
n2 n0
θ
ŷ
∑
ȳ