Whose Memory Is It? Building Multi-Tenant, Multi-Tier Memory for AI Agents (Part 1)

https://hackernoon.imgix.net/images/unHyrsAghrU6JJOxi6O6qcy67Cx2-6m820he.png

This is a 4-part series on how agents remember: building short-, medium- and long-term memory that scales across users, agents, and kubernetes clusters.


LLMs are stateless by design, and without added memory logic every session starts from zero.

A number of dedicated memory layers have emerged (and continue emerging almost daily) to tackle this, each with different approaches and tradeoffs. Which one should you adopt?

Recently I spent some time extending the Kubernetes Agent Orchestration System (KAOS) to support multi-tiered memory persistence (aka short-, medium- and long-term memory). Along the way I hit most of the same issues that anyone would whilst building or integrating multi-tiered memory into an agentic system, so I thought it would be useful to compile all the learnings, design choices and examples into this 4-part series.

Hopefully this post is useful for anyone looking to do this on their own project. My objective:

Let’s make...

Copyright of this story solely belongs to hackernoon.com. To see the full text click HERE

Read more