Shared Persistent Memory

concept
multi-agentmemoryknowledge-accumulationcoordination

Shared persistent memory is a coordination mechanism for multi-agent systems where agents communicate indirectly through a shared, durable knowledge repository rather than direct messaging.

Design in CORAL

CORAL implements shared persistent memory as a filesystem with three directories (source):

  • attempts/ — historical evaluations and solutions, keyed by commit hash (JSON records)
  • notes/ — observations, learnings, reflections as markdown files, organized into subdirectories by agent
  • skills/ — reusable procedures, tools, and implementation patterns with natural-language descriptions and executable artifacts

Each agent’s isolated workspace symlinks to this shared repository, maintaining a single source of truth. Agents read and write via CLI tools or direct filesystem access. Unique filenames per agent minimize write conflicts; no explicit locking is required.

Why filesystem

The filesystem design provides progressive disclosure — agents access only what they need without loading the entire knowledge base into context. It is also extensible: agents can create subdirectories to organize knowledge by category, and new artifact types can be added without schema changes. The symlink architecture preserves workspace isolation while enabling shared access.

Indirect coordination

Unlike peer-to-peer multi-agent systems (AutoGen, LangGraph, MetaGPT) where agents directly message each other, shared persistent memory enables indirect coordination. One agent’s discoveries influence another’s search through written artifacts: a technique documented as a skill, a failed approach recorded in notes, a high-scoring attempt visible on the leaderboard. This produces emergent behaviors — technique diffusion, spontaneous consensus, cross-referencing — without hardcoded communication protocols.

On Anthropic’s kernel engineering task, 36% of attempts use another agent’s commit as parent, and 66% of new records originate from cross-agent parents. On Polyominoes, 87% of rounds reference knowledge committed by other agents (source).

Connection to LLM wiki pattern

Shared persistent memory is a task-scoped application of the LLM wiki pattern. Both use persistent, structured knowledge stores maintained by LLMs that compound over time without forgetting. The LLM wiki pattern applies this to general knowledge management; CORAL applies it to evolutionary search, where the “wiki” is the agents’ collective understanding of what works and what doesn’t.