Ainary

Building in Public · Research

AI Agent Memory: What Anthropic Is Still Missing

Anthropic shipped persistent memory. Two flat files. We've been running a 7-layer system. A comparison of 8 systems across 9 dimensions.

Every AI agent resets between conversations. Claude, GPT, Gemini — they wake up with amnesia. The industry has recognized the problem, and solutions are emerging rapidly. Most of them solve the wrong part of it.

1.0The problem

Storage is not the bottleneck

The core issue is not storage. It is retrieval quality. Enterprise agents hit a 40–55% accuracy ceiling not because they lack intelligence, but because of data fragmentation, missing organizational context, and broken multi-step reasoning. Better answers come from better context, not bigger models.

Anthropic's Claude Code auto-memory (v2.1.32, February 2026) writes flat markdown files. The first 200 lines are loaded at session start. No semantic search, no graph, no decay mechanism. This is documented in the official docs.

There is a difference between a notepad and a brain. A notepad stores what you write. A brain decides what matters.

2.0The model

5 levels of memory maturity

Based on 21 sources, we propose a maturity spectrum. Each level is a categorical capability shift, not an incremental improvement.

1 · Flat StoreClaude Code

Breaks past 1K memories. No search — load the first N lines and hope.

2 · Structured StoreChatGPT Memory

Key-value with basic retrieval. Cannot find what is relevant.

3 · Semantic StoreMem0 · Letta

Finds similar content but has no sense of time or truth.

4 · Knowledge GraphZep · HippoRAG

Models relationships but treats all knowledge equally.

5 · Compound IntelligenceMia / OpenClaw

Architecture that improves its own memory quality over time.

FIG 1.0Five maturity levels, from flat file to compound intelligence. Placement based on 21 public sources; no vendor benchmarks were run.
3.0The gaps

5 unsolved problems

Problem 1Knowledge Hierarchy with Weights

Not all memories are equal. A verified architectural decision should outrank a casual observation from last Tuesday. But every system we tested treats memories as flat: Claude Code loads the first 200 lines with equal weight. Mem0 ranks by vector similarity. Zep by temporal recency. None applies domain-specific weighting.

Our approach: a 4-tier hierarchy. CORE (2x weight) for verified truths and decisions. KNOWLEDGE (1.5x) for domain patterns. OPERATIONAL (1x) for current projects and people. EPHEMERAL (0.5x) for daily notes. When sources conflict, the higher tier wins. Always.

Problem 2Epistemological Trust Labels

Without distinguishing fact from guess, AI memory becomes a hallucination amplifier. The failure mode: an agent guesses something in Session 1, saves it, and by Session 5 treats it as established fact. The system has reinforced its own hallucination.

Our approach: every claim carries a trust label at write time — is this a documented fact, an interpretation, or an unverified assumption? The survey “Memory in the Age of AI Agents” (Zhang et al., December 2025) identifies trustworthiness as an emerging research frontier. The February 2026 follow-up confirms it remains an open problem.

Problem 3The 30-Day Test

Every append-only system dies the same death: noise accumulation. The more you store, the harder it gets to find what matters. Mem0 filters automatically. Zep tracks temporal validity. Good partial solutions — but systems get larger, not denser.

Our approach: before anything is written to persistent memory, one question. “Will this change behavior in 30 days?” If no, it doesn't get stored. If it updates existing knowledge, the old entry is replaced. If existing info is now wrong, it gets deleted.

Problem 4Facts That Expire

Most memory systems assume facts are permanent. But facts expire. A product price changes. A team member leaves. A strategy shifts. Without explicit expiration logic, stale facts poison future decisions.

Our approach: verified truths carry a source citation, a confidence score, a last-verified date, and invalidation conditions — “this becomes false if X happens.” Zep's bitemporal modeling comes closest, but temporal validity is different from conditional invalidation.

Problem 5Cross-Agent Trust Scoring

When you spawn sub-agents for tasks, how do you know which results to trust? Most multi-agent systems share context but don't track quality. Every agent's output is treated equally, regardless of past performance.

Our approach: each sub-agent inherits a context document with relevant memory, decisions, and rules. When results come back, the human rates quality. That feedback updates a trust score per agent type.

What Anthropic got right

Claude Code's memory hierarchy — user-level, project-level, directory-level — is a smart design for the coding use case. Plain markdown files are defensible: transparent, version-controllable, human-editable. No lock-in. No database dependency.

But a notepad that knows which notebook to write in is still a notepad.

4.0For builders

Five design principles

01Architecture first

Decide your maturity level target first. Level 3 (vector search) is table stakes. Level 4 (knowledge graph) is where differentiation starts.

02Trust at write time

Fact-checking memories after retrieval is too late. Label claims at write time. Track provenance. Set invalidation conditions.

03Design for decay

The question is never “what should I remember?” It's “what should I forget?” The 30-day test is the simplest effective approach we've found.

04Anti-entropic by design

Every session should leave the memory cleaner. Not larger. Denser, more accurate, better organized.

05Knowledge is the moat

We've switched underlying models three times. The memory survived every transition. The model is replaceable. The knowledge is not.

FIG 2.0Five design principles, ordered by when they bite: architecture first, knowledge last.
An agent without memory has no history. An agent without structure has no memory worth keeping.

Disclosure: the author built the memory system described in this article. All comparisons are based on publicly available documentation and academic papers. Confidence: 82%. Sources: Zhang et al. (2025), Anthropic Claude Code docs, OpenAI ChatGPT Memory FAQ, Mem0, Letta, Zep — and 15 more.

Book a pilot.

01 See a live output02 Run a two-week pilot on your worst workflow03 Keep what works, or walk away
Book a pilot Or keep running a hundred half-finished tasks by hand.

Built in public

One system. Your team, at scale.

Get updates before anyone else. No noise.

Building in Public →