Tools3 min read
Karpathy's Alternative to RAG: Let LLMs Write and Maintain Their Own Knowledge Base
Andrej Karpathy has shared an architectural pattern that challenges the dominance of vector database RAG systems. The approach uses LLMs to actively maintain structured markdown wikis that serve as a living knowledge base — human-readable, self-healing, and potentially more reliable than chunk-and-retrieve pipelines.