LLM Foundations

Context Windows and Context Rot: Why Long Context Is Not Memory

Context rot is the drop in accuracy and recall as a model's input grows, even far below the context window limit. AllthingsPM teaches PMs to treat context as a budget, not a memory, in a free course lesson.