System prompt learning

A hypothesis about a missing paradigm of LLM learning: not changing weights (pretraining, finetuning), but changing "notes to self" — something like a system prompt that the model modifies after encountering a new problem. Analogous to human "remember this for the future" learning.