The decline in LLM reasoning and catastrophic forgetting might share the same root cause.

When we look at LLMs, we can see them as structures that generate and sustain a consistent reasoning path during inference, based on the specific premises, rules, and context they are given. During the LoRA-based continual learning phase, they act as knowledge structures that constantly reorganize t