Overcoming catastrophic forgetting with context-dependent activations
Master's thesis: context-based gating that switches pathways through a network, cutting destructive interference on long task sequences.
Abstract
Overcoming Catastrophic Forgetting in neural networks is crucial to solving continuous learning problems. Deep Reinforcement Learning uses neural networks to make predictions of actions according to the current state space of an environment. In a dynamic environment, robust and adaptive life-long learning algorithms mark the cornerstone of their success. In this thesis we will examine an elaborate subset of algorithms countering catastrophic forgetting in neural networks and reflect on their weaknesses and strengths. Furthermore, we present an enhanced alternative to promising synaptic stabilization methods, such as Elastic Weight Consolidation or Synaptic Intelligence. Our method uses context-based information to switch between different pathways throughout the neural network, reducing destructive activation interference during the forward pass and destructive weight updates during the backward pass. We call this method Context-Dependent Activations (XdA). We show that XdA enhanced methods outperform basic synaptic stabilization methods and are a better choice for long task sequences.
The thesis is titled Overcoming Catastrophic Forgetting with Context-Dependent Activations and Synaptic Stabilization; the implementation is on GitHub.
Documents
Read next
- Agentic AI for Scientific Discovery — the RL Bootcamp 2026 slides The 3rd International RL Bootcamp runs 16–18 September 2026 in Salzburg, free to attend. Here is the deck for my Friday talk, embedded to click through in full, plus what it argues and where the recordings land.
- Recap of the 2nd International RL Bootcamp A look back at the RL Bootcamp 2025 in Salzburg: highlights, speakers, and the recordings, slides and community links the organizers published.
- InfODist: online distillation with informative rewards Why curriculum-learning agents generalise badly to the next task, and why the culprit is the states they explore rather than the non-stationarity they endure.