Adjusting Model Size in Continual Gaussian Processes:
How Big is Big Enough?
We propose a method to dynamically adjust the model size of a Gaussian Process during training in a continual learning setting.
Figure: Three continual learning scenarios. The model size is adjusted during training to match the capacity requirements of each task.