Simon Schug

I am a PhD student in the group of Angelika Steger supervised by João Sacramento. Curious about our ability to quickly adapt and generalise, I study lifelong (meta-) learning in neural networks trying to learn something about the brain. I have a BSc in Psychology and a BSc in Electrical Engineering - both from RWTH Aachen University - as well as a MSc in Neural Systems & Computation from ETH Zurich & University of Zurich.

If you want to know more feel free to reach out or check my personal webpage.

Publications

* – equal contributions

A contrastive rule for meta-learning
Nicolas Zucchet*, Simon Schug*, Johannes von Oswald*, Dominic Zhao, João Sacramento
NeurIPS 2022

Random initialisations performing above chance and how to find them
Frederik Benzing, Simon Schug, Robert Meier, Johannes von Oswald, Yassir Akram, Nicolas Zucchet, Laurence Aitchison, Angelika Steger
OPT2022 Workshop at NeurIPS 2022

Presynaptic stochasticity improves energy efficiency and helps alleviate the stability-plasticity dilemma
Simon Schug*, Frederik Benzing*, Angelika Steger
eLife 10: e69884

Learning where to learn: Gradient sparsity in meta and continual learning
Johannes von Oswald*, Dominic Zhao*, Seijin Kobayashi, Simon Schug, Massimo Caccia, Nicolas Zucchet, João Sacramento
NeurIPS 2021

Task-Agnostic Continual Learning via Stochastic Synapses
Simon Schug*, Frederik Benzing*, Angelika Steger
Workshop on Continual Learning at ICML 2020

Check Google scholar for an updated and complete publication history.