Felix Dangel
Felix Dangel is a machine-learning researcher whose work gives neural networks access to information beyond gradients. He studied physics at the University of Stuttgart, completed a computer-science PhD at the University of Tübingen, and co-developed BackPACK, a PyTorch library for higher-order information during training. He later coauthored Cockpit and ViViT and researched second-order optimization during a postdoctoral appointment at the Vector Institute. Since 2026, he has been an assistant professor at Concordia, an Associate Academic Member of Mila and a Canada CIFAR AI Chair.
- Now at
- Concordia University and Mila
Timeline
-
2012–2017
Physics at Stuttgart
In 2015, he earns a bachelor's degree in physics at the University of Stuttgart; in 2017, he completes a master's degree there.
-
2018–2023
A PhD in computer science
From 2018 to 2023, he completes a PhD in computer science at the Max Planck Institute for Intelligent Systems and the University of Tübingen under advisor Philipp Hennig. His thesis is Backpropagation Beyond the Gradient.
-
2020
BackPACK for PyTorch
In 2020, he coauthors BackPACK: Packing more into backprop with Frederik Kunstner and Philipp Hennig. The PyTorch library extends backpropagation to expose first- and second-order information during training.
-
2021–2022
Cockpit and ViViT
In 2021, he coauthors Cockpit, a PyTorch debugging tool that helps practitioners inspect training behavior and identify failure modes. In 2022, he coauthors ViViT, which uses the low-rank structure of the generalized Gauss-Newton matrix to compute curvature eigenvalues and per-sample directional derivatives.
-
2023
A summa cum laude thesis
In 2023, his PhD thesis earns summa cum laude, the highest doctoral distinction in the German university system.
-
2023–2026
Postdoctoral researcher at Vector
From 2023 to 2026, he is a postdoctoral researcher at the Vector Institute in Toronto, working with Yaoliang Yu and Roger Grosse. His research focuses on automatic differentiation and second-order optimization for deep learning.
-
2025
Taylor-mode derivatives for PDEs
In 2025, he coauthors the NeurIPS paper Collapsing Taylor Mode Automatic Differentiation. The method rewrites computation graphs to reduce the cost of Taylor-mode derivatives for linear PDE operators used in scientific machine learning.
-
Since 2026
Assistant professor and AI chair
Since 2026, he is an assistant professor in Concordia's Department of Computer Science and Software Engineering and an Associate Academic Member of Mila. In October 2026, he becomes a Canada CIFAR AI Chair and studies second-order properties such as loss-landscape curvature.
Career
- Since 2026Concordia UniversityAssistant Professor
- Since 2026MilaAssociate Academic Member
- 2023–2026Vector InstitutePostdoctoral researcher
Education
- 2023Max Planck Institute for Intelligent SystemsPhD
- 2023University of TübingenPhD
- 2017University of StuttgartMaster's degree in physics
- 2015University of StuttgartBachelor's degree in physics
Sources and credits
Photo: We have no published photo of Felix Dangel yet. Send us a free-licensed photo.
- Curriculum vitæ: Felix Dangel
- BackPACK: Packing more into backprop
- Cockpit: A Practical Debugging Tool for the Training of Deep Neural Networks
- ViViT: Curvature access through the generalized Gauss-Newton's low-rank structure
- Collapsing Taylor Mode Automatic Differentiation
- Five Mila Members Appointed Canada-CIFAR AI Chairs
- Felix Dangel | Mila


