Implicit Bias of Linear Equivariant Steerable Networks
A talk by Wei Zhu:
April 13, 2023
5 p.m.
Zoom
Register now:
https://www.mis.mpg.de/calendar/lectures/2023/abstract-35592.html
https://www.mis.mpg.de/montufar/seminars/math-ml-seminar.html
Abstract
I will present, in this talk, the implicit bias of gradient flow on linear equivariant steerable networks in group-invariant binary classification. Our findings reveal that the parameterized predictor converges in direction to the unique group-invariant classifier with a maximum margin defined by the input group action. Under a unitary assumption on the input representation, we establish the equivalence between steerable networks and data augmentation. Furthermore, we demonstrate the improved margin and generalization bound of steerable networks over their non-invariant counterparts. This talk is based on a joint work with Ziyu Chen at UMass Amherst.
Events All Events
Anas Shahab
June 8, 2023
Join us (hybrid event)
Sophie Adama, Martin Bogdan
June 21, 2023
Join us (local event)
September 11, 2023
September 25, 2023
Register now
October 26, 2023