A law of robustness and the importance of overparametrization in deep learning

Microsoft Research Senior Principal Researcher Sebastien Bubeck answers several questions about the NeurIPS 2021 paper, “A Universal Law of Robustness via Isoperimetry.” He discusses what overparametrization is, the law of robustness, and how these two concepts can impact the future of large deep neural network research.

Read the full paper
Date:
Speakers:
Sebastien Bubeck
Affiliation:
Microsoft Research