Date/Time
Date(s) - 10/03/2023
11:45 am - 12:45 pm

Speaker:   Simone Brugiapaglia,  Concordia University

Title: The mathematical foundations of deep learning: from rating impossibility to practical existence theorems

Abstract:
Deep learning is having a profound impact on industry and scientific research. Yet, while this paradigm continues to show impressive performance in a wide variety of applications, its mathematical foundations are far from being well established. In this talk, I will present recent developments in this area by illustrating two case studies.First, motivated by applications in cognitive science, I will present “rating impossibility” theorems. They identify frameworks where deep learning is provably unable to generalize outside the training set for the seemingly simple task of learning identity effects, i.e. classifying whether pairs of objects are identical or not. Second, motivated by applications in scientific computing, I will illustrate “practical existence” theorems. They combine universal approximation results for deep neural networks with compressed sensing and high-dimensional polynomial approximation theory. As a result, they yield sufficient conditions on the network architecture, the training strategy, and the number of samples able to guarantee accurate approximation of smooth functions of many variables.

Zoom link:
https://mcmaster.zoom.us/j/98936371754?pwd=OFM3U2FwdU9vbTRMNVRJakdSQUd5Zz09