Robert Batterman - Deep Learning, Correlations, and the Statistics of Natural Images - IPAM at UCLA
Presenter
November 22, 2024
Abstract
Recorded 22 November 2024. Robert Batterman of the University of Pittsburgh presents "Deep Learning, Correlations, and the Statistics of Natural Images" at IPAM's Modeling Multi-Scale Collective Intelligences Workshop.
Abstract: This paper explores aspects of correlations in various data sets upon which state of the art DNNs are trained. It begins with an account of how to understand the statistics of natural images in terms of correlational structures in the data. I then focus on recent work that demonstrates a remarkable robustness in statistical regularities across the various data sets by appealing to Random Matrix Theory. I suggest that DNNs generalize as well as they do because their training allows them to discover/recover these robust regularities.
Learn more online at: https://www.ipam.ucla.edu/programs/workshops/workshop-iv-modeling-multi-scale-collective-intelligences/?tab=overview