Mean-field theory of learning dynamics in deep neural networks
Organizers
Speaker
Cengiz Pehlevan
Time
Tuesday, October 10, 2023 10:00 AM - 12:00 PM
Venue
A3-1a-205
Online
Zoom 537 192 5549
(BIMSA)
Abstract
Learning dynamics of deep neural networks is complex. While previous approaches made advances in mathematical analysis of the dynamics of two-layer neural networks, addressing deeper networks have been challenging. In this talk, I will present a mean field theory of the learning dynamics of deep networks and discuss its practical implications.
Speaker Intro
Cengiz (pronounced "Jen·ghiz") comes to Harvard SEAS from the Flatiron Institute's Center for Computational Biology (CCB), where he was a a research scientist in the neuroscience group. Before CCB, Cengiz was a postdoctoral associate at Janelia Research Campus, and before that a Swartz Fellow at Harvard. Cengiz received a doctorate in physics from Brown University and undergraduate degrees in physics and electrical engineering from Bogazici University. He is a native of Tosya, Turkey.