Mean-field theory of learning dynamics in deep neural networks
演讲者
Cengiz Pehlevan
时间
2023年10月10日 10:00 至 12:00
地点
A3-1a-205
线上
Zoom 537 192 5549
(BIMSA)
摘要
Learning dynamics of deep neural networks is complex. While previous approaches made advances in mathematical analysis of the dynamics of two-layer neural networks, addressing deeper networks have been challenging. In this talk, I will present a mean field theory of the learning dynamics of deep networks and discuss its practical implications.
演讲者介绍
Cengiz (pronounced "Jen·ghiz") comes to Harvard SEAS from the Flatiron Institute's Center for Computational Biology (CCB), where he was a a research scientist in the neuroscience group. Before CCB, Cengiz was a postdoctoral associate at Janelia Research Campus, and before that a Swartz Fellow at Harvard. Cengiz received a doctorate in physics from Brown University and undergraduate degrees in physics and electrical engineering from Bogazici University. He is a native of Tosya, Turkey.