Beijing Institute of Mathematical Sciences and Applications Beijing Institute of Mathematical Sciences and Applications

  • About
    • President
    • Governance
    • Partner Institutions
    • Visit
  • People
    • Management
    • Faculty
    • Postdocs
    • Visiting Scholars
    • Staff
  • Research
    • Research Groups
    • Courses
    • Seminars
  • Join Us
    • Faculty
    • Postdocs
    • Students
  • Events
    • Conferences
    • Workshops
    • Forum
  • Life @ BIMSA
    • Accommodation
    • Transportation
    • Facilities
    • Tour
  • News
    • News
    • Announcement
    • Downloads
About
President
Governance
Partner Institutions
Visit
People
Management
Faculty
Postdocs
Visiting Scholars
Staff
Research
Research Groups
Courses
Seminars
Join Us
Faculty
Postdocs
Students
Events
Conferences
Workshops
Forum
Life @ BIMSA
Accommodation
Transportation
Facilities
Tour
News
News
Announcement
Downloads
Qiuzhen College, Tsinghua University
Yau Mathematical Sciences Center, Tsinghua University (YMSC)
Tsinghua Sanya International  Mathematics Forum (TSIMF)
Shanghai Institute for Mathematics and  Interdisciplinary Sciences (SIMIS)
BIMSA > BIMSA-Tsinghua Seminar on Machine Learning and Differential Equations Symmetry-preserving machine learning for computer vision, scientific computing, and distribution learning
Symmetry-preserving machine learning for computer vision, scientific computing, and distribution learning
Organizers
Fan Sheng Xiong , Wu Yue Yang , Wen An Yong , Yi Zhu
Speaker
Wei Zhu
Time
Thursday, November 17, 2022 10:00 AM - 11:30 AM
Venue
1129B
Online
Zoom 537 192 5549 (BIMSA)
Abstract
Symmetry is ubiquitous in machine learning and scientific computing. Robust incorporation of symmetry prior into the learning process has shown to achieve significant model improvement for various learning tasks, especially in the small data regime. In the first part of the talk, I will explain a principled framework of deformation-robust symmetry-preserving machine learning. The key idea is the spectral regularization of the (group) convolutional filters, which ensures that symmetry is robustly preserved in the model even if the symmetry transformation is “contaminated” by nuisance data deformation. In the second part of the talk, I will demonstrate how to incorporate additional structural information (such as group symmetry) into generative adversarial networks (GANs) for data-efficient distribution learning. This is accomplished by developing new variational representations for divergences between probability measures with embedded structures. We study, both theoretically and empirically, the effect of structural priors in the two GAN players. The resulting structure-preserving GAN is able to achieve significantly improved sample fidelity and diversity—almost an order of magnitude measured in Fréchet Inception Distance—especially in the limited data regime.
Speaker Intro
Wei Zhu is an Assistant Professor at the Department of Mathematics and Statistics, University of Massachusetts Amherst. He received his B.S. in Mathematics from Tsinghua University in 2012, and Ph.D. in Applied Math from UCLA in 2017. Before joining UMass, he worked as a Research Assistant Professor at Duke University from 2017 to 2020. Wei is interested in developing theories and algorithms in statistical learning and applied harmonic analysis to solve problems in machine learning, inverse problems, and scientific computing. His recent research is particularly focused on exploiting and discovering the intrinsic structure and symmetry within the data to improve the interpretability, stability, reliability, and data-efficiency of deep learning models.
Beijing Institute of Mathematical Sciences and Applications
CONTACT

No. 544, Hefangkou Village Huaibei Town, Huairou District Beijing 101408

北京市怀柔区 河防口村544号
北京雁栖湖应用数学研究院 101408

Tel. 010-60661855
Email. administration@bimsa.cn

Copyright © Beijing Institute of Mathematical Sciences and Applications

京ICP备2022029550号-1

京公网安备11011602001060 京公网安备11011602001060