BIMSA > BIMSA Lecture Kolmogorov-Arnold networks
Kolmogorov-Arnold networks
Organizer
Fedor Pavutnitskiy
Speaker
Pavel Tikhomirov
Time
Thursday, June 27, 2024 3:15 PM - 4:15 PM
Venue
A3-3-301
Online
Zoom 928 682 9093 (BIMSA)
Abstract
This talk examines the architecture of Kolmogorov-Arnold networks (KANs), covering their theoretical foundation, motivations, advantages, and limitations. We will discuss KANs’ interpretability and methods for model structure analysis. The presentation will address the trade-off between model size and accuracy in KANs compared to Multilayer Perceptrons (MLPs), using Pareto frontiers. Basic machine learning problems, such as the curse of dimensionality and catastrophic forgetting, will be reviewed in the context of KANs, highlighting training procedure and its connection to spline approximation. Applications of KANs in knot theory will be discussed, along with the general limitations and potential of KANs in various fields. The goal is to provide a concise overview of KANs’ theoretical and practical aspects.