[Eoas-seminar] [Seminar-announce] Scientific Computing Colloquium with Gerrit Welper

[eoas-seminar at lists.fsu.edu]

"Approximation and Optimization Theory for Neural Networks"

Gerrit Welper
Assistant Professor of Mathematics,
College of Sciences
University of Central Florida

Please feel free to forward/share this invitation with other groups/disciplines that might be interested in this talk/topic. All are welcome to attend.

NOTE: In-person attendance is requested. Zoom access is intended for external (non-departmental) participants only.

https://fsu.zoom.us/j/94273595552
Zoom Meeting # 942 7359 5552

🎦 Colloquium recordings will be made available here, https://www.sc.fsu.edu/colloquium<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.sc.fsu.edu%2Fcolloquium&data=05%7C02%7Csc-seminar-announce%40lists.fsu.edu%7Cf198bbdbb9a3407fe67608dcd335d793%7Ca36450ebdb0642a78d1b026719f701e3%7C0%7C0%7C638617475414008860%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&sdata=pjkileQ6vNWC6so3zjiHE3hQmJlefQ3TPexgW6XlyPA%3D&reserved=0>

Wednesday, Sep 18, 2024, Schedule:

* 3:00 to 3:30 PM Eastern Time (US and Canada)
☕ Nespresso & Teatime - 417 DSL Commons

* 3:30 to 4:30 PM Eastern Time (US and Canada)
🕟 Colloquium - 499 DSL Seminar Room

Abstract:
The error analysis of neural networks is often split into three components: the approximation error, describes how well the networks can approximate functions, given infinite data. The estimation error describes the additional error contributions from sampling and the optimization error describes the contributions from the numerical optimizers.

In particular, the latter is best understood in severely over-parametrized regimes, where we have more samples than width and the networks show an almost linear behavior dominated by the neural tangent kernel (NTK). Many practical networks, however, have less width than samples and therefore, we extend the theory to the under-parametrized regime. This requires a more careful consideration of approximation errors and results in a unified theory for all three error components.

Since the NTK theory cannot adequately capture the nonlinear nature of the networks, we also provide some first steps towards a nonlinear theory by comparing trained simple model networks with known results form nonlinear approximation.


Additional colloquium details can be found here,
https://www.sc.fsu.edu/news-and-events/colloquium/1814-colloquium-with-gerrit-welper-2024-09-18<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.sc.fsu.edu%2Fnews-and-events%2Fcolloquium%2F1814-colloquium-with-gerrit-welper-2024-09-18&data=05%7C02%7Csc-seminar-announce%40lists.fsu.edu%7Cf198bbdbb9a3407fe67608dcd335d793%7Ca36450ebdb0642a78d1b026719f701e3%7C0%7C0%7C638617475414008860%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&sdata=VPkVsBo70xpBxxcmH0w0SiQfpyt0ho4lejlBWhYWjt4%3D&reserved=0>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.fsu.edu/pipermail/eoas-seminar/attachments/20240912/6d6c8162/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: text/calendar
Size: 4957 bytes
Desc: not available
URL: <http://lists.fsu.edu/pipermail/eoas-seminar/attachments/20240912/6d6c8162/attachment.ics>
-------------- next part --------------
_______________________________________________
SC-Seminar-announce mailing list
SC-Seminar-announce at lists.fsu.edu
https://lists.fsu.edu/mailman/listinfo/sc-seminar-announce