Yuqing Wang
yq.wang@berkeley.edu
CV and Google Scholar
I am a Research Fellow at the Simons Institute at UC Berkeley for the MPG program in fall 2024. Before that, I obtained my PhD in Mathematics at Georgia Institute of Technology, advised by Prof. Molei Tao.
Research
I focus on the mathematical foundations of machine learning, especially from dynamical perspective. My research lies at the intersection of machine learning, optimization, sampling, (stochastic) dynamics, and computational math, especially implicit biases of large learning rates. Currently, I am also interested in large language models and diffusion models.
Publications
Evaluating the design space of diffusion-based generative models
Yuqing Wang, Ye He, Molei Tao
NeurIPS 2024
Provable Acceleration of Nesterov’s Accelerated Gradient for Rectangular Matrix Factorization and Linear Neural Networks
Zhenghao Xu, Yuqing Wang, Tuo Zhao, Rachel Ward, Molei Tao
NeurIPS 2024
Good regularity creates large learning rate implicit biases: edge of stability, balancing, and catapult
Yuqing Wang, Zhenghao Xu, Tuo Zhao, Molei Tao
preprint (short version accepted in M3L, NeurIPS 2023 workshop)
Markov Chain Monte Carlo for Gaussian: A Linear Control Perspective
Bo Yuan, Jiaojiao Fan, Yuqing Wang, Molei Tao, Yongxin Chen
IEEE Control Systems Letters 2023
Momentum Stiefel Optimizer, with Applications to Suitably-Orthogonal Attention, and Optimal Transport
Lingkai Kong, Yuqing Wang, Molei Tao
ICLR 2023
Large Learning Rate Tames Homogeneity: Convergence and Balancing Effect
Yuqing Wang, Minshuo Chen, Tuo Zhao, Molei Tao
ICLR 2022 video
Why Do Deep Residual Networks Generalize Better than Deep Feedforward Networks? — A Neural Tangent Kernel Perspective
Kaixuan Huang*, Yuqing Wang*, Molei Tao, Tuo Zhao (*Equal contribution)
NeurIPS 2020 video
Teaching
TA in School of Mathematics, Georgia Institute of Technology:
- MATH 2552 Differential Equation, Fall 2018, Spring 2019, Fall 2019, Fall 2020, Spring 2021, Spring 2022, Spring 2023, Fall 2023
- MATH 2550 Introduction to Multivariable Calculus, Summer 2019, Summer 2024
- MATH 2551 Multivariable Calculus, Spring 2020