About Me

I'm Da Yu, a PhD student at Sun Yat-sen University since 2019. I'm very lucky to be advised by Prof. Jian Yin and Prof. Tie-Yan Liu. I'm also very lucky to have the opportunity to work with Dr. Huishuai Zhang. I received my B.S. degree of Computer Science from Sun Yat-sen University in 2019.

Currently, I am a research intern at Microsoft Research Asia. I'm interested in (differentially) private machine learning. I'm also interested in understanding deep learning through a better understanding of data. My research is supported by MSRA Fellowship.

I'm a reviewer of ICML 2022, NeurIPS 2022, and ICLR 2023. I'm an outstanding reviewer (top 10%) of ICML 2022.

Email: yuda3@mail2.sysu.edu.cn.

Publications

Individual Privacy Accounting for Differentially Private Stochastic Gradient Descent

Da Yu, Gautam Kamath*, Janardhan Kulkarni*, Tie-Yan Liu*, Jian Yin*, Huishuai Zhang* (* denotes alphabetical order).

Preprint, 2022.

Availability Attacks Create Shortcuts

Da Yu, Huishuai Zhang, Wei Chen, Jian Yin, Tie-Yan Liu.

SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), Research Track, 2022.

Differentially Private Fine-tuning of Language Models

Da Yu, Saurabh Naik, Arturs Backurs*, Sivakanth Gopi*, Huseyin A. Inan*, Gautam Kamath*, Janardhan Kulkarni*, Yin Tat Lee*, Andre Manoel*, Lukas Wutschitz*, Sergey Yekhanin*, Huishuai Zhang* (* denotes alphabetical order).

International Conference on Learning Representations (ICLR), 2022.

Large Scale Private Learning via Low-rank Reparametrization

Da Yu, Huishuai Zhang, Wei Chen, Jian Yin, Tie-Yan Liu.

International Conference on Machine Learning (ICML), 2021.

Do not Let Privacy Overbill Utility: Gradient Embedding Perturbation for Private Learning

Da Yu*, Huishuai Zhang*, Wei Chen, Tie-Yan Liu.

International Conference on Learning Representations (ICLR), 2021.

How Does Data Augmentation Affect Privacy in Machine Learning?

Da Yu, Huishuai Zhang, Wei Chen, Jian Yin, Tie-Yan Liu.

AAAI Conference on Artificial Intelligence (AAAI), 2021.

Gradient Perturbation is Underrated for Differentially Private Convex Optimization

Da Yu*, Huishuai Zhang*, Wei Chen, Jian Yin, Tie-Yan Liu.

International Joint Conference on Artificial Intelligence (IJCAI), 2020.

Stabilize deep ResNet with a sharp scaling factor τ

Huishuai Zhang, Da Yu, Mingyang Yi, Wei Chen, Tie-Yan Liu

Machine Learning, 2022.

Improve the Gradient Perturbation Approach for Differentially Private Optimization

Da Yu, Huishuai Zhang, Wei Chen.

Privacy Preserving Machine Learning, NeurIPS Workshop, 2018.