On the Convergence of Differentially-Private Fine-tuning: To Linearly
Probe or to Fully Fine-tune?

On the Convergence of Differentially-Private Fine-tuning: To Linearly Probe or to Fully Fine-tune?

29 February 2024

Papers citing "On the Convergence of Differentially-Private Fine-tuning: To Linearly Probe or to Fully Fine-tune?"

11 / 11 papers shown

Title
Towards a Complete Analysis of Langevin Monte Carlo: Beyond Poincaré Inequality Alireza Mousavi-Hosseini Tyler Farghly Ye He Krishnakumar Balasubramanian Murat A. Erdogdu 27 25 0 07 Mar 2023
Parameter-Efficient Tuning Makes a Good Classification Head Zhuoyi Yang Ming Ding Yanhui Guo Qingsong Lv Jie Tang VLM 30 14 0 30 Oct 2022
Differentially Private Fine-tuning of Language Models Da Yu Saurabh Naik A. Backurs Sivakanth Gopi Huseyin A. Inan ... Y. Lee Andre Manoel Lukas Wutschitz Sergey Yekhanin Huishuai Zhang 134 344 0 13 Oct 2021
Opacus: User-Friendly Differential Privacy Library in PyTorch Ashkan Yousefpour I. Shilov Alexandre Sablayrolles Davide Testuggine Karthik Prasad ... Sayan Gosh Akash Bharadwaj Jessica Zhao Graham Cormode Ilya Mironov VLM 138 347 0 25 Sep 2021
Continuous vs. Discrete Optimization of Deep Neural Networks Omer Elkabetz Nadav Cohen 58 44 0 14 Jul 2021
Differentially Private Stochastic Optimization: New Results in Convex and Non-Convex Settings Raef Bassily Cristóbal Guzmán Michael Menart 37 54 0 12 Jul 2021
Unadjusted Langevin algorithm for non-convex weakly smooth potentials D. Nguyen Xin Dang Yixin Chen 12 14 0 16 Jan 2021
Convergence of Langevin Monte Carlo in Chi-Squared and Renyi Divergence Murat A. Erdogdu Rasa Hosseinzadeh Matthew Shunshi Zhang 73 41 0 22 Jul 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 238 3,359 0 09 Mar 2020
A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights Weijie Su Stephen P. Boyd Emmanuel J. Candes 97 1,150 0 04 Mar 2015
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 279 39,083 0 01 Sep 2014