Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2305.04701
Cited By
Differentially Private Attention Computation
8 May 2023
Yeqi Gao
Zhao Song
Xin Yang
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Differentially Private Attention Computation"
18 / 18 papers shown
Subquadratic Algorithms and Hardness for Attention with Any Temperature
Shreya Gupta
Boyang Huang
Barna Saha
Yinzhan Xu
Christopher Ye
327
3
0
20 May 2025
Fast RoPE Attention: Combining the Polynomial Method and Fast Fourier Transform
Josh Alman
Zhao Song
386
26
0
17 May 2025
Differentially Private Kernel Density Estimation
Erzhi Liu
Jerry Yao-Chieh Hu
Alex Reneau
Zhao Song
Han Liu
520
8
0
03 Sep 2024
The Fine-Grained Complexity of Gradient Computation for Training Large Language Models
Josh Alman
Zhao Song
272
30
0
07 Feb 2024
Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Time
International Conference on Machine Learning (ICML), 2023
Zichang Liu
Jue Wang
Tri Dao
Wanrong Zhu
Binhang Yuan
...
Anshumali Shrivastava
Ce Zhang
Yuandong Tian
Christopher Ré
Beidi Chen
BDL
440
305
0
26 Oct 2023
How to Capture Higher-order Correlations? Generalizing Matrix Softmax Attention to Kronecker Computation
International Conference on Learning Representations (ICLR), 2023
Josh Alman
Zhao Song
404
52
0
06 Oct 2023
Solving Attention Kernel Regression Problem via Pre-conditioner
International Conference on Artificial Intelligence and Statistics (AISTATS), 2023
Zhao Song
Junze Yin
Licheng Zhang
336
23
0
28 Aug 2023
How to Protect Copyright Data in Optimization of Large Language Models?
AAAI Conference on Artificial Intelligence (AAAI), 2023
T. Chu
Zhao Song
Chiwun Yang
315
40
0
23 Aug 2023
GradientCoin: A Peer-to-Peer Decentralized Large Language Models
Yeqi Gao
Zhao Song
Junze Yin
197
26
0
21 Aug 2023
Zero-th Order Algorithm for Softmax Attention Optimization
BigData Congress [Services Society] (BSS), 2023
Yichuan Deng
Zhihang Li
Sridhar Mahadevan
Zhao Song
231
19
0
17 Jul 2023
Beyond Classical Attention: Quantum Attention for Scalable Computation
Yeqi Gao
Zhao Song
Xin Yang
Ruizhe Zhang
LRM
380
25
0
16 Jul 2023
H
2
_2
2
O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
Neural Information Processing Systems (NeurIPS), 2023
Zhenyu Zhang
Ying Sheng
Wanrong Zhu
Tianlong Chen
Lianmin Zheng
...
Yuandong Tian
Christopher Ré
Clark W. Barrett
Zinan Lin
Beidi Chen
VLM
893
592
0
24 Jun 2023
InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understanding
Neural Information Processing Systems (NeurIPS), 2023
Junda Wu
Tong Yu
Rui Wang
Zhao Song
Ruiyi Zhang
Handong Zhao
Chaochao Lu
Shuai Li
Ricardo Henao
VLM
253
39
0
08 Jun 2023
Query Complexity of Active Learning for Function Family With Nearly Orthogonal Basis
Xiangyi Chen
Zhao Song
Baochen Sun
Junze Yin
Danyang Zhuo
373
5
0
06 Jun 2023
A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Models
Ritwik Sinha
Zhao Song
Wanrong Zhu
315
30
0
04 Jun 2023
The Closeness of In-Context Learning and Weight Shifting for Softmax Regression
Neural Information Processing Systems (NeurIPS), 2023
Shuai Li
Zhao Song
Yu Xia
Tong Yu
Wanrong Zhu
244
50
0
26 Apr 2023
Solving Tensor Low Cycle Rank Approximation
BigData Congress [Services Society] (BSS), 2023
Yichuan Deng
Yeqi Gao
Zhao Song
223
9
0
13 Apr 2023
Fast Attention Requires Bounded Entries
Neural Information Processing Systems (NeurIPS), 2023
Josh Alman
Zhao Song
401
107
0
26 Feb 2023
1
Page 1 of 1