v1v2v3v4 (latest)

First Efficient Convergence for Streaming k-PCA: a Global, Gap-Free, and Near-Optimal Rate

26 July 2016

Papers citing "First Efficient Convergence for Streaming k-PCA: a Global, Gap-Free, and Near-Optimal Rate"

50 / 56 papers shown

Title
Global Convergence of Adaptive Sensing for Principal Eigenvector Estimation Alex Saad-Falcon Brighton Ancelin Justin Romberg 51 0 0 16 May 2025
Spectral Guarantees for Adversarial Streaming PCA Eric Price Zhiyang Xun 87 4 0 19 Aug 2024
Black-Box $k$ -to- $1$ -PCA Reductions: Theory and Applications A. Jambulapati Syamantak Kumar Jerry Li Shourya Pandey Ankit Pensia Kevin Tian 61 3 0 06 Mar 2024
On the Error-Propagation of Inexact Hotelling's Deflation for Principal Component Analysis Sorawit Saengkyongam Junhyung Lyle Kim Cruz Barnum Anastasios Kyrillidis 58 0 0 06 Oct 2023
The Effect of SGD Batch Size on Autoencoder Learning: Sparsity, Sharpness, and Feature Learning Nikhil Ghosh Spencer Frei Wooseok Ha Ting Yu MLT 61 3 0 06 Aug 2023
Convergence of Alternating Gradient Descent for Matrix Factorization R. Ward T. Kolda 84 9 0 11 May 2023
Streaming PCA for Markovian Data Syamantak Kumar Purnamrita Sarkar 101 7 0 03 May 2023
Streaming Kernel PCA Algorithm With Small Space Yichuan Deng Zhao Song Zifan Wang Hangke Zhang 114 4 0 08 Mar 2023
An online algorithm for contrastive Principal Component Analysis Siavash Golkar David Lipshutz Tiberiu Teşileanu D. Chklovskii 81 4 0 14 Nov 2022
Stochastic Parallelizable Eigengap Dilation for Large Graph Clustering Elise van der Pol I. Gemp Yoram Bachrach Richard Everett 75 0 0 29 Jul 2022
The Symmetric Generalized Eigenvalue Problem as a Nash Equilibrium I. Gemp Chen Chen Brian McWilliams 55 0 0 10 Jun 2022
Self-consistent Gradient-like Eigen Decomposition in Solving Schrödinger Equations Xihan Li Xiang Chen Rasul Tutunov Haitham Bou-Ammar Lei Wang Jun Wang 68 0 0 03 Feb 2022
Nonconvex Stochastic Scaled-Gradient Descent and Generalized Eigenvector Problems C. J. Li Michael I. Jordan 73 2 0 29 Dec 2021
Optimal Gradient-based Algorithms for Non-concave Bandit Optimization Baihe Huang Kaixuan Huang Sham Kakade Jason D. Lee Qi Lei Runzhe Wang Jiaqi Yang 417 17 0 09 Jul 2021
On the Optimality of the Oja's Algorithm for Online PCA Xin Liang 53 9 0 31 Mar 2021
EigenGame Unloaded: When playing games is better than optimizing I. Gemp Brian McWilliams Claire Vernade T. Graepel 65 13 0 08 Feb 2021
Streaming k-PCA: Efficient guarantees for Oja's algorithm, beyond rank-one updates De Huang Jonathan Niles-Weed Rachel A. Ward 50 21 0 06 Feb 2021
Community Preserved Social Graph Publishing with Node Differential Privacy Sen Zhang Weiwei Ni Nan Fu 95 17 0 05 Jan 2021
Stochastic Approximation for Online Tensorial Independent Component Analysis C. J. Li Michael I. Jordan 68 2 0 28 Dec 2020
The ELBO of Variational Autoencoders Converges to a Sum of Three Entropies Simon Damm D. Forster Dmytro Velychko Zhenwen Dai Asja Fischer Jörg Lücke DRL 69 5 0 28 Oct 2020
EigenGame: PCA as a Nash Equilibrium I. Gemp Brian McWilliams Claire Vernade T. Graepel 114 48 0 01 Oct 2020
Communication-efficient distributed eigenspace estimation Vasileios Charisopoulos Austin R. Benson Anil Damle 47 10 0 05 Sep 2020
A General Framework for Analyzing Stochastic Dynamics in Learning Algorithms Chi-Ning Chou Juspreet Singh Sandhu Mien Brabeeba Wang Tiancheng Yu 60 4 0 11 Jun 2020
Scaling-up Distributed Processing of Data Streams for Machine Learning M. Nokleby Haroon Raja W. Bajwa 69 15 0 18 May 2020
Memory-efficient training with streaming dimensionality reduction Siyuan Huang Brian D. Hoskins M. Daniels M. D. Stiles G. Adam 29 3 0 25 Apr 2020
Spectral Learning on Matrices and Tensors Majid Janzamin Rong Ge Jean Kossaifi Anima Anandkumar 85 41 0 16 Apr 2020
Distributed Stochastic Algorithms for High-rate Streaming Principal Component Analysis Haroon Raja W. Bajwa 74 11 0 04 Jan 2020
ROIPCA: An online memory-restricted PCA algorithm based on rank-one updates Roy Mitz Y. Shkolnisky 33 0 0 25 Nov 2019
ODE-Inspired Analysis for the Biological Version of Oja's Rule in Solving Streaming PCA Chi-Ning Chou Mien Brabeeba Wang 71 8 0 04 Nov 2019
On-Device Machine Learning: An Algorithms and Learning Theory Perspective Sauptik Dhar Junyao Guo Jiayi Liu S. Tripathi Unmesh Kurup Mohak Shah 127 144 0 02 Nov 2019
An Implicit Form of Krasulina's k-PCA Update without the Orthonormality Constraint Ehsan Amid Manfred K. Warmuth 82 11 0 11 Sep 2019
AdaOja: Adaptive Learning Rates for Streaming PCA Amelia Henriksen Rachel A. Ward 70 23 0 28 May 2019
Exponentially convergent stochastic k-PCA without variance reduction Cheng Tang 100 28 0 03 Apr 2019
Streaming Batch Eigenupdates for Hardware Neuromorphic Networks Brian D. Hoskins M. Daniels Siyuan Huang A. Madhavan G. Adam N. Zhitenev Jabez J. McClelland M. D. Stiles 49 14 0 05 Mar 2019
Robust Streaming PCA D. Bienstock Minchan Jeong Apurv Shukla Se-Young Yun 48 3 0 08 Feb 2019
Gen-Oja: A Two-time-scale approach for Streaming CCA Kush S. Bhatia Aldo Pacchiano Nicolas Flammarion Peter L. Bartlett Michael I. Jordan 61 2 0 20 Nov 2018
On the Regret Minimization of Nonconvex Online Gradient Ascent for Online PCA Dan Garber ODL 62 9 0 27 Sep 2018
$Streaming Kernel PCA with $\tilde{O}(\sqrt{n})$ Random Features$ Streaming Kernel PCA with $\tilde{O}(\sqrt{n})$ Random Features Enayat Ullah Poorya Mianjy T. V. Marinov R. Arora 129 22 0 02 Aug 2018
On the Randomized Complexity of Minimizing a Convex Quadratic Function Max Simchowitz 97 12 0 24 Jul 2018
An Acceleration Scheme for Memory Limited, Streaming PCA Salaheddin Alakkari J. Dingliana 33 2 0 17 Jul 2018
SPIDER: Near-Optimal Non-Convex Optimization via Stochastic Path Integrated Differential Estimator Cong Fang C. J. Li Zhouchen Lin Tong Zhang 133 580 0 04 Jul 2018
Streaming PCA and Subspace Tracking: The Missing Data Case Laura Balzano Yuejie Chi Yue M. Lu 73 87 0 12 Jun 2018
Subspace Estimation from Incomplete Observations: A High-Dimensional Analysis Chuang Wang Yonina C. Eldar Yue M. Lu 73 17 0 17 May 2018
Eigenvector Computation and Community Detection in Asynchronous Gossip Models Frederik Mallmann-Trenn Cameron Musco Christopher Musco 59 9 0 23 Apr 2018
Tight Query Complexity Lower Bounds for PCA via Finite Sample Deformed Wigner Law Max Simchowitz A. Alaoui Benjamin Recht 100 39 0 04 Apr 2018
Dimensionality Reduction for Stationary Time Series via Stochastic Nonconvex Optimization Minshuo Chen Ling Yang Mengdi Wang T. Zhao 34 10 0 06 Mar 2018
Averaging Stochastic Gradient Descent on Riemannian Manifolds Nilesh Tripuraneni Nicolas Flammarion Francis R. Bach Michael I. Jordan 73 100 0 26 Feb 2018
History PCA: A New Algorithm for Streaming PCA Puyudi Yang Cho-Jui Hsieh Jane-ling Wang AI4TS 56 24 0 15 Feb 2018
Katyusha X: Practical Momentum Method for Stochastic Sum-of-Nonconvex Optimization Zeyuan Allen-Zhu ODL 105 52 0 12 Feb 2018
Differentially Private Matrix Completion Revisited Prateek Jain Om Thakkar Abhradeep Thakurta FedML 59 34 0 28 Dec 2017