PipeFisher: Efficient Training of Large Language Models Using Pipelining
and Fisher Information MatricesConference on Machine Learning and Systems (MLSys), 2022 |
Scalable K-FAC Training for Deep Neural Networks with Distributed
PreconditioningIEEE Transactions on Cloud Computing (IEEE TCC), 2022 |
Invariance Learning in Deep Neural Networks with Differentiable Laplace
ApproximationsNeural Information Processing Systems (NeurIPS), 2022 |
Addressing Catastrophic Forgetting in Few-Shot ProblemsInternational Conference on Machine Learning (ICML), 2020 |