ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2404.18239
  4. Cited By
SOUL: Unlocking the Power of Second-Order Optimization for LLM
  Unlearning
v1v2v3v4 (latest)

SOUL: Unlocking the Power of Second-Order Optimization for LLM Unlearning

28 April 2024
Jinghan Jia
Yihua Zhang
Yimeng Zhang
Jiancheng Liu
Bharat Runwal
James Diffenderfer
B. Kailkhura
Sijia Liu
    MU
ArXiv (abs)PDFHTMLGithub (25★)

Papers citing "SOUL: Unlocking the Power of Second-Order Optimization for LLM Unlearning"

50 / 55 papers shown
DRAGON: Guard LLM Unlearning in Context via Negative Detection and Reasoning
DRAGON: Guard LLM Unlearning in Context via Negative Detection and ReasoningConference on Empirical Methods in Natural Language Processing (EMNLP), 2025
Y. Wang
Chris Yuhao Liu
Quan Liu
Jinglong Pang
Wei Wei
Yujia Bao
Yang Liu
MU
431
4
0
08 Nov 2025
A Survey on Unlearning in Large Language Models
A Survey on Unlearning in Large Language Models
Ruichen Qiu
Jiajun Tan
Jiayue Pu
Honglin Wang
Xiao-Shan Gao
Fei Sun
MUAILawPILM
791
2
0
29 Oct 2025
Label Smoothing Improves Gradient Ascent in LLM Unlearning
Label Smoothing Improves Gradient Ascent in LLM Unlearning
Zirui Pang
Hao Zheng
Zhijie Deng
Ling Li
Zixin Zhong
Jiaheng Wei
MU
268
2
0
25 Oct 2025
LLM Unlearning with LLM Beliefs
LLM Unlearning with LLM Beliefs
Kemou Li
Qizhou Wang
Y. Wang
Fengpeng Li
Jun Liu
Bo Han
Jiantao Zhou
MUKELM
290
7
0
22 Oct 2025
See, Think, Act: Online Shopper Behavior Simulation with VLM Agents
See, Think, Act: Online Shopper Behavior Simulation with VLM Agents
Yimeng Zhang
Jiri Gesi
Ran Xue
Tian Wang
Ziyi Wang
...
Qingjun Cui
Yufan Guo
Jing Huang
Mubarak Shah
Dakuo Wang
OffRL
205
5
0
22 Oct 2025
SIMU: Selective Influence Machine Unlearning
SIMU: Selective Influence Machine Unlearning
Anu Agarwal
Mihir Pamnani
Dilek Hakkani-Tur
MU
178
0
0
09 Oct 2025
Distribution Preference Optimization: A Fine-grained Perspective for LLM Unlearning
Distribution Preference Optimization: A Fine-grained Perspective for LLM Unlearning
Kai Qin
Jiaqi Wu
Jianxiang He
Haoyuan Sun
Yifei Zhao
Bin Liang
Yongzhe Chang
Tiantian Zhang
Houde Liu
MU
282
2
0
06 Oct 2025
Downgrade to Upgrade: Optimizer Simplification Enhances Robustness in LLM Unlearning
Downgrade to Upgrade: Optimizer Simplification Enhances Robustness in LLM Unlearning
Yicheng Lang
Yihua Zhang
Chongyu Fan
Changsheng Wang
Jinghan Jia
Sijia Liu
MU
449
0
0
01 Oct 2025
Direct Token Optimization: A Self-contained Approach to Large Language Model Unlearning
Direct Token Optimization: A Self-contained Approach to Large Language Model Unlearning
Hong kyu Lee
Ruixuan Liu
Li Xiong
MU
203
1
0
30 Sep 2025
Rotation Control Unlearning: Quantifying and Controlling Continuous Unlearning for LLM with The Cognitive Rotation Space
Rotation Control Unlearning: Quantifying and Controlling Continuous Unlearning for LLM with The Cognitive Rotation Space
Xiang Zhang
Kun-Juan Wei
Xu Yang
Chenghao Xu
Su Yan
Cheng Deng
MU
287
0
0
30 Sep 2025
Understanding the Dilemma of Unlearning for Large Language Models
Understanding the Dilemma of Unlearning for Large Language Models
Qingjie Zhang
Haoting Qian
Zhicong Huang
Cheng Hong
Shiyu Huang
Ke Xu
Chao Zhang
Han Qiu
MU
411
4
0
29 Sep 2025
Beyond Sharp Minima: Robust LLM Unlearning via Feedback-Guided Multi-Point Optimization
Beyond Sharp Minima: Robust LLM Unlearning via Feedback-Guided Multi-Point Optimization
Wenhan Wu
Zheyuan Liu
Chongyang Gao
Ren Wang
Kaize Ding
AAMLMUKELM
452
1
0
24 Sep 2025
Towards Mitigating Excessive Forgetting in LLM Unlearning via Entanglement-Guidance with Proxy Constraint
Towards Mitigating Excessive Forgetting in LLM Unlearning via Entanglement-Guidance with Proxy Constraint
Zhihao Liu
Jian Lou
Yuke Hu
Xiaochen Li
Tailun Chen
Yitian Chen
Zhan Qin
Kui Ren
Zhan Qin
MU
278
0
0
28 Aug 2025
Module-Aware Parameter-Efficient Machine Unlearning on Transformers
Module-Aware Parameter-Efficient Machine Unlearning on Transformers
Wenjie Bao
Jian Lou
Yuke Hu
Xiaochen Li
Zhihao Liu
Jiaqi Liu
Zhan Qin
K. Ren
MU
202
0
0
24 Aug 2025
Reliable Unlearning Harmful Information in LLMs with Metamorphosis Representation Projection
Reliable Unlearning Harmful Information in LLMs with Metamorphosis Representation Projection
Chengcan Wu
Zeming Wei
Huanran Chen
Yinpeng Dong
Meng Sun
MUCLLKELM
178
3
0
21 Aug 2025
Side Effects of Erasing Concepts from Diffusion Models
Side Effects of Erasing Concepts from Diffusion Models
Shaswati Saha
Sourajit Saha
Manas Gaur
Tejas Gokhale
DiffM
330
5
0
20 Aug 2025
Oblivionis: A Lightweight Learning and Unlearning Framework for Federated Large Language Models
Oblivionis: A Lightweight Learning and Unlearning Framework for Federated Large Language Models
Fuyao Zhang
Xinyu Yan
Tiantong Wu
Wenjie Li
Tianxiang Chen
Yang Cao
Ran Yan
Longtao Huang
Wei Yang Bryan Lim
Qiang Yang
MU
230
0
0
12 Aug 2025
A Survey on Generative Model Unlearning: Fundamentals, Taxonomy, Evaluation, and Future Direction
A Survey on Generative Model Unlearning: Fundamentals, Taxonomy, Evaluation, and Future Direction
Xiaohua Feng
Jiaming Zhang
Fengyuan Yu
C. Wang
Li Zhang
Kaixiang Li
Yuyuan Li
Chaochao Chen
Jianwei Yin
MU
358
3
0
26 Jul 2025
Shop-R1: Rewarding LLMs to Simulate Human Behavior in Online Shopping via Reinforcement Learning
Shop-R1: Rewarding LLMs to Simulate Human Behavior in Online Shopping via Reinforcement Learning
Yimeng Zhang
Tian Wang
Jiri Gesi
Liang Luo
Yuxuan Lu
...
Ran Xue
Houyu Zhang
Qingjun Cui
Yufan Guo
Dakuo Wang
OffRLRALMLRM
417
10
0
23 Jul 2025
Learning-Time Encoding Shapes Unlearning in LLMs
Learning-Time Encoding Shapes Unlearning in LLMs
Ruihan Wu
Konstantin Garov
Kamalika Chaudhuri
MU
266
0
0
18 Jun 2025
Reasoning Model Unlearning: Forgetting Traces, Not Just Answers, While Preserving Reasoning Skills
Reasoning Model Unlearning: Forgetting Traces, Not Just Answers, While Preserving Reasoning Skills
Changsheng Wang
Chongyu Fan
Yihua Zhang
Jinghan Jia
Dennis Wei
Parikshit Ram
Nathalie Baracaldo
Sijia Liu
MUKELMLRM
520
12
0
15 Jun 2025
OpenUnlearning: Accelerating LLM Unlearning via Unified Benchmarking of Methods and Metrics
OpenUnlearning: Accelerating LLM Unlearning via Unified Benchmarking of Methods and Metrics
Pratyush Maini
Anmol Mekala
Wenlong Zhao
Andrew McCallum
Zachary Chase Lipton
J. Zico Kolter
Pratyush Maini
MUELM
425
32
0
14 Jun 2025
SoK: Machine Unlearning for Large Language Models
SoK: Machine Unlearning for Large Language Models
Jie Ren
Yue Xing
Yingqian Cui
Charu C. Aggarwal
Hui Liu
MU
228
7
0
10 Jun 2025
Distillation Robustifies Unlearning
Distillation Robustifies Unlearning
Bruce W. Lee
Addie Foote
Alex Infanger
Leni Shor
Harish Kamath
Jacob Goldman-Wetzler
Bryce Woodworth
Alex Cloud
Alexander Matt Turner
MU
542
8
0
06 Jun 2025
Speech Unlearning
Speech Unlearning
Jiali Cheng
Hadi Amiri
SSLMU
384
4
0
01 Jun 2025
Model Unlearning via Sparse Autoencoder Subspace Guided Projections
Model Unlearning via Sparse Autoencoder Subspace Guided Projections
Xu Wang
Zihao Li
Benyou Wang
Yan Hu
Difan Zou
MU
234
8
0
30 May 2025
Exploring Criteria of Loss Reweighting to Enhance LLM Unlearning
Exploring Criteria of Loss Reweighting to Enhance LLM Unlearning
Puning Yang
Qizhou Wang
Zhuo Huang
Tongliang Liu
Chengqi Zhang
Bo Han
MU
497
29
0
17 May 2025
Ready2Unlearn: A Learning-Time Approach for Preparing Models with Future Unlearning Readiness
Ready2Unlearn: A Learning-Time Approach for Preparing Models with Future Unlearning Readiness
Hanyu Duan
Yi Yang
Ahmed Abbasi
Kar Yan Tam
MUOnRL
317
1
0
16 May 2025
HessFormer: Hessians at Foundation Scale
HessFormer: Hessians at Foundation Scale
Diego Granziol
514
1
0
16 May 2025
Layered Unlearning for Adversarial Relearning
Layered Unlearning for Adversarial Relearning
Timothy Qian
Vinith Suriyakumar
Ashia Wilson
Dylan Hadfield-Menell
MU
420
1
0
14 May 2025
Sharpness-Aware Parameter Selection for Machine Unlearning
Sharpness-Aware Parameter Selection for Machine Unlearning
Saber Malekmohammadi
Hong kyu Lee
Li Xiong
MU
1.1K
0
0
08 Apr 2025
Understanding Machine Unlearning Through the Lens of Mode Connectivity
Understanding Machine Unlearning Through the Lens of Mode Connectivity
Jiali Cheng
Hadi Amiri
MU
973
4
0
08 Apr 2025
SUV: Scalable Large Language Model Copyright Compliance with Regularized Selective Unlearning
SUV: Scalable Large Language Model Copyright Compliance with Regularized Selective Unlearning
Tianyang Xu
Xiaoze Liu
Feijie Wu
Xiaoqian Wang
Jing Gao
MU
613
5
0
29 Mar 2025
Safety Mirage: How Spurious Correlations Undermine VLM Safety Fine-Tuning and Can Be Mitigated by Machine Unlearning
Safety Mirage: How Spurious Correlations Undermine VLM Safety Fine-Tuning and Can Be Mitigated by Machine Unlearning
Yiwei Chen
Yuguang Yao
Yihua Zhang
Bingquan Shen
Gaowen Liu
Sijia Liu
AAMLMU
486
11
0
14 Mar 2025
Learning to Unlearn while Retaining: Combating Gradient Conflicts in Machine Unlearning
Learning to Unlearn while Retaining: Combating Gradient Conflicts in Machine Unlearning
Gaurav Patel
Qiang Qiu
MU
372
13
0
08 Mar 2025
Erasing Without Remembering: Implicit Knowledge Forgetting in Large Language Models
Erasing Without Remembering: Implicit Knowledge Forgetting in Large Language Models
Huazheng Wang
Yongcheng Jing
Haifeng Sun
Yingjie Wang
Jingchao Wang
Jianxin Liao
Dacheng Tao
KELMMU
489
0
0
27 Feb 2025
Machine Unlearning Doesn't Do What You Think: Lessons for Generative AI Policy and Research
Machine Unlearning Doesn't Do What You Think: Lessons for Generative AI Policy and Research
A. Feder Cooper
Christopher A. Choquette-Choo
Miranda Bogen
Matthew Jagielski
Katja Filippova
...
Hanna M. Wallach
Amy Cyphert
Katherine Lee
Nicolas Papernot
Katherine Lee
MUAILaw
395
29
0
09 Dec 2024
Benchmarking Vision Language Model Unlearning via Fictitious Facial Identity Dataset
Benchmarking Vision Language Model Unlearning via Fictitious Facial Identity DatasetInternational Conference on Learning Representations (ICLR), 2024
Yingzi Ma
Jiongxiao Wang
Haiwei Yang
Siyuan Ma
Jiazhao Li
...
B. Li
Yejin Choi
Mengzhao Chen
Chaowei Xiao
Chaowei Xiao
MU
568
16
0
05 Nov 2024
CLIPErase: Efficient Unlearning of Visual-Textual Associations in CLIP
CLIPErase: Efficient Unlearning of Visual-Textual Associations in CLIPAnnual Meeting of the Association for Computational Linguistics (ACL), 2024
Tianyu Yang
Lisen Dai
Zheyuan Liu
Minhao Cheng
Meng Jiang
Yapeng Tian
VLMMU
452
18
0
30 Oct 2024
WAGLE: Strategic Weight Attribution for Effective and Modular Unlearning in Large Language Models
WAGLE: Strategic Weight Attribution for Effective and Modular Unlearning in Large Language ModelsNeural Information Processing Systems (NeurIPS), 2024
Jinghan Jia
Jiancheng Liu
Yihua Zhang
Parikshit Ram
Nathalie Baracaldo
Sijia Liu
MU
445
18
0
23 Oct 2024
Catastrophic Failure of LLM Unlearning via Quantization
Catastrophic Failure of LLM Unlearning via QuantizationInternational Conference on Learning Representations (ICLR), 2024
Zhiwei Zhang
Fali Wang
Xiaomin Li
Zongyu Wu
Xianfeng Tang
Hui Liu
Qi He
Wenpeng Yin
Suhang Wang
MU
393
57
0
21 Oct 2024
Meta-Unlearning on Diffusion Models: Preventing Relearning Unlearned Concepts
Meta-Unlearning on Diffusion Models: Preventing Relearning Unlearned Concepts
Hongcheng Gao
Tianyu Pang
Chao Du
Taihang Hu
Zhijie Deng
Min Lin
DiffM
341
27
0
16 Oct 2024
LLM Unlearning via Loss Adjustment with Only Forget Data
LLM Unlearning via Loss Adjustment with Only Forget DataInternational Conference on Learning Representations (ICLR), 2024
Yaxuan Wang
Jiaheng Wei
Chris Yuhao Liu
Jinlong Pang
Qiang Liu
A. Shah
Yujia Bao
Yang Liu
Wei Wei
KELMMU
447
60
0
14 Oct 2024
A Closer Look at Machine Unlearning for Large Language Models
A Closer Look at Machine Unlearning for Large Language ModelsInternational Conference on Learning Representations (ICLR), 2024
Xiaojian Yuan
Tianyu Pang
Chao Du
Kejiang Chen
Weiming Zhang
Min Lin
MU
961
40
0
10 Oct 2024
Simplicity Prevails: Rethinking Negative Preference Optimization for LLM Unlearning
Simplicity Prevails: Rethinking Negative Preference Optimization for LLM Unlearning
Chongyu Fan
Jiancheng Liu
Licong Lin
Jinghan Jia
Ruiqi Zhang
Song Mei
Sijia Liu
MU
746
91
0
09 Oct 2024
Alternate Preference Optimization for Unlearning Factual Knowledge in
  Large Language Models
Alternate Preference Optimization for Unlearning Factual Knowledge in Large Language Models
Anmol Mekala
Pratyush Maini
Shreya Dubey
Abhishek Lalwani
David Koleczek
Mukund Rungta
Sadid Hasan
Elita Lobo
KELMMU
292
27
0
20 Sep 2024
MEOW: MEMOry Supervised LLM Unlearning Via Inverted Facts
MEOW: MEMOry Supervised LLM Unlearning Via Inverted Facts
Tianle Gu
Kexin Huang
Ruilin Luo
Yuanqi Yao
Yujiu Yang
Yan Teng
Yingchun Wang
MU
432
18
0
18 Sep 2024
On Large Language Model Continual Unlearning
On Large Language Model Continual Unlearning
Chongyang Gao
Lixu Wang
Chenkai Weng
Tianlin Li
Qi Zhu
Qi Zhu
MU
383
0
0
14 Jul 2024
MU-Bench: A Multitask Multimodal Benchmark for Machine Unlearning
MU-Bench: A Multitask Multimodal Benchmark for Machine Unlearning
Jiali Cheng
Hadi Amiri
BDL
405
11
0
21 Jun 2024
Reversing the Forget-Retain Objectives: An Efficient LLM Unlearning
  Framework from Logit Difference
Reversing the Forget-Retain Objectives: An Efficient LLM Unlearning Framework from Logit Difference
Jiabao Ji
Yujian Liu
Yang Zhang
Gaowen Liu
Ramana Rao Kompella
Sijia Liu
Shiyu Chang
KELMMU
308
77
0
12 Jun 2024
12
Next
Page 1 of 2