Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales

Terms and Conditions

Twitter GitHub LinkedIn Bluesky Youtube

© 2026 ResearchTrend.AI, All rights reserved.

Home
Papers
2312.05821
Cited By

ASVD: Activation-aware Singular Value Decomposition for Compressing Large Language Models

v1v2v3v4v5 (latest)

ASVD: Activation-aware Singular Value Decomposition for Compressing Large Language Models

10 December 2023

ArXiv (abs)PDF HTML Github

Papers citing "ASVD: Activation-aware Singular Value Decomposition for Compressing Large Language Models"

50 / 78 papers shown

Low-Rank Prehab: Preparing Neural Networks for SVD Compression

Low-Rank Prehab: Preparing Neural Networks for SVD Compression

Shansita D. Sharma

214

0

0

01 Dec 2025

Decomposed Trust: Exploring Privacy, Adversarial Robustness, Fairness, and Ethics of Low-Rank LLMs

Decomposed Trust: Exploring Privacy, Adversarial Robustness, Fairness, and Ethics of Low-Rank LLMs

Daniel Agyei Asante

Md Mokarram Chowdhury

158

0

0

27 Nov 2025

Globally optimized SVD compression of LLMs via Fermi-function-based rank selection and gauge fixing

Globally optimized SVD compression of LLMs via Fermi-function-based rank selection and gauge fixing

Sukhbinder Singh

68

2

0

26 Nov 2025

Optimal Singular Damage: Efficient LLM Inference in Low Storage Regimes

Optimal Singular Damage: Efficient LLM Inference in Low Storage Regimes

Mohammadsajad Alipour

Mohammad Mohammadi Amiri

133

0

0

04 Nov 2025

NeuronMM: High-Performance Matrix Multiplication for LLM Inference on AWS Trainium

NeuronMM: High-Performance Matrix Multiplication for LLM Inference on AWS Trainium

227

0

0

29 Oct 2025

KORE: Enhancing Knowledge Injection for Large Multimodal Models via Knowledge-Oriented Augmentations and Constraints

KORE: Enhancing Knowledge Injection for Large Multimodal Models via Knowledge-Oriented Augmentations and Constraints

CLL OffRL KELM VLM

262

6

0

22 Oct 2025

ARA: Adaptive Rank Allocation for Efficient Large Language Model SVD Compression

ARA: Adaptive Rank Allocation for Efficient Large Language Model SVD Compression

165

2

0

22 Oct 2025

Neuronal Group Communication for Efficient Neural representation

Neuronal Group Communication for Efficient Neural representation

164

0

0

19 Oct 2025

QSVD: Efficient Low-rank Approximation for Unified Query-Key-Value Weight Compression in Low-Precision Vision-Language Models

QSVD: Efficient Low-rank Approximation for Unified Query-Key-Value Weight Compression in Low-Precision Vision-Language Models

129

1

0

18 Oct 2025

A Guardrail for Safety Preservation: When Safety-Sensitive Subspace Meets Harmful-Resistant Null-Space

A Guardrail for Safety Preservation: When Safety-Sensitive Subspace Meets Harmful-Resistant Null-Space

336

3

0

16 Oct 2025

Purifying Task Vectors in Knowledge-Aware Subspace for Model Merging

Purifying Task Vectors in Knowledge-Aware Subspace for Model Merging

203

1

0

16 Oct 2025

Neural Weight Compression for Language Models

Neural Weight Compression for Language Models

176

0

0

13 Oct 2025

Efficient Resource-Constrained Training of Transformers via Subspace Optimization

Efficient Resource-Constrained Training of Transformers via Subspace Optimization

Le-Trung Nguyen

Enzo Tartaglione

186

0

0

10 Oct 2025

Boomerang Distillation Enables Zero-Shot Model Size Interpolation

Boomerang Distillation Enables Zero-Shot Model Size Interpolation

Sara Kangaslahti

Jonathan Geuter

Francesco Locatello

David Alvarez-Melis

211

1

0

06 Oct 2025

Accelerating Attention with Basis Decomposition

Accelerating Attention with Basis Decomposition

193

0

0

02 Oct 2025

Layer-wise dynamic rank for compressing large language models

Layer-wise dynamic rank for compressing large language models

238

3

0

30 Sep 2025

Quant-dLLM: Post-Training Extreme Low-Bit Quantization for Diffusion Large Language Models

Quant-dLLM: Post-Training Extreme Low-Bit Quantization for Diffusion Large Language Models

199

5

0

27 Sep 2025

Memory-Efficient Fine-Tuning via Low-Rank Activation Compression

Memory-Efficient Fine-Tuning via Low-Rank Activation Compression

176

0

0

27 Sep 2025

CoSpaDi: Compressing LLMs via Calibration-Guided Sparse Dictionary Learning

CoSpaDi: Compressing LLMs via Calibration-Guided Sparse Dictionary Learning

Dmitriy Shopkhoev

Magauiya Zhussip

Stamatios Lefkimmiatis

240

3

0

26 Sep 2025

Understanding Post-Training Structural Changes in Large Language Models

Understanding Post-Training Structural Changes in Large Language Models

243

0

0

22 Sep 2025

RL Fine-Tuning Heals OOD Forgetting in SFT

RL Fine-Tuning Heals OOD Forgetting in SFT

Guillaume Rabusseau

Reihaneh Rabbany

Mohammad Hamdaqa

223

10

0

08 Sep 2025

CALR: Corrective Adaptive Low-Rank Decomposition for Efficient Large Language Model Layer Compression

CALR: Corrective Adaptive Low-Rank Decomposition for Efficient Large Language Model Layer Compression

Muchammad Daniyal Kautsar

Afra Majida Hariono

Syukron Abu Ishaq Alfarozi

Kuntpong Woraratpanya

197

0

0

21 Aug 2025

Importance-Aware Activation Space Reconstruction

Importance-Aware Activation Space Reconstruction

Md Mokarram Chowdhury

Daniel Agyei Asante

194

0

0

04 Jul 2025

TensorSLM: Energy-efficient Embedding Compression of Sub-billion Parameter Language Models on Low-end Devices

TensorSLM: Energy-efficient Embedding Compression of Sub-billion Parameter Language Models on Low-end Devices

216

0

0

16 Jun 2025

Dynamic Context-oriented Decomposition for Task-aware Low-rank Adaptation with Less Forgetting and Faster Convergence

Dynamic Context-oriented Decomposition for Task-aware Low-rank Adaptation with Less Forgetting and Faster Convergence

Ming-Hsuan Yang

348

5

0

16 Jun 2025

ReCalKV: Low-Rank KV Cache Compression via Head Reordering and Offline Calibration

ReCalKV: Low-Rank KV Cache Compression via Head Reordering and Offline Calibration

554

4

0

30 May 2025

LittleBit: Ultra Low-Bit Quantization via Latent Factorization

LittleBit: Ultra Low-Bit Quantization via Latent Factorization

326

10

0

30 May 2025

Mustafar: Promoting Unstructured Sparsity for KV Cache Pruning in LLM Inference

Mustafar: Promoting Unstructured Sparsity for KV Cache Pruning in LLM Inference

315

2

0

28 May 2025

Efficient Large Language Model Inference with Neural Block Linearization

Efficient Large Language Model Inference with Neural Block Linearization

430

1

0

27 May 2025

TuneComp: Joint Fine-tuning and Compression for Large Foundation Models

TuneComp: Joint Fine-tuning and Compression for Large Foundation Models

287

0

0

27 May 2025

Multi-objective Large Language Model Alignment with Hierarchical Experts

Multi-objective Large Language Model Alignment with Hierarchical Experts

...

414

4

0

27 May 2025

ResSVD: Residual Compensated SVD for Large Language Model Compression

ResSVD: Residual Compensated SVD for Large Language Model Compression

410

5

0

26 May 2025

Can Compressed LLMs Truly Act? An Empirical Evaluation of Agentic Capabilities in LLM Compression

Can Compressed LLMs Truly Act? An Empirical Evaluation of Agentic Capabilities in LLM Compression

533

14

0

26 May 2025

Tensorization is a powerful but underexplored tool for compression and interpretability of neural networks

Tensorization is a powerful but underexplored tool for compression and interpretability of neural networks

Sukhbinder Singh

438

1

0

26 May 2025

$μ$-MoE: Test-Time Pruning as Micro-Grained Mixture-of-Experts

μ

-MoE: Test-Time Pruning as Micro-Grained Mixture-of-Experts

270

2

0

24 May 2025

LatentLLM: Attention-Aware Joint Tensor Compression

LatentLLM: Attention-Aware Joint Tensor Compression

281

4

0

23 May 2025

A3 : an Analytical Low-Rank Approximation Framework for Attention

A3 : an Analytical Low-Rank Approximation Framework for Attention

Jeffrey T. H. Wong

George A. Constantinides

456

4

0

19 May 2025

Accelerating Diffusion Transformer via Increment-Calibrated Caching with Channel-Aware Singular Value Decomposition

Accelerating Diffusion Transformer via Increment-Calibrated Caching with Channel-Aware Singular Value DecompositionComputer Vision and Pattern Recognition (CVPR), 2025

364

8

0

09 May 2025

Diffusion Model Quantization: A Review

Diffusion Model Quantization: A Review

504

4

0

08 May 2025

Beyond Low-rank Decomposition: A Shortcut Approach for Efficient On-Device Learning

Beyond Low-rank Decomposition: A Shortcut Approach for Efficient On-Device Learning

Le-Trung Nguyen

Enzo Tartaglione

448

5

0

08 May 2025

Position: Enough of Scaling LLMs! Lets Focus on Downscaling

Position: Enough of Scaling LLMs! Lets Focus on Downscaling

Tanmoy Chakraborty

517

6

0

02 May 2025

MiLo: Efficient Quantized MoE Inference with Mixture of Low-Rank Compensators

MiLo: Efficient Quantized MoE Inference with Mixture of Low-Rank Compensators

487

2

0

03 Apr 2025

Large Language Model Compression via the Nested Activation-Aware Decomposition

Large Language Model Compression via the Nested Activation-Aware Decomposition

265

1

0

21 Mar 2025

CASP: Compression of Large Multimodal Models Based on Attention Sparsity

CASP: Compression of Large Multimodal Models Based on Attention SparsityComputer Vision and Pattern Recognition (CVPR), 2025

Mohammad Akbari

360

4

0

07 Mar 2025

Universality of Layer-Level Entropy-Weighted Quantization Beyond Model Architecture and Size

Universality of Layer-Level Entropy-Weighted Quantization Beyond Model Architecture and Size

Alireza Behtash

Marijan Fofonjka

Hossein Moghimifam

487

4

0

06 Mar 2025

Delta Decompression for MoE-based LLMs Compression

Delta Decompression for MoE-based LLMs Compression

410

28

0

24 Feb 2025

Benchmarking Post-Training Quantization in LLMs: Comprehensive Taxonomy, Unified Evaluation, and Comparative Analysis

Benchmarking Post-Training Quantization in LLMs: Comprehensive Taxonomy, Unified Evaluation, and Comparative Analysis

746

6

0

18 Feb 2025

Choose Your Model Size: Any Compression of Large Language Models Without Re-Computation

Choose Your Model Size: Any Compression of Large Language Models Without Re-Computation

Mattes Mollenhauer

Thomas Wollmann

320

0

0

03 Feb 2025

Progressive Binarization with Semi-Structured Pruning for LLMs

Progressive Binarization with Semi-Structured Pruning for LLMs

680

5

0

03 Feb 2025

Implicit Bias in Matrix Factorization and its Explicit Realization in a New Architecture

Implicit Bias in Matrix Factorization and its Explicit Realization in a New Architecture

388

0

0

27 Jan 2025

Page 1 of 2