0

ASA: Activation Steering for Tool-Calling Domain Adaptation

Youjin Wang
Run Zhou
Rong Fu
Shuaishuai Cao
Hongwei Zeng
Jiaxuan Lu
Sicheng Fan
Jiaqiao Zhao
Liangming Pan
Main:8 Pages
9 Figures
Bibliography:2 Pages
21 Tables
Appendix:11 Pages
Abstract

For real-world deployment of general-purpose LLM agents, the core challenge is often not tool use itself, but efficient domain adaptation under rapidly evolving toolsets, APIs, and protocols. Repeated LoRA or SFT across domains incurs exponentially growing training and maintenance costs, while prompt or schema methods are brittle under distribution shift and complex interfaces. We propose \textbf{Activation Steering Adapter (ASA}), a lightweight, inference-time, training-free mechanism that reads routing signals from intermediate activations and uses an ultra-light router to produce adaptive control strengths for precise domain alignment. Across multiple model scales and domains, ASA achieves LoRA-comparable adaptation with substantially lower overhead and strong cross-model transferability, making it ideally practical for robust, scalable, and efficient multi-domain tool ecosystems with frequent interface churn dynamics.

View on arXiv
Comments on this paper