ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2505.18752
  4. Cited By
Unifying Attention Heads and Task Vectors via Hidden State Geometry in In-Context Learning
v1v2 (latest)

Unifying Attention Heads and Task Vectors via Hidden State Geometry in In-Context Learning

24 May 2025
Haolin Yang
Hakaze Cho
Yiqiao Zhong
Naoya Inoue
ArXiv (abs)PDFHTMLGithub

Papers citing "Unifying Attention Heads and Task Vectors via Hidden State Geometry in In-Context Learning"

6 / 6 papers shown
Localizing Task Recognition and Task Learning in In-Context Learning via Attention Head Analysis
Localizing Task Recognition and Task Learning in In-Context Learning via Attention Head Analysis
Haolin Yang
Hakaze Cho
Naoya Inoue
116
0
0
29 Sep 2025
Task Vectors, Learned Not Extracted: Performance Gains and Mechanistic Insight
Task Vectors, Learned Not Extracted: Performance Gains and Mechanistic Insight
Haolin Yang
Hakaze Cho
Kaize Ding
Naoya Inoue
186
0
0
29 Sep 2025
The Geometry of Prompting: Unveiling Distinct Mechanisms of Task Adaptation in Language Models
The Geometry of Prompting: Unveiling Distinct Mechanisms of Task Adaptation in Language ModelsNorth American Chapter of the Association for Computational Linguistics (NAACL), 2025
Artem Kirsanov
Chi-Ning Chou
Kyunghyun Cho
SueYeon Chung
AI4CE
196
10
0
11 Feb 2025
Out-of-distribution generalization via composition: a lens through induction heads in Transformers
Out-of-distribution generalization via composition: a lens through induction heads in TransformersProceedings of the National Academy of Sciences of the United States of America (PNAS), 2024
Jiajun Song
Zhuoyan Xu
Yiqiao Zhong
358
19
0
31 Dec 2024
Wrong-of-Thought: An Integrated Reasoning Framework with
  Multi-Perspective Verification and Wrong Information
Wrong-of-Thought: An Integrated Reasoning Framework with Multi-Perspective Verification and Wrong InformationConference on Empirical Methods in Natural Language Processing (EMNLP), 2024
Yongheng Zhang
Qiguang Chen
Jingxuan Zhou
Peng Wang
Jiasheng Si
Jin Wang
Wenpeng Lu
Libo Qin
LRM
368
11
0
06 Oct 2024
Token-based Decision Criteria Are Suboptimal in In-context Learning
Token-based Decision Criteria Are Suboptimal in In-context Learning
Hakaze Cho
Yoshihiro Sakai
Mariko Kato
Kenshiro Tanaka
Akira Ishii
Naoya Inoue
502
6
0
24 Jun 2024
1