Fantastic Semantics and Where to Find Them: Investigating Which Layers
of Generative LLMs Reflect Lexical Semantics

Fantastic Semantics and Where to Find Them: Investigating Which Layers of Generative LLMs Reflect Lexical Semantics

3 March 2024

Maosong Sun

Papers citing "Fantastic Semantics and Where to Find Them: Investigating Which Layers of Generative LLMs Reflect Lexical Semantics"

11 / 11 papers shown

Title
SEAL: Steerable Reasoning Calibration of Large Language Models for Free Runjin Chen Zhenyu (Allen) Zhang Junyuan Hong Souvik Kundu Zhangyang Wang OffRL LRM 47 2 0 07 Apr 2025
Beyond Prompting: An Efficient Embedding Framework for Open-Domain Question Answering Zhanghao Hu Hanqi Yan Qingling Zhu Zhenyi Shen Yulan He Lin Gui RALM 34 0 0 03 Mar 2025
Sparse Auto-Encoder Interprets Linguistic Features in Large Language Models Yi Jing Zijun Yao Lingxu Ran Hongzhu Guo Xiaozhi Wang Lei Hou Juanzi Li 47 0 0 27 Feb 2025
The Representation and Recall of Interwoven Structured Knowledge in LLMs: A Geometric and Layered Analysis Ge Lei Samuel J. Cooper KELM 44 0 0 15 Feb 2025
Emergent effects of scaling on the functional hierarchies within large language models Paul C. Bogdan 79 0 0 13 Jan 2025
Token Prepending: A Training-Free Approach for Eliciting Better Sentence Embeddings from LLMs Yuchen Fu Zifeng Cheng Zhiwei Jiang Zhonghui Wang Yafeng Yin Zhengliang Li Qing Gu LLMAG 72 0 0 16 Dec 2024
Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 small Kevin Wang Alexandre Variengien Arthur Conmy Buck Shlegeris Jacob Steinhardt 210 486 0 01 Nov 2022
In-context Learning and Induction Heads Catherine Olsson Nelson Elhage Neel Nanda Nicholas Joseph Nova Dassarma ... Tom B. Brown Jack Clark Jared Kaplan Sam McCandlish C. Olah 240 453 0 24 Sep 2022
Scalar Adjective Identification and Multilingual Ranking Aina Garí Soler Marianna Apidianaki 13 6 0 03 May 2021
The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectives Elena Voita Rico Sennrich Ivan Titov 182 181 0 03 Sep 2019
Language Models as Knowledge Bases? Fabio Petroni Tim Rocktaschel Patrick Lewis A. Bakhtin Yuxiang Wu Alexander H. Miller Sebastian Riedel KELM AI4MH 393 2,216 0 03 Sep 2019