Investigating semantic subspaces of Transformer sentence embeddings through linear structural probing

18 October 2023

Papers citing "Investigating semantic subspaces of Transformer sentence embeddings through linear structural probing"

8 / 8 papers shown

Title
Statistical Deficiency for Task Inclusion Estimation Loïc Fosse Frédéric Béchet Benoit Favre Géraldine Damnati Gwénolé Lecorvé Maxime Darrin Philippe Formont Pablo Piantanida 94 0 0 07 Mar 2025
Emergent effects of scaling on the functional hierarchies within large language models Paul C. Bogdan 85 0 0 13 Jan 2025
Transformer Normalisation Layers and the Independence of Semantic Subspaces S. Menary Samuel Kaski Andre Freitas 41 2 0 25 Jun 2024
Are there identifiable structural parts in the sentence embedding whole? Vivi Nastase Paola Merlo 25 3 0 24 Jun 2024
Estimating Knowledge in Large Language Models Without Generating a Single Token Daniela Gottesman Mor Geva 37 10 0 18 Jun 2024
All Bark and No Bite: Rogue Dimensions in Transformer Language Models Obscure Representational Quality William Timkey Marten van Schijndel 213 110 0 09 Sep 2021
BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models Nandan Thakur Nils Reimers Andreas Rucklé Abhishek Srivastava Iryna Gurevych VLM 229 961 0 17 Apr 2021
Probing Classifiers: Promises, Shortcomings, and Advances Yonatan Belinkov 224 402 0 24 Feb 2021