minicons: Enabling Flexible Behavioral and Representational Analyses of Transformer Language Models

24 March 2022

Papers citing "minicons: Enabling Flexible Behavioral and Representational Analyses of Transformer Language Models"

34 / 34 papers shown

Title
Investigating Syntactic Biases in Multilingual Transformers with RC Attachment Ambiguities in Italian and English Michael Kamerath Aniello De Santo 19 0 0 14 Apr 2025
Findings of the BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corpora Alex Warstadt Aaron Mueller Leshem Choshen E. Wilcox Chengxu Zhuang ... Rafael Mosquera Bhargavi Paranjape Adina Williams Tal Linzen Ryan Cotterell 35 106 0 10 Apr 2025
Both Direct and Indirect Evidence Contribute to Dative Alternation Preferences in Language Models Qing Yao Kanishka Misra Leonie Weissweiler Kyle Mahowald 43 0 0 26 Mar 2025
SPACER: A Parallel Dataset of Speech Production And Comprehension of Error Repairs Shiva Upadhye Jiaxuan Li Richard Futrell 31 0 0 20 Mar 2025
Language Models Fail to Introspect About Their Knowledge of Language Siyuan Song Jennifer Hu Kyle Mahowald LRM KELM HILM ELM 79 2 0 10 Mar 2025
All-in-one: Understanding and Generation in Multimodal Reasoning with the MAIA Benchmark Davide Testa Giovanni Bonetta Raffaella Bernardi Alessandro Bondielli Alessandro Lenci Alessio Miaschi Lucia Passaro Bernardo Magnini VGen LRM 50 0 0 24 Feb 2025
Language Models Largely Exhibit Human-like Constituent Ordering Preferences Ada Defne Tur Gaurav Kamath Siva Reddy 57 0 0 08 Feb 2025
Findings of the Second BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corpora Michael Y. Hu Aaron Mueller Candace Ross Adina Williams Tal Linzen Chengxu Zhuang Ryan Cotterell Leshem Choshen Alex Warstadt Ethan Gotlieb Wilcox 91 7 0 06 Dec 2024
A Psycholinguistic Evaluation of Language Models' Sensitivity to Argument Roles Eun-Kyoung Rosa Lee Sathvik Nair Naomi Feldman 45 4 0 21 Oct 2024
Teaching Models to Balance Resisting and Accepting Persuasion Elias Stengel-Eskin Peter Hase Mohit Bansal MU 29 4 0 18 Oct 2024
Models Can and Should Embrace the Communicative Nature of Human-Generated Math Sasha Boguraev Ben Lipkin Leonie Weissweiler Kyle Mahowald 41 1 0 25 Sep 2024
ProGRes: Prompted Generative Rescoring on ASR n-Best Ada Defne Tur Adel Moumen Mirco Ravanelli 26 1 0 30 Aug 2024
Reasoning Beyond Bias: A Study on Counterfactual Prompting and Chain of Thought Reasoning Kyle Moore Jesse Roberts Thao Pham Douglas H. Fisher LRM 25 1 0 16 Aug 2024
Generating novel experimental hypotheses from language models: A case study on cross-dative generalization Kanishka Misra Najoung Kim 23 3 0 09 Aug 2024
Large Language Model Recall Uncertainty is Modulated by the Fan Effect Jesse Roberts Kyle Moore Thao Pham Oseremhen Ewaleifoh Doug Fisher 34 3 0 08 Jul 2024
The Base-Rate Effect on LLM Benchmark Performance: Disambiguating Test-Taking Strategies from Benchmark Performance Kyle Moore Jesse Roberts Thao Pham Oseremhen Ewaleifoh Doug Fisher 37 2 0 17 Jun 2024
Superlatives in Context: Explicit and Implicit Domain Restrictions for Superlative Frames Valentina Pyatkin Bonnie Webber Ido Dagan Reut Tsarfaty ELM AILaw 18 0 0 31 May 2024
Scope Ambiguities in Large Language Models Gaurav Kamath Sebastian Schuster Sowmya Vajjala Siva Reddy 27 2 0 05 Apr 2024
BEAR: A Unified Framework for Evaluating Relational Knowledge in Causal and Masked Language Models Hongyu Lin Alexis Conneau Alan Akbik 30 5 0 05 Apr 2024
Robust Pronoun Fidelity with English LLMs: Are they Reasoning, Repeating, or Just Biased? Vagrant Gautam Eileen Bingert D. Zhu Anne Lauscher Dietrich Klakow 38 8 0 04 Apr 2024
Auxiliary task demands mask the capabilities of smaller language models Jennifer Hu Michael C. Frank ELM 21 25 0 03 Apr 2024
Large Language Models are Capable of Offering Cognitive Reappraisal, if Guided Hongli Zhan Allen Zheng Yoon Kyung Lee Jina Suh Junyi Jessy Li Desmond C. Ong AI4MH 33 8 0 01 Apr 2024
Language Models Learn Rare Phenomena from Less Rare Phenomena: The Case of the Missing AANNs Kanishka Misra Kyle Mahowald 19 22 0 28 Mar 2024
Experimental Contexts Can Facilitate Robust Semantic Property Inference in Language Models, but Inconsistently Kanishka Misra Allyson Ettinger Kyle Mahowald 8 4 0 12 Jan 2024
A Better Way to Do Masked Language Model Scoring Carina Kauf Anna A. Ivanova 29 21 0 17 May 2023
Language Model Behavior: A Comprehensive Survey Tyler A. Chang Benjamin Bergen VLM LRM LM&MA 27 100 0 20 Mar 2023
Language model acceptability judgements are not always robust to context Koustuv Sinha Jon Gauthier Aaron Mueller Kanishka Misra Keren Fuentes R. Levy Adina Williams 6 17 0 18 Dec 2022
The Curious Case of Absolute Position Embeddings Koustuv Sinha Amirhossein Kazemnejad Siva Reddy J. Pineau Dieuwke Hupkes Adina Williams 75 15 0 23 Oct 2022
"No, they did not": Dialogue response dynamics in pre-trained language models Sanghee Kim Lang-Chi Yu Allyson Ettinger 13 1 0 05 Oct 2022
COMPS: Conceptual Minimal Pair Sentences for testing Robust Property Knowledge and its Inheritance in Pre-trained Language Models Kanishka Misra Julia Taylor Rayz Allyson Ettinger 17 10 0 05 Oct 2022
Towards Zero-shot Commonsense Reasoning with Self-supervised Refinement of Language Models T. Klein Moin Nabi ReLM LRM 27 8 0 10 Sep 2021
The Pile: An 800GB Dataset of Diverse Text for Language Modeling Leo Gao Stella Biderman Sid Black Laurence Golding Travis Hoppe ... Horace He Anish Thite Noa Nabeshima Shawn Presser Connor Leahy AIMat 245 1,977 0 31 Dec 2020
Language Models as Knowledge Bases? Fabio Petroni Tim Rocktaschel Patrick Lewis A. Bakhtin Yuxiang Wu Alexander H. Miller Sebastian Riedel KELM AI4MH 396 2,576 0 03 Sep 2019
What you can cram into a single vector: Probing sentence embeddings for linguistic properties Alexis Conneau Germán Kruszewski Guillaume Lample Loïc Barrault Marco Baroni 199 876 0 03 May 2018