Discourse Probing of Pretrained Language Models

13 April 2021

Papers citing "Discourse Probing of Pretrained Language Models"

30 / 30 papers shown

Title
Geospatial Mechanistic Interpretability of Large Language Models Stef De Sabbata Stefano Mizzaro Kevin Roitero AI4CE 138 0 0 06 May 2025
Linguistic Interpretability of Transformer-based Language Models: a systematic review Miguel López-Otal Jorge Gracia Jordi Bernad Carlos Bobed Lucía Pitarch-Ballesteros Emma Anglés-Herrero VLM 113 1 0 09 Apr 2025
Probing LLMs for Multilingual Discourse Generalization Through a Unified Label Set Florian Eichin Yang Liu Yun Xue Michael A. Hedderich 135 0 0 13 Mar 2025
A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethics Kai He Rui Mao Qika Lin Yucheng Ruan Xiang Lan Mengling Feng Min Zhang LM&MA AILaw 234 177 0 28 Jan 2025
Probing Omissions and Distortions in Transformer-based RDF-to-Text Models J. Faille Albert Gatt Claire Gardent 84 0 0 25 Sep 2024
To Drop or Not to Drop? Predicting Argument Ellipsis Judgments: A Case Study in Japanese Yukiko Ishizuki Tatsuki Kuribayashi Yuichiroh Matsubayashi Ryohei Sasano Kentaro Inui 112 2 0 17 Apr 2024
Probing Multimodal Large Language Models for Global and Local Semantic Representations Mingxu Tao Quzhe Huang Kun Xu Liwei Chen Yansong Feng Dongyan Zhao 84 5 0 27 Feb 2024
Unlocking Structure Measuring: Introducing PDD, an Automatic Metric for Positional Discourse Coherence Yinhong Liu Yixuan Su Ehsan Shareghi Nigel Collier 89 4 0 15 Feb 2024
Dive into the Chasm: Probing the Gap between In- and Cross-Topic Generalization Andreas Waldis Yufang Hou Iryna Gurevych ELM 75 8 0 02 Feb 2024
Pit One Against Many: Leveraging Attention-head Embeddings for Parameter-efficient Multi-head Attention Huiyin Xue Nikolaos Aletras 115 0 0 11 Oct 2023
How Does Pretraining Improve Discourse-Aware Translation? Zhihong Huang Longyue Wang Siyou Liu Derek F. Wong 83 1 0 31 May 2023
Large Language Models Are Partially Primed in Pronoun Interpretation S. Lam Qingcheng Zeng Kexun Zhang Chenyu You Rob Voigt 57 4 0 26 May 2023
Incorporating Distributions of Discourse Structure for Long Document Abstractive Summarization Dongqi Pu Yifa Wang Vera Demberg 93 23 0 26 May 2023
A Survey on Zero Pronoun Translation Longyue Wang Siyou Liu Mingzhou Xu Linfeng Song Shuming Shi Zhaopeng Tu 72 10 0 17 May 2023
Which One Are You Referring To? Multimodal Object Identification in Situated Dialogue Holy Lovenia Samuel Cahyawijaya Pascale Fung 55 1 0 28 Feb 2023
Discourse Structure Extraction from Pre-Trained and Fine-Tuned Language Models in Dialogues Chuyuan Li Patrick Huber Wen Xiao M. Amblard Chloé Braud Giuseppe Carenini 58 8 0 12 Feb 2023
SocioProbe: What, When, and Where Language Models Learn about Sociodemographics Anne Lauscher Federico Bianchi Samuel R. Bowman Dirk Hovy 93 7 0 08 Nov 2022
Universal and Independent: Multilingual Probing Framework for Exhaustive Model Interpretation and Evaluation O. Serikov Vitaly Protasov E. Voloshina V. Knyazkova Tatiana Shavrina 77 3 0 24 Oct 2022
Probing with Noise: Unpicking the Warp and Weft of Embeddings Filip Klubicka John D. Kelleher 78 4 0 21 Oct 2022
Towards Domain-Independent Supervised Discourse Parsing Through Gradient Boosting Patrick Huber Giuseppe Carenini 54 0 0 18 Oct 2022
SimSCOOD: Systematic Analysis of Out-of-Distribution Generalization in Fine-tuned Source Code Models Hossein Hajipour Ning Yu Cristian-Alexandru Staicu Mario Fritz OODD 122 5 0 10 Oct 2022
"No, they did not": Dialogue response dynamics in pre-trained language models Sanghee Kim Lang-Chi Yu Allyson Ettinger 54 1 0 05 Oct 2022
Evaluation Benchmarks for Spanish Sentence Representations Vladimir Araujo Andrés Carvallo Souvik Kundu J. Canete Marcelo Mendoza Robert E. Mercer Felipe Bravo-Marquez Marie-Francine Moens Alvaro Soto ELM 64 10 0 15 Apr 2022
Towards Understanding Large-Scale Discourse Structures in Pre-Trained and Fine-Tuned Language Models Patrick Huber Giuseppe Carenini 76 11 0 08 Apr 2022
On the data requirements of probing Zining Zhu Jixuan Wang Bai Li Frank Rudzicz 69 5 0 25 Feb 2022
Probing Pretrained Models of Source Code Sergey Troshin Nadezhda Chirkova ELM 107 39 0 16 Feb 2022
DiscoScore: Evaluating Text Generation with BERT and Discourse Coherence Wei Zhao Michael Strube Steffen Eger 121 38 0 26 Jan 2022
Quantifying the Task-Specific Information in Text-Based Classifications Zining Zhu Aparna Balagopalan Marzyeh Ghassemi Frank Rudzicz 76 4 0 17 Oct 2021
Pre-trained Language Models in Biomedical Domain: A Systematic Survey Benyou Wang Qianqian Xie Jiahuan Pei Zhihong Chen Prayag Tiwari Zhao Li Jie Fu LM&MA AI4CE 154 171 0 11 Oct 2021
Pragmatic competence of pre-trained language models through the lens of discourse connectives Lalchand Pandia Yan Cong Allyson Ettinger 56 29 0 27 Sep 2021