Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
1909.07521
Cited By
v1
v2 (latest)
Probing Natural Language Inference Models through Semantic Fragments
AAAI Conference on Artificial Intelligence (AAAI), 2019
16 September 2019
Kyle Richardson
Hai Hu
L. Moss
Ashish Sabharwal
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Probing Natural Language Inference Models through Semantic Fragments"
50 / 92 papers shown
Natural Language Satisfiability: Exploring the Problem Distribution and Evaluating Transformer-based Language Models
Annual Meeting of the Association for Computational Linguistics (ACL), 2025
Tharindu Madusanka
Ian Pratt-Hartmann
Riza Batista-Navarro
LRM
111
2
0
23 Aug 2025
Linguistic Interpretability of Transformer-based Language Models: a systematic review
Miguel López-Otal
Jorge Gracia
Jordi Bernad
Carlos Bobed
Lucía Pitarch-Ballesteros
Emma Anglés-Herrero
VLM
381
8
0
09 Apr 2025
Logic Haystacks: Probing LLMs Long-Context Logical Reasoning (Without Easily Identifiable Unrelated Padding)
Damien Sileo
RALM
LRM
285
1
0
24 Feb 2025
Exploring Reasoning Biases in Large Language Models Through Syllogism: Insights from the NeuBAROCO Dataset
Annual Meeting of the Association for Computational Linguistics (ACL), 2024
Kentaro Ozeki
Risako Ando
Takanobu Morishita
Hirohiko Abe
K. Mineshima
Mitsuhiro Okada
LRM
214
10
0
08 Aug 2024
Scaling Synthetic Logical Reasoning Datasets with Context-Sensitive Declarative Grammars
Damien Sileo
LRM
ReLM
299
5
0
16 Jun 2024
Scope Ambiguities in Large Language Models
Gaurav Kamath
Sebastian Schuster
Sowmya Vajjala
Siva Reddy
273
19
0
05 Apr 2024
Estimating the Causal Effects of Natural Logic Features in Transformer-Based NLI Models
International Conference on Language Resources and Evaluation (LREC), 2024
Julia Rozanova
Marco Valentino
André Freitas
CML
226
1
0
03 Apr 2024
Enhancing Robustness in Biomedical NLI Models: A Probing Approach for Clinical Trials
Ata Mustafa
AAML
135
0
0
04 Feb 2024
Textual Entailment for Effective Triple Validation in Object Prediction
Andrés García-Silva
Cristian Berrío
José Manuél Gómez-Pérez
KELM
186
1
0
29 Jan 2024
Semantic Sensitivities and Inconsistent Predictions: Measuring the Fragility of NLI Models
Conference of the European Chapter of the Association for Computational Linguistics (EACL), 2024
Erik Arakelyan
Zhaoqi Liu
Isabelle Augenstein
AAML
351
16
0
25 Jan 2024
Pragmatic Reasoning Unlocks Quantifier Semantics for Foundation Models
Yiyuan Li
Rakesh R Menon
Sayan Ghosh
Shashank Srivastava
LRM
203
2
0
08 Nov 2023
OYXOY: A Modern NLP Test Suite for Modern Greek
Findings (Findings), 2023
Konstantinos Kogkalidis
S. Chatzikyriakidis
Eirini Chrysovalantou Giannikouri
Vassiliki Katsouli
Christina Klironomou
...
Dimitris Papadakis
Thelka Pasparaki
Erofili Psaltaki
E. Sakellariou
Hara Soupiona
183
0
0
13 Sep 2023
Learning Deductive Reasoning from Synthetic Corpus based on Formal Logic
International Conference on Machine Learning (ICML), 2023
Terufumi Morishita
Gaku Morio
Atsuki Yamaguchi
Yasuhiro Sogawa
ReLM
LRM
AI4CE
ELM
262
41
0
11 Aug 2023
Synthetic Dataset for Evaluating Complex Compositional Knowledge for Natural Language Inference
Sushma A. Akoju
Robert Vacareanu
Haris Riaz
Eduardo Blanco
Mihai Surdeanu
CoGe
NAI
199
1
0
11 Jul 2023
NatLogAttack: A Framework for Attacking Natural Language Inference Models with Natural Logic
Annual Meeting of the Association for Computational Linguistics (ACL), 2023
Zióu Zheng
Xiao-Dan Zhu
AAML
LRM
319
6
0
06 Jul 2023
SpaceNLI: Evaluating the Consistency of Predicting Inferences in Space
Lasha Abzianidze
J. Zwarts
Yoad Winter
156
4
0
05 Jul 2023
Evaluating Paraphrastic Robustness in Textual Entailment Models
Annual Meeting of the Association for Computational Linguistics (ACL), 2023
Dhruv Verma
Yash Kumar Lal
Shreyashee Sinha
Benjamin Van Durme
Adam Poliak
334
7
0
29 Jun 2023
Evaluating Large Language Models with NeuBAROCO: Syllogistic Reasoning Ability and Human-like Biases
Risako Ando
Takanobu Morishita
Hirohiko Abe
K. Mineshima
Mitsuhiro Okada
LRM
ELM
224
18
0
21 Jun 2023
Jamp: Controlled Japanese Temporal Inference Dataset for Evaluating Generalization Capacity of Language Models
Annual Meeting of the Association for Computational Linguistics (ACL), 2023
Tomoki Sugimoto
Yasumasa Onoe
Hitomi Yanaka
221
7
0
19 Jun 2023
ScoNe: Benchmarking Negation Reasoning in Language Models With Fine-Tuning and In-Context Learning
Annual Meeting of the Association for Computational Linguistics (ACL), 2023
Jingyuan Selena She
Christopher Potts
Sam Bowman
Atticus Geiger
303
22
0
30 May 2023
Estimating the Causal Effects of Natural Logic Features in Neural NLI Models
Julia Rozanova
Marco Valentino
André Freitas
CML
174
4
0
15 May 2023
Do Transformers Parse while Predicting the Masked Word?
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Haoyu Zhao
A. Panigrahi
Rong Ge
Sanjeev Arora
341
42
0
14 Mar 2023
Does Deep Learning Learn to Abstract? A Systematic Probing Framework
International Conference on Learning Representations (ICLR), 2023
Shengnan An
Zeqi Lin
B. Chen
Qiang Fu
Nanning Zheng
Jian-Guang Lou
228
6
0
23 Feb 2023
On Measuring the Intrinsic Few-Shot Hardness of Datasets
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Xinran Zhao
Shikhar Murty
Christopher D. Manning
201
5
0
16 Nov 2022
Breakpoint Transformers for Modeling and Tracking Intermediate Beliefs
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Kyle Richardson
Ronen Tamari
Oren Sultan
Reut Tsarfaty
Dafna Shahaf
Ashish Sabharwal
KELM
367
9
0
15 Nov 2022
Can Transformers Reason in Fragments of Natural Language?
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Viktor Schlegel
Kamen V. Pavlov
Ian Pratt-Hartmann
LRM
ReLM
199
9
0
10 Nov 2022
Probing neural language models for understanding of words of estimative probability
Damien Sileo
Marie-Francine Moens
230
13
0
07 Nov 2022
TestAug: A Framework for Augmenting Capability-based NLP Tests
International Conference on Computational Linguistics (COLING), 2022
Guanqun Yang
Mirazul Haque
Qiaochu Song
Wei Yang
Xueqing Liu
ELM
195
0
0
14 Oct 2022
Understanding Prior Bias and Choice Paralysis in Transformer-based Language Representation Models through Four Experimental Probes
Ke Shen
Mayank Kejriwal
197
4
0
03 Oct 2022
Benchmarking Learning Efficiency in Deep Reservoir Computing
Hugo Cisneros
Josef Sivic
Tomas Mikolov
144
5
0
29 Sep 2022
Negation, Coordination, and Quantifiers in Contextualized Language Models
International Conference on Computational Linguistics (COLING), 2022
A. Kalouli
Rita Sevastjanova
C. Beck
Maribel Romero
245
14
0
16 Sep 2022
Visual Comparison of Language Model Adaptation
IEEE Transactions on Visualization and Computer Graphics (TVCG), 2022
Rita Sevastjanova
E. Cakmak
Haiqin Yang
Robert Bamler
Mennatallah El-Assady
VLM
261
20
0
17 Aug 2022
Multi-Step Deductive Reasoning Over Natural Language: An Empirical Study on Out-of-Distribution Generalisation
International Workshop on Neural-Symbolic Learning and Reasoning (NeSy), 2022
Qiming Bao
A. Peng
Tim Hartill
N. Tan
Zhenyun Deng
Michael Witbrock
Jiamou Liu
ReLM
OOD
NAI
LRM
534
17
0
28 Jul 2022
Logical Inference for Counting on Semi-structured Tables
Annual Meeting of the Association for Computational Linguistics (ACL), 2022
Tomoya Kurosawa
Hitomi Yanaka
LMTD
175
2
0
16 Apr 2022
Curriculum: A Broad-Coverage Benchmark for Linguistic Phenomena in Natural Language Understanding
North American Chapter of the Association for Computational Linguistics (NAACL), 2022
Zeming Chen
Qiyue Gao
ELM
265
5
0
13 Apr 2022
Neuro-symbolic Natural Logic with Introspective Revision for Natural Language Inference
Transactions of the Association for Computational Linguistics (TACL), 2022
Yufei Feng
Xiaoyu Yang
Xiao-Dan Zhu
Michael A. Greenspan
LRM
NAI
393
14
0
09 Mar 2022
Logical Reasoning for Task Oriented Dialogue Systems
Sajjad Beygi
Maryam Fazel-Zarandi
Alessandra Cervone
Prakash Krishnan
Siddhartha Reddy Jonnalagadda
LRM
218
7
0
08 Feb 2022
Uncovering More Shallow Heuristics: Probing the Natural Language Inference Capacities of Transformer-Based Pre-Trained Language Models Using Syllogistic Patterns
Reto Gubelmann
Siegfried Handschuh
ReLM
LRM
209
6
0
19 Jan 2022
Polish Natural Language Inference and Factivity -- an Expert-based Dataset and Benchmarks
Natural Language Engineering (NLE), 2022
Daniel Ziembicki
Anna Wróblewska
Karolina Seweryn
162
1
0
10 Jan 2022
Pushing the Limits of Rule Reasoning in Transformers through Natural Language Satisfiability
Kyle Richardson
Ashish Sabharwal
ReLM
LRM
252
28
0
16 Dec 2021
Decomposing Natural Logic Inferences in Neural NLI
Julia Rozanova
Deborah Ferreira
Marco Valentino
Mokanrarangan Thayaparan
André Freitas
NAI
LRM
201
5
0
15 Dec 2021
Quantifying Adaptability in Pre-trained Language Models with 500 Tasks
North American Chapter of the Association for Computational Linguistics (NAACL), 2021
Belinda Z. Li
Jane A. Yu
Madian Khabsa
Luke Zettlemoyer
A. Halevy
Jacob Andreas
ELM
216
18
0
06 Dec 2021
LoNLI: An Extensible Framework for Testing Diverse Logical Reasoning Capabilities for NLI
Language Resources and Evaluation (LRE), 2021
Ishan Tarunesh
Somak Aditya
Monojit Choudhury
ELM
LRM
184
4
0
04 Dec 2021
Dyna-bAbI: unlocking bAbI's potential with dynamic synthetic benchmarking
Ronen Tamari
Kyle Richardson
Aviad Sar-Shalom
Noam Kahlon
Nelson F. Liu
Reut Tsarfaty
Dafna Shahaf
354
6
0
30 Nov 2021
IndoNLI: A Natural Language Inference Dataset for Indonesian
Rahmad Mahendra
Alham Fikri Aji
Samuel Louvan
Fahrurrozi Rahman
Clara Vania
229
40
0
27 Oct 2021
A Logic-Based Framework for Natural Language Inference in Dutch
Lasha Abzianidze
Konstantinos Kogkalidis
288
4
0
07 Oct 2021
Analyzing the Effects of Reasoning Types on Cross-Lingual Transfer Performance
Karthikeyan K
Aalok Sathe
Somak Aditya
Monojit Choudhury
LRM
179
10
0
05 Oct 2021
Abstraction, Reasoning and Deep Learning: A Study of the "Look and Say" Sequence
Wlodek Zadrozny
125
2
0
27 Sep 2021
BERT Has Uncommon Sense: Similarity Ranking for Word Sense BERTology
Luke Gessler
Nathan Schneider
179
9
0
20 Sep 2021
Commonsense-Focused Dialogues for Response Generation: An Empirical Study
Pei Zhou
Karthik Gopalakrishnan
Behnam Hedayatnia
Seokhwan Kim
Jay Pujara
Xiang Ren
Yang Liu
Dilek Z. Hakkani-Tür
LRM
162
50
0
14 Sep 2021
1
2
Next
Page 1 of 2
