We Need to Talk About Random Splits

We Need to Talk About Random Splits

1 May 2020

Anders Søgaard

Sebastian Ebert

Jasmijn Bastings

Katja Filippova

Papers citing "We Need to Talk About Random Splits"

17 / 17 papers shown

Title
Gaining More Insight into Neural Semantic Parsing with Challenging Benchmarks Xiao Zhang Chunliu Wang Rik van Noord Johan Bos 21 3 0 12 Apr 2024
Latent Feature-based Data Splits to Improve Generalisation Evaluation: A Hate Speech Detection Case Study Maike Zufle Verna Dankers Ivan Titov 17 0 0 16 Nov 2023
Examining the Limitations of Computational Rumor Detection Models Trained on Static Datasets Yida Mu Xingyi Song Kalina Bontcheva Nikolaos Aletras 22 3 0 20 Sep 2023
What's the Meaning of Superhuman Performance in Today's NLU? Simone Tedeschi Johan Bos T. Declerck Jan Hajic Daniel Hershcovich ... Simon Krek Steven Schockaert Rico Sennrich Ekaterina Shutova Roberto Navigli ELM LM&MA VLM ReLM LRM 24 26 0 15 May 2023
Predicting Long-Term Citations from Short-Term Linguistic Influence Sandeep Soni David Bamman Jacob Eisenstein 11 2 0 24 Oct 2022
Sequential Learning Of Neural Networks for Prequential MDL J. Bornschein Yazhe Li Marcus Hutter AI4TS 20 6 0 14 Oct 2022
Investigating data partitioning strategies for crosslinguistic low-resource ASR evaluation Zoey Liu J. Spence Emily Tucker Prudhommeaux 16 8 0 26 Aug 2022
What do we Really Know about State of the Art NER? Sowmya Vajjala Ramya Balasubramaniam 11 15 0 29 Apr 2022
You Are What You Write: Preserving Privacy in the Era of Large Language Models Richard Plant V. Giuffrida Dimitra Gkatzia PILM 15 19 0 20 Apr 2022
FairLex: A Multilingual Benchmark for Evaluating Fairness in Legal Text Processing Ilias Chalkidis Tommaso Pasini Shenmin Zhang Letizia Tomada Sebastian Felix Schwemer Anders Søgaard AILaw 27 54 0 14 Mar 2022
Data-driven Model Generalizability in Crosslinguistic Low-resource Morphological Segmentation Zoey Liu Emily Tucker Prudhommeaux 25 4 0 05 Jan 2022
Temporal Effects on Pre-trained Models for Language Processing Tasks Oshin Agarwal A. Nenkova VLM 12 52 0 24 Nov 2021
Randomness In Neural Network Training: Characterizing The Impact of Tooling Donglin Zhuang Xingyao Zhang S. Song Sara Hooker 12 75 0 22 Jun 2021
SemEval-2021 Task 1: Lexical Complexity Prediction Matthew Shardlow R. Evans Gustavo Henrique Paetzold Marcos Zampieri 14 96 0 01 Jun 2021
What you can cram into a single vector: Probing sentence embeddings for linguistic properties Alexis Conneau Germán Kruszewski Guillaume Lample Loïc Barrault Marco Baroni 199 879 0 03 May 2018
Six Challenges for Neural Machine Translation Philipp Koehn Rebecca Knowles AAML AIMat 208 1,205 0 12 Jun 2017
Effective Approaches to Attention-based Neural Machine Translation Thang Luong Hieu H. Pham Christopher D. Manning 214 7,687 0 17 Aug 2015