Leakage and the Reproducibility Crisis in ML-based Science

14 July 2022

Papers citing "Leakage and the Reproducibility Crisis in ML-based Science"

22 / 22 papers shown

Title
autrainer: A Modular and Extensible Deep Learning Toolkit for Computer Audition Tasks Simon Rampp Andreas Triantafyllopoulos M. Milling Björn Schuller 85 0 0 16 Dec 2024
Are Large Language Models Memorizing Bug Benchmarks? Daniel Ramos Claudia Mamede Kush Jain Paulo Canelas Catarina Gamboa Claire Le Goues PILM ELM 94 6 0 20 Nov 2024
Preictal Period Optimization for Deep Learning-Based Epileptic Seizure Prediction Petros Koutsouvelis Bartlomiej Chybowski Alfredo Gonzalez-Sulser Shima Abdullateef Javier Escudero 23 1 0 20 Jul 2024
Training on the Test Task Confounds Evaluation and Emergence Ricardo Dominguez-Olmedo Florian E. Dorner Moritz Hardt ELM 63 7 1 10 Jul 2024
From Model Performance to Claim: How a Change of Focus in Machine Learning Replicability Can Help Bridge the Responsibility Gap Tianqi Kou 32 0 0 19 Apr 2024
Data Authenticity, Consent, & Provenance for AI are all broken: what will it take to fix them? Shayne Longpre Robert Mahari Naana Obeng-Marnu William Brannon Tobin South Katy Gero Sandy Pentland Jad Kabbara 56 5 0 19 Apr 2024
Predicting Parkinson's disease trajectory using clinical and functional MRI features: a reproduction and replication study Elodie Germani Nikhil Baghwat Mathieu Dugré Rémi Gau A. Montillo Kevin Nguyen Andrzej Sokolowski Madeleine Sharp J B Poline Tristan Glatard 16 0 0 20 Feb 2024
Producing Plankton Classifiers that are Robust to Dataset Shift Cheng Chen S. Kyathanahally Marta Reyes Stefanie Merkli E. Merz Emanuele Francazi Marvin Hoege F. Pomati M. Baity-Jesi 16 2 0 25 Jan 2024
Does Pre-trained Language Model Actually Infer Unseen Links in Knowledge Graph Completion? Yusuke Sakai Hidetaka Kamigaito Katsuhiko Hayashi Taro Watanabe 24 1 0 15 Nov 2023
FetMRQC: an open-source machine learning framework for multi-centric fetal brain MRI quality control Thomas Sanchez Oscar Esteban Yvan Gomez A. Pron Mériam Koob ... Nadine Girard Andras Jakab E. Eixarch G. Auzias Meritxell Bach Cuadra 13 5 0 08 Nov 2023
The divergence time of protein structures modelled by Markov matrices and its relation to the divergence of sequences Sandun Rajapaksa L. Allison Peter James Stuckey M. G. D. L. Banda A. S. Konagurthu 14 0 0 11 Aug 2023
Adversarial Evasion Attacks Practicality in Networks: Testing the Impact of Dynamic Learning Mohamed el Shehaby Ashraf Matrawy AAML 19 7 0 08 Jun 2023
Versatile User Identification in Extended Reality using Pretrained Similarity-Learning Christian Rack Konstantin Kobs Tamara Fernando Andreas Hotho Marc Latoschik 18 5 0 15 Feb 2023
SpeckleNN: A unified embedding for real-time speckle pattern classification in X-ray single-particle imaging with limited labeled examples Cong Wang Eric Florin Hsing-Yin Chang Jana Thayer Chun Hong Yoon 13 4 0 14 Feb 2023
Inaccessible Neural Language Models Could Reinvigorate Linguistic Nativism Patrick Perrine 21 0 0 12 Jan 2023
Analysis of a Deep Learning Model for 12-Lead ECG Classification Reveals Learned Features Similar to Diagnostic Criteria Theresa Bender J. Beinecke D. Krefting Carolin Müller Henning Dathe T. Seidler Nicolai Spicher Anne-Christin Hauschild FAtt 11 24 0 03 Nov 2022
Building Robust Machine Learning Models for Small Chemical Science Data: The Case of Shear Viscosity Nikhil V. S. Avula S. K. Veesam Sudarshan Behera S. Balasubramanian 24 8 0 23 Aug 2022
On the role of benchmarking data sets and simulations in method comparison studies Sarah Friedrich T. Friede 25 24 0 02 Aug 2022
A methodology to characterize bias and harmful stereotypes in natural language processing in Latin America Laura Alonso Alemany Luciana Benotti Hernán Maina Lucía González Mariela Rajngewerc ... Guido Ivetta Alexia Halvorsen Amanda Rojo M. Bordone Beatriz Busaniche 14 3 0 14 Jul 2022
A Survey on Deep Learning for Skin Lesion Segmentation Z. Mirikharaji Kumar Abhishek Alceu Bissoto Catarina Barata Sandra Avila Eduardo Valle M. Celebi Ghassan Hamarneh 29 82 0 01 Jun 2022
How to avoid machine learning pitfalls: a guide for academic researchers M. Lones VLM FaML OnRL 54 76 0 05 Aug 2021
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 282 39,190 0 01 Sep 2014