Randomness In Neural Network Training: Characterizing The Impact of Tooling

22 June 2021

Papers citing "Randomness In Neural Network Training: Characterizing The Impact of Tooling"

41 / 41 papers shown

Title
MAGIC: Near-Optimal Data Attribution for Deep Learning Andrew Ilyas Logan Engstrom TDI 37 0 0 23 Apr 2025
Mixtera: A Data Plane for Foundation Model Training Maximilian Böther Xiaozhe Yao Tolga Kerimoglu Ana Klimovic Viktor Gsteiger Ana Klimovic MoE 87 0 0 27 Feb 2025
Deep Learning-Based Identification of Inconsistent Method Names: How Far Are We? Taiming Wang Yuxia Zhang Lin Jiang Yi Tang Guangjie Li Hui Liu 83 1 0 22 Jan 2025
Enhancement of Neural Inertial Regression Networks: A Data-Driven Perspective Victoria Khalfin Fekson Nitsan Pri-Hadash Netta Palez Aviad Etzion Itzik Klein 33 1 0 03 Jan 2025
Investigating the Impact of Randomness on Reproducibility in Computer Vision: A Study on Applications in Civil Engineering and Medicine Bahadır Eryılmaz Osman Alperen Koras Jorg Schlotterer Christin Seifert 21 0 0 19 Sep 2024
Revisiting Static Feature-Based Android Malware Detection Md Tanvirul Alam Dipkamal Bhusal Nidhi Rastogi AAML 30 0 0 11 Sep 2024
How Does Quantization Affect Multilingual LLMs? Kelly Marchisio Saurabh Dash Hongyu Chen Dennis Aumiller A. Ustun Sara Hooker Sebastian Ruder MQ 44 6 0 03 Jul 2024
Generalizability of experimental studies Federico Matteucci Vadim Arzamasov Jose Cribeiro-Ramallo Marco Heyden Konstantin Ntounas Klemens Bohm 42 0 0 25 Jun 2024
Rolling the dice for better deep learning performance: A study of randomness techniques in deep neural networks Mohammed Ghaith Altarabichi Sławomir Nowaczyk Sepideh Pashami Peyman Sheikholharam Mashhadi Julia Handl 21 9 0 05 Apr 2024
JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Models Patrick Chao Edoardo Debenedetti Alexander Robey Maksym Andriushchenko Francesco Croce ... Nicolas Flammarion George J. Pappas F. Tramèr Hamed Hassani Eric Wong ALM ELM AAML 52 94 0 28 Mar 2024
Optimistic Verifiable Training by Controlling Hardware Nondeterminism Megha Srivastava Simran Arora Dan Boneh 14 5 0 14 Mar 2024
On The Fairness Impacts of Hardware Selection in Machine Learning Sree Harsha Nelaturu Nishaanth Kanna Ravichandran Cuong Tran Sara Hooker Ferdinando Fioretto 42 2 0 06 Dec 2023
Elo Uncovered: Robustness and Best Practices in Language Model Evaluation M. Boubdir Edward Kim B. Ermiş Sara Hooker Marzieh Fadaee ELM 19 35 0 29 Nov 2023
Distilling Influences to Mitigate Prediction Churn in Graph Neural Networks Andreas Roth Thomas Liebig 50 0 0 02 Oct 2023
Are You Worthy of My Trust?: A Socioethical Perspective on the Impacts of Trustworthy AI Systems on the Environment and Human Society Jamell Dacon SILM 18 1 0 18 Sep 2023
The Co-12 Recipe for Evaluating Interpretable Part-Prototype Image Classifiers Meike Nauta Christin Seifert 21 11 0 26 Jul 2023
SysNoise: Exploring and Benchmarking Training-Deployment System Inconsistency Yan Wang Yuhang Li Ruihao Gong Aishan Liu Yanfei Wang ... Yongqiang Yao Yunchen Zhang Tianzi Xiao F. Yu Xianglong Liu AAML 32 0 0 01 Jul 2023
Machine Learning needs Better Randomness Standards: Randomised Smoothing and PRNG-based attacks Pranav Dahiya Ilia Shumailov Ross J. Anderson SILM AAML 13 0 0 24 Jun 2023
Evaluating the Social Impact of Generative AI Systems in Systems and Society Irene Solaiman Zeerak Talat William Agnew Lama Ahmad Dylan K. Baker ... Marie-Therese Png Shubham Singh A. Strait Lukas Struppek Arjun Subramonian ELM EGVM 31 103 0 09 Jun 2023
On the Variance of Neural Network Training with respect to Test Sets and Distributions Keller Jordan OOD 11 10 0 04 Apr 2023
FAIR-Ensemble: When Fairness Naturally Emerges From Deep Ensembling Wei-Yin Ko Daniel D'souza Karina Nguyen Randall Balestriero Sara Hooker FedML 16 11 0 01 Mar 2023
Reproducibility of Machine Learning: Terminology, Recommendations and Open Issues Riccardo Albertoni Sara Colantonio Piotr Skrzypczyñski J. Stefanowski 18 10 0 24 Feb 2023
Towards Inferential Reproducibility of Machine Learning Research Michael Hagmann Philipp Meier Stefan Riezler 21 2 0 08 Feb 2023
Instability in clinical risk stratification models using deep learning D. Martinez A. Yakubovich Martin G. Seneviratne Á. Lelkes Akshit Tyagi ... N. L. Downing Ron C. Li Keith Morse N. Shah Ming-Jun Chen OOD 14 2 0 20 Nov 2022
Quantifying Social Biases Using Templates is Unreliable P. Seshadri Pouya Pezeshkpour Sameer Singh 51 33 0 09 Oct 2022
On the Factory Floor: ML Engineering for Industrial-Scale Ads Recommendation Models Rohan Anil S. Gadanho Danya Huang Nijith Jacob Zhuoshu Li ... Cristina Pop Kevin Regan G. Shamir Rakesh Shivanna Qiqi Yan 3DV 8 41 0 12 Sep 2022
Power of Explanations: Towards automatic debiasing in hate speech detection Yitao Cai Arthur Zimek Gerhard Wunder Eirini Ntoutsi 21 6 0 07 Sep 2022
Proof-of-Learning is Currently More Broken Than You Think Cong Fang Hengrui Jia Anvith Thudi Mohammad Yaghini Christopher A. Choquette-Choo Natalie Dullerud Varun Chandrasekaran Nicolas Papernot AAML 8 16 0 06 Aug 2022
Data Banzhaf: A Robust Data Valuation Framework for Machine Learning Jiachen T. Wang R. Jia FedML TDI 50 94 0 30 May 2022
On the Prediction Instability of Graph Neural Networks Max Klabunde Florian Lemmerich 38 5 0 20 May 2022
Sources of Irreproducibility in Machine Learning: A Review Odd Erik Gundersen Kevin Coakley Christine R. Kirkpatrick Yolanda Gil SyDa 19 33 0 15 Apr 2022
Machine Learning State-of-the-Art with Uncertainties Peter Steinbach Felicita Gernhardt Mahnoor Tanveer Steve Schmerler Sebastian Starke UQCV OOD 14 3 0 11 Apr 2022
A Siren Song of Open Source Reproducibility Edward Raff Andrew L. Farris 8 9 0 09 Apr 2022
Real World Large Scale Recommendation Systems Reproducibility and Smooth Activations G. Shamir Dong Lin HAI OffRL 15 6 0 14 Feb 2022
Reproducibility in Optimization: Theoretical Framework and Limits Kwangjun Ahn Prateek Jain Ziwei Ji Satyen Kale Praneeth Netrapalli G. Shamir 17 22 0 09 Feb 2022
Deep Reinforcement Learning at the Edge of the Statistical Precipice Rishabh Agarwal Max Schwarzer P. S. Castro Aaron Courville Marc G. Bellemare OffRL 25 630 0 30 Aug 2021
Manipulating SGD with Data Ordering Attacks Ilia Shumailov Zakhar Shumaylov Dmitry Kazhdan Yiren Zhao Nicolas Papernot Murat A. Erdogdu Ross J. Anderson AAML 112 90 0 19 Apr 2021
Anti-Distillation: Improving reproducibility of deep networks G. Shamir Lorenzo Coviello 34 20 0 19 Oct 2020
Data-Efficient Pretraining via Contrastive Self-Supervision Nils Rethmeier Isabelle Augenstein 15 20 0 02 Oct 2020
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications Andrew G. Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand M. Andreetto Hartwig Adam 3DH 948 20,549 0 17 Apr 2017
Improving neural networks by preventing co-adaptation of feature detectors Geoffrey E. Hinton Nitish Srivastava A. Krizhevsky Ilya Sutskever Ruslan Salakhutdinov VLM 243 7,633 0 03 Jul 2012