A Scaling Law for Synthetic-to-Real Transfer: How Much Is Your
Pre-training Effective?

A Scaling Law for Synthetic-to-Real Transfer: How Much Is Your Pre-training Effective?

25 August 2021

Papers citing "A Scaling Law for Synthetic-to-Real Transfer: How Much Is Your Pre-training Effective?"

14 / 14 papers shown

Title
(Mis)Fitting: A Survey of Scaling Laws Margaret Li Sneha Kudugunta Luke Zettlemoyer 69 2 0 26 Feb 2025
Scaling Laws for Downstream Task Performance in Machine Translation Berivan Isik Natalia Ponomareva Hussein Hazimeh Dimitris Paparas Sergei Vassilvitskii Sanmi Koyejo 108 3 0 24 Feb 2025
A Hitchhiker's Guide to Scaling Law Estimation Leshem Choshen Yang Zhang Jacob Andreas 41 6 0 15 Oct 2024
Scaling Law of Sim2Real Transfer Learning in Expanding Computational Materials Databases for Real-World Predictions Shunya Minami Yoshihiro Hayashi Stephen Wu Kenji Fukumizu Hiroki Sugisawa Masashi Ishii Isao Kuwajima Kazuya Shiratori Ryo Yoshida AI4CE 18 0 0 07 Aug 2024
Analyzing and reducing the synthetic-to-real transfer gap in Music Information Retrieval: the task of automatic drum transcription Mickaël Zehren Marco Alunno Paolo Bientinesi 41 0 0 29 Jul 2024
An Empirical Study of Pre-trained Model Selection for Out-of-Distribution Generalization and Calibration Hiroki Naganuma Ryuichiro Hataya Kotaro Yoshida Ioannis Mitliagkas OODD 84 1 0 17 Jul 2023
Emergent and Predictable Memorization in Large Language Models Stella Biderman USVSN Sai Prashanth Lintang Sutawika Hailey Schoelkopf Quentin G. Anthony Shivanshu Purohit Edward Raf 19 117 0 21 Apr 2023
Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling Stella Biderman Hailey Schoelkopf Quentin G. Anthony Herbie Bradley Kyle O'Brien ... USVSN Sai Prashanth Edward Raff Aviya Skowron Lintang Sutawika Oskar van der Wal 30 1,164 0 03 Apr 2023
Scalable Modular Synthetic Data Generation for Advancing Aerial Autonomy Mehrnaz Sabet Praveen Palanisamy Sakshi Mishra 18 4 0 10 Nov 2022
Task2Sim : Towards Effective Pre-training and Transfer from Synthetic Data Samarth Mishra Rameswar Panda Cheng Perng Phoo Chun-Fu Chen Leonid Karlinsky Kate Saenko Venkatesh Saligrama Rogerio Feris 19 33 0 30 Nov 2021
Learning Curve Theory Marcus Hutter 128 58 0 08 Feb 2021
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 226 4,453 0 23 Jan 2020
Semantic Understanding of Scenes through the ADE20K Dataset Bolei Zhou Hang Zhao Xavier Puig Tete Xiao Sanja Fidler Adela Barriuso Antonio Torralba SSeg 249 1,824 0 18 Aug 2016
Norm-Based Capacity Control in Neural Networks Behnam Neyshabur Ryota Tomioka Nathan Srebro 114 577 0 27 Feb 2015