Revisiting Unreasonable Effectiveness of Data in Deep Learning Era

10 July 2017

Papers citing "Revisiting Unreasonable Effectiveness of Data in Deep Learning Era"

50 / 421 papers shown

Title
Go Wider Instead of Deeper Fuzhao Xue Ziji Shi Futao Wei Yuxuan Lou Yong Liu Yang You ViT MoE 19 80 0 25 Jul 2021
Reasoning-Modulated Representations Petar Velivcković Matko Bovsnjak Thomas Kipf Alexander Lerchner R. Hadsell Razvan Pascanu Charles Blundell OCL OOD SSL 13 15 0 19 Jul 2021
Geographical Knowledge-driven Representation Learning for Remote Sensing Images Wenyuan Li Keyan Chen Hao Chen Zhenwei Shi SSL 38 64 0 12 Jul 2021
A Dual-Purpose Deep Learning Model for Auscultated Lung and Tracheal Sound Analysis Based on Mixed Set Training Fu-Shun Hsu Shang-Ran Huang Chang-Fu Su Chien-Wen Huang Yuan-Ren Cheng ... Nian-Jhen Lin Wan-Ling Tsai Ching-Shiang Lu Chuan Chen F. Lai 29 5 0 09 Jul 2021
Mitigating Generation Shifts for Generalized Zero-Shot Learning Zhi Chen Yadan Luo Sen Wang Ruihong Qiu Jingjing Li Zi Huang 19 25 0 07 Jul 2021
Learning Vision Transformer with Squeeze and Excitation for Facial Expression Recognition Mouath Aouayeb W. Hamidouche Catherine Soladié K. Kpalma Renaud Séguier ViT 28 57 0 07 Jul 2021
Automatic size and pose homogenization with spatial transformer network to improve and accelerate pediatric segmentation Giammarco La Barbera Pietro Gori Haithem Boussaid Bruno Belucci A. Delmonte Jeanne Goulin S. Sarnacki L. Rouet Isabelle Bloch ViT MedIm 15 4 0 06 Jul 2021
Meta-learning Amidst Heterogeneity and Ambiguity Kyeongryeol Go Seyoung Yun 24 1 0 05 Jul 2021
The Evolution of Out-of-Distribution Robustness Throughout Fine-Tuning Anders Andreassen Yasaman Bahri Behnam Neyshabur Rebecca Roelofs OOD OODD 27 78 0 30 Jun 2021
Rethinking Token-Mixing MLP for MLP-based Vision Backbone Tan Yu Xu Li Yunfeng Cai Mingming Sun Ping Li 45 26 0 28 Jun 2021
IA-RED $^2$ : Interpretability-Aware Redundancy Reduction for Vision Transformers Bowen Pan Rameswar Panda Yi Ding Zhangyang Wang Rogerio Feris A. Oliva VLM ViT 39 153 0 23 Jun 2021
GAIA: A Transfer Learning System of Object Detection that Fits Your Needs Xingyuan Bu Junran Peng Junjie Yan Tieniu Tan Zhaoxiang Zhang ObjD VLM 28 53 0 21 Jun 2021
TokenLearner: What Can 8 Learned Tokens Do for Images and Videos? Michael S. Ryoo A. Piergiovanni Anurag Arnab Mostafa Dehghani A. Angelova ViT 37 127 0 21 Jun 2021
Secure Distributed Training at Scale Eduard A. Gorbunov Alexander Borzunov Michael Diskin Max Ryabinin FedML 21 15 0 21 Jun 2021
Does Optimal Source Task Performance Imply Optimal Pre-training for a Target Task? Steven Gutstein Brent Lance Sanjay Shakkottai 27 1 0 21 Jun 2021
Active Learning for Deep Neural Networks on Edge Devices Yuya Senzaki Christian Hamelain 26 7 0 21 Jun 2021
How to train your ViT? Data, Augmentation, and Regularization in Vision Transformers Andreas Steiner Alexander Kolesnikov Xiaohua Zhai Ross Wightman Jakob Uszkoreit Lucas Beyer ViT 45 614 0 18 Jun 2021
Learning to Predict Visual Attributes in the Wild Khoi Pham Kushal Kafle Zhe-nan Lin Zhi Ding Scott D. Cohen Q. Tran Abhinav Shrivastava 16 108 0 17 Jun 2021
Efficient Deep Learning: A Survey on Making Deep Learning Models Smaller, Faster, and Better Gaurav Menghani VLM MedIm 23 366 0 16 Jun 2021
Revisiting the Calibration of Modern Neural Networks Matthias Minderer Josip Djolonga Rob Romijnders F. Hubis Xiaohua Zhai N. Houlsby Dustin Tran Mario Lucic UQCV 39 358 0 15 Jun 2021
RETRIEVE: Coreset Selection for Efficient and Robust Semi-Supervised Learning Krishnateja Killamsetty Xujiang Zhao F. Chen Rishabh K. Iyer 24 78 0 14 Jun 2021
Learning the Precise Feature for Cluster Assignment Yanhai Gan Xinghui Dong Huiyu Zhou Feng Gao Junyu Dong 33 4 0 11 Jun 2021
Scaling Vision with Sparse Mixture of Experts C. Riquelme J. Puigcerver Basil Mustafa Maxim Neumann Rodolphe Jenatton André Susano Pinto Daniel Keysers N. Houlsby MoE 17 575 0 10 Jun 2021
CoAtNet: Marrying Convolution and Attention for All Data Sizes Zihang Dai Hanxiao Liu Quoc V. Le Mingxing Tan ViT 49 1,167 0 09 Jun 2021
Reveal of Vision Transformers Robustness against Adversarial Attacks Ahmed Aldahdooh W. Hamidouche Olivier Déforges ViT 15 56 0 07 Jun 2021
Large-scale Unsupervised Semantic Segmentation Shangqi Gao Zhong-Yu Li Ming-Hsuan Yang Mingg-Ming Cheng Junwei Han Philip H. S. Torr UQCV 38 84 0 06 Jun 2021
FoveaTer: Foveated Transformer for Image Classification Aditya Jonnalagadda Luu Anh Tuan B. S. Manjunath M. Eckstein ViT 22 23 0 29 May 2021
Correlated Input-Dependent Label Noise in Large-Scale Image Classification Mark Collier Basil Mustafa Efi Kokiopoulou Rodolphe Jenatton Jesse Berent NoLa 181 53 0 19 May 2021
Divide and Contrast: Self-supervised Learning from Uncurated Data Yonglong Tian Olivier J. Hénaff Aaron van den Oord SSL 64 96 0 17 May 2021
Vision Transformers are Robust Learners Sayak Paul Pin-Yu Chen ViT 28 304 0 17 May 2021
MLP-Mixer: An all-MLP Architecture for Vision Ilya O. Tolstikhin N. Houlsby Alexander Kolesnikov Lucas Beyer Xiaohua Zhai ... Andreas Steiner Daniel Keysers Jakob Uszkoreit Mario Lucic Alexey Dosovitskiy 271 2,603 0 04 May 2021
ImageNet-21K Pretraining for the Masses T. Ridnik Emanuel Ben-Baruch Asaf Noy Lihi Zelnik-Manor SSeg VLM CLIP 181 687 0 22 Apr 2021
Exploring Visual Engagement Signals for Representation Learning Menglin Jia Zuxuan Wu A. Reiter Claire Cardie Serge J. Belongie Ser-Nam Lim 21 13 0 15 Apr 2021
Escaping the Big Data Paradigm with Compact Transformers Ali Hassani Steven Walton Nikhil Shah Abulikemu Abuduweili Jiachen Li Humphrey Shi 54 462 0 12 Apr 2021
Comparing Transfer and Meta Learning Approaches on a Unified Few-Shot Classification Benchmark Vincent Dumoulin N. Houlsby Utku Evci Xiaohua Zhai Ross Goroshin Sylvain Gelly Hugo Larochelle 27 26 0 06 Apr 2021
Self-supervised Image-text Pre-training With Mixed Data In Chest X-rays Xiaosong Wang Ziyue Xu Leo K. Tam Dong Yang Daguang Xu ViT MedIm 17 23 0 30 Mar 2021
ViViT: A Video Vision Transformer Anurag Arnab Mostafa Dehghani G. Heigold Chen Sun Mario Lucic Cordelia Schmid ViT 30 2,087 0 29 Mar 2021
Factors of Influence for Transfer Learning across Diverse Appearance Domains and Task Types Thomas Mensink J. Uijlings Alina Kuznetsova Michael Gygli V. Ferrari VLM 43 80 0 24 Mar 2021
W2WNet: a two-module probabilistic Convolutional Neural Network with embedded data cleansing functionality Francesco Ponzio Enrico Macii E. Ficarra S. D. Cataldo 22 4 0 24 Mar 2021
UNICORN on RAINBOW: A Universal Commonsense Reasoning Model on a New Multitask Benchmark Nicholas Lourie Ronan Le Bras Chandra Bhagavatula Yejin Choi LRM 22 137 0 24 Mar 2021
Scaling Local Self-Attention for Parameter Efficient Visual Backbones Ashish Vaswani Prajit Ramachandran A. Srinivas Niki Parmar Blake A. Hechtman Jonathon Shlens 16 395 0 23 Mar 2021
Incorporating Convolution Designs into Visual Transformers Kun Yuan Shaopeng Guo Ziwei Liu Aojun Zhou F. Yu Wei Wu ViT 56 467 0 22 Mar 2021
The Shape of Learning Curves: a Review T. Viering Marco Loog 18 122 0 19 Mar 2021
Efficient Visual Pretraining with Contrastive Detection Olivier J. Hénaff Skanda Koppula Jean-Baptiste Alayrac Aaron van den Oord Oriol Vinyals João Carreira VLM SSL 35 162 0 19 Mar 2021
Revisiting ResNets: Improved Training and Scaling Strategies Irwan Bello W. Fedus Xianzhi Du E. D. Cubuk A. Srinivas Nayeon Lee Jonathon Shlens Barret Zoph 29 297 0 13 Mar 2021
Generalized Contrastive Optimization of Siamese Networks for Place Recognition María Leyva-Vallina N. Strisciuglio N. Petkov 10 31 0 11 Mar 2021
Knowledge Evolution in Neural Networks Ahmed Taha Abhinav Shrivastava L. Davis 47 21 0 09 Mar 2021
Nutrition5k: Towards Automatic Nutritional Understanding of Generic Food Quin Thames Arjun Karpur W. Norris Fangting Xia Liviu Panait Tobias Weyand Jack Sim 23 83 0 04 Mar 2021
Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices Max Ryabinin Eduard A. Gorbunov Vsevolod Plokhotnyuk Gennady Pekhimenko 35 32 0 04 Mar 2021
WIT: Wikipedia-based Image Text Dataset for Multimodal Multilingual Machine Learning Krishna Srinivasan K. Raman Jiecao Chen Michael Bendersky Marc Najork VLM 208 310 0 02 Mar 2021