Why do tree-based models still outperform deep learning on tabular data?

18 July 2022

Papers citing "Why do tree-based models still outperform deep learning on tabular data?"

50 / 129 papers shown

Title
Model Reporting for Certifiable AI: A Proposal from Merging EU Regulation into AI Development Danilo Brajovic Niclas Renner Vincent Philipp Goebels Philipp Wagner Benjamin Frész M. Biller Mara Klaeb Janika Kutz Jens Neuhuettler Marco F. Huber 11 8 0 21 Jul 2023
Tabular Machine Learning Methods for Predicting Gas Turbine Emissions Rebecca Potts R. Hackney Georgios Leontidis 8 1 0 17 Jul 2023
Including individual Customer Lifetime Value and competing risks in tree-based lapse management strategies Mathias Valla X. Milhaud Anani Olympio 16 3 0 13 Jul 2023
Scalable Membership Inference Attacks via Quantile Regression Martín Bertrán Shuai Tang Michael Kearns Jamie Morgenstern Aaron Roth Zhiwei Steven Wu MIACV 25 44 0 07 Jul 2023
Assisting Clinical Decisions for Scarcely Available Treatment via Disentangled Latent Representation Bing Xue A. Said Ziqi Xu Hanyang Liu N. Shah Hanqing Yang Philip R. O. Payne Chenyang Lu 15 5 0 06 Jul 2023
JoinBoost: Grow Trees Over Normalized Data Using Only SQL Zezhou Huang Rathijit Sen Jiaxiang Liu Eugene Wu 17 12 0 01 Jul 2023
Numerical Data Imputation for Multimodal Data Sets: A Probabilistic Nearest-Neighbor Kernel Density Approach F. Lalande Kenji Doya 13 3 0 29 Jun 2023
Homological Neural Networks: A Sparse Architecture for Multivariate Complexity Yuanrong Wang Antonio Briola T. Aste 20 5 0 27 Jun 2023
Virtual Human Generative Model: Masked Modeling Approach for Learning Human Characteristics Kenta Oono Nontawat Charoenphakdee K. Bito Zhengyan Gao Yoshiaki Ota ... Kohei Hayashi Yuki Saito Koki Tsuda Hiroshi Maruyama K. Hayashi 22 1 0 19 Jun 2023
Stacking of Hyperparameter Tuned Models for Tagging Coding Problems Sathya Krishnan Dr.S. Lakshmana Pandian Dr.P. Shunmugapriya 6 0 0 16 Jun 2023
In Search of netUnicorn: A Data-Collection Platform to Develop Generalizable ML Models for Network Security Problems Roman Beltiukov Wenbo Guo Arpit Gupta W. Willinger 17 7 0 15 Jun 2023
Integrating Uncertainty Awareness into Conformalized Quantile Regression Raphael Rossellini Rina Foygel Barber Rebecca Willett 20 7 0 14 Jun 2023
RankFormer: Listwise Learning-to-Rank Using Listwide Labels Maarten Buyl Paul Missault Pierre-Antoine Sondag OffRL 9 6 0 09 Jun 2023
Maximally Machine-Learnable Portfolios Philippe Goulet Coulombe Maximilian Göbel 8 3 0 08 Jun 2023
DynamoRep: Trajectory-Based Population Dynamics for Classification of Black-box Optimization Problems Gjorgjina Cenikj G. Petelin Carola Doerr Peter Korošec T. Eftimov 26 12 0 08 Jun 2023
Transferable Adversarial Robustness for Categorical Data via Universal Robust Embeddings Klim Kireev Maksym Andriushchenko Carmela Troncoso Nicolas Flammarion OOD 25 0 0 06 Jun 2023
A Large-Scale Study of Probabilistic Calibration in Neural Network Regression V. Dheur Souhaib Ben Taieb BDL 22 13 0 05 Jun 2023
Beyond Rankings: Exploring the Impact of SERP Features on Organic Click-through Rates Erik Fubel Niclas Michael Groll Patrick Gundlach Qiwei Han Maximilian Kaiser 8 5 0 31 May 2023
Improving Neural Additive Models with Bayesian Principles Kouroche Bouchiat Alexander Immer Hugo Yèche Gunnar Rätsch Vincent Fortuin BDL MedIm 9 6 0 26 May 2023
Differentially-Private Decision Trees and Provable Robustness to Data Poisoning D. Vos Jelle Vos Tianyu Li Z. Erkin S. Verwer FedML 11 1 0 24 May 2023
Unbiased Gradient Boosting Decision Tree with Unbiased Feature Importance Zheyu Zhang T. Zhang Jun Yu Li 18 0 0 18 May 2023
Machine Learning and VIIRS Satellite Retrievals for Skillful Fuel Moisture Content Monitoring in Wildfire Management John S. Schreck William Petzke P. Jiménez Thomas Brummet J. Knievel E. James B. Kosović D. Gagne 10 8 0 17 May 2023
Rethinking Data Augmentation for Tabular Data in Deep Learning Soma Onishi Shoya Meguro LMTD 12 14 0 17 May 2023
Generative Table Pre-training Empowers Models for Tabular Prediction T. Zhang Shaowen Wang Shuicheng Yan Jian Li Qian Liu LMTD 11 38 0 16 May 2023
Standardized Benchmark Dataset for Localized Exposure to a Realistic Source at 10 $-$ 90 GHz A. Kapetanović D. Poljak Kun Li 11 0 0 03 May 2023
FreeLM: Fine-Tuning-Free Language Model Xiang Li Xin Jiang Xuying Meng Aixin Sun Yequan Wang 39 3 0 02 May 2023
Interpretable Machine Learning for Science with PySR and SymbolicRegression.jl M. Cranmer 35 38 0 02 May 2023
Interpreting Deep Forest through Feature Contribution and MDI Feature Importance Yi He Shen-Huan Lyu Yuan Jiang FAtt 20 2 0 01 May 2023
A Supervised Machine Learning Approach to Operator Intent Recognition for Teleoperated Mobile Robot Navigation Evangelos Tsagkournis Dimitris J. Panagopoulos Giannis Petousakis Grigoris Nikolaou Rustam Stolkin Manolis Chiou 19 1 0 27 Apr 2023
DuETT: Dual Event Time Transformer for Electronic Health Records Alex Labach Aslesha Pokhrel Xiao Shi Huang S. Zuberi S. Yi M. Volkovs T. Poutanen Rahul G. Krishnan AI4TS MedIm 12 3 0 25 Apr 2023
Gradient-less Federated Gradient Boosting Trees with Learnable Learning Rates Chenyang Ma Xinchi Qiu Daniel J. Beutel Nicholas D. Lane FedML 13 12 0 15 Apr 2023
The No Free Lunch Theorem, Kolmogorov Complexity, and the Role of Inductive Biases in Machine Learning Micah Goldblum Marc Finzi K. Rowan A. Wilson UQCV FedML 11 37 0 11 Apr 2023
Partitioner Selection with EASE to Optimize Distributed Graph Processing Nikolai Merkel R. Mayer Tawkir Ahmed Fakir Hans-Arno Jacobsen 13 5 0 11 Apr 2023
HyperTab: Hypernetwork Approach for Deep Learning on Small Tabular Datasets Witold Wydmański Oleksii Bulenok Marek Śmieja LMTD 20 9 0 07 Apr 2023
TabRet: Pre-training Transformer-based Tabular Models for Unseen Columns Soma Onishi Kenta Oono Kohei Hayashi LMTD 21 13 0 28 Mar 2023
LEURN: Learning Explainable Univariate Rules with Neural Networks Çağlar Aytekin FAtt 17 0 0 27 Mar 2023
Efficient Multi-stage Inference on Tabular Data Daniel S Johnson Igor L. Markov 15 0 0 21 Mar 2023
Vortex Feature Positioning: Bridging Tabular IIoT Data and Image-Based Deep Learning Jong-Ik Park Sihoon Seong JunKyu Lee CheolKee Hong 20 1 0 16 Mar 2023
Deep incremental learning models for financial temporal tabular datasets with distribution shifts Thomas Wong Mauricio Barahona OOD AIFin AI4TS 11 0 0 14 Mar 2023
Model scale versus domain knowledge in statistical forecasting of chaotic systems W. Gilpin AI4TS 14 13 0 13 Mar 2023
TANGOS: Regularizing Tabular Neural Networks through Gradient Orthogonalization and Specialization Alan Jeffares Tennison Liu Jonathan Crabbé F. Imrie M. Schaar CML 32 21 0 09 Mar 2023
Improved Differentially Private Regression via Gradient Boosting Shuai Tang Sergul Aydore Michael Kearns Saeyoung Rho Aaron Roth Yichen Wang Yu-Xiang Wang Zhiwei Steven Wu FedML 14 4 0 06 Mar 2023
Deep Learning Methods for Small Molecule Drug Discovery: A Survey Wenhao Hu Yingying Liu Xuanyu Chen Wenhao Chai Hangyue Chen Hongwei Wang Gaoang Wang 42 10 0 01 Mar 2023
Tiny Classifier Circuits: Evolving Accelerators for Tabular Data Konstantinos Iordanou Timothy Atkinson Emre Ozer Jedrzej Kufel J. Biggs Gavin Brown M. Luján 8 1 0 28 Feb 2023
Anomalous NO2 emitting ship detection with TROPOMI satellite data and machine learning Solomiia Kurchaba J. Vliet F. Verbeek C. Veenman 12 2 0 24 Feb 2023
Practical Knowledge Distillation: Using DNNs to Beat DNNs Chungman Lee Pavlos Anastasios Apostolopulos Igor L. Markov FedML 12 1 0 23 Feb 2023
Embeddings for Tabular Data: A Survey Rajat Singh Srikanta J. Bedathur LMTD 12 2 0 23 Feb 2023
Bayesian Decision Trees via Tractable Priors and Probabilistic Context-Free Grammars Colin D. Sullivan Mo Tiwari Sebastian Thrun Chris Piech TPM 10 0 0 15 Feb 2023
Augmenting Rule-based DNS Censorship Detection at Scale with Machine Learning Jacob Alexander Markson Brown Xi Jiang Van-Tai Tran A. Bhagoji Nguyen Phong Hoang Nick Feamster Prateek Mittal V. Yegneswaran 11 4 0 03 Feb 2023
Joint Training of Deep Ensembles Fails Due to Learner Collusion Alan Jeffares Tennison Liu Jonathan Crabbé M. Schaar FedML 21 15 0 26 Jan 2023