Why do tree-based models still outperform deep learning on tabular data?

18 July 2022

Papers citing "Why do tree-based models still outperform deep learning on tabular data?"

50 / 129 papers shown

Title
Targeted AMP generation through controlled diffusion with efficient embeddings Diogo Soares Leon Hetzel Paulina Szymczak Fabian J. Theis Stephan Günnemann E. Szczurek MedIm 25 0 0 24 Apr 2025
InfluenceNet: AI Models for Banzhaf and Shapley Value Prediction Benjamin Kempinski Tal Kachman 34 0 0 11 Mar 2025
Learning Decision Trees as Amortized Structure Inference Mohammed Mahfoud Ghait Boukachab Michał Koziarski A. Garcia Stefan Bauer Yoshua Bengio Nikolay Malkin BDL 38 0 0 10 Mar 2025
LimeSoDa: A Dataset Collection for Benchmarking of Machine Learning Regressors in Digital Soil Mapping J. Schmidinger S. Vogel V. Barkov A.-D. Pham R. Gebbers ... P. Rosso M. M. Costa R. S. Zandonadi J. Wetterlind M. Atzmueller 56 0 0 27 Feb 2025
Sample Selection via Contrastive Fragmentation for Noisy Label Regression C. Kim Sangwoo Moon Jihwan Moon Dongyeon Woo Gunhee Kim NoLa 47 0 0 25 Feb 2025
TabICL: A Tabular Foundation Model for In-Context Learning on Large Data Jingang Qu David Holzmüller Gaël Varoquaux Marine Le Morvan LMTD 78 4 0 08 Feb 2025
Gradient Boosting Trees and Large Language Models for Tabular Data Few-Shot Learning Carlos Huertas LMTD 30 1 0 06 Nov 2024
Position Specific Scoring Is All You Need? Revisiting Protein Sequence Classification Tasks Sarwan Ali Taslim Murad Prakash Chourasia Haris Mansoor I. Khan Pin-Yu Chen Murray Patterson 14 1 0 16 Oct 2024
A Survey on Deep Tabular Learning Shriyank Somvanshi Subasish Das Syed Aaqib Javed Gian Antariksa Ahmed Hossain LMTD 21 7 0 15 Oct 2024
A Spatio-Temporal Machine Learning Model for Mortgage Credit Risk: Default Probabilities and Loan Portfolios Pascal Kündig Fabio Sigrist 15 1 0 03 Oct 2024
Generating peak-aware pseudo-measurements for low-voltage feeders using metadata of distribution system operators Manuel Treutlein Marc Schmidt Roman Hahn Matthias Hertel Benedikt Heidrich Ralf Mikut V. Hagenmeyer 17 0 0 29 Sep 2024
Non-verbal Hands-free Control for Smart Glasses using Teeth Clicks Payal Mohapatra Ali Aroudi Anurag Kumar Morteza Khaleghimeybodi 27 0 0 21 Aug 2024
MonoSparse-CAM: Harnessing Monotonicity and Sparsity for Enhanced Tree Model Processing on CAMs Tergel Molom-Ochir Brady Taylor Hai Li Yiran Chen 11 0 0 12 Jul 2024
Gradient Boosting Reinforcement Learning Benjamin Fuhrer Chen Tessler Gal Dalal OffRL AI4CE 31 3 0 11 Jul 2024
Teaching Models To Survive: Proper Scoring Rule and Stochastic Optimization with Competing Risks Julie Alberge Vincent Maladiere O. Grisel Judith Abecassis Gaël Varoquaux 25 0 0 20 Jun 2024
Large Scale Transfer Learning for Tabular Data via Language Modeling Josh Gardner Juan C. Perdomo Ludwig Schmidt LMTD 21 13 0 17 Jun 2024
Generative modeling of density regression through tree flows Zhuoqun Wang Naoki Awaya Li Ma DRL 17 0 0 07 Jun 2024
Diffusion Boosted Trees Xizewen Han Mingyuan Zhou AI4CE 16 0 0 03 Jun 2024
Biathlon: Harnessing Model Resilience for Accelerating ML Inference Pipelines Chaokun Chang Eric Lo Chunxiao Ye 13 2 0 18 May 2024
Automated Deep Learning for Load Forecasting Julie Keisler Sandra Claudel Gilles Cabriel Margaux Brégère AI4TS 19 3 0 14 May 2024
A Federated Learning Benchmark on Tabular Data: Comparing Tree-Based Models and Neural Networks William Lindskog Christian Prehofer FedML 37 1 0 03 May 2024
Why Tabular Foundation Models Should Be a Research Priority B. V. Breugel M. Schaar LMTD VLM AI4CE 31 32 0 02 May 2024
BUFF: Boosted Decision Tree based Ultra-Fast Flow matching Cheng Jiang Sitian Qian Huilin Qu 19 1 0 28 Apr 2024
PyTorch Frame: A Modular Framework for Multi-Modal Tabular Learning Weihua Hu Yiwen Yuan Zecheng Zhang Akihiro Nitta Kaidi Cao Vid Kocijan J. Leskovec Matthias Fey LMTD 24 9 0 31 Mar 2024
Probabilistic Calibration by Design for Neural Network Regression V. Dheur Souhaib Ben Taieb 14 3 0 18 Mar 2024
Structured Evaluation of Synthetic Tabular Data Scott Cheng-Hsin Yang Baxter S. Eaves Michael Schmidt Ken Swanson Patrick Shafto 20 4 0 15 Mar 2024
Tree-Regularized Tabular Embeddings Xuan Li Yunhe Wang Boqian Li LMTD 25 3 0 01 Mar 2024
Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Survey Xi Fang Weijie Xu Fiona Anting Tan Jiani Zhang Ziqing Hu Yanjun Qi Scott Nickleach Diego Socolinsky Srinivasan H. Sengamedu Christos Faloutsos LMTD ALM 30 63 0 27 Feb 2024
CARTE: Pretraining and Transfer for Tabular Learning Myung Jun Kim Léo Grinsztajn Gaël Varoquaux LMTD 41 13 0 26 Feb 2024
Boosting gets full Attention for Relational Learning Mathieu Guillame-Bert Richard Nock LMTD 23 0 0 22 Feb 2024
Estimating the age-conditioned average treatment effects curves: An application for assessing load-management strategies in the NBA S. Nakamura-Sakai L. Forastiere Brian Macdonald CML 11 0 0 17 Feb 2024
Connecting Algorithmic Fairness to Quality Dimensions in Machine Learning in Official Statistics and Survey Production Patrick Oliver Schenk Christoph Kern FaML 14 0 0 14 Feb 2024
DoubleMLDeep: Estimation of Causal Effects with Multimodal Data Sven Klaassen Jan Teichert-Kluge Philipp Bach Victor Chernozhukov Martin Spindler Suhas Vijaykumar BDL CML 9 6 0 01 Feb 2024
MobilityDL: A Review of Deep Learning From Trajectory Data Anita Graser Anahid N. Jalali Jasmin Lampert Axel Weissenfeld Krzysztof Janowicz 14 6 0 01 Feb 2024
Vectorizing string entries for data processing on tables: when are larger language models better? Léo Grinsztajn Edouard Oyallon Myung Jun Kim Gaël Varoquaux 15 2 0 15 Dec 2023
Benchmarking Distribution Shift in Tabular Data with TableShift Josh Gardner Zoran Popovic Ludwig Schmidt OOD 8 13 0 10 Dec 2023
Fine-Tuning the Retrieval Mechanism for Tabular Deep Learning Felix den Breejen Sangmin Bae Stephen Cha Tae-Young Kim Seoung Hyun Koh SeYoung Yun 17 3 0 13 Nov 2023
TabRepo: A Large Scale Repository of Tabular Model Evaluations and its AutoML Applications David Salinas Nick Erickson 14 10 0 06 Nov 2023
Reimagining Synthetic Tabular Data Generation through Data-Centric AI: A Comprehensive Benchmark Lasse Hansen Nabeel Seedat M. Schaar Andrija Petrović 22 17 0 25 Oct 2023
FATA-Trans: Field And Time-Aware Transformer for Sequential Tabular Data Dongyu Zhang Liang Wang Xin Dai Shubham Jain Junpeng Wang Yujie Fan Chin-Chia Michael Yeh Yan Zheng Zhongfang Zhuang Wei Zhang LMTD AI4TS 55 1 0 20 Oct 2023
MAPTree: Beating "Optimal" Decision Trees with Bayesian Decision Trees Colin D. Sullivan Mo Tiwari Sebastian Thrun 8 3 0 26 Sep 2023
Era Splitting -- Invariant Learning for Decision Trees Timothy DeLise CML OOD 11 0 0 25 Sep 2023
SHAPNN: Shapley Value Regularized Tabular Neural Network Qisen Cheng Shuhui Qu Janghwan Lee 9 3 0 15 Sep 2023
Unveiling Invariances via Neural Network Pruning Derek Xu Yizhou Sun Wei Wang 23 0 0 15 Sep 2023
Multitask Deep Learning for Accurate Risk Stratification and Prediction of Next Steps for Coronary CT Angiography Patients Juan Lu Bennamoun J. Stewart J. Eshraghian Yanbin Liu B. Chow Frank M. Sanfilippo Girish Dwivedi OOD 4 1 0 01 Sep 2023
Homological Convolutional Neural Networks Antonio Briola Yuanrong Wang Silvia Bartolucci T. Aste LMTD 17 5 0 26 Aug 2023
Global Warming In Ghana's Major Cities Based on Statistical Analysis of NASA's POWER Over 3-Decades Joshua Attih 11 1 0 20 Aug 2023
Endogenous Macrodynamics in Algorithmic Recourse Patrick Altmeyer Giovan Angela Aleksander Buszydlik Karol Dobiczek A. V. Deursen Cynthia C. S. Liem 17 7 0 16 Aug 2023
Adversarial training for tabular data with attack propagation Tiago Leon Melo Joao Bravo Marco O. P. Sampaio Paolo Romano Hugo Ferreira João Tiago Ascensão P. Bizarro AAML 12 1 0 28 Jul 2023
eXplainable Artificial Intelligence (XAI) in aging clock models Alena I. Kalyakulina I. Yusipov Alexey Moskalev Claudio Franceschi Mikhail Ivanchenko 9 19 0 21 Jul 2023