Making Pre-trained Language Models Great on Tabular Prediction

4 March 2024

Jimeng Sun

Jintai Chen

Papers citing "Making Pre-trained Language Models Great on Tabular Prediction"

32 / 32 papers shown

Title
Griffin: Towards a Graph-Centric Relational Database Foundation Model Yanbo Wang Xiyuan Wang Quan Gan Minjie Wang Qibin Yang David Wipf Muhan Zhang 38 0 0 08 May 2025
Representation Learning for Tabular Data: A Comprehensive Survey Jun-Peng Jiang Si-Yang Liu Hao-Run Cai Qile Zhou Han-Jia Ye LMTD 38 0 0 17 Apr 2025
LLM-FE: Automated Feature Engineering for Tabular Data with LLMs as Evolutionary Optimizers Nikhil Abhyankar Parshin Shojaee Chandan K. Reddy 61 0 0 18 Mar 2025
Architectural and Inferential Inductive Biases For Exchangeable Sequence Modeling Daksh Mittal Ang Li Tzu-Ching Yen Daniel Guetta Hongseok Namkoong 45 0 0 03 Mar 2025
A Closer Look at TabPFN v2: Strength, Limitation, and Extension Han-Jia Ye Si-Yang Liu Wei-Lun Chao 34 3 0 24 Feb 2025
LLM Embeddings for Deep Learning on Tabular Data Boshko Koloski Andrei Margeloiu Xiangjian Jiang Blaž Škrlj Nikola Simidjievski M. Jamnik LMTD 72 0 0 17 Feb 2025
TabPFN Unleashed: A Scalable and Effective Solution to Tabular Classification Problems Si-Yang Liu Han-Jia Ye 66 5 0 04 Feb 2025
PORTAL: Scalable Tabular Foundation Models via Content-Specific Tokenization Marco Spinaci Marek Polewczyk Johannes Hoffart Markus C. Kohler Sam Thelin Tassilo Klein LMTD 23 2 0 17 Oct 2024
A Survey on Deep Tabular Learning Shriyank Somvanshi Subasish Das Syed Aaqib Javed Gian Antariksa Ahmed Hossain LMTD 24 7 0 15 Oct 2024
Scalable Representation Learning for Multimodal Tabular Transactions Natraj Raman Sumitra Ganesh Manuela Veloso LMTD 29 0 0 10 Oct 2024
LLM Embeddings Improve Test-time Adaptation to Tabular $Y\|X$ -Shifts Yibo Zeng Jiashuo Liu H. Lam Hongseok Namkoong LMTD 19 1 0 09 Oct 2024
TREB: a BERT attempt for imputing tabular data imputation Shuyue Wang Wenjun Zhou Han drk-m-s Jiang Shuo Wang Ren Zheng 20 0 0 16 Sep 2024
LBC: Language-Based-Classifier for Out-Of-Variable Generalization Kangjun Noh Baekryun Seong Hoyoon Byun Youngjun Choi Sungjin Song Kyungwoo Song 21 0 0 20 Aug 2024
HySem: A context length optimized LLM pipeline for unstructured tabular extraction Narayanan PP A. P. N. Iyer 33 0 0 18 Aug 2024
Tabular Transfer Learning via Prompting LLMs Jaehyun Nam Woomin Song Seong Hyeon Park Jihoon Tack Sukmin Yun Jaehyung Kim Kyu Hwan Oh Jinwoo Shin RALM LMTD VPVLM 29 2 0 09 Aug 2024
HARMONIC: Harnessing LLMs for Tabular Data Synthesis and Privacy Protection Yuxin Wang Duanyu Feng Yongfu Dai Zhengyu Chen Jimin Huang Sophia Ananiadou Qianqian Xie Hao Wang 24 3 0 06 Aug 2024
Team up GBDTs and DNNs: Advancing Efficient and Effective Tabular Prediction with Tree-hybrid MLPs Jiahuan Yan Jintai Chen Qianxing Wang D. Z. Chen Jian Wu 24 3 0 13 Jul 2024
Quantifying Prediction Consistency Under Model Multiplicity in Tabular LLMs Faisal Hamman Pasan Dissanayake Saumitra Mishra Freddy Lecue Sanghamitra Dutta AAML 32 3 0 04 Jul 2024
Optimized Feature Generation for Tabular Data via LLMs with Decision Tree Reasoning Jaehyun Nam Kyuyoung Kim Seunghyuk Oh Jihoon Tack Jaehyung Kim Jinwoo Shin LMTD 25 9 0 12 Jun 2024
CTSyn: A Foundational Model for Cross Tabular Data Generation Xiaofeng Lin Chenheng Xu Matthew Yang Guang Cheng 32 3 0 07 Jun 2024
Is In-Context Learning in Large Language Models Bayesian? A Martingale Perspective Fabian Falck Ziyu Wang Chris Holmes 53 12 0 02 Jun 2024
SysCaps: Language Interfaces for Simulation Surrogates of Complex Systems Patrick Emami Zhaonan Li Saumya Sinha Truc Nguyen 48 1 0 30 May 2024
TWIN-GPT: Digital Twins for Clinical Trials via Large Language Model Yue Wang Tianfan Fu Yinlong Xu Zihan Ma Hongxia Xu Yingzhou Lu Bang Du Hong-Yan Gao Jian Wu LM&MA 27 26 0 01 Apr 2024
Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Survey Xi Fang Weijie Xu Fiona Anting Tan Jiani Zhang Ziqing Hu Yanjun Qi Scott Nickleach Diego Socolinsky Srinivasan H. Sengamedu Christos Faloutsos LMTD ALM 30 63 0 27 Feb 2024
A Survey on Self-Supervised Learning for Non-Sequential Tabular Data Wei-Yao Wang Wei-Wei Du Derek Xu Wei Wang Wenjie Peng LMTD 27 7 0 02 Feb 2024
From Supervised to Generative: A Novel Paradigm for Tabular Deep Learning with Large Language Models Xumeng Wen Han Zhang Shun Zheng Wei Xu Jiang Bian LMTD ALM 62 20 0 11 Oct 2023
Pretrained deep models outperform GBDTs in Learning-To-Rank under label scarcity Charlie Hou K. K. Thekumparampil Michael Shavlovsky Giulia Fanti Yesh Dattatreya Sujay Sanghavi LMTD 11 1 0 31 Jul 2023
ExcelFormer: A neural network surpassing GBDTs on tabular data Jintai Chen Jiahuan Yan Qiyuan Chen D. Z. Chen Jian Wu Jimeng Sun LMTD 25 22 0 07 Jan 2023
DANets: Deep Abstract Networks for Tabular Data Classification and Regression Jintai Chen Kuan-Yu Liao Yao Wan D. Z. Chen Jian Wu LMTD 30 48 0 06 Dec 2021
Making Pre-trained Language Models Better Few-shot Learners Tianyu Gao Adam Fisch Danqi Chen 241 1,898 0 31 Dec 2020
Neural Oblivious Decision Ensembles for Deep Learning on Tabular Data Sergei Popov S. Morozov Artem Babenko LMTD 83 290 0 13 Sep 2019
Language Models as Knowledge Bases? Fabio Petroni Tim Rocktaschel Patrick Lewis A. Bakhtin Yuxiang Wu Alexander H. Miller Sebastian Riedel KELM AI4MH 396 2,576 0 03 Sep 2019