ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2302.09419
  4. Cited By
A Comprehensive Survey on Pretrained Foundation Models: A History from
  BERT to ChatGPT
v1v2v3 (latest)

A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT

18 February 2023
Ce Zhou
Qian Li
Chen Li
Jun Yu
Yixin Liu
Guan Wang
Kaichao Zhang
Cheng Ji
Qi Yan
Lifang He
Hao Peng
Jianxin Li
Hongzhi Zhang
Ziwei Liu
P. Xie
Caiming Xiong
Jian Pei
Philip S. Yu
U. Chicago
    AI4CE
ArXiv (abs)PDFHTML

Papers citing "A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT"

50 / 293 papers shown
Title
BMFM-RNA: An Open Framework for Building and Evaluating Transcriptomic Foundation Models
BMFM-RNA: An Open Framework for Building and Evaluating Transcriptomic Foundation Models
Bharath Dandala
Michael M. Danziger
Ella Barkan
Tanwi Biswas
Viatcheslav Gurev
...
Akira Koseki
Tal Kozlovski
Michal Rosen-Zvi
Yishai Shimoni
Ching-Huei Tsou
AI4CE
15
0
0
17 Jun 2025
Fed-HeLLo: Efficient Federated Foundation Model Fine-Tuning with Heterogeneous LoRA Allocation
Fed-HeLLo: Efficient Federated Foundation Model Fine-Tuning with Heterogeneous LoRA Allocation
Zikai Zhang
Ping Liu
Jiahao Xu
Rui Hu
20
0
0
13 Jun 2025
Neural Network Reprogrammability: A Unified Theme on Model Reprogramming, Prompt Tuning, and Prompt Instruction
Neural Network Reprogrammability: A Unified Theme on Model Reprogramming, Prompt Tuning, and Prompt Instruction
Zesheng Ye
C. Cai
Ruijiang Dong
Jianzhong Qi
Lei Feng
Pin-Yu Chen
Feng Liu
201
0
0
05 Jun 2025
The Future of Continual Learning in the Era of Foundation Models: Three Key Directions
The Future of Continual Learning in the Era of Foundation Models: Three Key Directions
Jack Bell
Luigi Quarantiello
Eric Nuertey Coleman
Lanpei Li
Malio Li
Mauro Madeddu
Elia Piccoli
Vincenzo Lomonaco
KELM
27
0
0
03 Jun 2025
Benchmarking Foundation Models for Zero-Shot Biometric Tasks
Benchmarking Foundation Models for Zero-Shot Biometric Tasks
Redwan Sony
Parisa Farmanifard
Hamzeh Alzwairy
Nitish Shukla
Arun Ross
CVBMVLM
49
0
0
30 May 2025
AgriFM: A Multi-source Temporal Remote Sensing Foundation Model for Crop Mapping
AgriFM: A Multi-source Temporal Remote Sensing Foundation Model for Crop Mapping
Wenyuan Li
Shunlin Liang
Keyan Chen
Yongzhe Chen
Han Ma
Jianglei Xu
Yichuan Ma
Shikang Guan
Husheng Fang
Z. Shi
35
0
0
27 May 2025
Position is Power: System Prompts as a Mechanism of Bias in Large Language Models (LLMs)
Position is Power: System Prompts as a Mechanism of Bias in Large Language Models (LLMs)
Anna Neumann
Elisabeth Kirsten
Muhammad Bilal Zafar
Jatinder Singh
59
0
0
27 May 2025
Graceful Forgetting in Generative Language Models
Graceful Forgetting in Generative Language Models
Chunyang Jiang
Chi-Min Chan
Yiyang Cai
Yulong Liu
Wei Xue
Yike Guo
MoMeCLLKELM
33
0
0
26 May 2025
DGRAG: Distributed Graph-based Retrieval-Augmented Generation in Edge-Cloud Systems
DGRAG: Distributed Graph-based Retrieval-Augmented Generation in Edge-Cloud Systems
Wenqing Zhou
Yuxuan Yan
Qianqian Yang
24
0
0
26 May 2025
COLORA: Efficient Fine-Tuning for Convolutional Models with a Study Case on Optical Coherence Tomography Image Classification
COLORA: Efficient Fine-Tuning for Convolutional Models with a Study Case on Optical Coherence Tomography Image Classification
M. Rivera
A. Hoyos
128
0
0
23 May 2025
TabSTAR: A Foundation Tabular Model With Semantically Target-Aware Representations
Alan Arazi
Eilam Shapira
Roi Reichart
LMTD
205
0
0
23 May 2025
Improve Rule Retrieval and Reasoning with Self-Induction and Relevance ReEstimate
Improve Rule Retrieval and Reasoning with Self-Induction and Relevance ReEstimate
Ziyang Huang
Wangtao Sun
Jun Zhao
Kang Liu
LRM
62
0
0
16 May 2025
Towards Artificial General or Personalized Intelligence? A Survey on Foundation Models for Personalized Federated Intelligence
Towards Artificial General or Personalized Intelligence? A Survey on Foundation Models for Personalized Federated Intelligence
Yu Qiao
Huy Q. Le
Avi Deb Raha
Phuong-Nam Tran
Apurba Adhikary
Mengchun Zhang
Loc X. Nguyen
Eui-nam Huh
Dusit Niyato
Choong Seon Hong
AI4CE
161
1
0
11 May 2025
An empathic GPT-based chatbot to talk about mental disorders with Spanish teenagers
An empathic GPT-based chatbot to talk about mental disorders with Spanish teenagers
Alba María Mármol-Romero
Manuel García-Vega
Miguel Ángel García-Cumbreras
Arturo Montejo-Ráez
94
3
0
09 May 2025
Vision Mamba in Remote Sensing: A Comprehensive Survey of Techniques, Applications and Outlook
Vision Mamba in Remote Sensing: A Comprehensive Survey of Techniques, Applications and Outlook
Muyi Bao
Shuchang Lyu
Zhaoyang Xu
Huiyu Zhou
Jinchang Ren
Shiming Xiang
Xuelong Li
Guangliang Cheng
Mamba
267
0
0
01 May 2025
Multimodal Large Language Models for Medicine: A Comprehensive Survey
Multimodal Large Language Models for Medicine: A Comprehensive Survey
Jiarui Ye
Hao Tang
LM&MA
183
0
0
29 Apr 2025
Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks
Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks
Yang Liu
Bingjie Yan
Tianyuan Zou
Jianqing Zhang
Zixuan Gu
...
Jiajian Li
Xiaozhou Ye
Ye Ouyang
Qiang Yang
Yanzhe Zhang
ALM
458
1
0
24 Apr 2025
Aria-MIDI: A Dataset of Piano MIDI Files for Symbolic Music Modeling
Aria-MIDI: A Dataset of Piano MIDI Files for Symbolic Music Modeling
Louis B. Bradshaw
Simon Colton
96
1
0
21 Apr 2025
Intrinsic Barriers to Explaining Deep Foundation Models
Intrinsic Barriers to Explaining Deep Foundation Models
Zhen Tan
Huan Liu
AI4CE
59
0
0
21 Apr 2025
Representation Learning for Tabular Data: A Comprehensive Survey
Representation Learning for Tabular Data: A Comprehensive Survey
Jun-Peng Jiang
Si-Yang Liu
Hao-Run Cai
Qile Zhou
Han-Jia Ye
LMTD
170
4
0
17 Apr 2025
Bridging Distribution Gaps in Time Series Foundation Model Pretraining with Prototype-Guided Normalization
Bridging Distribution Gaps in Time Series Foundation Model Pretraining with Prototype-Guided Normalization
Peiliang Gong
Emadeldeen Eldele
Min Wu
Zhenghua Chen
Xiaoli Li
Daoqiang Zhang
AI4TSAI4CE
135
0
0
15 Apr 2025
Foundation Models for Environmental Science: A Survey of Emerging Frontiers
Foundation Models for Environmental Science: A Survey of Emerging Frontiers
Runlong Yu
Shengyu Chen
Yiqun Xie
Huaxiu Yao
J. Willard
X. Jia
AI4CE
129
1
0
05 Apr 2025
ChatGPT and U(X): A Rapid Review on Measuring the User Experience
ChatGPT and U(X): A Rapid Review on Measuring the User Experience
Katie Seaborn
LM&MAELM
114
0
0
20 Mar 2025
SharedAssembly: A Data Collection Approach via Shared Tele-Assembly
SharedAssembly: A Data Collection Approach via Shared Tele-Assembly
Yansong Wu
Xiao Chen
Yu Chen
Hamid Sadeghian
Fan Wu
Zhenshan Bing
Sami Haddadin
Alexander König
Alois C. Knoll
116
0
0
15 Mar 2025
FedALT: Federated Fine-Tuning through Adaptive Local Training with Rest-of-World LoRA
FedALT: Federated Fine-Tuning through Adaptive Local Training with Rest-of-World LoRA
Jieming Bian
Lei Wang
Letian Zhang
Jie Xu
105
3
0
14 Mar 2025
Isolated Channel Vision Transformers: From Single-Channel Pretraining to Multi-Channel Finetuning
Wenyi Lian
Joakim Lindblad
Patrick Micke
Natasa Sladoje
102
1
0
12 Mar 2025
The Algorithmic State Architecture (ASA): An Integrated Framework for AI-Enabled Government
Zeynep Engin
Jon Crowcroft
David Hand
Philip Treleaven
82
2
0
11 Mar 2025
Fairness-Aware Low-Rank Adaptation Under Demographic Privacy Constraints
Parameswaran Kamalaruban
Mark Anderson
Stuart Burrell
Maeve Madigan
Piotr Skalski
David Sutton
87
0
0
07 Mar 2025
SafeVLA: Towards Safety Alignment of Vision-Language-Action Model via Constrained Learning
SafeVLA: Towards Safety Alignment of Vision-Language-Action Model via Constrained Learning
Borong Zhang
Yuhao Zhang
Yalan Qin
Yingshan Lei
Josef Dai
Yuanpei Chen
Yaodong Yang
126
4
0
05 Mar 2025
LLMs are everywhere: Ubiquitous Utilization of AI Models through Air Computing
Baris Yamansavascilar
Atay Ozgovde
Cem Ersoy
66
0
0
02 Mar 2025
Unlocking Efficient, Scalable, and Continual Knowledge Editing with Basis-Level Representation Fine-Tuning
Tianci Liu
R. Li
Yunzhe Qi
Hui Liu
Xianfeng Tang
...
Qingyu Yin
Monica Cheng
Jun Huan
Haoyu Wang
Jing Gao
KELM
98
4
0
01 Mar 2025
A Closer Look at TabPFN v2: Understanding Its Strengths and Extending Its Capabilities
Han-Jia Ye
Si-Yang Liu
Wei-Lun Chao
124
8
0
24 Feb 2025
MedForge: Building Medical Foundation Models Like Open Source Software Development
MedForge: Building Medical Foundation Models Like Open Source Software Development
Zheling Tan
Kexin Ding
Jin Gao
Mu Zhou
Dimitris N. Metaxas
Shaoting Zhang
Dequan Wang
AI4CE
122
2
0
22 Feb 2025
Towards Physics-Guided Foundation Models
Towards Physics-Guided Foundation Models
Majid Farhadloo
Arun Sharma
Mingzhou Yang
B. Jayaprakash
W. Northrop
Shashi Shekhar
AI4CE
102
0
0
20 Feb 2025
Generative Multi-Agent Collaboration in Embodied AI: A Systematic Review
Generative Multi-Agent Collaboration in Embodied AI: A Systematic Review
Di Wu
Xian Wei
Guang Chen
Hao Shen
Xiangfeng Wang
Wenhao Li
Bo Jin
139
2
0
17 Feb 2025
Ten Challenging Problems in Federated Foundation Models
Ten Challenging Problems in Federated Foundation Models
Tao Fan
Hanlin Gu
Xuemei Cao
Chee Seng Chan
Qian Chen
...
Yu Zhang
Xiaojin Zhang
Zhenzhe Zheng
Lixin Fan
Qiang Yang
FedML
176
8
0
14 Feb 2025
Foundation Models for Anomaly Detection: Vision and Challenges
Foundation Models for Anomaly Detection: Vision and Challenges
Jing Ren
Tao Tang
Hong Jia
Haytham Fayek
Haytham Fayek
Xiaodong Li
Suyu Ma
Xiwei Xu
Feng Xia
153
0
0
10 Feb 2025
Physics-Guided Foundation Model for Scientific Discovery: An Application to Aquatic Science
Physics-Guided Foundation Model for Scientific Discovery: An Application to Aquatic Science
Runlong Yu
Chonghao Qiu
R. Ladwig
Paul C. Hanson
Yiqun Xie
X. Jia
AI4CE
99
3
0
10 Feb 2025
TabICL: A Tabular Foundation Model for In-Context Learning on Large Data
TabICL: A Tabular Foundation Model for In-Context Learning on Large Data
Jingang Qu
David Holzmüller
Gaël Varoquaux
Marine Le Morvan
LMTD
277
16
0
08 Feb 2025
A Comprehensive Survey of Foundation Models in Medicine
A Comprehensive Survey of Foundation Models in Medicine
Wasif Khan
Seowung Leem
Kyle B. See
Joshua K. Wong
Shaoting Zhang
R. Fang
AI4CELM&MAVLM
282
27
0
17 Jan 2025
BTGenBot: Behavior Tree Generation for Robotic Tasks with Lightweight LLMs
BTGenBot: Behavior Tree Generation for Robotic Tasks with Lightweight LLMs
Riccardo Andrea Izzo
Gianluca Bardaro
Matteo Matteucci
LM&Ro
98
8
0
08 Jan 2025
A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicine
A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicine
Hanguang Xiao
Feizhong Zhou
Xianglong Liu
Tianqi Liu
Zhipeng Li
Xin Liu
Xiaoxuan Huang
AILawLM&MALRM
145
30
0
31 Dec 2024
Is ChatGPT Massively Used by Students Nowadays? A Survey on the Use of
  Large Language Models such as ChatGPT in Educational Settings
Is ChatGPT Massively Used by Students Nowadays? A Survey on the Use of Large Language Models such as ChatGPT in Educational Settings
Jérémie Sublime
Ilaria Renna
AI4CE
38
1
0
23 Dec 2024
Unimib Assistant: designing a student-friendly RAG-based chatbot for all
  their needs
Unimib Assistant: designing a student-friendly RAG-based chatbot for all their needs
Chiara Antico
Stefano Giordano
Cansu Koyuturk
D. Ognibene
115
2
0
29 Nov 2024
GFT: Graph Foundation Model with Transferable Tree Vocabulary
GFT: Graph Foundation Model with Transferable Tree Vocabulary
Zehong Wang
Zheyuan Zhang
Nitesh Chawla
Chuxu Zhang
Yanfang Ye
101
20
0
09 Nov 2024
Multi-modal NeRF Self-Supervision for LiDAR Semantic Segmentation
Multi-modal NeRF Self-Supervision for LiDAR Semantic Segmentation
Xavier Timoneda
Markus Herb
Fabian Duerr
Daniel Goehring
Fisher Yu
SSL3DPC
61
1
0
05 Nov 2024
Optical Lens Attack on Monocular Depth Estimation for Autonomous Driving
Optical Lens Attack on Monocular Depth Estimation for Autonomous Driving
Ce Zhou
Qiben Yan
Daniel Kent
Guangjing Wang
Weikang Ding
Ziqi Zhang
Hayder Radha
AAML
159
0
0
31 Oct 2024
FedBaF: Federated Learning Aggregation Biased by a Foundation Model
FedBaF: Federated Learning Aggregation Biased by a Foundation Model
Jong-Ik Park
Srinivasa Pranav
J. M. F. Moura
Carlee Joe-Wong
AI4CE
140
2
0
24 Oct 2024
Upsampling DINOv2 features for unsupervised vision tasks and weakly
  supervised materials segmentation
Upsampling DINOv2 features for unsupervised vision tasks and weakly supervised materials segmentation
Ronan Docherty
Antonis Vamvakeros
Samuel J. Cooper
69
2
0
20 Oct 2024
LangGFM: A Large Language Model Alone Can be a Powerful Graph Foundation
  Model
LangGFM: A Large Language Model Alone Can be a Powerful Graph Foundation Model
Tianqianjin Lin
Pengwei Yan
Kaisong Song
Zhuoren Jiang
Yangyang Kang
Jun Lin
Weikang Yuan
Junjie Cao
Changlong Sun
Wei Lu
AI4CE
60
3
0
19 Oct 2024
123456
Next