ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2302.09419
  4. Cited By
A Comprehensive Survey on Pretrained Foundation Models: A History from
  BERT to ChatGPT
v1v2v3 (latest)

A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT

18 February 2023
Ce Zhou
Qian Li
Chen Li
Jun Yu
Yixin Liu
Guan Wang
Kaichao Zhang
Cheng Ji
Qi Yan
Lifang He
Hao Peng
Jianxin Li
Hongzhi Zhang
Ziwei Liu
P. Xie
Caiming Xiong
Jian Pei
Philip S. Yu
U. Chicago
    AI4CE
ArXiv (abs)PDFHTMLHuggingFace (1 upvotes)Github (8276★)

Papers citing "A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT"

50 / 333 papers shown
Towards a General Framework for HTN Modeling with LLMs
Towards a General Framework for HTN Modeling with LLMs
Israel Puerta-Merino
Carlos Núnez-Molina
Pablo Mesejo
Juan Fernández-Olivares
166
0
0
22 Nov 2025
DeepDefense: Layer-Wise Gradient-Feature Alignment for Building Robust Neural Networks
DeepDefense: Layer-Wise Gradient-Feature Alignment for Building Robust Neural Networks
Ci Lin
T. Yeap
I. Kiringa
Biwei Zhang
AAML
170
0
0
13 Nov 2025
Adaptation and Fine-tuning with TabPFN for Travelling Salesman Problem
Adaptation and Fine-tuning with TabPFN for Travelling Salesman Problem
Nguyen Gia Hien Vu
Yifan Tang
Rey Lim
Yifan Yang
Hang Ma
Ke Wang
Guanhua Wang
229
0
0
08 Nov 2025
HiMAE: Hierarchical Masked Autoencoders Discover Resolution-Specific Structure in Wearable Time Series
HiMAE: Hierarchical Masked Autoencoders Discover Resolution-Specific Structure in Wearable Time Series
Simon A. Lee
Cyrus Tanade
Hao Zhou
Juhyeon Lee
Megha Thukral
...
Viswam Nathan
M. Rahman
Li Zhu
Subramaniam Venkatraman
Sharanya Arcot Desai
161
8
0
28 Oct 2025
Beyond the Failures: Rethinking Foundation Models in Pathology
Beyond the Failures: Rethinking Foundation Models in Pathology
Hamid R. Tizhoosh
MedImAI4CE
256
0
0
27 Oct 2025
Energy-Efficient Domain-Specific Artificial Intelligence Models and Agents: Pathways and Paradigms
Energy-Efficient Domain-Specific Artificial Intelligence Models and Agents: Pathways and Paradigms
Abhijit Chatterjee
N. Jha
Jonathan D. Cohen
Thomas Griffiths
Hongjing Lu
Diana Marculescu
Ashiqur Rasul
Keshab K. Parhi
LLMAGAI4CE
492
2
0
24 Oct 2025
Integrating Machine Learning into Belief-Desire-Intention Agents: Current Advances and Open Challenges
Integrating Machine Learning into Belief-Desire-Intention Agents: Current Advances and Open Challenges
Andrea Agiollo
Andrea Omicini
LM&RoAI4CE
219
0
0
23 Oct 2025
Can You Trust What You See? Alpha Channel No-Box Attacks on Video Object Detection
Can You Trust What You See? Alpha Channel No-Box Attacks on Video Object Detection
Ariana Yi
Ce Zhou
Liyang Xiao
Qiben Yan
AAML
171
0
0
22 Oct 2025
Can LLMs Correct Themselves? A Benchmark of Self-Correction in LLMs
Can LLMs Correct Themselves? A Benchmark of Self-Correction in LLMs
Guiyao Tie
Zenghui Yuan
Zeli Zhao
Chaoran Hu
Tianhe Gu
...
Ming Jin
Qingsong Wen
Lixing Chen
P. Zhou
Lichao Sun
KELMReLMLRM
299
5
0
17 Oct 2025
Towards Human-Centric Intelligent Treatment Planning for Radiation Therapy
Towards Human-Centric Intelligent Treatment Planning for Radiation Therapy
Adnan Jafar
Xun Jia
162
0
0
15 Oct 2025
Relational Transformer: Toward Zero-Shot Foundation Models for Relational Data
Relational Transformer: Toward Zero-Shot Foundation Models for Relational Data
Rishabh Ranjan
Valter Hudovernik
Mark Znidar
Charilaos I. Kanatsoulis
Roshan Upendra
Mahmoud Mohammadi
Joe Meyer
Tom Palczewski
Carlos Guestrin
Jure Leskovec
LMTD
302
13
0
07 Oct 2025
ADAPT: Lightweight, Long-Range Machine Learning Force Fields Without Graphs
ADAPT: Lightweight, Long-Range Machine Learning Force Fields Without Graphs
Evan Dramko
Yihuang Xiong
Yizhi Zhu
Geoffroy Hautier
Thomas Reps
C. Jermaine
Anastasios Kyrillidis
AI4CE
234
2
0
28 Sep 2025
Super-Linear: A Lightweight Pretrained Mixture of Linear Experts for Time Series Forecasting
Super-Linear: A Lightweight Pretrained Mixture of Linear Experts for Time Series Forecasting
Liran Nochumsohn
Raz Marshanski
Hedi Zisling
Omri Azencot
AI4TS
128
1
0
18 Sep 2025
Interpreting Public Sentiment in Diplomacy Events: A Counterfactual Analysis Framework Using Large Language Models
Interpreting Public Sentiment in Diplomacy Events: A Counterfactual Analysis Framework Using Large Language Models
Leyi Ouyang
205
1
0
15 Sep 2025
MedDINOv3: How to adapt vision foundation models for medical image segmentation?
MedDINOv3: How to adapt vision foundation models for medical image segmentation?
Yuheng Li
Yizhou Wu
Yuxiang Lai
Mingzhe Hu
Xiaofeng Yang
MedIm
418
15
0
02 Sep 2025
LLM-Guided Semantic Relational Reasoning for Multimodal Intent Recognition
LLM-Guided Semantic Relational Reasoning for Multimodal Intent Recognition
Qianrui Zhou
Hua Xu
Yifan Wang
Xinzhi Dong
Hanlei Zhang
152
3
0
01 Sep 2025
DELIVER: A System for LLM-Guided Coordinated Multi-Robot Pickup and Delivery using Voronoi-Based Relay Planning
DELIVER: A System for LLM-Guided Coordinated Multi-Robot Pickup and Delivery using Voronoi-Based Relay Planning
Alkesh K. Srivastava
Jared Michael Levin
Alexander Derrico
Philip Dames
134
2
0
26 Aug 2025
EMind: A Foundation Model for Multi-task Electromagnetic Signals Understanding
EMind: A Foundation Model for Multi-task Electromagnetic Signals Understanding
Luqing Luo
Wenjin Gui
Yunfei Liu
Ziyue Zhang
Yunxi Zhang
...
Hanxiang He
Jinhai Li
Xin Qiu
Wupeng Xie
Yangang Sun
238
2
0
26 Aug 2025
SPANER: Shared Prompt Aligner for Multimodal Semantic Representation
SPANER: Shared Prompt Aligner for Multimodal Semantic Representation
Thye Shan Ng
Caren Soyeon Han
Eun-Jung Holden
172
0
0
18 Aug 2025
Large-Small Model Collaborative Framework for Federated Continual Learning
Large-Small Model Collaborative Framework for Federated Continual Learning
Hao Yu
Xin Yang
Boyang Fan
Xuemei Cao
Hanlin Gu
Lixin Fan
Qiang Yang
FedMLCLL
1.6K
0
0
13 Aug 2025
Adapting Vision-Language Models Without Labels: A Comprehensive Survey
Adapting Vision-Language Models Without Labels: A Comprehensive Survey
Hao Dong
Lijun Sheng
Jian Liang
Ran He
Eleni Chatzi
Olga Fink
OffRLVLM
273
5
0
07 Aug 2025
Zero-shot Shape Classification of Nanoparticles in SEM Images using Vision Foundation Models
Zero-shot Shape Classification of Nanoparticles in SEM Images using Vision Foundation Models
Freida Barnatan
Emunah Goldstein
Einav Kalimian
Orchen Madar
Avi Huri
David Zitoun
Yaákov Mandelbaum
Moshe Amitay
VLM
133
1
0
05 Aug 2025
Towards Affordable Tumor Segmentation and Visualization for 3D Breast MRI Using SAM2
Towards Affordable Tumor Segmentation and Visualization for 3D Breast MRI Using SAM2
Solha Kang
Eugene Kim
J. Vankerschaver
Utku Ozbulak
171
0
0
31 Jul 2025
Distilling Knowledge from Large Language Models: A Concept Bottleneck Model for Hate and Counter Speech Recognition
Distilling Knowledge from Large Language Models: A Concept Bottleneck Model for Hate and Counter Speech Recognition
Roberto Labadie-Tamayo
D. Slijepcevic
Xihui Chen
Adrian Jaques Böck
Andreas Babic
Liz Freimann
Christiane Atzmüller Matthias Zeppelzauer
168
2
0
30 Jul 2025
UniDomain: Pretraining a Unified PDDL Domain from Real-World Demonstrations for Generalizable Robot Task Planning
UniDomain: Pretraining a Unified PDDL Domain from Real-World Demonstrations for Generalizable Robot Task Planning
Haoming Ye
Yunxiao Xiao
Cewu Lu
Panpan Cai
LM&Ro
243
0
0
29 Jul 2025
Resource Consumption Red-Teaming for Large Vision-Language Models
Resource Consumption Red-Teaming for Large Vision-Language Models
Haoran Gao
Yuanhe Zhang
Zhenhong Zhou
Lei Jiang
Fanyu Meng
Yujia Xiao
Kun Wang
Zehua Wang
Yang Liu
Junlan Feng
AAML
238
0
0
24 Jul 2025
CompLeak: Deep Learning Model Compression Exacerbates Privacy Leakage
CompLeak: Deep Learning Model Compression Exacerbates Privacy Leakage
Na Li
Yansong Gao
Hongsheng Hu
Boyu Kuang
Anmin Fu
260
0
0
22 Jul 2025
A Survey on Efficiency Optimization Techniques for DNN-based Video Analytics: Process Systems, Algorithms, and Applications
A Survey on Efficiency Optimization Techniques for DNN-based Video Analytics: Process Systems, Algorithms, and Applications
Shanjiang Tang
Rui Huang
Hsinyu Luo
C. Wang
Ce Yu
Yusen Li
Hao Fu
Chao Sun
and Jian Xiao
199
0
0
21 Jul 2025
Foundation Models and Transformers for Anomaly Detection: A Survey
Foundation Models and Transformers for Anomaly Detection: A SurveyInformation Fusion (Inf. Fusion), 2025
Mouin Ben Ammar
Arturo Mendoza
Nacim Belkhir
Antoine Manzanera
Gianni Franchi
257
9
0
21 Jul 2025
A Clinically-Grounded Two-Stage Framework for Renal CT Report Generation
A Clinically-Grounded Two-Stage Framework for Renal CT Report Generation
Renjie Liang
Zhengkang Fan
Jinqian Pan
Chenkun Sun
Bruce Daniel Steinberg
Russell Terry
Jie Xu
MedIm
161
0
0
30 Jun 2025
Towards a Unified Textual Graph Framework for Spectral Reasoning via Physical and Chemical Information Fusion
Towards a Unified Textual Graph Framework for Spectral Reasoning via Physical and Chemical Information Fusion
Jiheng Liang
Ziru Yu
Zujie Xie
Yuchen Guo
Yulan Guo
Xiangyang Yu
177
1
0
21 Jun 2025
BMFM-RNA: whole-cell expression decoding improves transcriptomic foundation models
BMFM-RNA: whole-cell expression decoding improves transcriptomic foundation models
Bharath Dandala
Michael M. Danziger
Ella Barkan
Tanwi Biswas
Viatcheslav Gurev
...
Yishai Shimoni
Ching-Huei Tsou
Yishai Shimoni
Jianying Hu
Michal Rosen-Zvi
230
2
0
17 Jun 2025
Fed-HeLLo: Efficient Federated Foundation Model Fine-Tuning with Heterogeneous LoRA Allocation
Fed-HeLLo: Efficient Federated Foundation Model Fine-Tuning with Heterogeneous LoRA AllocationIEEE Transactions on Neural Networks and Learning Systems (IEEE TNNLS), 2025
Zikai Zhang
Ping Liu
Jiahao Xu
Rui Hu
287
11
0
13 Jun 2025
Neural Network Reprogrammability: A Unified Theme on Model Reprogramming, Prompt Tuning, and Prompt Instruction
Neural Network Reprogrammability: A Unified Theme on Model Reprogramming, Prompt Tuning, and Prompt Instruction
Zesheng Ye
C. Cai
Ruijiang Dong
Jianzhong Qi
Bingquan Shen
Pin-Yu Chen
Feng Liu
805
3
0
05 Jun 2025
The Future of Continual Learning in the Era of Foundation Models: Three Key Directions
The Future of Continual Learning in the Era of Foundation Models: Three Key Directions
Jack Bell
Luigi Quarantiello
Eric Nuertey Coleman
Lanpei Li
Malio Li
Mauro Madeddu
Elia Piccoli
Vincenzo Lomonaco
KELM
410
8
0
03 Jun 2025
Benchmarking Foundation Models for Zero-Shot Biometric Tasks
Benchmarking Foundation Models for Zero-Shot Biometric Tasks
Redwan Sony
Parisa Farmanifard
Hamzeh Alzwairy
Nitish Shukla
Arun Ross
CVBMVLM
353
11
0
30 May 2025
AgriFM: A Multi-source Temporal Remote Sensing Foundation Model for Agriculture Mapping
AgriFM: A Multi-source Temporal Remote Sensing Foundation Model for Agriculture Mapping
Wenyuan Li
Shunlin Liang
Keyan Chen
Yongzhe Chen
Han Ma
Jianglei Xu
Yichuan Ma
Shikang Guan
Husheng Fang
Z. Shi
315
1
0
27 May 2025
Position is Power: System Prompts as a Mechanism of Bias in Large Language Models (LLMs)
Position is Power: System Prompts as a Mechanism of Bias in Large Language Models (LLMs)Conference on Fairness, Accountability and Transparency (FAccT), 2025
Anna Neumann
Elisabeth Kirsten
Muhammad Bilal Zafar
Jatinder Singh
428
16
0
27 May 2025
Graceful Forgetting in Generative Language Models
Graceful Forgetting in Generative Language Models
Chunyang Jiang
Chi-Min Chan
Yiyang Cai
Yulong Liu
Wei Xue
Wenhan Luo
KELMCLLMoMe
185
1
0
26 May 2025
DGRAG: Distributed Graph-based Retrieval-Augmented Generation in Edge-Cloud Systems
DGRAG: Distributed Graph-based Retrieval-Augmented Generation in Edge-Cloud Systems
Wenqing Zhou
Yuxuan Yan
Qianqian Yang
297
1
0
26 May 2025
COLORA: Efficient Fine-Tuning for Convolutional Models with a Study Case on Optical Coherence Tomography Image Classification
COLORA: Efficient Fine-Tuning for Convolutional Models with a Study Case on Optical Coherence Tomography Image Classification
M. Rivera
A. Hoyos
451
1
0
23 May 2025
TabSTAR: A Tabular Foundation Model for Tabular Data with Text Fields
TabSTAR: A Tabular Foundation Model for Tabular Data with Text Fields
Alan Arazi
Eilam Shapira
Roi Reichart
LMTD
578
0
0
23 May 2025
Improve Rule Retrieval and Reasoning with Self-Induction and Relevance ReEstimate
Improve Rule Retrieval and Reasoning with Self-Induction and Relevance ReEstimateAnnual Meeting of the Association for Computational Linguistics (ACL), 2025
Ziyang Huang
Wangtao Sun
Jun Zhao
Kang Liu
LRM
323
3
0
16 May 2025
Towards Artificial General or Personalized Intelligence? A Survey on Foundation Models for Personalized Federated Intelligence
Towards Artificial General or Personalized Intelligence? A Survey on Foundation Models for Personalized Federated Intelligence
Yu Qiao
Huy Q. Le
Avi Deb Raha
Phuong-Nam Tran
Apurba Adhikary
Mengchun Zhang
Loc X. Nguyen
Eui-nam Huh
Zhu Han
Choong Seon Hong
AI4CE
461
7
0
11 May 2025
An empathic GPT-based chatbot to talk about mental disorders with Spanish teenagers
An empathic GPT-based chatbot to talk about mental disorders with Spanish teenagersInternational Journal of Human-Computer Interaction (IJHCI), 2024
Alba María Mármol-Romero
Manuel García-Vega
Miguel Ángel García-Cumbreras
Arturo Montejo-Ráez
260
8
0
09 May 2025
Vision Mamba in Remote Sensing: A Comprehensive Survey of Techniques, Applications and Outlook
Vision Mamba in Remote Sensing: A Comprehensive Survey of Techniques, Applications and Outlook
Muyi Bao
Shuchang Lyu
Zhaoyang Xu
Huiyu Zhou
Jinchang Ren
Shiming Xiang
Xuelong Li
Guangliang Cheng
Mamba
672
20
0
01 May 2025
Multimodal Large Language Models for Medicine: A Comprehensive Survey
Multimodal Large Language Models for Medicine: A Comprehensive Survey
Jiarui Ye
Hao Tang
LM&MA
648
18
0
29 Apr 2025
Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks
Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks
Yang Liu
Bingjie Yan
Tianyuan Zou
Jianqing Zhang
Zixuan Gu
...
Jiajian Li
Xiaozhou Ye
Ye Ouyang
Qiang Yang
Yanzhe Zhang
ALM
1.1K
6
0
24 Apr 2025
Aria-MIDI: A Dataset of Piano MIDI Files for Symbolic Music Modeling
Aria-MIDI: A Dataset of Piano MIDI Files for Symbolic Music ModelingInternational Conference on Learning Representations (ICLR), 2025
Louis B. Bradshaw
Simon Colton
298
8
0
21 Apr 2025
Intrinsic Barriers to Explaining Deep Foundation Models
Intrinsic Barriers to Explaining Deep Foundation Models
Zhen Tan
Huan Liu
AI4CE
213
1
0
21 Apr 2025
1234567
Next
Page 1 of 7