ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2302.09419
  4. Cited By
A Comprehensive Survey on Pretrained Foundation Models: A History from
  BERT to ChatGPT
v1v2v3 (latest)

A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT

18 February 2023
Ce Zhou
Qian Li
Chen Li
Jun Yu
Yixin Liu
Guan Wang
Kaichao Zhang
Cheng Ji
Qi Yan
Lifang He
Hao Peng
Jianxin Li
Hongzhi Zhang
Ziwei Liu
P. Xie
Caiming Xiong
Jian Pei
Philip S. Yu
U. Chicago
    AI4CE
ArXiv (abs)PDFHTML

Papers citing "A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT"

43 / 293 papers shown
Title
A Survey on ChatGPT: AI-Generated Contents, Challenges, and Solutions
A Survey on ChatGPT: AI-Generated Contents, Challenges, and Solutions
Yuntao Wang
Yanghe Pan
Miao Yan
Zhou Su
Tom H. Luan
96
168
0
25 May 2023
ChatGPT for PLC/DCS Control Logic Generation
ChatGPT for PLC/DCS Control Logic Generation
Heiko Koziolek
Sten Gruener
Virendra Ashiwal
AI4CE
36
22
0
25 May 2023
ChatAgri: Exploring Potentials of ChatGPT on Cross-linguistic
  Agricultural Text Classification
ChatAgri: Exploring Potentials of ChatGPT on Cross-linguistic Agricultural Text Classification
Biao Zhao
Weiqiang Jin
Javier Del Ser
Guangyao Yang
83
67
0
24 May 2023
Weakly Supervised 3D Open-vocabulary Segmentation
Weakly Supervised 3D Open-vocabulary Segmentation
Kunhao Liu
Fangneng Zhan
Jiahui Zhang
Muyu Xu
Yingchen Yu
Abdulmotaleb El Saddik
Christian Theobalt
Eric P. Xing
Shijian Lu
121
70
0
23 May 2023
Enhancing Large Language Models Against Inductive Instructions with
  Dual-critique Prompting
Enhancing Large Language Models Against Inductive Instructions with Dual-critique Prompting
Rui Wang
Hongru Wang
Fei Mi
Yi Chen
Boyang Xue
Kam-Fai Wong
Rui-Lan Xu
83
17
0
23 May 2023
Watermarking Text Data on Large Language Models for Dataset Copyright
Watermarking Text Data on Large Language Models for Dataset Copyright
Yixin Liu
Hongsheng Hu
Xun Chen
Xuyun Zhang
Lichao Sun
WaLM
77
26
0
22 May 2023
Crosslingual Transfer Learning for Low-Resource Languages Based on
  Multilingual Colexification Graphs
Crosslingual Transfer Learning for Low-Resource Languages Based on Multilingual Colexification Graphs
Yihong Liu
Haotian Ye
Leonie Weissweiler
Renhao Pei
Hinrich Schütze
91
11
0
22 May 2023
Reflective Linguistic Programming (RLP): A Stepping Stone in
  Socially-Aware AGI (SocialAGI)
Reflective Linguistic Programming (RLP): A Stepping Stone in Socially-Aware AGI (SocialAGI)
Kevin Fischer
127
16
0
22 May 2023
Cue-CoT: Chain-of-thought Prompting for Responding to In-depth Dialogue
  Questions with LLMs
Cue-CoT: Chain-of-thought Prompting for Responding to In-depth Dialogue Questions with LLMs
Hongru Wang
Rui Wang
Fei Mi
Yang Deng
Zezhong Wang
Bin Liang
Ruifeng Xu
Kam-Fai Wong
LRM
84
68
0
19 May 2023
M3KE: A Massive Multi-Level Multi-Subject Knowledge Evaluation Benchmark
  for Chinese Large Language Models
M3KE: A Massive Multi-Level Multi-Subject Knowledge Evaluation Benchmark for Chinese Large Language Models
Chuang Liu
Renren Jin
Yuqi Ren
Linhao Yu
Tianyu Dong
...
Peiyi Zhang
Qingqing Lyu
Xiaowen Su
Qun Liu
Deyi Xiong
ELMALM
119
26
0
17 May 2023
Taking Advice from ChatGPT
Taking Advice from ChatGPT
Peter Zhang
70
5
0
11 May 2023
ChatGPT-Like Large-Scale Foundation Models for Prognostics and Health
  Management: A Survey and Roadmaps
ChatGPT-Like Large-Scale Foundation Models for Prognostics and Health Management: A Survey and Roadmaps
Yanfang Li
Huan Wang
Muxia Sun
LM&MAAI4TSAI4CE
101
59
0
10 May 2023
Visual Tuning
Visual Tuning
Bruce X. B. Yu
Jianlong Chang
Haixin Wang
Lin Liu
Shijie Wang
...
Lingxi Xie
Haojie Li
Zhouchen Lin
Qi Tian
Chang Wen Chen
VLM
171
41
0
10 May 2023
The Application of Affective Measures in Text-based Emotion Aware
  Recommender Systems
The Application of Affective Measures in Text-based Emotion Aware Recommender Systems
John Kalung Leung
Igor Griva
W. Kennedy
J. Kinser
Sohyun Park
Seoyoon Lee
113
2
0
04 May 2023
Evaluation of GPT-3.5 and GPT-4 for supporting real-world information
  needs in healthcare delivery
Evaluation of GPT-3.5 and GPT-4 for supporting real-world information needs in healthcare delivery
Debadutta Dash
Rahul Thapa
Juan M. Banda
Akshay Swaminathan
Morgan Cheatham
...
Garret K. Morris
H. Magon
M. Lungren
Eric Horvitz
N. Shah
ELMLM&MAAI4MH
137
52
0
26 Apr 2023
Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyond
Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyond
Jingfeng Yang
Hongye Jin
Ruixiang Tang
Xiaotian Han
Qizhang Feng
Haoming Jiang
Bing Yin
Helen Zhou
LM&MA
214
682
0
26 Apr 2023
Segment Anything in Non-Euclidean Domains: Challenges and Opportunities
Segment Anything in Non-Euclidean Domains: Challenges and Opportunities
Yongcheng Jing
Xinchao Wang
Dacheng Tao
100
22
0
23 Apr 2023
Segment Anything Model for Medical Image Analysis: an Experimental Study
Segment Anything Model for Medical Image Analysis: an Experimental Study
Maciej A. Mazurowski
Haoyu Dong
Han Gu
Jichen Yang
Nicholas Konz
Yixin Zhang
MedImVLM
117
508
0
20 Apr 2023
The Self-Perception and Political Biases of ChatGPT
The Self-Perception and Political Biases of ChatGPT
Jérôme Rutinowski
Sven Franke
Jan Endendyk
Ina Dormuth
Markus Pauly
106
104
0
14 Apr 2023
On Efficient Training of Large-Scale Deep Learning Models: A Literature
  Review
On Efficient Training of Large-Scale Deep Learning Models: A Literature Review
Li Shen
Yan Sun
Zhiyuan Yu
Liang Ding
Xinmei Tian
Dacheng Tao
VLM
105
43
0
07 Apr 2023
One Small Step for Generative AI, One Giant Leap for AGI: A Complete
  Survey on ChatGPT in AIGC Era
One Small Step for Generative AI, One Giant Leap for AGI: A Complete Survey on ChatGPT in AIGC Era
Chaoning Zhang
Chenshuang Zhang
Chenghao Li
Yu Qiao
Sheng Zheng
...
Sung-Ho Bae
Lik-Hang Lee
Pan Hui
In So Kweon
Choong Seon Hong
LM&MAAI4MHLRMELM
106
137
0
04 Apr 2023
CQSumDP: A ChatGPT-Annotated Resource for Query-Focused Abstractive
  Summarization Based on Debatepedia
CQSumDP: A ChatGPT-Annotated Resource for Query-Focused Abstractive Summarization Based on Debatepedia
Md Tahmid Rahman Laskar
Mizanur Rahman
Israt Jahan
Enamul Hoque
J. Huang
84
9
0
31 Mar 2023
Unlocking the Potential of ChatGPT: A Comprehensive Exploration of its
  Applications, Advantages, Limitations, and Future Directions in Natural
  Language Processing
Unlocking the Potential of ChatGPT: A Comprehensive Exploration of its Applications, Advantages, Limitations, and Future Directions in Natural Language Processing
Walid Hariri
AI4MHLM&MA
169
94
0
27 Mar 2023
A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to
  GPT-5 All You Need?
A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?
Chaoning Zhang
Chenshuang Zhang
Sheng Zheng
Yu Qiao
Chenghao Li
...
Lik-Hang Lee
Yang Yang
Heng Tao Shen
In So Kweon
Choong Seon Hong
186
170
0
21 Mar 2023
DeID-GPT: Zero-shot Medical Text De-Identification by GPT-4
DeID-GPT: Zero-shot Medical Text De-Identification by GPT-4
Zheng-Long Liu
Yue Huang
Xiao-Xing Yu
Lu Zhang
Zihao Wu
...
Dinggang Shen
Quanzheng Li
Tianming Liu
Dajiang Zhu
Xiang Li
LM&MAMedIm
127
178
0
20 Mar 2023
Retrieving Multimodal Information for Augmented Generation: A Survey
Retrieving Multimodal Information for Augmented Generation: A Survey
Ruochen Zhao
Hailin Chen
Weishi Wang
Fangkai Jiao
Do Xuan Long
...
Bosheng Ding
Xiaobao Guo
Minzhi Li
Xingxuan Li
Shafiq Joty
129
88
0
20 Mar 2023
Memory-adaptive Depth-wise Heterogenous Federated Learning
Memory-adaptive Depth-wise Heterogenous Federated Learning
Kai Zhang
Yutong Dai
Hongyi Wang
Eric P. Xing
Xun Chen
Lichao Sun
FedML
75
8
0
08 Mar 2023
A Comprehensive Survey of AI-Generated Content (AIGC): A History of
  Generative AI from GAN to ChatGPT
A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT
Yihan Cao
Siyu Li
Yixin Liu
Zhiling Yan
Yutong Dai
Philip S. Yu
Lichao Sun
105
555
0
07 Mar 2023
Unlearnable Graph: Protecting Graphs from Unauthorized Exploitation
Unlearnable Graph: Protecting Graphs from Unauthorized Exploitation
Yixin Liu
Chenrui Fan
Pan Zhou
Lichao Sun
70
4
0
05 Mar 2023
Securing Biomedical Images from Unauthorized Training with Anti-Learning
  Perturbation
Securing Biomedical Images from Unauthorized Training with Anti-Learning Perturbation
Yixin Liu
Haohui Ye
Kai Zhang
Lichao Sun
MedIm
56
3
0
05 Mar 2023
Will Affective Computing Emerge from Foundation Models and General AI? A
  First Evaluation on ChatGPT
Will Affective Computing Emerge from Foundation Models and General AI? A First Evaluation on ChatGPT
Mostafa M. Amin
Min Zhang
Björn W. Schuller
AI4MH
94
74
0
03 Mar 2023
AugGPT: Leveraging ChatGPT for Text Data Augmentation
AugGPT: Leveraging ChatGPT for Text Data Augmentation
Haixing Dai
Zheng Liu
Wenxiong Liao
Xiaoke Huang
Yihan Cao
...
Lichao Sun
Quanzheng Li
Dinggang Shen
Tianming Liu
Xiang Li
139
160
0
25 Feb 2023
A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPT
A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPT
Jules White
Quchen Fu
Sam Hays
Michael Sandborn
Carlos Olea
Henry Gilbert
Ashraf Elnashar
Jesse Spencer-Smith
Douglas C. Schmidt
LLMAG
169
1,132
0
21 Feb 2023
BadGPT: Exploring Security Vulnerabilities of ChatGPT via Backdoor
  Attacks to InstructGPT
BadGPT: Exploring Security Vulnerabilities of ChatGPT via Backdoor Attacks to InstructGPT
Jiawen Shi
Yixin Liu
Pan Zhou
Lichao Sun
SILM
66
83
0
21 Feb 2023
Backdoor Attacks to Pre-trained Unified Foundation Models
Backdoor Attacks to Pre-trained Unified Foundation Models
Zenghui Yuan
Yixin Liu
Kai Zhang
Pan Zhou
Lichao Sun
AAML
88
11
0
18 Feb 2023
A Categorical Archive of ChatGPT Failures
A Categorical Archive of ChatGPT Failures
Ali Borji
ELM
143
396
0
06 Feb 2023
QR-CLIP: Introducing Explicit Open-World Knowledge for Location and Time
  Reasoning
QR-CLIP: Introducing Explicit Open-World Knowledge for Location and Time Reasoning
Weimin Shi
Mingchen Zhuge
D. Gao
Zhong Zhou
Ming-Ming Cheng
Deng-Ping Fan
LRMVLM
81
0
0
02 Feb 2023
Reference Twice: A Simple and Unified Baseline for Few-Shot Instance
  Segmentation
Reference Twice: A Simple and Unified Baseline for Few-Shot Instance Segmentation
Yue Han
Jiangning Zhang
Zhucun Xue
Chao Xu
Xintian Shen
Yabiao Wang
Chengjie Wang
Yong Liu
Xiangtai Li
102
17
0
03 Jan 2023
Principled and Efficient Transfer Learning of Deep Models via Neural
  Collapse
Principled and Efficient Transfer Learning of Deep Models via Neural Collapse
Xiao Li
Sheng Liu
Jin-li Zhou
Xin Lu
C. Fernandez‐Granda
Zhihui Zhu
Q. Qu
AAML
97
20
0
23 Dec 2022
Towards a Unified View on Visual Parameter-Efficient Transfer Learning
Towards a Unified View on Visual Parameter-Efficient Transfer Learning
Bruce X. B. Yu
Jianlong Chang
Lin Liu
Qi Tian
Changan Chen
VPVLMVLM
115
36
0
03 Oct 2022
Data Augmentation is a Hyperparameter: Cherry-picked Self-Supervision
  for Unsupervised Anomaly Detection is Creating the Illusion of Success
Data Augmentation is a Hyperparameter: Cherry-picked Self-Supervision for Unsupervised Anomaly Detection is Creating the Illusion of Success
Jaemin Yoo
Tianchen Zhao
Leman Akoglu
141
8
0
16 Aug 2022
NeuroMixGDP: A Neural Collapse-Inspired Random Mixup for Private Data
  Release
NeuroMixGDP: A Neural Collapse-Inspired Random Mixup for Private Data Release
Donghao Li
Yang Cao
Yuan Yao
85
2
0
14 Feb 2022
How to avoid machine learning pitfalls: a guide for academic researchers
How to avoid machine learning pitfalls: a guide for academic researchers
M. Lones
VLMFaMLOnRL
145
80
0
05 Aug 2021
Previous
123456