ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2302.09419
  4. Cited By
A Comprehensive Survey on Pretrained Foundation Models: A History from
  BERT to ChatGPT
v1v2v3 (latest)

A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT

18 February 2023
Ce Zhou
Qian Li
Chen Li
Jun Yu
Yixin Liu
Guan Wang
Kaichao Zhang
Cheng Ji
Qi Yan
Lifang He
Hao Peng
Jianxin Li
Hongzhi Zhang
Ziwei Liu
P. Xie
Caiming Xiong
Jian Pei
Philip S. Yu
U. Chicago
    AI4CE
ArXiv (abs)PDFHTML

Papers citing "A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT"

50 / 293 papers shown
Title
AI-Generated Content (AIGC) for Various Data Modalities: A Survey
AI-Generated Content (AIGC) for Various Data Modalities: A Survey
Lin Geng Foo
Hossein Rahmani
Jing Liu
270
31
0
27 Aug 2023
A Wide Evaluation of ChatGPT on Affective Computing Tasks
A Wide Evaluation of ChatGPT on Affective Computing Tasks
Mostafa M. Amin
Rui Mao
Min Zhang
Björn W. Schuller
AI4MH
67
35
0
26 Aug 2023
Journey to the Center of the Knowledge Neurons: Discoveries of
  Language-Independent Knowledge Neurons and Degenerate Knowledge Neurons
Journey to the Center of the Knowledge Neurons: Discoveries of Language-Independent Knowledge Neurons and Degenerate Knowledge Neurons
Yuheng Chen
Pengfei Cao
Yubo Chen
Kang Liu
Jun Zhao
KELM
95
49
0
25 Aug 2023
Local Distortion Aware Efficient Transformer Adaptation for Image
  Quality Assessment
Local Distortion Aware Efficient Transformer Adaptation for Image Quality Assessment
Kangmin Xu
Liang Liao
Jing Xiao
Chaofeng Chen
Haoning Wu
Qiong Yan
Weisi Lin
ViT
55
5
0
23 Aug 2023
FedDAT: An Approach for Foundation Model Finetuning in Multi-Modal
  Heterogeneous Federated Learning
FedDAT: An Approach for Foundation Model Finetuning in Multi-Modal Heterogeneous Federated Learning
Haokun Chen
Yao Zhang
Denis Krompass
Jindong Gu
Volker Tresp
FedML
114
54
0
21 Aug 2023
Learning Representations on Logs for AIOps
Learning Representations on Logs for AIOps
Pranjal Gupta
Harshit Kumar
Debanjana Kar
Karan Bhukar
Pooja Aggarwal
P. Mohapatra
52
11
0
18 Aug 2023
V2A-Mapper: A Lightweight Solution for Vision-to-Audio Generation by
  Connecting Foundation Models
V2A-Mapper: A Lightweight Solution for Vision-to-Audio Generation by Connecting Foundation Models
Heng Wang
Jianbo Ma
Santiago Pascual
Richard Cartwright
Weidong (Tom) Cai
VGen
112
43
0
18 Aug 2023
Adaptive Low Rank Adaptation of Segment Anything to Salient Object
  Detection
Adaptive Low Rank Adaptation of Segment Anything to Salient Object Detection
Rui-Qing Cui
Siyuan He
Shi Qiu
VLM
53
5
0
10 Aug 2023
Semantic Communications for Artificial Intelligence Generated Content
  (AIGC) Toward Effective Content Creation
Semantic Communications for Artificial Intelligence Generated Content (AIGC) Toward Effective Content Creation
Guangyuan Liu
Hongyang Du
Dusit Niyato
Jiawen Kang
Zehui Xiong
Dong In Kim
Xuemin
X. Shen
48
31
0
09 Aug 2023
Pre-Trained Large Language Models for Industrial Control
Pre-Trained Large Language Models for Industrial Control
Lei Song
Wei Shen
Li Zhao
Jiang Bian
LM&RoAI4CE
62
14
0
06 Aug 2023
A Survey of Spanish Clinical Language Models
A Survey of Spanish Clinical Language Models
Guillem García Subies
Á. Jiménez
Paloma Martínez
LM&MAELMLRM
57
0
0
04 Aug 2023
Experiments on Generative AI-Powered Parametric Modeling and BIM for
  Architectural Design
Experiments on Generative AI-Powered Parametric Modeling and BIM for Architectural Design
Jaechang Ko
John Ajibefun
Wei Yan
AI4CE
56
9
0
01 Aug 2023
Instructed to Bias: Instruction-Tuned Language Models Exhibit Emergent
  Cognitive Bias
Instructed to Bias: Instruction-Tuned Language Models Exhibit Emergent Cognitive Bias
Itay Itzhak
Gabriel Stanovsky
Nir Rosenfeld
Yonatan Belinkov
114
26
0
01 Aug 2023
Foundational Models Defining a New Era in Vision: A Survey and Outlook
Foundational Models Defining a New Era in Vision: A Survey and Outlook
Muhammad Awais
Muzammal Naseer
Salman Khan
Rao Muhammad Anwer
Hisham Cholakkal
M. Shah
Ming-Hsuan Yang
Fahad Shahbaz Khan
VLM
146
127
0
25 Jul 2023
Evaluating Large Language Models for Radiology Natural Language
  Processing
Evaluating Large Language Models for Radiology Natural Language Processing
Zheng Liu
Tianyang Zhong
Yiwei Li
Yutong Zhang
Yirong Pan
...
Shijie Zhao
Quanzheng Li
Hongtu Zhu
Dinggang Shen
Tianming Liu
LM&MAELM
126
6
0
25 Jul 2023
FinPT: Financial Risk Prediction with Profile Tuning on Pretrained
  Foundation Models
FinPT: Financial Risk Prediction with Profile Tuning on Pretrained Foundation Models
Yuwei Yin
Yazheng Yang
Jian Yang
Qi Liu
63
17
0
22 Jul 2023
Amazon-M2: A Multilingual Multi-locale Shopping Session Dataset for
  Recommendation and Text Generation
Amazon-M2: A Multilingual Multi-locale Shopping Session Dataset for Recommendation and Text Generation
Wei Jin
Haitao Mao
Zheng Li
Haoming Jiang
Cheng-hsin Luo
...
Suhang Wang
Yizhou Sun
Jiliang Tang
Bing Yin
Xianfeng Tang
AI4TS
114
41
0
19 Jul 2023
Can Large Language Models Empower Molecular Property Prediction?
Can Large Language Models Empower Molecular Property Prediction?
Chao Qian
Huayi Tang
Zhi-Jiang Yang
Hongsi Liang
Y. Liu
AI4CE
83
41
0
14 Jul 2023
Dialogue Agents 101: A Beginner's Guide to Critical Ingredients for
  Designing Effective Conversational Systems
Dialogue Agents 101: A Beginner's Guide to Critical Ingredients for Designing Effective Conversational Systems
Shivani Kumar
S. Bhatia
Milan Aggarwal
Tanmoy Chakraborty
99
1
0
14 Jul 2023
Understanding Multi-Turn Toxic Behaviors in Open-Domain Chatbots
Understanding Multi-Turn Toxic Behaviors in Open-Domain Chatbots
Bocheng Chen
Guangjing Wang
Hanqing Guo
Yuanda Wang
Qiben Yan
95
17
0
14 Jul 2023
Assessing the Ability of ChatGPT to Screen Articles for Systematic
  Reviews
Assessing the Ability of ChatGPT to Screen Articles for Systematic Reviews
Eugene Syriani
István Dávid
Gauransh Kumar
88
21
0
12 Jul 2023
A Comprehensive Overview of Large Language Models
A Comprehensive Overview of Large Language Models
Humza Naveed
Asad Ullah Khan
Shi Qiu
Muhammad Saqib
Saeed Anwar
Muhammad Usman
Naveed Akhtar
Nick Barnes
Ajmal Mian
OffRL
255
622
0
12 Jul 2023
FDAPT: Federated Domain-adaptive Pre-training for Language Models
FDAPT: Federated Domain-adaptive Pre-training for Language Models
Lekang Jiang
F. Svoboda
Nicholas D. Lane
FedMLAI4CE
104
4
0
12 Jul 2023
Transformers in Reinforcement Learning: A Survey
Transformers in Reinforcement Learning: A Survey
Pranav Agarwal
A. Rahman
P. St-Charles
Simon J. D. Prince
Samira Ebrahimi Kahou
OffRL
106
21
0
12 Jul 2023
On the Use of Self-Supervised Speech Representations in Spontaneous
  Speech Synthesis
On the Use of Self-Supervised Speech Representations in Spontaneous Speech Synthesis
Siyang Wang
G. Henter
Joakim Gustafson
Éva Székely
73
6
0
11 Jul 2023
Substance or Style: What Does Your Image Embedding Know?
Substance or Style: What Does Your Image Embedding Know?
Cyrus Rashtchian
Charles Herrmann
Chun-Sung Ferng
Ayan Chakrabarti
Dilip Krishnan
Deqing Sun
Da-Cheng Juan
Andrew Tomkins
57
6
0
10 Jul 2023
Can ChatGPT's Responses Boost Traditional Natural Language Processing?
Can ChatGPT's Responses Boost Traditional Natural Language Processing?
Mostafa M. Amin
Min Zhang
Björn W. Schuller
AI4MH
31
13
0
06 Jul 2023
Learning to Prompt in the Classroom to Understand AI Limits: A pilot
  study
Learning to Prompt in the Classroom to Understand AI Limits: A pilot study
Emily Theophilou
Cansu Koyuturk
Mona Yavari
Sathya Bursic
Gregor Donabauer
...
Davinia Hernández Leo
Martin Ruskov
D. Taibi
A. Gabbiadini
D. Ognibene
60
34
0
04 Jul 2023
SAMAug: Point Prompt Augmentation for Segment Anything Model
SAMAug: Point Prompt Augmentation for Segment Anything Model
Haixing Dai
Chong Ma
Zhiling Yan
Zheng Liu
Enze Shi
...
Wen Liu
Quanzheng Li
Lichao Sun
Shu Zhang Tianming Liu
Xiang Li
VLM
129
43
0
03 Jul 2023
Exploring the In-context Learning Ability of Large Language Model for
  Biomedical Concept Linking
Exploring the In-context Learning Ability of Large Language Model for Biomedical Concept Linking
Qinyong Wang
Zhenxiang Gao
Rong Xu
83
14
0
03 Jul 2023
The Art of Embedding Fusion: Optimizing Hate Speech Detection
The Art of Embedding Fusion: Optimizing Hate Speech Detection
Mohammad Aflah Khan
Neemesh Yadav
Mohit Jain
Sanyam Goyal
38
3
0
26 Jun 2023
End-to-End Augmentation Hyperparameter Tuning for Self-Supervised Anomaly Detection
End-to-End Augmentation Hyperparameter Tuning for Self-Supervised Anomaly Detection
Jaemin Yoo
Lingxiao Zhao
Leman Akoglu
106
4
0
21 Jun 2023
A Systematic Survey in Geometric Deep Learning for Structure-based Drug
  Design
A Systematic Survey in Geometric Deep Learning for Structure-based Drug Design
Zaixin Zhang
Jiaxian Yan
Qi Liu
Enhong Chen
Marinka Zitnik
131
1
0
20 Jun 2023
Large Generative AI Models for Telecom: The Next Big Thing?
Large Generative AI Models for Telecom: The Next Big Thing?
Lina Bariah
Qiyang Zhao
Han Zou
Yu Tian
Faouzi Bader
Merouane Debbah
AI4CE
141
75
0
17 Jun 2023
Radiology-GPT: A Large Language Model for Radiology
Radiology-GPT: A Large Language Model for Radiology
Zheng Liu
Aoxiao Zhong
Yiwei Li
Longtao Yang
Chao Ju
...
Wen Liu
Dinggang Shen
Xiang Li
Quanzheng Li
Tianming Liu
LM&MAMedImAI4CE
143
60
0
14 Jun 2023
POP: Prompt Of Prompts for Continual Learning
POP: Prompt Of Prompts for Continual Learning
Zhiyuan Hu
J. Lyu
Dashan Gao
Nuno Vasconcelos
CLLLRMVLM
73
5
0
14 Jun 2023
ChatGPT vs Human-authored Text: Insights into Controllable Text
  Summarization and Sentence Style Transfer
ChatGPT vs Human-authored Text: Insights into Controllable Text Summarization and Sentence Style Transfer
Dongqi Pu
Vera Demberg
DeLMO
95
67
0
13 Jun 2023
Mind2Web: Towards a Generalist Agent for the Web
Mind2Web: Towards a Generalist Agent for the Web
Xiang Deng
Yu Gu
Boyuan Zheng
Shijie Chen
Samuel Stevens
Boshi Wang
Huan Sun
Yu-Chuan Su
LLMAG
141
488
0
09 Jun 2023
Xiezhi: An Ever-Updating Benchmark for Holistic Domain Knowledge
  Evaluation
Xiezhi: An Ever-Updating Benchmark for Holistic Domain Knowledge Evaluation
Zhouhong Gu
Xiaoxuan Zhu
Haoning Ye
Lin Zhang
Jianchen Wang
...
Zili Wang
Shusen Wang
Weiguo Zheng
Hongwei Feng
Yanghua Xiao
ALMELM
148
60
0
09 Jun 2023
Artificial General Intelligence for Medical Imaging
Artificial General Intelligence for Medical Imaging
Xiang Li
Lu Zhang
Zihao Wu
Zheng Liu
Lin Zhao
...
Pingkuan Yan
Quanzheng Li
Wen Liu
Tianming Liu
Dinggang Shen
LM&MAAI4CE
140
42
0
08 Jun 2023
Evaluation of ChatGPT on Biomedical Tasks: A Zero-Shot Comparison with
  Fine-Tuned Generative Transformers
Evaluation of ChatGPT on Biomedical Tasks: A Zero-Shot Comparison with Fine-Tuned Generative Transformers
Israt Jahan
Md Tahmid Rahman Laskar
Chun Peng
J. Huang
LM&MAMedImAI4MH
106
32
0
07 Jun 2023
Applying Standards to Advance Upstream & Downstream Ethics in Large
  Language Models
Applying Standards to Advance Upstream & Downstream Ethics in Large Language Models
Jose Berengueres
Marybeth Sandell
68
0
0
06 Jun 2023
Benchmarking Robustness of Adaptation Methods on Pre-trained
  Vision-Language Models
Benchmarking Robustness of Adaptation Methods on Pre-trained Vision-Language Models
Shuo Chen
Jindong Gu
Zhen Han
Yunpu Ma
Philip Torr
Volker Tresp
VPVLMVLM
118
21
0
03 Jun 2023
On Optimal Caching and Model Multiplexing for Large Model Inference
On Optimal Caching and Model Multiplexing for Large Model Inference
Banghua Zhu
Ying Sheng
Lianmin Zheng
Clark W. Barrett
Michael I. Jordan
Jiantao Jiao
90
21
0
03 Jun 2023
ChatGPT is a Remarkable Tool -- For Experts
ChatGPT is a Remarkable Tool -- For Experts
A. Azaria
Rina Azoulay-Schwartz
S. Reches
68
63
0
02 Jun 2023
A Survey of Label-Efficient Deep Learning for 3D Point Clouds
A Survey of Label-Efficient Deep Learning for 3D Point Clouds
Aoran Xiao
Xiaoqin Zhang
Ling Shao
Shijian Lu
3DPC
109
24
0
31 May 2023
The Utility of Large Language Models and Generative AI for Education
  Research
The Utility of Large Language Models and Generative AI for Education Research
Andrew Katz
Umair Shakir
B. Chambers
AI4CE
68
6
0
29 May 2023
A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark
  Datasets
A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark Datasets
Md Tahmid Rahman Laskar
M Saiful Bari
Mizanur Rahman
Md Amran Hossen Bhuiyan
Shafiq Joty
J. Huang
LM&MAELMALM
125
193
0
29 May 2023
Augmentation-Adapted Retriever Improves Generalization of Language
  Models as Generic Plug-In
Augmentation-Adapted Retriever Improves Generalization of Language Models as Generic Plug-In
Zichun Yu
Chenyan Xiong
S. Yu
Zhiyuan Liu
KELMVLM
102
69
0
27 May 2023
BiomedGPT: A Unified and Generalist Biomedical Generative Pre-trained
  Transformer for Vision, Language, and Multimodal Tasks
BiomedGPT: A Unified and Generalist Biomedical Generative Pre-trained Transformer for Vision, Language, and Multimodal Tasks
Kai Zhang
Jun Yu
Eashan Adhikarla
Rong Zhou
Zhilin Yan
...
Xun Chen
Yong Chen
Quanzheng Li
Hongfang Liu
Lichao Sun
LM&MAMedIm
103
185
0
26 May 2023
Previous
123456
Next