ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2302.09419
  4. Cited By
A Comprehensive Survey on Pretrained Foundation Models: A History from
  BERT to ChatGPT
v1v2v3 (latest)

A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT

18 February 2023
Ce Zhou
Qian Li
Chen Li
Jun Yu
Yixin Liu
Guan Wang
Kaichao Zhang
Cheng Ji
Qi Yan
Lifang He
Hao Peng
Jianxin Li
Hongzhi Zhang
Ziwei Liu
P. Xie
Caiming Xiong
Jian Pei
Philip S. Yu
U. Chicago
    AI4CE
ArXiv (abs)PDFHTML

Papers citing "A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT"

50 / 293 papers shown
Title
Multi-Granularity Framework for Unsupervised Representation Learning of
  Time Series
Multi-Granularity Framework for Unsupervised Representation Learning of Time Series
Chengyang Ye
Qiang Ma
AI4TS
51
0
0
12 Dec 2023
NLLG Quarterly arXiv Report 09/23: What are the most influential current
  AI Papers?
NLLG Quarterly arXiv Report 09/23: What are the most influential current AI Papers?
Ran Zhang
Aida Kostikova
Christoph Leiter
Jonas Belouadi
Daniil Larionov
Yanran Chen
Vivian Fresen
Steffen Eger
81
0
0
09 Dec 2023
Empowering ChatGPT-Like Large-Scale Language Models with Local Knowledge
  Base for Industrial Prognostics and Health Management
Empowering ChatGPT-Like Large-Scale Language Models with Local Knowledge Base for Industrial Prognostics and Health Management
Huan Wang
Yan-Fu Li
Min Xie
LM&MAAI4MHAI4CE
24
4
0
06 Dec 2023
MEDPSeg: Hierarchical polymorphic multitask learning for the
  segmentation of ground-glass opacities, consolidation, and pulmonary
  structures on computed tomography
MEDPSeg: Hierarchical polymorphic multitask learning for the segmentation of ground-glass opacities, consolidation, and pulmonary structures on computed tomography
Diedre S. Carmo
Jean Ribeiro
A. Comellas
Joseph M. Reinhardt
S. Gerard
Letícia Rittner
R.A. Lotufo
84
2
0
04 Dec 2023
The Efficiency Spectrum of Large Language Models: An Algorithmic Survey
The Efficiency Spectrum of Large Language Models: An Algorithmic Survey
Tianyu Ding
Tianyi Chen
Haidong Zhu
Jiachen Jiang
Yiqi Zhong
Jinxin Zhou
Guangzhi Wang
Zhihui Zhu
Ilya Zharkov
Luming Liang
121
24
0
01 Dec 2023
PALM: Predicting Actions through Language Models
PALM: Predicting Actions through Language Models
Sanghwan Kim
Daoji Huang
Yongqin Xian
Otmar Hilliges
Luc Van Gool
Xi Wang
VLM
79
14
0
29 Nov 2023
A Survey of the Evolution of Language Model-Based Dialogue Systems
A Survey of the Evolution of Language Model-Based Dialogue Systems
Hongru Wang
Lingzhi Wang
Yiming Du
Liang Chen
Jing Zhou
Yufei Wang
Kam-Fai Wong
LRM
147
23
0
28 Nov 2023
Efficient Transformer Knowledge Distillation: A Performance Review
Efficient Transformer Knowledge Distillation: A Performance Review
Nathan Brown
Ashton Williamson
Tahj Anderson
Logan Lawrence
VLM
50
5
0
22 Nov 2023
Stable Unlearnable Example: Enhancing the Robustness of Unlearnable
  Examples via Stable Error-Minimizing Noise
Stable Unlearnable Example: Enhancing the Robustness of Unlearnable Examples via Stable Error-Minimizing Noise
Yixin Liu
Kaidi Xu
Xun Chen
Lichao Sun
67
9
0
22 Nov 2023
Can Large Language Models Understand Content and Propagation for
  Misinformation Detection: An Empirical Study
Can Large Language Models Understand Content and Propagation for Misinformation Detection: An Empirical Study
Mengyang Chen
Lingwei Wei
Han Cao
Wei Zhou
Song Hu
56
6
0
21 Nov 2023
Beyond Boundaries: A Comprehensive Survey of Transferable Attacks on AI Systems
Beyond Boundaries: A Comprehensive Survey of Transferable Attacks on AI Systems
Guangjing Wang
Ce Zhou
Yuanda Wang
Bocheng Chen
Hanqing Guo
Qiben Yan
AAMLSILM
135
3
0
20 Nov 2023
XplainLLM: A QA Explanation Dataset for Understanding LLM
  Decision-Making
XplainLLM: A QA Explanation Dataset for Understanding LLM Decision-Making
Zichen Chen
Jianda Chen
Mitali Gaidhani
Ambuj K. Singh
Misha Sra
60
4
0
15 Nov 2023
Zero-Shot Segmentation of Eye Features Using the Segment Anything Model
  (SAM)
Zero-Shot Segmentation of Eye Features Using the Segment Anything Model (SAM)
Virmarie Maquiling
Sean Anthony Byrne
D. Niehorster
Marcus Nyström
Enkelejda Kasneci
VLM
120
14
0
14 Nov 2023
ReactionT5: a large-scale pre-trained model towards application of
  limited reaction data
ReactionT5: a large-scale pre-trained model towards application of limited reaction data
Tatsuya Sagawa
Ryosuke Kojima
AI4CE
72
9
0
12 Nov 2023
Tuning-less Object Naming with a Foundation Model
Tuning-less Object Naming with a Foundation Model
Andrej Lácny
Pavel Petrovic
VLM
58
0
0
03 Nov 2023
Filter bubbles and affective polarization in user-personalized large
  language model outputs
Filter bubbles and affective polarization in user-personalized large language model outputs
Tomo Lazovich
22
4
0
31 Oct 2023
Rethinking Pre-Training in Tabular Data: A Neighborhood Embedding Perspective
Rethinking Pre-Training in Tabular Data: A Neighborhood Embedding Perspective
Han-Jia Ye
Qi-Le Zhou
De-Chuan Zhan
De-Chuan Zhan
Wei-Lun Chao
29
10
0
31 Oct 2023
A Survey on Knowledge Editing of Neural Networks
A Survey on Knowledge Editing of Neural Networks
Vittorio Mazzia
Alessandro Pedrani
Andrea Caciolai
Kay Rottmann
Davide Bernardi
KELM
121
25
0
30 Oct 2023
Are Natural Domain Foundation Models Useful for Medical Image
  Classification?
Are Natural Domain Foundation Models Useful for Medical Image Classification?
Joana Palés Huix
Adithya Raju Ganeshan
Johan Fredin Haslum
Magnus P Soderberg
Christos Matsoukas
Kevin Smith
OODMedImVLM
87
34
0
30 Oct 2023
A foundational neural operator that continuously learns without
  forgetting
A foundational neural operator that continuously learns without forgetting
Tapas Tripura
Souvik Chakraborty
CLL
88
9
0
29 Oct 2023
netFound: Foundation Model for Network Security
netFound: Foundation Model for Network Security
Satyandra Guthula
Navya Battula
Roman Beltiukov
Wenbo Guo
Arpit Gupta
Inder Monga
143
19
0
25 Oct 2023
Dynamics Generalisation in Reinforcement Learning via Adaptive
  Context-Aware Policies
Dynamics Generalisation in Reinforcement Learning via Adaptive Context-Aware Policies
Michael Beukman
Devon Jarvis
Richard Klein
Steven D. James
Benjamin Rosman
105
13
0
25 Oct 2023
Towards LLM-driven Dialogue State Tracking
Towards LLM-driven Dialogue State Tracking
Yujie Feng
Zexin Lu
Bo Liu
Li-Ming Zhan
Xiao-Ming Wu
64
23
0
23 Oct 2023
DT/MARS-CycleGAN: Improved Object Detection for MARS Phenotyping Robot
DT/MARS-CycleGAN: Improved Object Detection for MARS Phenotyping Robot
David Liu
Zhengkun Li
Zihao Wu
Changying Li
106
3
0
19 Oct 2023
Vision and Language Navigation in the Real World via Online Visual
  Language Mapping
Vision and Language Navigation in the Real World via Online Visual Language Mapping
Chengguang Xu
Hieu T. Nguyen
Christopher Amato
Lawson L. S. Wong
72
9
0
16 Oct 2023
Large Models for Time Series and Spatio-Temporal Data: A Survey and
  Outlook
Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlook
Ming Jin
Qingsong Wen
Yuxuan Liang
Chaoli Zhang
Siqiao Xue
...
Shirui Pan
Vincent S. Tseng
Yu Zheng
Lei Chen
Hui Xiong
AI4TSSyDa
166
123
0
16 Oct 2023
FATE-LLM: A Industrial Grade Federated Learning Framework for Large
  Language Models
FATE-LLM: A Industrial Grade Federated Learning Framework for Large Language Models
Tao Fan
Yan Kang
Guoqiang Ma
Weijing Chen
Wenbin Wei
Lixin Fan
Qiang Yang
97
65
0
16 Oct 2023
A Recent Survey of Heterogeneous Transfer Learning
A Recent Survey of Heterogeneous Transfer Learning
Runxue Bao
Yiming Sun
Yuhe Gao
Jindong Wang
Qiang Yang
Zhi-Hong Mao
Ye Ye
86
4
0
12 Oct 2023
Foundation Models Meet Visualizations: Challenges and Opportunities
Foundation Models Meet Visualizations: Challenges and Opportunities
Weikai Yang
Mengchen Liu
Zheng Wang
Shixia Liu
87
40
0
09 Oct 2023
Imitator Learning: Achieve Out-of-the-Box Imitation Ability in Variable
  Environments
Imitator Learning: Achieve Out-of-the-Box Imitation Ability in Variable Environments
Xiong-Hui Chen
Junyin Ye
Hang Zhao
Yi-Chen Li
Haoran Shi
...
Si-Hang Yang
Anqi Huang
Kai Xu
Zongzhang Zhang
Yang Yu
73
0
0
09 Oct 2023
Learning Generalizable Agents via Saliency-Guided Features Decorrelation
Learning Generalizable Agents via Saliency-Guided Features Decorrelation
Sili Huang
Yanchao Sun
Jifeng Hu
Siyuan Guo
Hechang Chen
Yi-Ju Chang
Lichao Sun
Bo Yang
69
6
0
08 Oct 2023
FakeGPT: Fake News Generation, Explanation and Detection of Large
  Language Models
FakeGPT: Fake News Generation, Explanation and Detection of Large Language Models
Yue Huang
Lichao Sun
62
8
0
08 Oct 2023
Model Compression in Practice: Lessons Learned from Practitioners
  Creating On-device Machine Learning Experiences
Model Compression in Practice: Lessons Learned from Practitioners Creating On-device Machine Learning Experiences
Fred Hohman
Mary Beth Kery
Donghao Ren
Dominik Moritz
108
19
0
06 Oct 2023
A Formalism and Approach for Improving Robustness of Large Language
  Models Using Risk-Adjusted Confidence Scores
A Formalism and Approach for Improving Robustness of Large Language Models Using Risk-Adjusted Confidence Scores
Ke Shen
Mayank Kejriwal
89
2
0
05 Oct 2023
MetaTool Benchmark for Large Language Models: Deciding Whether to Use
  Tools and Which to Use
MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Use
Yue Huang
Jiawen Shi
Yuan Li
Chenrui Fan
Siyuan Wu
...
Yixin Liu
Pan Zhou
Yao Wan
Neil Zhenqiang Gong
Lichao Sun
LLMAG
119
96
0
04 Oct 2023
SNIP: Bridging Mathematical Symbolic and Numeric Realms with Unified
  Pre-training
SNIP: Bridging Mathematical Symbolic and Numeric Realms with Unified Pre-training
Kazem Meidani
Parshin Shojaee
Chandan K. Reddy
A. Farimani
126
19
0
03 Oct 2023
City Foundation Models for Learning General Purpose Representations from
  OpenStreetMap
City Foundation Models for Learning General Purpose Representations from OpenStreetMap
Pasquale Balsebre
Weiming Huang
Gao Cong
Yi Li
AI4CE
110
18
0
01 Oct 2023
Medical Foundation Models are Susceptible to Targeted Misinformation
  Attacks
Medical Foundation Models are Susceptible to Targeted Misinformation Attacks
T. Han
S. Nebelung
Firas Khader
Tian Wang
Gustav Mueller-Franzes
...
Jens Kleesiek
Christoph Haarburger
Keno K. Bressem
Jakob Nikolas Kather
Daniel Truhn
AAML
34
6
0
29 Sep 2023
Ruffle&Riley: Towards the Automated Induction of Conversational Tutoring
  Systems
Ruffle&Riley: Towards the Automated Induction of Conversational Tutoring Systems
Robin Schmucker
Meng Xia
A. Azaria
Tom Michael Mitchell
52
17
0
26 Sep 2023
Disinformation Detection: An Evolving Challenge in the Age of LLMs
Disinformation Detection: An Evolving Challenge in the Age of LLMs
Qinglong Cao
Yuntian Chen
Ayushi Nirmal
Xiaokang Yang
DeLMO
87
53
0
25 Sep 2023
Can LLM-Generated Misinformation Be Detected?
Can LLM-Generated Misinformation Be Detected?
Canyu Chen
Kai Shu
DeLMO
191
182
0
25 Sep 2023
Natural Language based Context Modeling and Reasoning for Ubiquitous
  Computing with Large Language Models: A Tutorial
Natural Language based Context Modeling and Reasoning for Ubiquitous Computing with Large Language Models: A Tutorial
Haoyi Xiong
Jiang Bian
Sijia Yang
Xiaofei Zhang
Linghe Kong
Daqing Zhang
LRMLLMAG
107
5
0
24 Sep 2023
Is it Possible to Modify Text to a Target Readability Level? An Initial
  Investigation Using Zero-Shot Large Language Models
Is it Possible to Modify Text to a Target Readability Level? An Initial Investigation Using Zero-Shot Large Language Models
Asma Farajidizaji
Vatsal Raina
Mark Gales
60
2
0
22 Sep 2023
RadOnc-GPT: A Large Language Model for Radiation Oncology
RadOnc-GPT: A Large Language Model for Radiation Oncology
Zheng Liu
Peilong Wang
Yiwei Li
J. Holmes
Peng Shu
...
Quanzheng Li
Samir H. Patel
Terence T. Sio
Tianming Liu
Wen Liu
LM&MA
107
23
0
18 Sep 2023
Bias and Fairness in Chatbots: An Overview
Bias and Fairness in Chatbots: An Overview
Jintang Xue
Yun Cheng Wang
Chengwei Wei
Xiaofeng Liu
Jonghye Woo
C.-C. Jay Kuo
115
35
0
16 Sep 2023
Towards Artificial General Intelligence (AGI) in the Internet of Things
  (IoT): Opportunities and Challenges
Towards Artificial General Intelligence (AGI) in the Internet of Things (IoT): Opportunities and Challenges
Fei Dou
Jin Ye
Geng Yuan
Qin Lu
Wei Niu
...
Hongyue Sun
Yunli Shao
Changying Li
Tianming Liu
Wenzhan Song
AI4CE
85
29
0
14 Sep 2023
Evaluating ChatGPT as a Recommender System: A Rigorous Approach
Evaluating ChatGPT as a Recommender System: A Rigorous Approach
Dario Di Palma
Giovanni Maria Biancofiore
Vito Walter Anelli
Fedelucio Narducci
Tommaso Di Noia
E. Sciascio
ALM
130
30
0
07 Sep 2023
The Impact of Artificial Intelligence on the Evolution of Digital Education: A Comparative Study of OpenAI Text Generation Tools including ChatGPT, Bing Chat, Bard, and Ernie
The Impact of Artificial Intelligence on the Evolution of Digital Education: A Comparative Study of OpenAI Text Generation Tools including ChatGPT, Bing Chat, Bard, and Ernie
Negin Yazdani Motlagh
Matin Khajavi
Abbas Sharifi
Mohsen Ahmadi
85
33
0
05 Sep 2023
A Survey on Privacy in Graph Neural Networks: Attacks, Preservation, and
  Applications
A Survey on Privacy in Graph Neural Networks: Attacks, Preservation, and Applications
Yi Zhang
Yuying Zhao
Zhaoqing Li
Xueqi Cheng
Yu Wang
Olivera Kotevska
Philip S. Yu
Hanyu Wang
109
13
0
31 Aug 2023
Radiology-Llama2: Best-in-Class Large Language Model for Radiology
Radiology-Llama2: Best-in-Class Large Language Model for Radiology
Zheng Liu
Yiwei Li
Peng Shu
Aoxiao Zhong
Longtao Yang
...
Wen Liu
Dinggang Shen
Tianming Liu
Quanzheng Li
Xiang Li
LM&MA
80
42
0
29 Aug 2023
Previous
123456
Next