Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2302.09419
Cited By
v1
v2
v3 (latest)
A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT
18 February 2023
Ce Zhou
Qian Li
Chen Li
Jun Yu
Yixin Liu
Guan Wang
Kaichao Zhang
Cheng Ji
Qi Yan
Lifang He
Hao Peng
Jianxin Li
Hongzhi Zhang
Ziwei Liu
P. Xie
Caiming Xiong
Jian Pei
Philip S. Yu
U. Chicago
AI4CE
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT"
50 / 293 papers shown
Title
Federated Domain-Specific Knowledge Transfer on Large Language Models Using Synthetic Data
Haoran Li
Xinyuan Zhao
Dadi Guo
Hanlin Gu
Huiping Zhuang
Yuxing Han
Yangqiu Song
Lixin Fan
Qiang Yang
99
1
0
23 May 2024
Aggregation of Reasoning: A Hierarchical Framework for Enhancing Answer Selection in Large Language Models
Zhangyue Yin
Qiushi Sun
Qipeng Guo
Zhiyuan Zeng
Xiaonan Li
...
Qinyuan Cheng
Ding Wang
Xiaofeng Mou
Xipeng Qiu
XuanJing Huang
LRM
96
4
0
21 May 2024
PathOCL: Path-Based Prompt Augmentation for OCL Generation with GPT-4
Seif Abukhalaf
Mohammad Hamdaqa
Foutse Khomh
LLMAG
84
7
0
21 May 2024
Data Selection for Transfer Unlearning
N. Sepahvand
Vincent Dumoulin
Eleni Triantafillou
Gintare Karolina Dziugaite
MU
78
4
0
16 May 2024
Localizing Task Information for Improved Model Merging and Compression
Ke Wang
Nikolaos Dimitriadis
Guillermo Ortiz-Jimenez
Franccois Fleuret
Pascal Frossard
MoMe
91
60
0
13 May 2024
UniDM: A Unified Framework for Data Manipulation with Large Language Models
Yichen Qian
Yongyi He
Rong Zhu
Jintao Huang
Zhijian Ma
...
Yaohua Wang
Xiuyu Sun
Defu Lian
Bolin Ding
Jingren Zhou
54
4
0
10 May 2024
Zero-shot Degree of Ill-posedness Estimation for Active Small Object Change Detection
Koji Takeda
Kanji Tanaka
Yoshimasa Nakamura
Asako Kanezaki
85
0
0
10 May 2024
A Survey of Time Series Foundation Models: Generalizing Time Series Representation with Large Language Model
Weiqi Zhang
Jiexia Ye
Ke Yi
Yongzi Yu
Ziyue Li
Jia Li
Fugee Tsung
AI4TS
AI4CE
94
29
0
03 May 2024
Advances and Open Challenges in Federated Learning with Foundation Models
Chao Ren
Han Yu
Hongyi Peng
Xiaoli Tang
Anran Li
...
A. Tan
Bo Zhao
Xiaoxiao Li
Zengxiang Li
Qiang Yang
FedML
AIFin
AI4CE
150
11
0
23 Apr 2024
emrQA-msquad: A Medical Dataset Structured with the SQuAD V2.0 Framework, Enriched with emrQA Medical Information
Jimenez Eladio
Hao Wu
74
4
0
18 Apr 2024
A Survey on Multimodal Wearable Sensor-based Human Action Recognition
Jianyuan Ni
Hao Tang
Syed Tousiful Haque
Yan Yan
A. Ngu
122
9
0
14 Apr 2024
FreeSeg-Diff: Training-Free Open-Vocabulary Segmentation with Diffusion Models
Barbara Toniella Corradini
Mustafa Shukor
Paul Couairon
Guillaume Couairon
Franco Scarselli
Matthieu Cord
DiffM
VLM
105
6
0
29 Mar 2024
Hallucination Detection in Foundation Models for Decision-Making: A Flexible Definition and Review of the State of the Art
Neeloy Chakraborty
Melkior Ornik
Katherine Driggs-Campbell
LRM
243
12
0
25 Mar 2024
Segment Anything for comprehensive analysis of grapevine cluster architecture and berry properties
Efrain Torres-Lomas
Jimena Lado-Jimena
Guillermo Garcia-Zamora
Luis Diaz-Garcia
65
2
0
19 Mar 2024
Fisher Mask Nodes for Language Model Merging
Thennal D K
Ganesh Nathan
Suchithra M S
MoMe
AI4CE
97
5
0
14 Mar 2024
VLOGGER: Multimodal Diffusion for Embodied Avatar Synthesis
Enric Corona
Andrei Zanfir
Eduard Gabriel Bazavan
Nikos Kolotouros
Thiemo Alldieck
C. Sminchisescu
VGen
DiffM
103
32
0
13 Mar 2024
Debiased Noise Editing on Foundation Models for Fair Medical Image Classification
Ruinan Jin
Wenlong Deng
Minghui Chen
Xiaoxiao Li
MedIm
92
2
0
10 Mar 2024
Intensive Care as One Big Sequence Modeling Problem
Vadim Liventsev
Tobias Fritz
64
1
0
27 Feb 2024
Quantum linear algebra is all you need for Transformer architectures
Naixu Guo
Zhan Yu
Matthew Choi
Aman Agrawal
Kouhei Nakaji
Alán Aspuru-Guzik
Patrick Rebentrost
AI4CE
72
16
0
26 Feb 2024
OmniArch: Building Foundation Model For Scientific Computing
Tianyu Chen
Haoyi Zhou
Ying Li
Hao Wang
Chonghan Gao
Rongye Shi
Shanghang Zhang
Jianxin Li
AI4CE
79
0
0
25 Feb 2024
A Literature Review of Literature Reviews in Pattern Analysis and Machine Intelligence
Penghai Zhao
Xin Zhang
Ming-Ming Cheng
Jian Yang
Xiang Li
115
1
0
20 Feb 2024
A Comprehensive Review of Machine Learning Advances on Data Change: A Cross-Field Perspective
Jeng-Lin Li
Chih-Fan Hsu
Ming-Ching Chang
Wei-Chao Chen
OOD
110
2
0
20 Feb 2024
An Empirical Categorization of Prompting Techniques for Large Language Models: A Practitioner's Guide
Oluwole Fagbohun
Rachel M. Harrison
Anton Dereventsov
131
9
0
18 Feb 2024
MoRAL: MoE Augmented LoRA for LLMs' Lifelong Learning
Shu Yang
Muhammad Asif Ali
Cheng-Long Wang
Lijie Hu
Di Wang
CLL
MoE
114
46
0
17 Feb 2024
Towards a Foundation Model for Brain Age Prediction using coVariance Neural Networks
Saurabh Sihag
Gonzalo Mateos
Alejandro Ribeiro
70
6
0
12 Feb 2024
Large Language Models: A Survey
Shervin Minaee
Tomas Mikolov
Narjes Nikzad
M. Asgari-Chenaghlu
R. Socher
Xavier Amatriain
Jianfeng Gao
ALM
LM&MA
ELM
246
425
0
09 Feb 2024
The Future of Cognitive Strategy-enhanced Persuasive Dialogue Agents: New Perspectives and Trends
Mengqi Chen
Bin Guo
Hao Wang
Haoyu Li
Qian Zhao
Jingqi Liu
Yasan Ding
Yan Pan
Zhiwen Yu
LLMAG
82
2
0
07 Feb 2024
De-amplifying Bias from Differential Privacy in Language Model Fine-tuning
Sanjari Srivastava
Piotr (Peter) Mardziel
Zhikhun Zhang
Archana Ahlawat
Anupam Datta
John C. Mitchell
92
2
0
07 Feb 2024
The Essential Role of Causality in Foundation World Models for Embodied AI
Tarun Gupta
Wenbo Gong
Chao Ma
Nick Pawlowski
Agrin Hilmkil
...
Jianfeng Gao
Stefan Bauer
Danica Kragic
Bernhard Schölkopf
Cheng Zhang
79
17
0
06 Feb 2024
Bayesian Uncertainty for Gradient Aggregation in Multi-Task Learning
Idan Achituve
I. Diamant
Arnon Netzer
Gal Chechik
Ethan Fetaya
UQCV
92
7
0
06 Feb 2024
Bringing Generative AI to Adaptive Learning in Education
Hang Li
Tianlong Xu
Chaoli Zhang
Eason Chen
Jing Liang
Xing Fan
Haoyang Li
Jiliang Tang
Qingsong Wen
102
25
0
02 Feb 2024
Large Language Models in Cybersecurity: State-of-the-Art
Farzad Nourmohammadzadeh Motlagh
Mehrdad Hajizadeh
Mehryar Majd
Pejman Najafi
Feng Cheng
Christoph Meinel
ELM
118
48
0
30 Jan 2024
Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Models
Weijiao Zhang
Jindong Han
Zhao Xu
Hang Ni
Hao Liu
Hui Xiong
Hui Xiong
AI4CE
248
18
0
30 Jan 2024
Depth Anything in Medical Images: A Comparative Study
John J. Han
Ayberk Acar
Callahan Henry
Jie Ying Wu
MedIm
47
10
0
29 Jan 2024
Cutup and Detect: Human Fall Detection on Cutup Untrimmed Videos Using a Large Foundational Video Understanding Model
Till Grutschus
Ola Karrar
Emir Esenov
Ekta Vats
55
0
0
29 Jan 2024
UnMASKed: Quantifying Gender Biases in Masked Language Models through Linguistically Informed Job Market Prompts
Inigo Parra
26
1
0
28 Jan 2024
Charting the Future of AI in Project-Based Learning: A Co-Design Exploration with Students
Chengbo Zheng
Kangyu Yuan
Bingcan Guo
Reza Hadi Mogavi
Zhenhui Peng
Shuai Ma
Xiaojuan Ma
74
27
0
26 Jan 2024
(Chat)GPT v BERT: Dawn of Justice for Semantic Change Detection
Francesco Periti
Haim Dubossarsky
Nina Tahmasebi
AI4MH
106
15
0
25 Jan 2024
Facing the Elephant in the Room: Visual Prompt Tuning or Full Finetuning?
Cheng Han
Qifan Wang
Yiming Cui
Wenguan Wang
Lifu Huang
Siyuan Qi
Dongfang Liu
VLM
157
22
0
23 Jan 2024
Heterogeneous LoRA for Federated Fine-tuning of On-Device Foundation Models
Yae Jee Cho
Luyang Liu
Zheng Xu
Aldi Fahrezi
Gauri Joshi
85
68
0
12 Jan 2024
A Survey on Efficient Federated Learning Methods for Foundation Model Training
Herbert Woisetschläger
Alexander Isenko
Shiqiang Wang
R. Mayer
Hans-Arno Jacobsen
FedML
113
26
0
09 Jan 2024
Large Language Models for Robotics: Opportunities, Challenges, and Perspectives
Jiaqi Wang
Zihao Wu
Yiwei Li
Hanqi Jiang
Peng Shu
...
Lin Zhao
Bao Ge
Xiang Li
Tianming Liu
Shu Zhang
LM&Ro
95
75
0
09 Jan 2024
Training and Serving System of Foundation Models: A Comprehensive Survey
Jiahang Zhou
Yanyu Chen
Zicong Hong
Wuhui Chen
Yue Yu
Tao Zhang
Hui Wang
Chuan-fu Zhang
Zibin Zheng
ALM
94
11
0
05 Jan 2024
Data-Centric Foundation Models in Computational Healthcare: A Survey
Yunkun Zhang
Jin Gao
Zheling Tan
Lingfeng Zhou
Kexin Ding
Mu Zhou
Shaoting Zhang
Dequan Wang
AI4CE
113
25
0
04 Jan 2024
GOAT-Bench: Safety Insights to Large Multimodal Models through Meme-Based Social Abuse
Hongzhan Lin
Ziyang Luo
Bo Wang
Ruichao Yang
Jing Ma
116
31
0
03 Jan 2024
Large language model for Bible sentiment analysis: Sermon on the Mount
M. Vora
Tom Blau
Vansh Kachhwal
A. Solo
Rohitash Chandra
MILM
65
1
0
01 Jan 2024
SDIF-DA: A Shallow-to-Deep Interaction Framework with Data Augmentation for Multi-modal Intent Detection
Shijue Huang
Libo Qin
Bingbing Wang
Geng Tu
Ruifeng Xu
64
7
0
31 Dec 2023
A Comprehensive Survey of Attack Techniques, Implementation, and Mitigation Strategies in Large Language Models
Aysan Esmradi
Daniel Wankit Yip
C. Chan
AAML
83
14
0
18 Dec 2023
SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagery
Xin Guo
Jiangwei Lao
Bo Dang
Yingying Zhang
Lei Yu
...
Jian Wang
Jingdong Chen
Ming Yang
Yongjun Zhang
Yansheng Li
150
129
0
15 Dec 2023
Saturn Platform: Foundation Model Operations and Generative AI for Financial Services
Antonio Busson
Rennan Gaio
Rafael H. Rocha
Francisco Evangelista
Bruno Rizzi
Luan Carvalho
Rafael Miceli
Marcos Rabaioli
David Favaro
60
1
0
12 Dec 2023
Previous
1
2
3
4
5
6
Next