An Empirical Study of Scaling Instruct-Tuned Large Multimodal Models

An Empirical Study of Scaling Instruct-Tuned Large Multimodal Models

18 September 2023

Jianwei Yang

ArXiv (abs)PDF HTML HuggingFace (19 upvotes)

Papers citing "An Empirical Study of Scaling Instruct-Tuned Large Multimodal Models"

10 / 10 papers shown

Title
DARE the Extreme: Revisiting Delta-Parameter Pruning For Fine-Tuned ModelsInternational Conference on Learning Representations (ICLR), 2024 Wenlong Deng Yize Zhao V. Vakilian Minghui Chen Xiaoxiao Li Christos Thrampoulidis 419 8 0 12 Oct 2024
Heron-Bench: A Benchmark for Evaluating Vision Language Models in Japanese Yuichi Inoue Kento Sasaki Yuma Ochi Kazuki Fujii Kotaro Tanahashi Yu Yamaguchi VLM 115 8 0 11 Apr 2024
HyperLLaVA: Dynamic Visual and Language Expert Tuning for Multimodal Large Language Models Wenqiao Zhang Tianwei Lin Jiang Liu Fangxun Shu Haoyuan Li ... Zheqi Lv Hao Jiang Juncheng Li Siliang Tang Yueting Zhuang VLM MLLM 195 15 0 20 Mar 2024
PhyGrasp: Generalizing Robotic Grasping with Physics-informed Large Multimodal Models Dingkun Guo Yuqi Xiang Shuqi Zhao Xinghao Zhu Masayoshi Tomizuka Mingyu Ding Wei Zhan 202 14 0 26 Feb 2024
RoboCodeX: Multimodal Code Generation for Robotic Behavior Synthesis Yao Mu Junting Chen Qinglong Zhang Shoufa Chen Qiaojun Yu ... Wenhai Wang Jifeng Dai Yu Qiao Mingyu Ding Ping Luo 236 45 0 25 Feb 2024
Honeybee: Locality-enhanced Projector for Multimodal LLM Junbum Cha Wooyoung Kang Jonghwan Mun Byungseok Roh MLLM 321 191 0 11 Dec 2023
ChartLlama: A Multimodal LLM for Chart Understanding and Generation Yucheng Han C. Zhang Xin Chen Xu Yang Zhibin Wang Gang Yu Bin-Bin Fu Hanwang Zhang MLLM 193 134 0 27 Nov 2023
Emu: Generative Pretraining in MultimodalityInternational Conference on Learning Representations (ICLR), 2023 Quan-Sen Sun Qiying Yu Yufeng Cui Fan Zhang Xiaosong Zhang Yueze Wang Hongcheng Gao Jingjing Liu Tiejun Huang Xinlong Wang MLLM 301 155 0 11 Jul 2023
A Survey on Multimodal Large Language ModelsNational Science Review (NSR), 2023 Xinglong Mao Chaoyou Fu Zhengye Zhang Ke Li Xing Sun Tong Xu Enhong Chen MLLM LRM 397 951 0 23 Jun 2023
Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open QuestionsACM Computing Surveys (ACM CSUR), 2022 Paul Pu Liang Amir Zadeh Louis-Philippe Morency 270 158 0 07 Sep 2022