v1v2v3v4 (latest)

HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face

Neural Information Processing Systems (NeurIPS), 2023

30 March 2023

Yongliang Shen

Kaitao Song

Xu Tan

Dongsheng Li

Weiming Lu

Yueting Zhuang

MLLM

ArXiv (abs)PDF HTML HuggingFace (12 upvotes)

Papers citing "HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face"

50 / 750 papers shown

Title
When Foundation Model Meets Federated Learning: Motivations, Challenges, and Future Directions Weiming Zhuang Chen Chen Lingjuan Lyu Chong Chen Yaochu Jin Lingjuan Lyu AIFin AI4CE 613 119 0 27 Jun 2023
A Survey on Multimodal Large Language ModelsNational Science Review (NSR), 2023 Xinglong Mao Chaoyou Fu Zhengye Zhang Ke Li Xing Sun Tong Xu Enhong Chen MLLM LRM 405 955 0 23 Jun 2023
ToolQA: A Dataset for LLM Question Answering with External ToolsNeural Information Processing Systems (NeurIPS), 2023 Yuchen Zhuang Yue Yu Kuan-Chieh Wang Haotian Sun Chao Zhang ELM LLMAG 253 339 0 23 Jun 2023
MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Models Chaoyou Fu Peixian Chen Chunjiang Ge Yulei Qin Mengdan Zhang ... Xing Sun Zhenyu Qiu Rongrong Ji Caifeng Shan Ran He ELM MLLM 721 1,199 0 23 Jun 2023
Domain-specific ChatBots for Science using EmbeddingsDigital Discovery (DD), 2023 Kevin G. Yager 156 15 0 15 Jun 2023
Towards AGI in Computer Vision: Lessons Learned from GPT and Large Language Models Lingxi Xie Longhui Wei Xiaopeng Zhang Kaifeng Bi Xiaotao Gu Jianlong Chang Qi Tian 230 9 0 14 Jun 2023
AssistGPT: A General Multi-modal Assistant that can Plan, Execute, Inspect, and Learn Difei Gao Lei Ji Luowei Zhou Kevin Lin Joya Chen Zihan Fan Mike Zheng Shou MLLM 359 105 0 14 Jun 2023
Synapse: Trajectory-as-Exemplar Prompting with Memory for Computer ControlInternational Conference on Learning Representations (ICLR), 2023 Longtao Zheng Rongpin Wang Xinrun Wang Bo An LLMAG 324 97 0 13 Jun 2023
ChatGPT vs Human-authored Text: Insights into Controllable Text Summarization and Sentence Style TransferAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Dongqi Pu Vera Demberg DeLMO 203 72 0 13 Jun 2023
Data-Copilot: Bridging Billions of Data and Humans with Autonomous Workflow Wenqi Zhang Yongliang Shen Weiming Lu Yueting Zhuang LLMAG 578 73 0 12 Jun 2023
Sticker820K: Empowering Interactive Retrieval with Stickers Sijie Zhao Yixiao Ge Chen Ma Lin Song Xiaohan Ding Zehua Xie Ying Shan 110 14 0 12 Jun 2023
Valley: Video Assistant with Large Language model Enhanced abilitY Ruipu Luo Ziwang Zhao Min Yang Junwei Dong Da Li Pengcheng Lu Tao Wang Linmei Hu Ming-Hui Qiu MLLM 475 248 0 12 Jun 2023
LAMM: Language-Assisted Multi-Modal Instruction-Tuning Dataset, Framework, and BenchmarkNeural Information Processing Systems (NeurIPS), 2023 Zhen-fei Yin Zhenghao Hu Jianjian Cao Zhelun Shi Dingning Liu ... Mengwei He Xiaoshui Huang Zhiyong Wang Jing Shao Wanli Ouyang MLLM 228 204 0 11 Jun 2023
RestGPT: Connecting Large Language Models with Real-World RESTful APIs Yifan Song Weimin Xiong Dawei Zhu Wenhao Wu Han Qian ... Cheng Li Ke Wang Rong Yao Ye Tian Sujian Li RALM LLMAG CLL LM&MA 262 112 0 11 Jun 2023
14 Examples of How LLMs Can Transform Materials Science and Chemistry: A Reflection on a Large Language Model HackathonDigital Discovery (DD), 2023 Kevin Maik Jablonka Qianxiang Ai Alexander H Al-Feghali S. Badhwar Joshua D. Bocarsly Andres M Bran ... Aristana Scourtas K. J. Schmidt Ian Foster Andrew D. White Ben Blaiszik 455 145 0 09 Jun 2023
Mind2Web: Towards a Generalist Agent for the WebNeural Information Processing Systems (NeurIPS), 2023 Xiang Deng Yu Gu Boyuan Zheng Shijie Chen Samuel Stevens Boshi Wang Huan Sun Yu-Chuan Su LLMAG 468 748 0 09 Jun 2023
Prompt Injection attack against LLM-integrated Applications Yi Liu Gelei Deng Yuekang Li Kailong Wang Zihao Wang ... Tianwei Zhang Yepang Liu Haoyu Wang Yanhong Zheng Yang Liu SILM 319 536 0 08 Jun 2023
MIMIC-IT: Multi-Modal In-Context Instruction Tuning Yue Liu Yuanhan Zhang Liangyu Chen Jinghao Wang Fanyi Pu Jingkang Yang Xuefei Liu Ziwei Liu MLLM VLM 231 287 0 08 Jun 2023
ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Cases Qiaoyu Tang Ziliang Deng Hongyu Lin Xianpei Han Qiao Liang Boxi Cao Le Sun CLL SyDa 250 275 0 08 Jun 2023
ChatDB: Augmenting LLMs with Databases as Their Symbolic Memory Chenxu Hu Jie Fu Chenzhuang Du Simian Luo Jiaqi Zhao Hang Zhao KELM LLMAG 349 136 0 06 Jun 2023
An Approach to Solving the Abstraction and Reasoning Corpus (ARC) Challenge Tan John Chong Min RALM LRM 87 7 0 06 Jun 2023
Natural Language Commanding via Program Synthesis Apurva Gandhi Thong Q. Nguyen Huitian Jiao R. Steen Ameya Bhatawdekar 143 9 0 06 Jun 2023
Leveraging Large Language Models for Topic Classification in the Domain of Public Affairs Alejandro Peña Aythami Morales Julian Fierrez Ignacio Serna J. Ortega-Garcia Iñigo Puente Jorge Cordova Gonzalo Cordova 135 27 0 05 Jun 2023
Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video UnderstandingConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Hang Zhang Xin Li Lidong Bing MLLM 522 1,453 0 05 Jun 2023
A survey of Generative AI ApplicationsJournal of Computer Science (JCS), 2023 Roberto Gozalo-Brizuela Eduardo C. Garrido-Merchán 3DV MedIm 330 124 0 05 Jun 2023
Auto-GPT for Online Decision Making: Benchmarks and Additional Opinions Hui Yang Sifu Yue Yunzhong He RALM 208 247 0 04 Jun 2023
MathChat: Converse to Tackle Challenging Math Problems with LLM Agents Yiran Wu Feiran Jia Shaokun Zhang Han-Tai Li Erkang Zhu Yue Wang Y. Lee Richard Peng Qingyun Wu Chi Wang LLMAG 269 66 0 02 Jun 2023
Responsible Task Automation: Empowering Large Language Models as Responsible Task Automators Zhizheng Zhang Xiaoyi Zhang Wenxuan Xie Yan Lu 139 18 0 02 Jun 2023
Thought Cloning: Learning to Think while Acting by Imitating Human ThinkingNeural Information Processing Systems (NeurIPS), 2023 Shengran Hu Jeff Clune LM&Ro OffRL LRM AI4CE 424 37 0 01 Jun 2023
Using Visual Cropping to Enhance Fine-Detail Question Answering of BLIP-Family Models Jiarui Zhang Mahyar Khayatkhoei P. Chhikara Filip Ilievski 139 1 0 31 May 2023
Deliberate then Generate: Enhanced Prompting Framework for Text Generation Bei Li Rui Wang Junliang Guo Kaitao Song Xuejiao Tan Hany Hassan Arul Menezes Tong Xiao Jiang Bian JingBo Zhu 147 18 0 31 May 2023
SheetCopilot: Bringing Software Productivity to the Next Level through Large Language ModelsNeural Information Processing Systems (NeurIPS), 2023 Hongxin Li Jingran Su Yuntao Chen Qing Li Zhaoxiang Zhang LMTD 244 48 0 30 May 2023
Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive SurveyACM Computing Surveys (ACM Comput. Surv.), 2023 Chen Ling Xujiang Zhao Jiaying Lu Chengyuan Deng Can Zheng ... Chris White Quanquan Gu Jian Pei Carl Yang Bo Pan ALM 348 209 0 30 May 2023
Contextual Object Detection with Multimodal Large Language ModelsInternational Journal of Computer Vision (IJCV), 2023 Yuhang Zang Wei Li Jun Han Kaiyang Zhou Chen Change Loy ObjD VLM MLLM 277 135 0 29 May 2023
Make-An-Audio 2: Temporal-Enhanced Text-to-Audio Generation Jia-Bin Huang Yi Ren Rongjie Huang Dongchao Yang Zhenhui Ye Chen Zhang Jinglin Liu Xiang Yin Zejun Ma Zhou Zhao DiffM 188 92 0 29 May 2023
Ask an Expert: Leveraging Language Models to Improve Strategic Reasoning in Goal-Oriented Dialogue ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Qiang Zhang Jason Naradowsky Yusuke Miyao ELM 220 43 0 29 May 2023
SwiftSage: A Generative Agent with Fast and Slow Thinking for Complex Interactive TasksNeural Information Processing Systems (NeurIPS), 2023 Bill Yuchen Lin Yicheng Fu Karina Yang Faeze Brahman Shiyu Huang Chandra Bhagavatula Prithviraj Ammanabrolu Yejin Choi Xiang Ren LLMAG LM&Ro LRM 219 190 0 27 May 2023
Large Language Models as Tool MakersInternational Conference on Learning Representations (ICLR), 2023 Tianle Cai Xuezhi Wang Tengyu Ma Xinyun Chen Denny Zhou LLMAG 248 256 0 26 May 2023
NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language ModelsAAAI Conference on Artificial Intelligence (AAAI), 2023 Gengze Zhou Yicong Hong Qi Wu ELM LM&Ro LLMAG LRM 433 260 0 26 May 2023
Attention Paper: How Generative AI Reshapes Digital Shadow Industry?ACM Turing Celebration Conference (TC), 2023 Qichao Wang Huan Ma Wen-Ke Wei Hang Li Liang Chen ... Binwen Zhao Bo Hu Shu Zhen Zhang Zibin Zheng Bing Wu 156 1 0 26 May 2023
AdaPlanner: Adaptive Planning from Feedback with Language ModelsNeural Information Processing Systems (NeurIPS), 2023 Haotian Sun Yuchen Zhuang Lingkai Kong Bo Dai Chao Zhang LLMAG 178 177 0 26 May 2023
Enhancing Human Capabilities through Symbiotic Artificial Intelligence with Shared Sensory Experiences Rui Hao Dianbo Liu Linmei Hu 172 4 0 26 May 2023
On the Tool Manipulation Capability of Open-source Large Language Models Qiantong Xu Fenglu Hong Yangqiu Song Changran Hu Zheng Chen Jian Zhang LLMAG 228 95 0 25 May 2023
Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memory Xizhou Zhu Yuntao Chen Hao Tian Chenxin Tao Weijie Su ... Lewei Lu Xiaogang Wang Yu Qiao Zhaoxiang Zhang Jifeng Dai LLMAG LM&Ro 251 283 0 25 May 2023
ChatBridge: Bridging Modalities with Large Language Model as a Language Catalyst Zijia Zhao Longteng Guo Tongtian Yue Si-Qing Chen Shuai Shao Xinxin Zhu Zehuan Yuan Jing Liu MLLM 257 67 0 25 May 2023
Gorilla: Large Language Model Connected with Massive APIsNeural Information Processing Systems (NeurIPS), 2023 Shishir G. Patil Tianjun Zhang Xin Wang Joseph E. Gonzalez ELM CLL ALM SyDa 356 833 0 24 May 2023
Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language ModelsNeural Information Processing Systems (NeurIPS), 2023 Gen Luo Weihao Ye Tianhe Ren Shen Chen Xiaoshuai Sun Rongrong Ji VLM MLLM 274 134 0 24 May 2023
EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of ThoughtNeural Information Processing Systems (NeurIPS), 2023 Yao Mu Qinglong Zhang Mengkang Hu Wen Wang Mingyu Ding Jun Jin Bin Wang Jifeng Dai Yu Qiao Ping Luo LM&Ro LRM 329 343 0 24 May 2023
ChatFace: Chat-Guided Real Face Editing via Diffusion Latent Space Manipulation Dongxu Yue Qin Guo Munan Ning Jiaxi Cui Yuesheng Zhu Liuliang Yuan DiffM 273 15 0 24 May 2023
IdealGPT: Iteratively Decomposing Vision and Language Reasoning via Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Haoxuan You Rui Sun Zhecan Wang Long Chen Gengyu Wang Hammad A. Ayyubi Kai-Wei Chang Shih-Fu Chang VLM MLLM LRM 363 55 0 24 May 2023