v1v2v3v4 (latest)

HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face

Neural Information Processing Systems (NeurIPS), 2023

30 March 2023

Yongliang Shen

Kaitao Song

Xu Tan

Dongsheng Li

Weiming Lu

Yueting Zhuang

MLLM

ArXiv (abs)PDF HTML HuggingFace (12 upvotes)

Papers citing "HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face"

50 / 750 papers shown

Title
A Survey on Large Language Model based Autonomous Agents Lei Wang Chengbang Ma Xueyang Feng Zeyu Zhang Hao-ran Yang ... Xu Chen Yankai Lin Wayne Xin Zhao Zhewei Wei Ji-Rong Wen LLMAG AI4CE LM&Ro 650 2,022 0 22 Aug 2023
LatEval: An Interactive LLMs Evaluation Benchmark with Incomplete Information from Lateral Thinking PuzzlesInternational Conference on Language Resources and Evaluation (LREC), 2023 Shulin Huang Shirong Ma Hai-Tao Zheng Mengzuo Huang Wuhe Zou Weidong Zhang Haitao Zheng LLMAG LRM 274 40 0 21 Aug 2023
CharacterChat: Learning towards Conversational AI with Personalized Social Support Quan Tu Chuanqi Chen Jinpeng Li Yanran Li Shuo Shang Dongyan Zhao Ran Wang Rui Yan 279 64 0 20 Aug 2023
StableLLaVA: Enhanced Visual Instruction Tuning with Synthesized Image-Dialogue Data Yanda Li Chi Zhang Gang Yu Zhibin Wang Bin-Bin Fu Guosheng Lin Chunhua Shen Ling Chen Yunchao Wei MLLM 156 35 0 20 Aug 2023
Tree-of-Mixed-Thought: Combining Fast and Slow Thinking for Multi-hop Visual Reasoning Pengbo Hu Jingxian Qi Xingyu Li Hong Li Xinqi Wang Bing Quan Ruiyu Wang Yi Zhou LRM LLMAG 178 19 0 18 Aug 2023
PUMGPT: A Large Vision-Language Model for Product Understanding Wei Xue Zongyi Guo Baoliang Cui Zengming Tang Weiwei Zhang Haihong Tang Shuhui Wu Weiming Lu VLM 178 4 0 18 Aug 2023
FashionLOGO: Prompting Multimodal Large Language Models for Fashion Logo EmbeddingsInternational Conference on Information and Knowledge Management (CIKM), 2023 Yulin Su Min Yang Minghui Qiu Jing Wang Tao Wang VLM 176 2 0 17 Aug 2023
GIT-Mol: A Multi-modal Large Language Model for Molecular Science with Graph, Image, and Text Peng Liu Yiming Ren Jun Tao Zhixiang Ren AI4CE 330 115 0 14 Aug 2023
A Large Language Model Enhanced Conversational Recommender System Yue Feng Shuchang Liu Zhenghai Xue Qingpeng Cai Lantao Hu Peng Jiang Kun Gai Fei Sun LRM 241 66 0 11 Aug 2023
BOLAA: Benchmarking and Orchestrating LLM-augmented Autonomous Agents Zhiwei Liu Weiran Yao Jianguo Zhang Le Xue Shelby Heinecke ... Ran Xu P. Mùi Haiquan Wang Caiming Xiong Silvio Savarese LLMAG 208 100 0 11 Aug 2023
Gentopia: A Collaborative Platform for Tool-Augmented LLMsConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Binfeng Xu Xukun Liu Hua Shen Zeyu Han Yuhan Li Murong Yue Zhi-Ping Peng Yuchen Liu Ziyu Yao Dongkuan Xu LLMAG 199 24 0 08 Aug 2023
AgentSims: An Open-Source Sandbox for Large Language Model Evaluation Jiaju Lin Haoran Zhao Aochi Zhang Yiting Wu Huqiuyue Ping Qin Chen ELM LLMAG 296 89 0 08 Aug 2023
TPTU: Large Language Model-based AI Agents for Task Planning and Tool Usage Jingqing Ruan Yihong Chen Bin Zhang Zhiwei Xu Tianpeng Bao ... Shiwei Shi Hangyu Mao Ziyue Li Xingyu Zeng Rui Zhao LLMAG LM&Ro 285 49 0 07 Aug 2023
MM-Vet: Evaluating Large Multimodal Models for Integrated CapabilitiesInternational Conference on Machine Learning (ICML), 2023 Weihao Yu Zhengyuan Yang Linjie Li Jianfeng Wang Kevin Qinghong Lin Zicheng Liu Xinchao Wang Lijuan Wang MLLM 474 1,006 0 04 Aug 2023
Retroformer: Retrospective Large Language Agents with Policy Gradient OptimizationInternational Conference on Learning Representations (ICLR), 2023 Weiran Yao Shelby Heinecke Juan Carlos Niebles Zhiwei Liu Yihao Feng ... Ran Xu P. Mùi Haiquan Wang Caiming Xiong Silvio Savarese LLMAG LM&Ro 232 103 0 04 Aug 2023
The All-Seeing Project: Towards Panoptic Visual Recognition and Understanding of the Open WorldInternational Conference on Learning Representations (ICLR), 2023 Weiyun Wang Min Shi Qingyun Li Wen Wang Zhenhang Huang ... Zhiguo Cao Yushi Chen Tong Lu Jifeng Dai Yu Qiao LRM MLLM 219 116 0 03 Aug 2023
Flows: Building Blocks of Reasoning and Collaborating AI Martin Josifoski Lars Klein Maxime Peyrard Nicolas Mario Baldwin Yifei Li ... Julian Paul Schnitzler Yuxing Yao Jiheng Wei Debjit Paul Robert West AI4CE 343 30 0 02 Aug 2023
LISA: Reasoning Segmentation via Large Language ModelComputer Vision and Pattern Recognition (CVPR), 2023 Xin Lai Zhuotao Tian Yukang Chen Yanwei Li Yuhui Yuan Shu Liu Jiaya Jia LM&Ro VLM MLLM LRM 449 704 0 01 Aug 2023
Tool Documentation Enables Zero-Shot Tool-Usage with Large Language Models Cheng-Yu Hsieh Sibei Chen Chun-Liang Li Yasuhisa Fujii Alexander Ratner Chen-Yu Lee Ranjay Krishna Tomas Pfister LLMAG SyDa 268 58 0 01 Aug 2023
ChatMOF: An Autonomous AI System for Predicting and Generating Metal-Organic Frameworks Y. Kang Jihan Kim AI4CE LLMAG 157 16 0 01 Aug 2023
ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIsInternational Conference on Learning Representations (ICLR), 2023 Yujia Qin Shi Liang Yining Ye Kunlun Zhu Lan Yan ... Jie Zhou Mark B. Gerstein Dahai Li Zhiyuan Liu Maosong Sun CLL ALM LLMAG ELM LM&MA 569 1,058 0 31 Jul 2023
NLLG Quarterly arXiv Report 06/23: What are the most influential current AI Papers? Steffen Eger Christoph Leiter Jonas Belouadi Ran Zhang Aida Kostikova Daniil Larionov Yanran Chen Vivian Fresen AI4CE 172 5 0 31 Jul 2023
When Large Language Models Meet Personalization: Perspectives of Challenges and OpportunitiesWorld wide web (Bussum) (WWWB), 2023 Jin Chen Zheng Liu Xunpeng Huang Chenwang Wu Qi Liu ... Yuxuan Lei Xiaolong Chen Xingmei Wang Defu Lian Enhong Chen ALM 250 239 0 31 Jul 2023
CHATREPORT: Democratizing Sustainability Disclosure Analysis through LLM-based ToolsConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Jingwei Ni J. Bingler Chiara Colesanti-Senni Mathias Kraus Glen Gostlow ... Qian Wang Nicolas Webersinke Tobias Wekhof Ting Yu Markus Leippold 140 40 0 28 Jul 2023
Testing the Depth of ChatGPT's Comprehension via Cross-Modal Tasks Based on ASCII-Art: GPT3.5's Abilities in Regard to Recognizing and Generating ASCII-Art Are Not Totally LackingFindings (Findings), 2023 David Bayani MLLM 163 7 0 28 Jul 2023
New Interaction Paradigm for Complex EDA Software Leveraging GPT Xinyu Wang Boyu Han Zhenghan Tai Jingrui Tian Yifan Wang Junyu Yan Yidong Tian 53 5 0 27 Jul 2023
WavJourney: Compositional Audio Creation with Large Language ModelsIEEE Transactions on Audio, Speech, and Language Processing (TASLP), 2023 Xubo Liu Zhongkai Zhu Haohe Liu Yiitan Yuan Meng Cui ... Jinhua Liang Yin Cao Qiuqiang Kong Mark D. Plumbley Wenwu Wang AuLLM 220 35 0 26 Jul 2023
General Purpose Artificial Intelligence Systems (GPAIS): Properties, Definition, Taxonomy, Societal Implications and Responsible Governance I. Triguero Daniel Molina Javier Poyatos Javier Del Ser Francisco Herrera AI4TS AI4MH 355 6 0 26 Jul 2023
Foundational Models Defining a New Era in Vision: A Survey and Outlook Muhammad Awais Muzammal Naseer Salman Khan Rao Muhammad Anwer Hisham Cholakkal M. Shah Ming-Hsuan Yang Fahad Shahbaz Khan VLM 408 151 0 25 Jul 2023
FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarios Ethan Chern Steffi Chern Shiqi Chen Weizhe Yuan Kehua Feng Chunting Zhou Junxian He Graham Neubig Pengfei Liu HILM 259 262 0 25 Jul 2023
Fashion Matrix: Editing Photos by Just Talking Zheng Chong Xujie Zhang Fuwei Zhao Zhenyu Xie Xiaodan Liang DiffM 185 2 0 25 Jul 2023
Getting pwn'd by AI: Penetration Testing with Large Language Models A. Happe Jürgen Cito 312 121 0 24 Jul 2023
Bridging Intelligence and Instinct: A New Control Paradigm for Autonomous Robots Shimian Zhang Qiuhong Lu 144 4 0 20 Jul 2023
DVPT: Dynamic Visual Prompt Tuning of Large Pre-trained Models for Medical Image AnalysisNeural Networks (Neural Netw.), 2023 Along He Kai Wang Zhihong Wang Tao Li Huazhu Fu MedIm 210 13 0 19 Jul 2023
ChatSpot: Bootstrapping Multimodal LLMs via Precise Referring Instruction TuningInternational Joint Conference on Artificial Intelligence (IJCAI), 2023 Liang Zhao En Yu Zheng Ge Jinrong Yang Hao-Ran Wei ... Jian‐Yuan Sun Yuang Peng Runpei Dong Chunrui Han Xiangyu Zhang MLLM LRM 149 69 0 18 Jul 2023
REX: Rapid Exploration and eXploitation for AI Agents Rithesh Murthy Shelby Heinecke Juan Carlos Niebles Zhiwei Liu Le Xue ... Ran Xu P. Mùi Haiquan Wang Caiming Xiong Silvio Savarese OffRL 222 12 0 18 Jul 2023
BuboGPT: Enabling Visual Grounding in Multi-Modal LLMs Yang Zhao Zhijie Lin Daquan Zhou Zilong Huang Jiashi Feng Bingyi Kang MLLM 194 124 0 17 Jul 2023
Mini-Giants: "Small" Language Models and Open Source Win-Win Zhengping Zhou Lezhi Li Xinxi Chen Andy Li SyDa ALM MoE 322 10 0 17 Jul 2023
GeoGPT: Understanding and Processing Geospatial Tasks through An Autonomous GPT Yifan Zhang Cheng Wei Shangyou Wu Zhengting He Wenhao Yu 225 50 0 16 Jul 2023
A Comprehensive Overview of Large Language ModelsACM Transactions on Intelligent Systems and Technology (ACM TIST), 2023 Humza Naveed Asad Ullah Khan Shi Qiu Muhammad Saqib Saeed Anwar Muhammad Usman Naveed Akhtar Nick Barnes Lin Wang OffRL 784 1,122 0 12 Jul 2023
AmadeusGPT: a natural language interface for interactive animal behavioral analysisNeural Information Processing Systems (NeurIPS), 2023 Shaokai Ye Jessy Lauer Mu Zhou Alexander Mathis Mackenzie W. Mathis MLLM LLMAG 310 25 0 10 Jul 2023
On decoder-only architecture for speech-to-text and large language model integrationAutomatic Speech Recognition & Understanding (ASRU), 2023 Jian Wu Yashesh Gaur Zhuo Chen Long Zhou Yilun Zhu ... Jinyu Li Shujie Liu Bo Ren Linquan Liu Yu-Huan Wu AuLLM 459 182 0 08 Jul 2023
A Survey on Evaluation of Large Language ModelsACM Transactions on Intelligent Systems and Technology (ACM TIST), 2023 Yu-Chu Chang Xu Wang Yongfeng Zhang Yuanyi Wu Linyi Yang ... Yue Zhang Yi-Ju Chang Philip S. Yu Qian Yang Xingxu Xie ELM LM&MA ALM 700 2,667 0 06 Jul 2023
What Should Data Science Education Do with Large Language Models? Xinming Tu James Zou Weijie J. Su Linjun Zhang AI4Ed 130 44 0 06 Jul 2023
Large Language Models Empowered Autonomous Edge AI for Connected IntelligenceIEEE Communications Magazine (IEEE Commun. Mag.), 2023 Yifei Shen Jiawei Shao Xinjie Zhang Zehong Lin Hao Pan Dongsheng Li Jun Zhang Khaled B. Letaief 305 129 0 06 Jul 2023
Wireless Multi-Agent Generative AI: From Connected Intelligence to Collective Intelligence Han Zou Qiyang Zhao Lina Bariah M. Bennis Merouane Debbah LLMAG 146 60 0 06 Jul 2023
What Matters in Training a GPT4-Style Language Model with Multimodal Inputs?North American Chapter of the Association for Computational Linguistics (NAACL), 2023 Yan Zeng Hanbo Zhang Jiani Zheng Jiangnan Xia Guoqiang Wei Yang Wei Yuchen Zhang Tao Kong MLLM 250 88 0 05 Jul 2023
Visual Instruction Tuning with Polite FlamingoAAAI Conference on Artificial Intelligence (AAAI), 2023 Delong Chen Jianfeng Liu Wenliang Dai Baoyuan Wang MLLM 332 52 0 03 Jul 2023
Harnessing LLMs in Curricular Design: Using GPT-4 to Support Authoring of Learning Objectives Pragnya Sridhar Aidan Doyle Arav Agarwal Chris Bogart Jaromír Šavelka M. Sakr 182 63 0 30 Jun 2023
LyricWhiz: Robust Multilingual Zero-shot Lyrics Transcription by Whispering to ChatGPTInternational Society for Music Information Retrieval Conference (ISMIR), 2023 Le Zhuo Ruibin Yuan Jiahao Pan Yi Ma Yi Zhou ... Chenghua Lin Emmanouil Benetos Wenhu Chen Wei Xue Yi-Ting Guo 282 24 0 29 Jun 2023