UGIF: UI Grounded Instruction Following

14 November 2022

Papers citing "UGIF: UI Grounded Instruction Following"

10 / 10 papers shown

Title
MobileSteward: Integrating Multiple App-Oriented Agents with Self-Evolution to Automate Cross-App Instructions Yuxuan Liu Hongda Sun Wei Liu Jian Luan Bo Du Rui Yan 51 2 0 24 Feb 2025
AMEX: Android Multi-annotation Expo Dataset for Mobile GUI Agents Yuxiang Chai Siyuan Huang Yazhe Niu Han Xiao Liang Liu Dingyu Zhang Peng Gao Shuai Ren Hongsheng Li LLMAG 33 25 0 03 Jul 2024
GUI Action Narrator: Where and When Did That Action Take Place? Qinchen Wu Difei Gao Kevin Qinghong Lin Zhuoyu Wu Xiangwu Guo Peiran Li Weichen Zhang Hengxu Wang Mike Zheng Shou 37 3 0 19 Jun 2024
GUI Odyssey: A Comprehensive Dataset for Cross-App GUI Navigation on Mobile Devices Quanfeng Lu Wenqi Shao Zitao Liu Fanqing Meng Boxuan Li Botong Chen Siyuan Huang Kaipeng Zhang Yu Qiao Ping Luo 46 26 0 12 Jun 2024
Enhancing Mobile "How-to" Queries with Automated Search Results Verification and Reranking Lei Ding Jeshwanth Bheemanpally Yi Zhang 27 1 0 13 Apr 2024
AXNav: Replaying Accessibility Tests from Natural Language Maryam Taeb Amanda Swearngin E. Schoop Ruijia Cheng Yue Jiang Jeffrey Nichols 26 37 0 03 Oct 2023
Android in the Wild: A Large-Scale Dataset for Android Device Control Christopher Rawles Alice Li Daniel Rodriguez Oriana Riva Timothy Lillicrap LM&Ro 18 137 0 19 Jul 2023
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 323 8,448 0 28 Jan 2022
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 280 3,843 0 18 Apr 2021
Spatial Reasoning from Natural Language Instructions for Robot Manipulation S. Gubbi Anirban Biswas Raviteja Upadrashta V. Srinivasan Partha P. Talukdar B. Amrutur LM&Ro LRM 48 29 0 26 Dec 2020