Video2Action: Reducing Human Interactions in Action Annotation of App Tutorial Videos

7 August 2023

Papers citing "Video2Action: Reducing Human Interactions in Action Annotation of App Tutorial Videos"

6 / 6 papers shown

Title
ScreenLLM: Stateful Screen Schema for Efficient Action Understanding and Prediction Yiqiao Jin Stefano Petrangeli Yu Shen Gang Wu LLMAG LM&Ro 75 0 0 26 Mar 2025
GUI-Xplore: Empowering Generalizable GUI Agents with One Exploration Yuchen Sun Shanhui Zhao Tao Yu Hao Wen Samith Va Mengwei Xu Yuanchun Li Chongyang Zhang LLMAG 62 0 0 22 Mar 2025
MUD: Towards a Large-Scale and Noise-Filtered UI Dataset for Modern Style UI Modeling Sidong Feng Suyu Ma Han Wang David Kong Chunyang Chen 19 9 0 11 May 2024
Designing with Language: Wireframing UI Design Intent with Generative Large Language Models Sidong Feng Mingyue Yuan Jieshan Chen Zhenchang Xing Chunyang Chen AI4CE 3DV 14 7 0 12 Dec 2023
Extracting Replayable Interactions from Videos of Mobile App Usage Jieshan Chen Amanda Swearngin Jason Wu Titus Barik Jeffrey Nichols Xiaoyi Zhang 22 9 0 09 Jul 2022
Screen Recognition: Creating Accessibility Metadata for Mobile Applications from Pixels Xiaoyi Zhang Lilian de Greef Amanda Swearngin Samuel White Kyle I. Murray ... Jeffrey Nichols Jason Wu Chris Fleizach Aaron Everitt Jeffrey P. Bigham 156 163 0 13 Jan 2021