Joint Hand Motion and Interaction Hotspots Prediction from Egocentric Videos

4 April 2022

Xiaolong Wang

Papers citing "Joint Hand Motion and Interaction Hotspots Prediction from Egocentric Videos"

50 / 75 papers shown

Title
The Invisible EgoHand: 3D Hand Forecasting through EgoBody Pose Estimation Masashi Hatano Zhifan Zhu Hideo Saito Dima Damen EgoV 24 0 0 11 Apr 2025
Novel Diffusion Models for Multimodal 3D Hand Trajectory Prediction Junyi Ma Wentao Bao Jingyi Xu Guanzhong Sun Xieyuanli Chen Hesheng Wang 30 0 0 10 Apr 2025
Learning Predictive Visuomotor Coordination Wenqi Jia Bolin Lai Miao Liu Danfei Xu James M. Rehg 47 0 0 30 Mar 2025
HOIGPT: Learning Long Sequence Hand-Object Interaction with Language Models Mingzhen Huang Fu-Jen Chu Bugra Tekin Kevin J Liang Haoyu Ma ... Hongfei Xue Siwei Lyu Kris M. Kitani Matt Feiszli Hao Tang VLM 59 0 0 24 Mar 2025
VidBot: Learning Generalizable 3D Actions from In-the-Wild 2D Human Videos for Zero-Shot Robotic Manipulation Hanzhi Chen Boyang Sun Anran Zhang Marc Pollefeys Stefan Leutenegger LM&Ro 59 0 0 10 Mar 2025
A Helping (Human) Hand in Kinematic Structure Estimation Adrian Pfisterer Xing Li Vito Mengers Oliver Brock 40 0 0 07 Mar 2025
An Egocentric Vision-Language Model based Portable Real-time Smart Assistant Y. Huang Jilan Xu Baoqi Pei Yuping He Guo Chen ... Xinyuan Chen Yaohui Wang Yali Wang Yu Qiao Limin Wang 70 1 0 06 Mar 2025
HandsOnVLM: Vision-Language Models for Hand-Object Interaction Prediction Chen Bao Jiarui Xu Xiaolong Wang Abhinav Gupta Homanga Bharadhwaj 68 2 0 17 Dec 2024
Leverage Task Context for Object Affordance Ranking Haojie Huang Hongchen Luo Wei-dong Zhai Yang Cao Zheng-jun Zha 61 0 0 25 Nov 2024
STEER: Flexible Robotic Manipulation via Dense Language Grounding Laura Smith A. Irpan Montserrat Gonzalez Arenas Sean Kirmani Dmitry Kalashnikov Dhruv Shah Ted Xiao LLMSV 32 1 0 05 Nov 2024
Human Action Anticipation: A Survey Bolin Lai Sam Toyer Tushar Nagarajan Rohit Girdhar S. Zha James M. Rehg Kris M. Kitani Kristen Grauman Ruta Desai Miao Liu AI4TS 33 1 0 17 Oct 2024
Gen2Act: Human Video Generation in Novel Scenarios enables Generalizable Robot Manipulation Homanga Bharadhwaj Debidatta Dwibedi Abhinav Gupta Shubham Tulsiani Carl Doersch Ted Xiao Dhruv Shah Fei Xia Dorsa Sadigh Sean Kirmani VGen LM&Ro 35 21 0 24 Sep 2024
Embodiment-Agnostic Action Planning via Object-Part Scene Flow Weiliang Tang Jia-Hui Pan Wei Zhan Jianshu Zhou Huaxiu Yao Yun-Hui Liu M. Tomizuka Mingyu Ding Chi-Wing Fu 41 0 0 16 Sep 2024
One-shot Video Imitation via Parameterized Symbolic Abstraction Graphs Jianren Wang Kangni Liu Dingkun Guo Xian Zhou Christopher G Atkeson 22 0 0 22 Aug 2024
Learning Precise Affordances from Egocentric Videos for Robotic Manipulation Gen Li Nikolaos Tsagkas Jifei Song Ruaridh Mon-Williams S. Vijayakumar Kun Shao Laura Sevilla-Lara 25 7 0 19 Aug 2024
Controlling the World by Sleight of Hand Sruthi Sudhakar Ruoshi Liu Basile Van Hoorick Carl Vondrick Richard Zemel 24 3 0 13 Aug 2024
PEAR: Phrase-Based Hand-Object Interaction Anticipation Zichen Zhang Hongcheng Luo Wei Zhai N. A. Ushakov Yu Kang 35 5 0 31 Jul 2024
HRP: Human Affordances for Robotic Pre-Training M. K. Srirama Sudeep Dasari Shikhar Bahl Abhinav Gupta 18 12 0 26 Jul 2024
Flow as the Cross-Domain Manipulation Interface Mengda Xu Zhenjia Xu Yinghao Xu Cheng Chi Gordon Wetzstein Manuela Veloso Shuran Song AI4CE 23 32 0 21 Jul 2024
CaRe-Ego: Contact-aware Relationship Modeling for Egocentric Interactive Hand-object Segmentation Yuejiao Su Yi Wang Lap-Pui Chau 57 1 0 08 Jul 2024
RAM: Retrieval-Based Affordance Transfer for Generalizable Zero-Shot Robotic Manipulation Yuxuan Kuang Junjie Ye Haoran Geng Jiageng Mao Congyue Deng Leonidas J. Guibas He Wang Yue Wang LM&Ro 38 20 0 05 Jul 2024
ZARRIO @ Ego4D Short Term Object Interaction Anticipation Challenge: Leveraging Affordances and Attention-based models for STA Lorenzo Mur-Labadia Ruben Martinez-Cantin J. Guerrero-Campo G. Farinella 21 0 0 05 Jul 2024
AFF-ttention! Affordances and Attention models for Short-Term Object Interaction Anticipation Lorenzo Mur-Labadia Ruben Martinez-Cantin Jose J. Guerrero G. Farinella Antonino Furnari 24 4 0 03 Jun 2024
EMAG: Ego-motion Aware and Generalizable 2D Hand Forecasting from Egocentric Videos Masashi Hatano Ryo Hachiuma Hideo Saito EgoV 24 3 0 30 May 2024
Bidirectional Progressive Transformer for Interaction Intention Anticipation Zichen Zhang Hongcheng Luo Wei Zhai Yang Cao Yu Kang 19 5 0 09 May 2024
Diff-IP2D: Diffusion-Based Hand-Object Interaction Prediction on Egocentric Videos Junyi Ma Jingyi Xu Xieyuanli Chen Hesheng Wang VGen 27 1 0 07 May 2024
Track2Act: Predicting Point Tracks from Internet Videos enables Diverse Zero-shot Robot Manipulation Homanga Bharadhwaj Roozbeh Mottaghi Abhinav Gupta Shubham Tulsiani 3DPC 41 15 0 02 May 2024
G-HOP: Generative Hand-Object Prior for Interaction Reconstruction and Grasp Synthesis Yufei Ye Abhinav Gupta Kris M. Kitani Shubham Tulsiani 18 16 0 18 Apr 2024
Self-Explainable Affordance Learning with Embodied Caption Zhipeng Zhang Zhimin Wei Guolei Sun Peng Wang Luc Van Gool 40 2 0 08 Apr 2024
Text-driven Affordance Learning from Egocentric Vision Tomoya Yoshida Shuhei Kurita Taichi Nishimura Shinsuke Mori 35 5 0 03 Apr 2024
EgoExoLearn: A Dataset for Bridging Asynchronous Ego- and Exo-centric View of Procedural Activities in Real World Yifei Huang Guo Chen Jilan Xu Mingfang Zhang Lijin Yang ... Hongjie Zhang Lu Dong Yali Wang Limin Wang Yu Qiao EgoV 49 32 0 24 Mar 2024
Intention Action Anticipation Model with Guide-Feedback Loop Mechanism Zongnan Ma Fuchun Zhang Zhixiong Nan Yao Ge 28 1 0 19 Mar 2024
EgoPAT3Dv2: Predicting 3D Action Target from 2D Egocentric Vision for Human-Robot Interaction Irving Fang Yuzhong Chen Yifan Wang Jianghan Zhang Qiushi Zhang ... Xibo He Weibo Gao Hao Su Yiming Li Chen Feng EgoV 27 2 0 08 Mar 2024
General Flow as Foundation Affordance for Scalable Robot Learning Chengbo Yuan Chuan Wen Tong Zhang Yang Gao AI4CE 15 8 0 21 Jan 2024
Robo-ABC: Affordance Generalization Beyond Categories via Semantic Correspondence for Robot Manipulation Yuanchen Ju Kaizhe Hu Guowei Zhang Gu Zhang Mingrun Jiang Huazhe Xu 17 38 0 15 Jan 2024
Virtual Pets: Animatable Animal Generation in 3D Scenes Yen-Chi Cheng C. Lin Chaoyang Wang Yash Kant Sergey Tulyakov Alexander Schwing Liangyan Gui Hsin-Ying Lee 25 2 0 21 Dec 2023
EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level Planning Yi Chen Yuying Ge Yixiao Ge Mingyu Ding Bohao Li Rui Wang Rui-Lan Xu Ying Shan Xihui Liu LLMAG ELM LRM 16 8 0 11 Dec 2023
SKT-Hang: Hanging Everyday Objects via Object-Agnostic Semantic Keypoint Trajectory Generation Chia-Liang Kuo Yu-Wei Chao Yi-Ting Chen 17 1 0 08 Dec 2023
LEGO: Learning EGOcentric Action Frame Generation via Visual Instruction Tuning Bolin Lai Xiaoliang Dai Lawrence Chen Guan Pang James M. Rehg Miao Liu 31 14 0 06 Dec 2023
Are Synthetic Data Useful for Egocentric Hand-Object Interaction Detection? Rosario Leonardi Antonino Furnari Francesco Ragusa G. Farinella EgoV 11 3 0 05 Dec 2023
Towards Generalizable Zero-Shot Manipulation via Translating Human Interaction Plans Homanga Bharadhwaj Abhi Gupta Vikash Kumar Shubham Tulsiani LM&Ro 17 17 0 01 Dec 2023
One-Shot Open Affordance Learning with Foundation Models Gen Li Deqing Sun Laura Sevilla-Lara Varun Jampani VLM 49 21 0 29 Nov 2023
Generative Hierarchical Temporal Transformer for Hand Action Recognition and Motion Prediction Yilin Wen Hao Pan Takehiko Ohkawa Lei Yang Jia Pan Yoichi Sato Taku Komura Wenping Wang 33 0 0 29 Nov 2023
EgoThink: Evaluating First-Person Perspective Thinking Capability of Vision-Language Models Sijie Cheng Zhicheng Guo Jingwen Wu Kechen Fang Peng Li Huaping Liu Yang Janet Liu EgoV LRM 15 15 0 27 Nov 2023
HoloAssist: an Egocentric Human Interaction Dataset for Interactive AI Assistants in the Real World Linghao Yang Taein Kwon Mahdi Rad Bowen Pan Ishani Chakraborty ... Ashley Feniello Rui Tian Felipe Vieira Frujeri Neel Joshi Marc Pollefeys EgoV 18 44 0 29 Sep 2023
Multi-label affordance mapping from egocentric vision Lorenzo Mur-Labadia Jose J. Guerrero Ruben Martinez-Cantin EgoV 15 14 0 05 Sep 2023
InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusion Sirui Xu Zhengyu Li Yu-Xiong Wang Liangyan Gui DiffM 22 111 0 31 Aug 2023
Structured World Models from Human Videos Russell Mendonca Shikhar Bahl Deepak Pathak LM&Ro 15 85 0 21 Aug 2023
Leveraging Next-Active Objects for Context-Aware Anticipation in Egocentric Videos Sanket Thakur Cigdem Beyan Pietro Morerio Vittorio Murino Alessio Del Bue 12 6 0 16 Aug 2023
Helping Hands: An Object-Aware Ego-Centric Video Recognition Model Chuhan Zhang Ankush Gupta Andrew Zisserman VLM 18 19 0 15 Aug 2023