What Would You Expect? Anticipating Egocentric Actions with Rolling-Unrolling LSTMs and Modality Attention

22 May 2019

Papers citing "What Would You Expect? Anticipating Egocentric Actions with Rolling-Unrolling LSTMs and Modality Attention"

50 / 104 papers shown

Title
The Invisible EgoHand: 3D Hand Forecasting through EgoBody Pose Estimation Masashi Hatano Zhifan Zhu Hideo Saito Dima Damen EgoV 24 0 0 11 Apr 2025
Memory-efficient Streaming VideoLLMs for Real-time Procedural Video Understanding Dibyadip Chatterjee Edoardo Remelli Yale Song Bugra Tekin Abhay Mittal ... Shreyas Hampali Eric Sauser Shugao Ma Angela Yao Fadime Sener VLM 35 0 0 10 Apr 2025
Context-Enhanced Memory-Refined Transformer for Online Action Detection Zhanzhong Pang Fadime Sener Angela Yao OffRL 54 1 0 24 Mar 2025
DIV-FF: Dynamic Image-Video Feature Fields For Environment Understanding in Egocentric Videos Lorenzo Mur-Labadia Josechu Guerrero Ruben Martinez-Cantin VGen 56 0 0 11 Mar 2025
Vinci: A Real-time Embodied Smart Assistant based on Egocentric Vision-Language Model Y. Huang Jilan Xu Baoqi Pei Yuping He Guo Chen ... Kunpeng Li C. Yuan Y. Wang Yu Qiao L. Wang 78 4 0 31 Dec 2024
HiMemFormer: Hierarchical Memory-Aware Transformer for Multi-Agent Action Anticipation Zirui Wang Xinran Zhao Simon Stepputtis Woojun Kim Tongshuang Wu Katia P. Sycara Yaqi Xie OffRL 49 0 0 03 Nov 2024
Human Action Anticipation: A Survey Bolin Lai Sam Toyer Tushar Nagarajan Rohit Girdhar S. Zha James M. Rehg Kris M. Kitani Kristen Grauman Ruta Desai Miao Liu AI4TS 36 1 0 17 Oct 2024
CathAction: A Benchmark for Endovascular Intervention Understanding Baoru Huang Tuan Vo Chayun Kongtongvattana G. Dagnino Dennis Kundrat ... Francisco Vasconcelos Danail Stoyanov Daniel Elson Ferdinando Rodriguez y Baena Anh Nguyen 31 2 0 23 Aug 2024
From Recognition to Prediction: Leveraging Sequence Reasoning for Action Anticipation Xin Liu Chao Hao Zitong Yu Huanjing Yue Jingyu Yang 31 1 0 05 Aug 2024
OphNet: A Large-Scale Video Benchmark for Ophthalmic Surgical Workflow Understanding Ming Hu Peng Xia Lin Wang Siyuan Yan Feilong Tang ... Xuelian Cheng Jun Cheng Chi Liu Kaijing Zhou Zongyuan Ge 33 17 0 11 Jun 2024
Bidirectional Progressive Transformer for Interaction Intention Anticipation Zichen Zhang Hongcheng Luo Wei Zhai Yang Cao Yu Kang 22 5 0 09 May 2024
Uncertainty-boosted Robust Video Activity Anticipation Zhaobo Qi Shuhui Wang Weigang Zhang Qingming Huang 28 5 0 29 Apr 2024
EgoExoLearn: A Dataset for Bridging Asynchronous Ego- and Exo-centric View of Procedural Activities in Real World Yifei Huang Guo Chen Jilan Xu Mingfang Zhang Lijin Yang ... Hongjie Zhang Lu Dong Yali Wang Limin Wang Yu Qiao EgoV 54 36 0 24 Mar 2024
Intention Action Anticipation Model with Guide-Feedback Loop Mechanism Zongnan Ma Fuchun Zhang Zhixiong Nan Yao Ge 40 1 0 19 Mar 2024
On the Efficacy of Text-Based Input Modalities for Action Anticipation Apoorva Beedu Karan Samel Irfan Essa 45 2 0 23 Jan 2024
Instance Tracking in 3D Scenes from Egocentric Videos Yunhan Zhao Haoyu Ma Shu Kong Charless C. Fowlkes 3DPC 23 4 0 07 Dec 2023
DiffAnt: Diffusion Models for Action Anticipation Zeyun Zhong Chengzhi Wu Manuel Martin Michael Voit Juergen Gall Jürgen Beyerer DiffM VGen 15 6 0 27 Nov 2023
GePSAn: Generative Procedure Step Anticipation in Cooking Videos M. A. Abdelsalam Samrudhdhi B. Rangrej Isma Hadji Nikita Dvornik Konstantinos G. Derpanis Afsaneh Fazly AI4TS 27 6 0 12 Oct 2023
A Survey on Deep Learning Techniques for Action Anticipation Zeyun Zhong Manuel Martin Michael Voit Juergen Gall Jürgen Beyerer 24 7 0 29 Sep 2023
Knowledge-Guided Short-Context Action Anticipation in Human-Centric Videos Sarthak Bhagat Simon Stepputtis Joseph Campbell Katia P. Sycara 26 4 0 12 Sep 2023
Multi-label affordance mapping from egocentric vision Lorenzo Mur-Labadia Jose J. Guerrero Ruben Martinez-Cantin EgoV 21 14 0 05 Sep 2023
Learning from Semantic Alignment between Unpaired Multiviews for Egocentric Video Recognition Qitong Wang Long Zhao Liangzhe Yuan Ting Liu Xi Peng 28 11 0 22 Aug 2023
Leveraging Next-Active Objects for Context-Aware Anticipation in Egocentric Videos Sanket Thakur Cigdem Beyan Pietro Morerio Vittorio Murino Alessio Del Bue 20 11 0 16 Aug 2023
Memory-and-Anticipation Transformer for Online Action Understanding Jiahao Wang Guo Chen Yifei Huang Liming Wang Tong Lu OffRL 54 37 0 15 Aug 2023
An Outlook into the Future of Egocentric Vision Chiara Plizzari Gabriele Goletto Antonino Furnari Siddhant Bansal Francesco Ragusa G. Farinella Dima Damen Tatiana Tommasi EgoV 32 38 0 14 Aug 2023
Multimodal Distillation for Egocentric Action Recognition Gorjan Radevski Dusan Grujicic Marie-Francine Moens Matthew Blaschko Tinne Tuytelaars EgoV 18 23 0 14 Jul 2023
EgoCOL: Egocentric Camera pose estimation for Open-world 3D object Localization @Ego4D challenge 2023 Cristhian Forigua María Escobar Jordi Pont-Tuset Kevis-Kokitsi Maninis Pablo Arbelaez EgoV 14 1 0 29 Jun 2023
Guided Attention for Next Active Object @ EGO4D STA Challenge Sanket Thakur Cigdem Beyan Pietro Morerio Vittorio Murino Alessio Del Bue 10 0 0 25 May 2023
Cross-view Action Recognition Understanding From Exocentric to Egocentric Perspective Thanh-Dat Truong Khoa Luu EgoV 27 10 0 25 May 2023
VideoLLM: Modeling Video Sequence with Large Language Models Guo Chen Yin-Dong Zheng Jiahao Wang Jilan Xu Yifei Huang ... Yi Wang Yali Wang Yu Qiao Tong Lu Limin Wang MLLM 92 76 0 22 May 2023
Enhancing Next Active Object-based Egocentric Action Anticipation with Guided Attention Sanket Thakur Cigdem Beyan Pietro Morerio Vittorio Murino Alessio Del Bue 31 6 0 22 May 2023
Pretrained Language Models as Visual Planners for Human Assistance Dhruvesh Patel H. Eghbalzadeh Nitin Kamra Michael L. Iuzzolino Unnat Jain Ruta Desai LM&Ro 19 24 0 17 Apr 2023
Affordances from Human Videos as a Versatile Representation for Robotics Shikhar Bahl Russell Mendonca Lili Chen Unnat Jain Deepak Pathak 30 160 0 17 Apr 2023
StillFast: An End-to-End Approach for Short-Term Object Interaction Anticipation Francesco Ragusa G. Farinella Antonino Furnari 19 18 0 08 Apr 2023
Anticipating Next Active Objects for Egocentric Videos Sanket Thakur Cigdem Beyan Pietro Morerio Vittorio Murino Alessio Del Bue EgoV 28 6 0 13 Feb 2023
Zero-Shot Robot Manipulation from Passive Human Videos Homanga Bharadhwaj Abhi Gupta Shubham Tulsiani Vikash Kumar 20 34 0 03 Feb 2023
FutureHuman3D: Forecasting Complex Long-Term 3D Human Behavior from Video Observations Christian Diller Thomas Funkhouser Angela Dai 25 3 0 25 Nov 2022
TAMFormer: Multi-Modal Transformer with Learned Attention Mask for Early Intent Prediction Nada Osman Guglielmo Camporese Lamberto Ballan 23 8 0 26 Oct 2022
Anticipative Feature Fusion Transformer for Multi-Modal Action Anticipation Zeyun Zhong David Schneider Michael Voit Rainer Stiefelhagen Jürgen Beyerer 66 44 0 23 Oct 2022
Rethinking Learning Approaches for Long-Term Action Anticipation Megha Nawhal Akash Abdu Jyothi Greg Mori AI4TS 34 26 0 20 Oct 2022
Text-Derived Knowledge Helps Vision: A Simple Cross-modal Distillation for Video-based Action Anticipation Sayontan Ghosh Tanvi Aggarwal Minh Hoai Niranjan Balasubramanian VLM 4 4 0 12 Oct 2022
ConTra: (Con)text (Tra)nsformer for Cross-Modal Video Retrieval A. Fragomeni Michael Wray Dima Damen CLIP ViT 25 3 0 09 Oct 2022
Visual Object Tracking in First Person Vision Matteo Dunnhofer Antonino Furnari G. Farinella C. Micheloni 27 27 0 27 Sep 2022
MECCANO: A Multimodal Egocentric Dataset for Humans Behavior Understanding in the Industrial-like Domain Francesco Ragusa Antonino Furnari G. Farinella EgoV 33 23 0 19 Sep 2022
Graphing the Future: Activity and Next Active Object Prediction using Graph-based Activity Representations Victoria Manousaki K. Papoutsakis Antonis Argyros 16 3 0 12 Sep 2022
Predicting the Next Action by Modeling the Abstract Goal Debaditya Roy Basura Fernando EgoV 16 18 0 12 Sep 2022
EgoEnv: Human-centric environment representations from egocentric video Tushar Nagarajan Santhosh Kumar Ramakrishnan Ruta Desai James M. Hillis Kristen Grauman EgoV 21 19 0 22 Jul 2022
1st Place Solution to the EPIC-Kitchens Action Anticipation Challenge 2022 Zeyu Jiang Changxing Ding EgoV 11 1 0 10 Jul 2022
Unified Recurrence Modeling for Video Action Anticipation Tsung-Ming Tai G. Fiameni Cheng-Kuang Lee Simon See O. Lanz 19 8 0 02 Jun 2022
Future Transformer for Long-term Action Anticipation Dayoung Gong Joonseok Lee Manjin Kim S. Ha Minsu Cho AI4TS 8 61 0 27 May 2022