Track2Act: Predicting Point Tracks from Internet Videos enables Diverse
Zero-shot Robot Manipulation

Track2Act: Predicting Point Tracks from Internet Videos enables Diverse Zero-shot Robot Manipulation

2 May 2024

Homanga Bharadhwaj

Roozbeh Mottaghi

Shubham Tulsiani

Papers citing "Track2Act: Predicting Point Tracks from Internet Videos enables Diverse Zero-shot Robot Manipulation"

17 / 17 papers shown

Title
RoboGround: Robotic Manipulation with Grounded Vision-Language Priors Haifeng Huang Xinyi Chen Y. Chen H. Li Xiaoshen Han Z. Wang Tai Wang Jiangmiao Pang Zhou Zhao LM&Ro 75 0 0 30 Apr 2025
TAPNext: Tracking Any Point (TAP) as Next Token Prediction Artem Zholus Carl Doersch Yi Yang Skanda Koppula Viorica Patraucean Xu He Ignacio Rocco Mehdi S. M. Sajjadi Sarath Chandar Ross Goroshin 28 0 0 08 Apr 2025
VidBot: Learning Generalizable 3D Actions from In-the-Wild 2D Human Videos for Zero-Shot Robotic Manipulation Hanzhi Chen Boyang Sun Anran Zhang Marc Pollefeys Stefan Leutenegger LM&Ro 59 0 0 10 Mar 2025
HAMSTER: Hierarchical Action Models For Open-World Robot Manipulation Yi Li Yuquan Deng J. Zhang Joel Jang Marius Memme ... Fabio Ramos Dieter Fox Anqi Li Abhishek Gupta Ankit Goyal LM&Ro 80 5 0 08 Feb 2025
Tra-MoE: Learning Trajectory Prediction Model from Multiple Domains for Adaptive Policy Conditioning Jiange Yang Haoyi Zhu Y. Wang Gangshan Wu Tong He Limin Wang 83 2 0 21 Nov 2024
Grounding Video Models to Actions through Goal Conditioned Exploration Yunhao Luo Yilun Du LM&Ro VGen 71 1 0 11 Nov 2024
SPOT: SE(3) Pose Trajectory Diffusion for Object-Centric Manipulation Cheng-Chun Hsu Bowen Wen Jie Xu Yashraj S. Narang Xiaolong Wang Yuke Zhu Joydeep Biswas Stan Birchfield DiffM 29 8 0 01 Nov 2024
MotIF: Motion Instruction Fine-tuning Minyoung Hwang Joey Hejna Dorsa Sadigh Yonatan Bisk 42 1 0 16 Sep 2024
Embodiment-Agnostic Action Planning via Object-Part Scene Flow Weiliang Tang Jia-Hui Pan Wei Zhan Jianshu Zhou Huaxiu Yao Yun-Hui Liu M. Tomizuka Mingyu Ding Chi-Wing Fu 41 0 0 16 Sep 2024
Hand-Object Interaction Pretraining from Videos Himanshu Gaurav Singh Antonio Loquercio Carmelo Sferrazza Jane Wu Haozhi Qi Pieter Abbeel Jitendra Malik 38 11 0 12 Sep 2024
One-Shot Imitation under Mismatched Execution K. Kedia Prithwish Dan Sanjiban Choudhury Maximus Adrian Pace Sanjiban Choudhury 30 1 0 10 Sep 2024
Leveraging Object Priors for Point Tracking Bikram Boote Anh Thai Wenqi Jia Ozgur Kara Stefan Stojanov James M. Rehg Sangmin Lee 3DPC 26 0 0 09 Sep 2024
RoboTAP: Tracking Arbitrary Points for Few-Shot Visual Imitation Mel Vecerík Carl Doersch Yi Yang Todor Davchev Y. Aytar Guangyao Zhou R. Hadsell Lourdes Agapito Jonathan Scholz 37 24 0 30 Aug 2023
Ego4D: Around the World in 3,000 Hours of Egocentric Video Kristen Grauman Andrew Westbury Eugene Byrne Zachary Chavis Antonino Furnari ... Mike Zheng Shou Antonio Torralba Lorenzo Torresani Mingfei Yan Jitendra Malik EgoV 218 682 0 13 Oct 2021
DexMV: Imitation Learning for Dexterous Manipulation from Human Videos Yuzhe Qin Yueh-hua Wu Shaowei Liu Hanwen Jiang Ruihan Yang Yang Fu Xiaolong Wang 114 112 0 12 Aug 2021
Learning by Watching: Physical Imitation of Manipulation Skills from Human Videos Haoyu Xiong Quanzhou Li Yun-Chun Chen Homanga Bharadhwaj Samarth Sinha Animesh Garg SSL 113 92 0 18 Jan 2021
Where2Act: From Pixels to Actions for Articulated 3D Objects Kaichun Mo Leonidas J. Guibas Mustafa Mukadam Abhinav Gupta Shubham Tulsiani 152 175 0 07 Jan 2021