Track2Act: Predicting Point Tracks from Internet Videos enables Diverse Zero-shot Robot Manipulation

European Conference on Computer Vision (ECCV), 2024

2 May 2024

Homanga Bharadhwaj

Papers citing "Track2Act: Predicting Point Tracks from Internet Videos enables Diverse Zero-shot Robot Manipulation"

32 / 32 papers shown

Title
Goal-Driven Reward by Video Diffusion Models for Reinforcement Learning Q. Wang Mian Wu Y. Zhang Mingqi Yuan Wenyao Zhang Haoxiang You Yunbo Wang Xin Jin Xiaokang Yang Wenjun Zeng VGen 90 0 0 30 Nov 2025
X-Diffusion: Training Diffusion Policies on Cross-Embodiment Human Demonstrations Maximus Adrian Pace Prithwish Dan Chuanruo Ning Atiksh Bhardwaj Audrey Du Edward Weiyi Duan Wei-Chiu Ma Kushal Kedia VGen 207 0 0 06 Nov 2025
From Human Hands to Robot Arms: Manipulation Skills Transfer via Trajectory Alignment Han Zhou Jinjin Cao Liyuan Ma Xueji Fang Guo-Jun Qi 72 0 0 01 Oct 2025
Pixel Motion Diffusion is What We Need for Robot Control E-Ro Nguyen Y. Zhang Kanchana Ranasinghe Xiang Li Michael S. Ryoo DiffM 109 0 0 26 Sep 2025
Parse-Augment-Distill: Learning Generalizable Bimanual Visuomotor Policies from Single Human Video Georgios Tziafas Jiayun Zhang Hamidreza Kasaei 128 0 0 24 Sep 2025
3D Flow Diffusion Policy: Visuomotor Policy Learning via Generating Flow in 3D Space Sangjun Noh Dongwoo Nam Kangmin Kim Geonhyup Lee Yeonguk Yu Raeyoung Kang K. Lee VGen 66 0 0 23 Sep 2025
ActionSink: Toward Precise Robot Manipulation with Dynamic Integration of Action Flow Shanshan Guo Xiwen Liang Junfan Lin Yuzheng Zhuang Guanbin Li Xiaodan Liang 113 0 0 05 Aug 2025
GR-3 Technical Report Chilam Cheang S. Chen Zhongren Cui Yingdong Hu Liqun Huang ... Hongtao Wu Xin Xiao Yuyang Xiao Jiafeng Xu Yichu Yang 252 43 0 21 Jul 2025
VLM-SFD: VLM-Assisted Siamese Flow Diffusion Framework for Dual-Arm Cooperative ManipulationIEEE Robotics and Automation Letters (IEEE RA-L), 2025 Jiaming Chen Yiyu Jiang Aoshen Huang Yang Li Wei Pan 95 0 0 16 Jun 2025
GENMANIP: LLM-driven Simulation for Generalizable Instruction-Following ManipulationComputer Vision and Pattern Recognition (CVPR), 2025 Ning Gao Yilun Chen Shuai Yang Xinyi Chen Yang Tian Hao Li Haifeng Huang Hanqing Wang Tai Wang Jiangmiao Pang LM&Ro 289 4 0 12 Jun 2025
UAD: Unsupervised Affordance Distillation for Generalization in Robotic ManipulationIEEE International Conference on Robotics and Automation (ICRA), 2025 Yihe Tang Wenlong Huang Yingke Wang Chengshu Li Roy Yuan Ruohan Zhang Jiajun Wu Li Fei-Fei 256 0 0 10 Jun 2025
Object-centric 3D Motion Field for Robot Learning from Human Videos Zhao-Heng Yin Sherry Yang Pieter Abbeel 234 2 0 04 Jun 2025
DreamGen: Unlocking Generalization in Robot Learning through Video World Models Joel Jang Seonghyeon Ye Zongyu Lin Jiannan Xiang Johan Bjorck ... Dieter Fox Jan Kautz Scott Reed Yuke Zhu Linxi Fan VGen OffRL AI4TS 342 0 0 19 May 2025
Pixel Motion as Universal Representation for Robot Control Kanchana Ranasinghe Xiang Li Cristina Mata Cristina Mata Michael S. Ryoo Michael Ryoo VGen 355 5 0 12 May 2025
X-Sim: Cross-Embodiment Learning via Real-to-Sim-to-Real Prithwish Dan Kushal Kedia Angela Chao Edward Weiyi Duan Maximus Adrian Pace Wei-Chiu Ma Sanjiban Choudhury 598 7 0 11 May 2025
TAPNext: Tracking Any Point (TAP) as Next Token Prediction Artem Zholus Carl Doersch Yi Yang Skanda Koppula Viorica Patraucean Xu He Ignacio Rocco Mehdi S. M. Sajjadi Sarath Chandar Ross Goroshin 268 16 0 08 Apr 2025
ZeroMimic: Distilling Robotic Manipulation Skills from Web VideosIEEE International Conference on Robotics and Automation (ICRA), 2025 Junyao Shi Zhuolun Zhao Tianyou Wang Ian Pedroza Amy Luo Jie Wang Jason Ma Dinesh Jayaraman LM&Ro 241 13 0 31 Mar 2025
GR00T N1: An Open Foundation Model for Generalist Humanoid Robots Nvidia Johan Bjorck Fernando Castañeda Nikita Cherniadev Xingye Da ... Ao Zhang Hao Zhang Yizhou Zhao Ruijie Zheng Yuke Zhu VLM 489 349 0 18 Mar 2025
VidBot: Learning Generalizable 3D Actions from In-the-Wild 2D Human Videos for Zero-Shot Robotic ManipulationComputer Vision and Pattern Recognition (CVPR), 2025 Hanzhi Chen Boyang Sun Anran Zhang Marc Pollefeys Stefan Leutenegger LM&Ro 388 28 0 10 Mar 2025
HAMSTER: Hierarchical Action Models For Open-World Robot ManipulationInternational Conference on Learning Representations (ICLR), 2025 Yi Li Yuquan Deng Jing Zhang Joel Jang Marius Memme ... Fabio Ramos Dieter Fox Anqi Li Abhishek Gupta Ankit Goyal LM&Ro 663 62 0 08 Feb 2025
Motion Tracks: A Unified Representation for Human-Robot Transfer in Few-Shot Imitation LearningIEEE International Conference on Robotics and Automation (ICRA), 2025 Juntao Ren Priya Sundaresan Dorsa Sadigh Sanjiban Choudhury Jeannette Bohg 266 45 0 13 Jan 2025
Tra-MoE: Learning Trajectory Prediction Model from Multiple Domains for Adaptive Policy ConditioningComputer Vision and Pattern Recognition (CVPR), 2024 Jiange Yang Haoyi Zhu Yanjie Wang Gangshan Wu Tong He Limin Wang 380 11 0 21 Nov 2024
Grounding Video Models to Actions through Goal Conditioned ExplorationInternational Conference on Learning Representations (ICLR), 2024 Yunhao Luo Yilun Du LM&Ro VGen 351 18 0 11 Nov 2024
SPOT: SE(3) Pose Trajectory Diffusion for Object-Centric ManipulationIEEE International Conference on Robotics and Automation (ICRA), 2024 Cheng-Chun Hsu Bowen Wen Jie Xu Yashraj S. Narang Xiaolong Wang Yuke Zhu Joydeep Biswas Stan Birchfield DiffM 404 22 0 01 Nov 2024
Latent Action Pretraining from VideosInternational Conference on Learning Representations (ICLR), 2024 Seonghyeon Ye Joel Jang Byeongguk Jeon Sejune Joo Jianwei Yang ... Kimin Lee J. Gao Luke Zettlemoyer Dieter Fox Minjoon Seo 380 129 0 15 Oct 2024
Gen2Act: Human Video Generation in Novel Scenarios enables Generalizable Robot Manipulation Homanga Bharadhwaj Debidatta Dwibedi Abhinav Gupta Shubham Tulsiani Carl Doersch Ted Xiao Dhruv Shah Fei Xia Dorsa Sadigh Sean Kirmani VGen LM&Ro 269 86 0 24 Sep 2024
$DexSim2Real$^{2}$: Building Explicit World Model for Precise Articulated Object Dexterous Manipulation$ DexSim2Real $^{2}$ : Building Explicit World Model for Precise Articulated Object Dexterous ManipulationIEEE Transactions on robotics (IEEE Trans. Robot.), 2024 Taoran Jiang Yixuan Guan Liqian Ma Jing Xu Weihang Chen Zecui Zeng Lusong Li Dan Wu Jing Xu Rui Chen 420 0 0 13 Sep 2024
Hand-Object Interaction Pretraining from VideosIEEE International Conference on Robotics and Automation (ICRA), 2024 Himanshu Gaurav Singh Antonio Loquercio Carmelo Sferrazza Jane Wu Haozhi Qi Pieter Abbeel Jitendra Malik 194 34 0 12 Sep 2024
One-Shot Imitation under Mismatched ExecutionIEEE International Conference on Robotics and Automation (ICRA), 2024 Kushal Kedia Prithwish Dan Sanjiban Choudhury Maximus Adrian Pace Sanjiban Choudhury 462 8 0 10 Sep 2024
Leveraging Object Priors for Point Tracking Bikram Boote Anh Thai Wenqi Jia Ozgur Kara Stefan Stojanov James M. Rehg Sangmin Lee 3DPC 187 0 0 09 Sep 2024
Affordance-based Robot Manipulation with Flow Matching Fan Zhang Michael Gienger 602 40 0 02 Sep 2024
Flow as the Cross-Domain Manipulation Interface Mengda Xu Zhenjia Xu Yinghao Xu Cheng Chi Gordon Wetzstein Manuela Veloso Shuran Song AI4CE 275 96 0 21 Jul 2024