LATTE: LAnguage Trajectory TransformEr

4 August 2022

Papers citing "LATTE: LAnguage Trajectory TransformEr"

43 / 43 papers shown

Title
I Can Tell What I am Doing: Toward Real-World Natural Language Grounding of Robot Experiences Zihan Wang Brian Liang Varad Dhat Zander Brumbaugh Nick Walker Ranjay Krishna Maya Cakmak 61 4 0 20 Nov 2024
Foundation Models for Rapid Autonomy Validation Alec Farid Peter Schleede Aaron Huang Christoffer Heckman 38 0 0 22 Oct 2024
Semantically Safe Robot Manipulation: From Semantic Scene Understanding to Motion Safeguards Lukas Brunke Yanni Zhang Ralf Romer Jack Naimer Nikola Staykov Siqi Zhou Angela P. Schoellig 59 4 0 19 Oct 2024
Enabling Novel Mission Operations and Interactions with ROSA: The Robot Operating System Agent Rob Royce Marcel Kaufmann Jonathan Becktor Sangwoo Moon Kalind Carpenter Kai Pak Amanda Towler Rohan Thakker Shehryar Khattak LM&Ro 42 2 0 09 Oct 2024
Trajectory Improvement and Reward Learning from Comparative Language Feedback Zhaojing Yang Miru Jun J. Tien Stuart J. Russell Anca Dragan Erdem Bıyık 34 6 0 08 Oct 2024
Solving Multi-Goal Robotic Tasks with Decision Transformer Paul Gajewski Dominik Zurek Marcin Pietroñ Kamil Faber OffRL 26 1 0 08 Oct 2024
Hey Robot! Personalizing Robot Navigation through Model Predictive Control with a Large Language Model Diego Martínez Baselga O. de Groot Luzia Knoedler Javier Alonso-Mora L. Riazuelo Luis Montano LM&Ro 46 0 0 20 Sep 2024
Intelligent LiDAR Navigation: Leveraging External Information and Semantic Maps with LLM as Copilot Fujing Xie Jiajie Zhang Sören Schwertfeger 35 1 0 13 Sep 2024
Visual Grounding for Object-Level Generalization in Reinforcement Learning Haobin Jiang Zongqing Lu LM&Ro 34 2 0 04 Aug 2024
QueST: Self-Supervised Skill Abstractions for Learning Continuous Control Atharva Mete Haotian Xue Albert Wilcox Yongxin Chen Animesh Garg SSL 35 16 0 22 Jul 2024
Lifelong Robot Library Learning: Bootstrapping Composable and Generalizable Skills for Embodied Control with Language Models Georgios Tziafas H. Kasaei KELM LM&Ro 45 8 0 26 Jun 2024
LIT: Large Language Model Driven Intention Tracking for Proactive Human-Robot Collaboration -- A Robot Sous-Chef Application Zhe Huang John Pohovey Ananya Yammanuru Katherine Driggs-Campbell LM&Ro 38 0 0 19 Jun 2024
Robustness Testing of Multi-Modal Models in Varied Home Environments for Assistive Robots Lea Hirlimann Shengqiang Zhang Hinrich Schütze Philipp Wicke 32 0 0 18 Jun 2024
A Survey of Language-Based Communication in Robotics William Hunt Sarvapali D. Ramchurn Mohammad D. Soorati LM&Ro 65 12 0 06 Jun 2024
Meta-Control: Automatic Model-based Control Synthesis for Heterogeneous Robot Skills Tianhao Wei Liqian Ma Rui Chen Weiye Zhao Changliu Liu 45 3 0 18 May 2024
Potentials of the Metaverse for Robotized Applications in Industry 4.0 and Industry 5.0 E. Kaigom 32 2 0 31 Mar 2024
Comp4D: LLM-Guided Compositional 4D Scene Generation Dejia Xu Hanwen Liang N. Bhatt Hezhen Hu Hanxue Liang Konstantinos N. Plataniotis Zhangyang Wang 36 23 0 25 Mar 2024
C-TPT: Calibrated Test-Time Prompt Tuning for Vision-Language Models via Text Feature Dispersion Hee Suk Yoon Eunseop Yoon Joshua Tian Jin Tee M. Hasegawa-Johnson Yingzhen Li C. Yoo VLM 62 23 0 21 Mar 2024
"Task Success" is not Enough: Investigating the Use of Video-Language Models as Behavior Critics for Catching Undesirable Agent Behaviors L. Guan Yifan Zhou Denis Liu Yantian Zha H. B. Amor Subbarao Kambhampati LM&Ro 36 16 0 06 Feb 2024
Large Language Models for Robotics: Opportunities, Challenges, and Perspectives Jiaqi Wang Zihao Wu Yiwei Li Hanqi Jiang Peng Shu ... Lin Zhao Bao Ge Xiang Li Tianming Liu Shu Zhang LM&Ro 37 60 0 09 Jan 2024
ExTraCT -- Explainable Trajectory Corrections from language inputs using Textual description of features J-Anne Yow N. P. Garg Manoj Ramanathan Wei Tech Ang 26 5 0 08 Jan 2024
Foundation Models in Robotics: Applications, Challenges, and the Future Roya Firoozi Johnathan Tucker Stephen Tian Anirudha Majumdar Jiankai Sun ... Brian Ichter Danny Driess Jiajun Wu Cewu Lu Mac Schwager LM&Ro AI4CE LRM VLM 37 140 0 13 Dec 2023
FoMo Rewards: Can we cast foundation models as reward functions? Ekdeep Singh Lubana Johann Brehmer P. D. Haan Taco S. Cohen OffRL LRM 48 2 0 06 Dec 2023
Swarm-GPT: Combining Large Language Models with Safe Motion Planning for Robot Choreography Design Aoran Jiao Tanmay P. Patel Sanjmi Khurana Anna-Mariya Korol Lukas Brunke V. K. Adajania Utku Çulha Siqi Zhou Angela P. Schoellig 41 16 0 02 Dec 2023
Distilling and Retrieving Generalizable Knowledge for Robot Manipulation via Language Corrections Lihan Zha Yuchen Cui Li-Heng Lin Minae Kwon Montse Gonzalez Arenas Andy Zeng Fei Xia Dorsa Sadigh 35 36 0 17 Nov 2023
Language and Sketching: An LLM-driven Interactive Multimodal Multitask Robot Navigation Framework Weiqin Zu Wenbin Song Ruiqing Chen Ze Guo Fanglei Sun Zheng Tian Wei Pan Jun Wang 15 13 0 14 Nov 2023
LanguageMPC: Large Language Models as Decision Makers for Autonomous Driving Hao Sha Yao Mu Yuxuan Jiang Li Chen Chenfeng Xu Ping Luo Shengbo Eben Li Masayoshi Tomizuka Wei Zhan Mingyu Ding 114 159 0 04 Oct 2023
LANCAR: Leveraging Language for Context-Aware Robot Locomotion in Unstructured Environments Chak Lam Shek Xiyang Wu Wesley A Suttle Carl E. Busart Erin Zaroukian Dinesh Manocha Pratap Tokekar Amrit Singh Bedi LLMAG 48 8 0 30 Sep 2023
Learning Navigational Visual Representations with Semantic Map Supervision Yicong Hong Yang Zhou Ruiyi Zhang Franck Dernoncourt Trung Bui Stephen Gould Hao Tan SSL 30 21 0 23 Jul 2023
Is Imitation All You Need? Generalized Decision-Making with Dual-Phase Training Yao Wei Yanchao Sun Ruijie Zheng Sai H. Vemprala Rogerio Bonatti Shuhang Chen Ratnesh Madaan Zhongjie Ba Ashish Kapoor Shuang Ma OffRL 27 15 0 16 Jul 2023
Towards Language-Based Modulation of Assistive Robots through Multimodal Models Philipp Wicke Lufti Kerem cSenel Shengqiang Zhang Luis F. C. Figueredo Abdeldjallil Naceri Sami Haddadin Hinrich Schütze 20 2 0 26 Jun 2023
Language to Rewards for Robotic Skill Synthesis Wenhao Yu Nimrod Gileadi Chuyuan Fu Sean Kirmani Kuang-Huei Lee ... N. Heess Dorsa Sadigh Jie Tan Yuval Tassa F. Xia LM&Ro 37 269 0 14 Jun 2023
SayTap: Language to Quadrupedal Locomotion Yujin Tang Wenhao Yu Jie Tan Heiga Zen Aleksandra Faust Tatsuya Harada 36 40 0 13 Jun 2023
Embodied Executable Policy Learning with Language-based Scene Summarization Jielin Qiu Mengdi Xu William Jongwon Han Seungwhan Moon Ding Zhao LM&Ro 24 7 0 09 Jun 2023
ChatGPT for Robotics: Design Principles and Model Abilities Sai H. Vemprala Rogerio Bonatti A. Bucker Ashish Kapoor LM&Ro 33 459 0 20 Feb 2023
"No, to the Right" -- Online Language Corrections for Robotic Manipulation via Shared Autonomy Yuchen Cui Siddharth Karamcheti Raj Palleti Nidhya Shivakumar Percy Liang Dorsa Sadigh LM&Ro 29 76 0 06 Jan 2023
On Transforming Reinforcement Learning by Transformer: The Development Trajectory Shengchao Hu Li Shen Ya-Qin Zhang Yixin Chen Dacheng Tao OffRL 27 25 0 29 Dec 2022
Relative Behavioral Attributes: Filling the Gap between Symbolic Goal Specification and Reward Learning from Human Preferences L. Guan Karthik Valmeekam Subbarao Kambhampati 51 8 0 28 Oct 2022
VIMA: General Robot Manipulation with Multimodal Prompts Yunfan Jiang Agrim Gupta Zichen Zhang Guanzhi Wang Yongqiang Dou Yanjun Chen Li Fei-Fei Anima Anandkumar Yuke Zhu Linxi Fan LM&Ro 28 335 0 06 Oct 2022
Language-Conditioned Imitation Learning for Robot Manipulation Tasks Simon Stepputtis Joseph Campbell Mariano Phielipp Stefan Lee Chitta Baral H. B. Amor LM&Ro 124 193 0 22 Oct 2020
Transformer Networks for Trajectory Forecasting Francesco Giuliari Irtiza Hasan Marco Cristani Fabio Galasso 113 371 0 18 Mar 2020
Unified Vision-Language Pre-Training for Image Captioning and VQA Luowei Zhou Hamid Palangi Lei Zhang Houdong Hu Jason J. Corso Jianfeng Gao MLLM VLM 252 927 0 24 Sep 2019
Help, Anna! Visual Navigation with Natural Multimodal Assistance via Retrospective Curiosity-Encouraging Imitation Learning Khanh Nguyen Hal Daumé LM&Ro EgoV 180 150 0 04 Sep 2019