The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervision

26 April 2019

Jiayuan Mao

Chuang Gan

Jiajun Wu

Papers citing "The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervision"

50 / 425 papers shown

Title
A neuro-symbolic approach for multimodal reference expression comprehension Aman Jain Anirudh Reddy Kondapally Kentaro Yamada Hitomi Yanaka 88 2 0 19 Jun 2023
Rapid Image Labeling via Neuro-Symbolic LearningKnowledge Discovery and Data Mining (KDD), 2023 Yifeng Wang Zhi Tu Yiwen Xiang Shiyuan Zhou Xiyuan Chen Bingxuan Li Tianyi Zhang VLM 159 10 0 18 Jun 2023
Tell Me Where to Go: A Composable Framework for Context-Aware Embodied Robot NavigationConference on Robot Learning (CoRL), 2023 Harel Biggie Ajay Narasimha Mopidevi Dusty Woods Christoffer Heckman LM&Ro 196 13 0 15 Jun 2023
Sample-Efficient Learning of Novel Visual Concepts Sarthak Bhagat Simon Stepputtis Joseph Campbell Katia Sycara 175 9 0 15 Jun 2023
World-to-Words: Grounded Open Vocabulary Acquisition through Fast Mapping in Vision-Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Ziqiao Ma Jiayi Pan J. Chai ObjD VLM 167 12 0 14 Jun 2023
Scalable Neural-Probabilistic Answer Set ProgrammingJournal of Artificial Intelligence Research (JAIR), 2023 Arseny Skryagin Daniel Ochs Devendra Singh Dhami Kristian Kersting 199 16 0 14 Jun 2023
V-LoL: A Diagnostic Dataset for Visual Logical Learning Lukas Helff Wolfgang Stammer Hikaru Shindo Devendra Singh Dhami Kristian Kersting NAI 254 9 0 13 Jun 2023
SNeL: A Structured Neuro-Symbolic Language for Entity-Based Multimodal Scene Understanding Silvan Ferreira Allan Martins Ivanovitch Silva 154 1 0 09 Jun 2023
ConceptBed: Evaluating Concept Learning Abilities of Text-to-Image Diffusion ModelsAAAI Conference on Artificial Intelligence (AAAI), 2023 Maitreya Patel Tejas Gokhale Chitta Baral Yezhou Yang CoGe 234 16 0 07 Jun 2023
Infusing Lattice Symmetry Priors in Attention Mechanisms for Sample-Efficient Abstract Geometric ReasoningInternational Conference on Machine Learning (ICML), 2023 Mattia Atzeni Mrinmaya Sachan Andreas Loukas LRM 136 3 0 05 Jun 2023
Encoding Time-Series Explanations through Self-Supervised Model Behavior ConsistencyNeural Information Processing Systems (NeurIPS), 2023 Owen Queen Thomas Hartvigsen Teddy Koker Huan He Theodoros Tsiligkaridis Marinka Zitnik AI4TS 270 33 0 03 Jun 2023
Measuring Faithful and Plausible Visual Grounding in VQAConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Daniel Reich F. Putze Tanja Schultz 198 6 0 24 May 2023
TaxoKnow: Taxonomy as Prior Knowledge in the Loss Function of Multi-class Classification Mohsen Pourvali Yao Meng Chen Sheng Yangzhou Du 113 0 0 24 May 2023
Image Manipulation via Multi-Hop Instructions -- A New Dataset and Weakly-Supervised Neuro-Symbolic ApproachConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Harman Singh Poorva Garg M. Gupta Kevin Shah Ashish Goswami A. Mondal Arnab Kumar Mondal Dinesh Khandelwal Dinesh Garg Parag Singla LM&Ro 113 2 0 23 May 2023
Logical Entity Representation in Knowledge-Graphs for Differentiable Rule LearningInternational Conference on Learning Representations (ICLR), 2023 Chi Han Qizheng He Charles Yu Xinya Du Hanghang Tong Heng Ji 128 19 0 22 May 2023
Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical ReasoningConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Liangming Pan Alon Albalak Xinyi Wang William Yang Wang ReLM LRM AI4CE 355 396 0 20 May 2023
Motion Question Answering via Modular Motion ProgramsInternational Conference on Machine Learning (ICML), 2023 Mark Endo Joy Hsu Jiaman Li Jiajun Wu LRM 277 21 0 15 May 2023
Neurosymbolic AI and its Taxonomy: a survey Wandemberg Gibaut Leonardo Pereira Fabio Grassiotto Alexandre Osorio Eder Gadioli Amparo Munoz Sildolfo Gomes Claudio dos Santos NAI AI4CE 190 11 0 12 May 2023
Improved Logical Reasoning of Language Models via Differentiable Symbolic ProgrammingAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Hanlin Zhang Jiani Huang Ziyang Li Mayur Naik Eric P. Xing ReLM LRM 217 37 0 05 May 2023
Programming-by-Demonstration for Long-Horizon Robot Tasks Noah T Patton Kia Rahmani Meghana Missula Joydeep Biswas Icsil Dillig 364 17 0 04 May 2023
Continual Reasoning: Non-Monotonic Reasoning in Neurosymbolic AI using Continual LearningInternational Workshop on Neural-Symbolic Learning and Reasoning (NeSy), 2023 Sofoklis Kyriakopoulos Artur Garcez NAI LRM 148 0 0 03 May 2023
Energy-based Models are Zero-Shot Planners for Compositional Scene Rearrangement N. Gkanatsios Ayush Jain Zhou Xian Yunchu Zhang C. Atkeson Katerina Fragkiadaki LM&Ro 314 43 0 27 Apr 2023
Analogy-Forming Transformers for Few-Shot 3D ParsingInternational Conference on Learning Representations (ICLR), 2023 N. Gkanatsios M. Singh Zhaoyuan Fang Shubham Tulsiani Katerina Fragkiadaki 3DPC 3DV 289 2 0 27 Apr 2023
Interpretable Neural-Symbolic Concept ReasoningInternational Workshop on Neural-Symbolic Learning and Reasoning (NeSy), 2023 Pietro Barbiero Gabriele Ciravegna Francesco Giannini M. Zarlenga Lucie Charlotte Magister Alberto Tonda Pietro Lio F. Precioso M. Jamnik G. Marra NAI LRM 302 55 0 27 Apr 2023
Programmatically Grounded, Compositionally Generalizable Robotic ManipulationInternational Conference on Learning Representations (ICLR), 2023 Renhao Wang Jiayuan Mao Joy Hsu Hang Zhao Jiajun Wu Yang Gao LM&Ro 294 41 0 26 Apr 2023
The Roles of Symbols in Neural-based AI: They are Not What You Think!Frontiers in Artificial Intelligence and Applications (FAIA), 2023 D. Silver Tom Michael Mitchell 46 5 0 26 Apr 2023
Learning Situation Hyper-Graphs for Video Question AnsweringComputer Vision and Pattern Recognition (CVPR), 2023 Aisha Urooj Khan Hilde Kuehne Bo Wu Kim Chheu Walid Bousselham Chuang Gan N. Lobo M. Shah 173 22 0 18 Apr 2023
LASER: A Neuro-Symbolic Framework for Learning Spatial-Temporal Scene Graphs with Weak SupervisionInternational Conference on Learning Representations (ICLR), 2023 Jiani Huang Ziyang Li Mayur Naik Ser-Nam Lim 536 9 0 15 Apr 2023
Scallop: A Language for Neurosymbolic Programming Ziyang Li Jiani Huang Mayur Naik ReLM LRM NAI 190 50 0 10 Apr 2023
Embodied Concept Learner: Self-supervised Learning of Concepts and Mapping through Instruction FollowingConference on Robot Learning (CoRL), 2023 Mingyu Ding Yan Xu Zhenfang Chen David D. Cox Ping Luo J. Tenenbaum Chuang Gan LM&Ro 163 24 0 07 Apr 2023
ImageEye: Batch Image Processing Using Program Synthesis Celeste Barnaby Qiaochuan Chen R. Samanta Işıl Dillig DiffM 249 13 0 06 Apr 2023
Grounding Object Relations in Language-Conditioned Robotic Manipulation with Semantic-Spatial Reasoning Qian Luo Yunfei Li Yi Wu LM&Ro 139 5 0 31 Mar 2023
Shepherding Slots to Objects: Towards Stable and Robust Object-Centric LearningComputer Vision and Pattern Recognition (CVPR), 2023 Jinwoo Kim Janghyuk Choi Ho-Jin Choi Seon Joo Kim OCL VLM 259 18 0 31 Mar 2023
Neuro-Symbolic Execution of Generic Source Code Yaojie Hu Jin Tian NAI 177 0 0 23 Mar 2023
NS3D: Neuro-Symbolic Grounding of 3D Objects and RelationsComputer Vision and Pattern Recognition (CVPR), 2023 Joy Hsu Jiayuan Mao Jiajun Wu PINN 204 67 0 23 Mar 2023
3D Concept Learning and Reasoning from Multi-View ImagesComputer Vision and Pattern Recognition (CVPR), 2023 Yining Hong Chun-Tse Lin Yilun Du Zhenfang Chen J. Tenenbaum Chuang Gan 3DV 230 70 0 20 Mar 2023
Variational Cross-Graph Reasoning and Adaptive Structured Semantics Learning for Compositional Temporal GroundingIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023 Juncheng Li Siliang Tang Linchao Zhu Wenqiao Zhang Yi Yang Tat-Seng Chua Fei Wu Yueting Zhuang BDL 189 22 0 22 Jan 2023
Dissociating language and thought in large language models Kyle Mahowald Anna A. Ivanova I. Blank Nancy Kanwisher J. Tenenbaum Evelina Fedorenko ELM ReLM 248 228 0 16 Jan 2023
See, Think, Confirm: Interactive Prompting Between Vision and Language Models for Knowledge-based Visual Reasoning Zhenfang Chen Qinhong Zhou Songlin Yang Yining Hong Hao Zhang Chuang Gan LRM VLM 235 52 0 12 Jan 2023
VQA and Visual Reasoning: An Overview of Recent Datasets, Methods and Challenges R. Zakari Jim Wilson Owusu Hailin Wang Ke Qin Zaharaddeen Karami Lawal Yue-hong Dong LRM 149 18 0 26 Dec 2022
Towards Unsupervised Visual Reasoning: Do Off-The-Shelf Features Know How to Reason?IEEE Access (IEEE Access), 2022 Monika Wysoczañska Tom Monnier Tomasz Trzciñski David Picard ReLM OCL 172 1 0 20 Dec 2022
LaSQuE: Improved Zero-Shot Classification from Explanations Through Quantifier Modeling and Curriculum LearningAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Sayan Ghosh Rakesh R Menon Shashank Srivastava 186 3 0 18 Dec 2022
Super-CLEVR: A Virtual Benchmark to Diagnose Domain Robustness in Visual ReasoningComputer Vision and Pattern Recognition (CVPR), 2022 Zhuowan Li Xingrui Wang Elias Stengel-Eskin Adam Kortylewski Wufei Ma Benjamin Van Durme Max Planck Institute for Informatics OOD LRM 216 100 0 01 Dec 2022
A Probabilistic-Logic based Commonsense Representation Framework for Modelling Inferences with Multiple Antecedents and Varying Likelihoods Shantanu Jaiswal Liu Yan Dongkyu Choi Kenneth Kwok 256 0 0 30 Nov 2022
Neuro-Symbolic Spatio-Temporal Reasoning Pascal Hitzler Michael Sioutis Md Kamruzzaman Sarker Marjan Alirezaie Aaron Eberhart Stefan Wermter NAI 230 0 0 28 Nov 2022
A Short Survey of Systematic Generalization Yuanpeng Li AI4CE 251 1 0 22 Nov 2022
Versatile Diffusion: Text, Images and Variations All in One Diffusion ModelIEEE International Conference on Computer Vision (ICCV), 2022 Xingqian Xu Zinan Lin Eric Zhang Kai Wang Humphrey Shi DiffM 463 239 0 15 Nov 2022
Simulated Mental Imagery for Robotic Task Planning Shijia Li Tomas Kulvicius M. Tamosiunaite Florentin Wörgötter LM&Ro 167 2 0 15 Nov 2022
Learning Neuro-symbolic Programs for Language Guided Robot ManipulationIEEE International Conference on Robotics and Automation (ICRA), 2022 Namasivayam Kalithasan H. Singh Vishal Bindal Arnav Tuli Vishwajeet Agrawal Rahul Jain Parag Singla Rohan Paul LM&Ro 203 25 0 12 Nov 2022
CRIPP-VQA: Counterfactual Reasoning about Implicit Physical Properties via Video Question AnsweringConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Maitreya Patel Tejas Gokhale Chitta Baral Yezhou Yang 215 13 0 07 Nov 2022