Decoding Visual Neural Representations by Multimodal Learning of Brain-Visual-Linguistic Features

13 October 2022

Papers citing "Decoding Visual Neural Representations by Multimodal Learning of Brain-Visual-Linguistic Features"

35 / 35 papers shown

Title
CMCRD: Cross-Modal Contrastive Representation Distillation for Emotion Recognition Siyuan Kan Huanyu Wu Zhenyao Cui Fan Huang Xiaolong Xu Dongrui Wu 29 0 0 12 Apr 2025
A Survey of fMRI to Image Reconstruction Weiyu Guo Guoying Sun JianXiang He Tong Shao Shaoguang Wang Ziyang Chen Meisheng Hong Ying Sun Hui Xiong 36 1 0 24 Feb 2025
BP-GPT: Auditory Neural Decoding Using fMRI-prompted LLM Xiaoyu Chen Changde Du Che Liu Yizhe Wang Huiguang He 60 0 0 24 Feb 2025
Animate Your Thoughts: Decoupled Reconstruction of Dynamic Natural Vision from Slow Brain Activity Yizhuo Lu Changde Du Chong Wang Xuanliu Zhu Liuyun Jiang Xujin Li Huiguang He VGen 102 4 0 20 Feb 2025
Neural-MCRL: Neural Multimodal Contrastive Representation Learning for EEG-based Visual Decoding Yueyang Li Zijian Kang Shengyu Gong Wenhao Dong Weiming Zeng Hongjie Yan W. Siok Nizhuan Wang 52 2 0 23 Dec 2024
CognitionCapturer: Decoding Visual Stimuli From Human EEG Signal With Multimodal Information K. Zhang Lihuo He Xin Jiang Wen Lu Di Wang Xinbo Gao 70 0 0 13 Dec 2024
EEG-Driven 3D Object Reconstruction with Style Consistency and Diffusion Prior Xin Xiang Wenhui Zhou Guojun Dai DiffM 23 0 0 28 Oct 2024
Optical Generative Models Shiqi Chen Yuhang Li Hanlong Chen Aydogan Ozcan VLM 15 0 0 23 Oct 2024
Optimising EEG decoding with refined sampling and multimodal feature integration Arash Akbarinia 15 0 0 30 Sep 2024
NeuralOOD: Improving Out-of-Distribution Generalization Performance with Brain-machine Fusion Learning Framework Shuangchen Zhao Changde Du Hui Li Huiguang He 24 0 0 27 Aug 2024
Visual Neural Decoding via Improved Visual-EEG Semantic Consistency Hongzhou Chen Lianghua He Yihang Liu Longzhen Yang 30 1 0 13 Aug 2024
Adaptive Modality Balanced Online Knowledge Distillation for Brain-Eye-Computer based Dim Object Detection Zixing Li Chao Yan Zhen Lan Xiaojia Xiang Han Zhou Jun Lai Dengqing Tang 23 0 0 02 Jul 2024
Mind's Eye: Image Recognition by EEG via Multimodal Similarity-Keeping Contrastive Learning Chi-Sheng Chen Chun-Shu Wei 28 9 0 05 Jun 2024
D-FaST: Cognitive Signal Decoding with Disentangled Frequency-Spatial-Temporal Attention WeiGuo Chen Changjian Wang Kele Xu Yuan Yuan Yanru Bai Dongsong Zhang 24 1 0 02 Jun 2024
Open-vocabulary Auditory Neural Decoding Using fMRI-prompted LLM Xiaoyu Chen Changde Du Che Liu Yizhe Wang Huiguang He 19 2 0 13 May 2024
Wills Aligner: A Robust Multi-Subject Brain Representation Learner Guangyin Bao Zixuan Gong Qi Zhang Jialei Zhou Wei Fan Kun Yi Usman Naseem Liang Hu Duoqian Miao 41 0 0 20 Apr 2024
MindTuner: Cross-Subject Visual Decoding with Visual Fingerprint and Semantic Correction Zixuan Gong Qi Zhang Guangyin Bao Lei Zhu Ke Liu Liang Hu Duoqian Miao 24 9 0 19 Apr 2024
Visual Decoding and Reconstruction via EEG Embeddings with Guided Diffusion Dongyang Li Chen Wei Shiying Li Jiachen Zou Quanying Liu DiffM 16 18 0 12 Mar 2024
See Through Their Minds: Learning Transferable Neural Representation from Cross-Subject fMRI Yulong Liu Yongqiang Ma Guibo Zhu Haodong Jing Nanning Zheng 14 4 0 11 Mar 2024
Achieving More Human Brain-Like Vision via Human EEG Representational Alignment Zitong Lu Yile Wang Julie D. Golomb 13 5 0 30 Jan 2024
Brain-Conditional Multimodal Synthesis: A Survey and Taxonomy Weijian Mai Jian Zhang Pengfei Fang Zhijun Zhang 32 9 0 31 Dec 2023
fMRI-PTE: A Large-scale fMRI Pretrained Transformer Encoder for Multi-Subject Brain Activity Decoding Xuelin Qian Yun Wang Jingyang Huo Jianfeng Feng Yanwei Fu MedIm 11 8 0 01 Nov 2023
SI-SD: Sleep Interpreter through awake-guided cross-subject Semantic Decoding Hui Zheng Zhongtao Chen Haiteng Wang Jianyang Zhou Lin Zheng Pei-Yang Lin Yun-Zhe Liu 13 2 0 28 Sep 2023
MindGPT: Interpreting What You See with Non-invasive Brain Recordings Jiaxuan Chen Yu Qi Yueming Wang Gang Pan 30 5 0 27 Sep 2023
Mapping EEG Signals to Visual Stimuli: A Deep Learning Approach to Match vs. Mismatch Classification Yiqian Yang Zhengqiao Zhao Qian Wang Yan Yang Jingdong Chen 14 0 0 08 Sep 2023
Decoding Natural Images from EEG for Object Recognition Yonghao Song Bingchuan Liu Xiang Li Nanlin Shi Yijun Wang Xiaorong Gao 6 22 0 25 Aug 2023
Joint fMRI Decoding and Encoding with Latent Embedding Alignment Xuelin Qian Yikai Wang Yanwei Fu Xinwei Sun Xiangyang Xue Jianfeng Feng 52 6 0 26 Mar 2023
MindDiffuser: Controlled Image Reconstruction from Human Brain Activity with Semantic and Structural Diffusion Yizhuo Lu Changde Du Dianpeng Wang Huiguang He DiffM 122 39 0 24 Mar 2023
BrainCLIP: Bridging Brain and Visual-Linguistic Representation Via CLIP for Generic Natural Visual Stimulus Decoding Yulong Liu Yongqiang Ma Wei Zhou Guibo Zhu Nanning Zheng VLM 22 34 0 25 Feb 2023
Group-level Brain Decoding with Deep Learning Richard Csaky M. Es Oiwi Parker Jones M. Woolrich 20 11 0 27 May 2022
BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Junnan Li Dongxu Li Caiming Xiong S. Hoi MLLM BDL VLM CLIP 382 4,010 0 28 Jan 2022
End-to-end translation of human neural activity to speech with a dual-dual generative adversarial network Yina Guo Xiaofei Zhang Zhenying Gong Anhong Wang Wenwu Wang 22 11 0 13 Oct 2021
Revisiting Document Representations for Large-Scale Zero-Shot Learning Jihyung Kil Wei-Lun Chao VLM 40 10 0 21 Apr 2021
RepVGG: Making VGG-style ConvNets Great Again Xiaohan Ding X. Zhang Ningning Ma Jungong Han Guiguang Ding Jian-jun Sun 117 1,484 0 11 Jan 2021
Decoding Brain Representations by Multimodal Learning of Neural Activity and Visual Features S. Palazzo C. Spampinato I. Kavasidis D. Giordano Joseph Schmidt M. Shah 97 109 0 25 Oct 2018