Seeing Beyond the Brain: Conditional Diffusion Model with Sparse Masked Modeling for Vision Decoding

13 November 2022

Papers citing "Seeing Beyond the Brain: Conditional Diffusion Model with Sparse Masked Modeling for Vision Decoding"

39 / 89 papers shown

Title
NeuroPictor: Refining fMRI-to-Image Reconstruction via Multi-individual Pretraining and Multi-level Modulation Jingyang Huo Yikai Wang Xuelin Qian Yun Wang Chong Li Jianfeng Feng Yanwei Fu DiffM MedIm 40 8 0 27 Mar 2024
MindEye2: Shared-Subject Models Enable fMRI-To-Image With 1 Hour of Data Paul S. Scotti Mihir Tripathy Cesar Kadir Torrico Villanueva Reese Kneeland Tong Chen ... Charan Santhirasegaran Jonathan Xu Thomas Naselaris Kenneth A. Norman Tanishq Mathew Abraham 32 35 0 17 Mar 2024
See Through Their Minds: Learning Transferable Neural Representation from Cross-Subject fMRI Yulong Liu Yongqiang Ma Guibo Zhu Haodong Jing Nanning Zheng 14 4 0 11 Mar 2024
Controllable Generation with Text-to-Image Diffusion Models: A Survey Pu Cao Feng Zhou Qing-Huang Song Lu Yang 67 35 0 07 Mar 2024
Contrastive Learning of Shared Spatiotemporal EEG Representations Across Individuals for Naturalistic Neuroscience Xinke Shen Lingyi Tao Xuyang Chen Sen Song Quanying Liu Dan Zhang 22 1 0 22 Feb 2024
NeuralDiffuser: Neuroscience-inspired Diffusion Guidance for fMRI Visual Reconstruction Haoyu Li Hao Wu Badong Chen 23 1 0 21 Feb 2024
Brain-Conditional Multimodal Synthesis: A Survey and Taxonomy Weijian Mai Jian Zhang Pengfei Fang Zhijun Zhang 37 9 0 31 Dec 2023
BrainVis: Exploring the Bridge between Brain and Visual Signals via Image Reconstruction Honghao Fu Zhiqi Shen Jing Jih Chin Hao Wang DiffM 14 5 0 22 Dec 2023
MinD-3D: Reconstruct High-quality 3D objects in Human Brain Jianxiong Gao Yu Fu Yun Wang Xuelin Qian Jianfeng Feng Yanwei Fu DiffM 17 6 0 12 Dec 2023
Brainformer: Mimic Human Visual Brain Functions to Machine Vision Models via fMRI Xuan-Bac Nguyen Xin Li Pawan Sinha Samee U. Khan Khoa Luu ViT MedIm 22 0 0 30 Nov 2023
ChatTraffic: Text-to-Traffic Generation via Diffusion Model Chengyang Zhang Yong Zhang Qitan Shao Bo Li Yisheng Lv Xinglin Piao Baocai Yin 19 5 0 27 Nov 2023
A Survey of Emerging Applications of Diffusion Probabilistic Models in MRI Yuheng Fan Hanxi Liao Shiqi Huang Yimin Luo Huazhu Fu Haikun Qi MedIm 25 18 0 19 Nov 2023
Mitigating Exposure Bias in Discriminator Guided Diffusion Models Eleftherios Tsonis Paraskevi Tzouveli Athanasios Voulodimos DiffM 10 2 0 18 Nov 2023
Generative Artificial Intelligence in Healthcare: Ethical Considerations and Assessment Checklist Yilin Ning Salinelat Teixayavong Yuqing Shang Julian Savulescu Vaishaanth Nagaraj ... Roger Vaughan M. Ong J. Sung E. J. Topol Nan Liu 13 7 0 02 Nov 2023
fMRI-PTE: A Large-scale fMRI Pretrained Transformer Encoder for Multi-Subject Brain Activity Decoding Xuelin Qian Yun Wang Jingyang Huo Jianfeng Feng Yanwei Fu MedIm 11 8 0 01 Nov 2023
Large-scale Foundation Models and Generative AI for BigData Neuroscience Ran Wang Zhe Sage Chen MedIm AI4CE LRM 16 8 0 27 Oct 2023
Self-supervised Fetal MRI 3D Reconstruction Based on Radiation Diffusion Generation Model Junpeng Tan Xin Zhang Yao Lv Xiangmin Xu Gang Li DiffM MedIm 20 0 0 16 Oct 2023
BrainSCUBA: Fine-Grained Natural Language Captions of Visual Cortex Selectivity Andrew F. Luo Margaret M. Henderson Michael J. Tarr Brian Karrer 21 15 0 06 Oct 2023
DREAM: Visual Decoding from Reversing Human Visual System Weihao Xia Raoul de Charette Cengiz Öztireli Jing-Hao Xue 10 30 0 03 Oct 2023
MindGPT: Interpreting What You See with Non-invasive Brain Recordings Jiaxuan Chen Yu Qi Yueming Wang Gang Pan 30 6 0 27 Sep 2023
Through their eyes: multi-subject Brain Decoding with simple alignment techniques Matteo Ferrante T. Boccato N. Toschi 25 14 0 01 Aug 2023
Seeing through the Brain: Image Reconstruction of Visual Perception from Human Brain Signals Yu-Ting Lan Kan Ren Yansen Wang Wei-Long Zheng Dongsheng Li Bao-Liang Lu Lili Qiu DiffM 17 19 0 27 Jul 2023
UniCoRN: Unified Cognitive Signal ReconstructioN bridging cognitive signals and human language Nuwa Xi Sendong Zhao Hao Wang Chi-Liang Liu Bing Qin Ting Liu 16 19 0 06 Jul 2023
DreamDiffusion: Generating High-Quality Images from Brain EEG Signals Yun-Hao Bai Xintao Wang Yanpei Cao Yixiao Ge Chun Yuan Ying Shan DiffM 15 50 0 29 Jun 2023
Improving visual image reconstruction from human brain activity using latent diffusion models via multiple decoded inputs Yu Takagi Shinji Nishimoto AI4CE DiffM 19 21 0 20 Jun 2023
DreamCatcher: Revealing the Language of the Brain with fMRI using GPT Embedding Subhrasankar Chatterjee D. Samanta 29 4 0 16 Jun 2023
Brain Diffusion for Visual Exploration: Cortical Discovery using Large Scale Generative Models Andrew F. Luo Margaret M. Henderson Leila Wehbe Michael J. Tarr DiffM 16 16 0 05 Jun 2023
MindBigData 2023 MNIST-8B The 8 billion datapoints Multimodal Dataset of Brain Signals David Vivancos 8 0 0 01 Jun 2023
Reconstructing the Mind's Eye: fMRI-to-Image with Contrastive Learning and Diffusion Priors Paul S. Scotti Atmadeep Banerjee J. Goode Stepan Shabalin A. Nguyen ... Nathalie Verlinde Elad Yundler David Weisberg K. A. Norman Tanishq Mathew Abraham DiffM 27 106 0 29 May 2023
Brain Captioning: Decoding human brain activity into images and text Matteo Ferrante Furkan Ozcelik T. Boccato R. V. Rullen N. Toschi DiffM 18 26 0 19 May 2023
Controllable Mind Visual Diffusion Model Bo-Wen Zeng Shanglin Li Xuhui Liu Sicheng Gao Xiaolong Jiang Xu Tang Yao Hu Jianzhuang Liu Baochang Zhang DiffM 17 24 0 17 May 2023
Joint fMRI Decoding and Encoding with Latent Embedding Alignment Xuelin Qian Yikai Wang Yanwei Fu Xinwei Sun Xiangyang Xue Jianfeng Feng 52 6 0 26 Mar 2023
MindDiffuser: Controlled Image Reconstruction from Human Brain Activity with Semantic and Structural Diffusion Yizhuo Lu Changde Du Dianpeng Wang Huiguang He DiffM 125 39 0 24 Mar 2023
Improving 3D Imaging with Pre-Trained Perpendicular 2D Diffusion Models Suhyeon Lee Hyungjin Chung Minyoung Park Jonghyuk Park Wi-Sun Ryu J. C. Ye DiffM MedIm 10 44 0 15 Mar 2023
Natural scene reconstruction from fMRI signals using generative latent diffusion Furkan Ozcelik Rufin VanRullen DiffM 90 77 0 09 Mar 2023
Semantic Brain Decoding: from fMRI to conceptually similar image reconstruction of visual stimuli Matteo Ferrante T. Boccato N. Toschi DiffM 22 21 0 13 Dec 2022
Mind Reader: Reconstructing complex images from brain activities Sikun Lin Thomas C. Sprague Ambuj K. Singh DiffM 116 86 0 30 Sep 2022
Pretraining is All You Need for Image-to-Image Translation Tengfei Wang Ting Zhang Bo Zhang Hao Ouyang Dong Chen Qifeng Chen Fang Wen DiffM 184 177 0 25 May 2022
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 258 7,412 0 11 Nov 2021