Partial success in closing the gap between human and machine vision

14 June 2021

Robert Geirhos

Kantharaju Narayanappa

Wieland Brendel

Papers citing "Partial success in closing the gap between human and machine vision"

50 / 131 papers shown

Title
Linking forward-pass dynamics in Transformers and real-time human processing Jennifer Hu Michael A. Lepori Michael Franke AI4CE 83 0 0 18 Apr 2025
DGFamba: Learning Flow Factorized State Space for Visual Domain Generalization Qi Bi Jingjun Yi Hao Zheng Haolan Zhan Wei Ji Yawen Huang Yuexiang Li OOD 30 1 0 10 Apr 2025
Contour Integration Underlies Human-Like Vision Ben Lonnqvist Elsa Scialom Abdülkadir Gökce Zehra Merchant Michael H. Herzog Martin Schrimpf VLM 28 0 0 07 Apr 2025
Evaluating Compositional Scene Understanding in Multimodal Generative Models Shuhao Fu Andrew Jun Lee Anna Wang Ida Momennejad Trevor J. Bihl Hongjing Lu Taylor W. Webb CoGe OCL 101 1 0 29 Mar 2025
Beyond Accuracy: What Matters in Designing Well-Behaved Models? Robin Hesse Doğukan Bağcı Bernt Schiele Simone Schaub-Meyer Stefan Roth VLM 54 0 0 21 Mar 2025
EasyRobust: A Comprehensive and Easy-to-use Toolkit for Robust and Generalized Vision Xiaofeng Mao YueFeng Chen Rong Zhang Hui Xue Zhao Li Hang Su AAML VLM 41 0 0 21 Mar 2025
MAME: Multidimensional Adaptive Metamer Exploration with Human Perceptual Feedback Mina Kamao Hayato Ono Ayumu Yamashita Kaoru Amano Masataka Sawayama 36 0 0 17 Mar 2025
Shape Bias and Robustness Evaluation via Cue Decomposition for Image Classification and Segmentation Edgar Heinert Thomas Gottwald Annika Mütze Matthias Rottmann 57 0 0 16 Mar 2025
Do computer vision foundation models learn the low-level characteristics of the human visual system? Yancheng Cai Fei Yin Dounia Hammou Rafal Mantiuk VLM Presented at ResearchTrend Connect \| VLM on 14 Mar 2025 138 1 0 13 Mar 2025
A Causal Framework for Aligning Image Quality Metrics and Deep Neural Network Robustness Nathan G. Drenkow Mathias Unberath OOD 76 0 0 04 Mar 2025
Bridging Critical Gaps in Convergent Learning: How Representational Alignment Evolves Across Layers, Training, and Distribution Shifts Chaitanya Kapoor Sudhanshu Srivastava Meenakshi Khosla 68 0 0 26 Feb 2025
Category-Selective Neurons in Deep Networks: Comparing Purely Visual and Visual-Language Models Zitong Lu Yuxin Wang 39 0 0 23 Feb 2025
Brain-Model Evaluations Need the NeuroAI Turing Test Jenelle Feather Meenakshi Khosla N. Apurva Ratan Murty Aran Nayebi 67 3 0 22 Feb 2025
Efficient Reinforcement Learning Through Adaptively Pretrained Visual Encoder Yuhan Zhang Guoqing Ma Guangfu Hao Liangxuan Guo Yang Chen S. Yu OnRL 69 0 0 08 Feb 2025
The in-context inductive biases of vision-language models differ across modalities Kelsey Allen Ishita Dasgupta Eliza Kosoy Andrew Kyle Lampinen 68 0 0 03 Feb 2025
Human Gaze Boosts Object-Centered Representation Learning Timothy Schaumlöffel A. Aubret Gemma Roig Jochen Triesch 33 0 0 06 Jan 2025
Measuring Error Alignment for Decision-Making Systems Binxia Xu Antonis Bikakis Daniel Onah A. Vlachidis Luke Dickens 34 0 0 03 Jan 2025
DT-JRD: Deep Transformer based Just Recognizable Difference Prediction Model for Video Coding for Machines Junqi Liu Yun Zhang Xiaoqi Wang Xu Long Sam Kwong 26 0 0 14 Nov 2024
MomentumSMoE: Integrating Momentum into Sparse Mixture of Experts R. Teo Tan M. Nguyen MoE 31 3 0 18 Oct 2024
How Do Training Methods Influence the Utilization of Vision Models? Paul Gavrikov Shashank Agnihotri M. Keuper J. Keuper 26 2 0 18 Oct 2024
Explicitly Modeling Pre-Cortical Vision with a Neuro-Inspired Front-End Improves CNN Robustness Lucas Piper Arlindo L. Oliveira Tiago Marques 20 1 0 25 Sep 2024
VFA: Vision Frequency Analysis of Foundation Models and Human Mohammad Javad Darvishi Bayazi Md Rifat Arefin Jocelyn Faubert Irina Rish VLM 29 1 0 09 Sep 2024
HVM-1: Large-scale video models pretrained with nearly 5000 hours of human-like video data Emin Orhan VLM SyDa 27 1 0 25 Jul 2024
What does Kiki look like? Cross-modal associations between speech sounds and visual shapes in vision-and-language models Tessa Verhoef Kiana Shahrasbi Tom Kouwenhoven VLM 23 2 0 25 Jul 2024
PartImageNet++ Dataset: Scaling up Part-based Models for Robust Recognition Xiao-Li Li Yining Liu Na Dong Sitian Qin Xiaolin Hu 34 3 0 15 Jul 2024
Teaching CORnet Human fMRI Representations for Enhanced Model-Brain Alignment Zitong Lu Yile Wang 18 1 0 15 Jul 2024
How Aligned are Different Alignment Metrics? Jannis Ahlert Thomas Klein Felix Wichmann Robert Geirhos 27 4 0 10 Jul 2024
Wavelet Convolutions for Large Receptive Fields Shahaf E. Finder Roy Amoyal Eran Treister O. Freifeld ViT MDE 20 50 0 08 Jul 2024
What Does Softmax Probability Tell Us about Classifiers Ranking Across Diverse Test Conditions? Weijie Tu Weijian Deng Liang Zheng Tom Gedeon 32 0 0 14 Jun 2024
Clarifying Myths About the Relationship Between Shape Bias, Accuracy, and Robustness Zahra Golpayegani Patrick St-Amant Nizar Bouguila 27 1 0 07 Jun 2024
The 3D-PC: a benchmark for visual perspective taking in humans and machines Drew Linsley Peisen Zhou A. Ashok Akash Nagaraj Gaurav Gaonkar Francis E Lewis Zygmunt Pizlo Thomas Serre 41 6 0 06 Jun 2024
Enhancing 2D Representation Learning with a 3D Prior Mehmet Aygun Prithviraj Dhar Zhicheng Yan Oisin Mac Aodha Rakesh Ranjan SSL 47 1 0 04 Jun 2024
Transparency Distortion Robustness for SOTA Image Segmentation Tasks Volker Knauthe Arne Rak Tristan Wirth Thomas Pollabauer Simon Metzler Arjan Kuijper Dieter W. Fellner 29 2 0 21 May 2024
CLIP-Mamba: CLIP Pretrained Mamba Models with OOD and Hessian Evaluation Weiquan Huang Yifei Shen Yifan Yang Mamba 33 4 0 30 Apr 2024
Saliency Suppressed, Semantics Surfaced: Visual Transformations in Neural Networks and the Brain Gustaw Opielka Jessica Loke Steven Scholte 19 0 0 29 Apr 2024
DGMamba: Domain Generalization via Generalized State Space Model Shaocong Long Qianyu Zhou Xiangtai Li Xuequan Lu Chenhao Ying Yuan Luo Lizhuang Ma Shuicheng Yan 49 9 0 11 Apr 2024
Two Effects, One Trigger: On the Modality Gap, Object Bias, and Information Imbalance in Contrastive Vision-Language Models Simon Schrodi David T. Hoffmann Max Argus Volker Fischer Thomas Brox VLM 50 0 0 11 Apr 2024
MindSet: Vision. A toolbox for testing DNNs on key psychological experiments Valerio Biscione Don Yin Gaurav Malhotra Marin Dujmović M. Montero ... Rachel Heaton John E. Hummel Benjamin D. Evans Karim G. Habashy Jeffrey S. Bowers 24 2 0 08 Apr 2024
Learning Correlation Structures for Vision Transformers Manjin Kim Paul Hongsuck Seo Cordelia Schmid Minsu Cho ViT 24 7 0 05 Apr 2024
Can Biases in ImageNet Models Explain Generalization? Paul Gavrikov J. Keuper OOD VLM 24 11 0 01 Apr 2024
Machine Learning Robustness: A Primer Houssem Ben Braiek Foutse Khomh AAML OOD 29 5 0 01 Apr 2024
Complementarity in Human-AI Collaboration: Concept, Sources, and Evidence Patrick Hemmer Max Schemmer Niklas Kühl Michael Vossing G. Satzger 22 15 0 21 Mar 2024
Learning Decomposable and Debiased Representations via Attribute-Centric Information Bottlenecks Jinyung Hong Eunyeong Jeon Changhoon Kim Keun Hee Park Utkarsh Nath Yezhou Yang P. Turaga Theodore P. Pavlic CML 22 0 0 21 Mar 2024
Explorations in Texture Learning Blaine Hoak Patrick D. McDaniel 29 2 0 14 Mar 2024
An Analysis of Human Alignment of Latent Diffusion Models Lorenz Linhardt Marco Morik Sidney Bender Naima Elosegui Borras DiffM 31 3 0 13 Mar 2024
Assessing Visually-Continuous Corruption Robustness of Neural Networks Relative to Human Performance Huakun Shen Boyue Caroline Hu Krzysztof Czarnecki Lina Marsso Marsha Chechik 27 0 0 29 Feb 2024
A Closer Look at the Robustness of Contrastive Language-Image Pre-Training (CLIP) Weijie Tu Weijian Deng Tom Gedeon UQCV VLM 20 32 0 12 Feb 2024
Self-supervised learning of video representations from a child's perspective A. Orhan Wentao Wang Alex N. Wang Mengye Ren Brenden Lake 17 4 0 01 Feb 2024
Achieving More Human Brain-Like Vision via Human EEG Representational Alignment Zitong Lu Yile Wang Julie D. Golomb 18 5 0 30 Jan 2024
Trapped in texture bias? A large scale comparison of deep instance segmentation J. Theodoridis Jessica Hofmann J. Maucher A. Schilling SSeg 19 5 0 17 Jan 2024