Cosine Normalization: Using Cosine Similarity Instead of Dot Product in Neural Networks

20 February 2017

Lei Wang

Papers citing "Cosine Normalization: Using Cosine Similarity Instead of Dot Product in Neural Networks"

22 / 22 papers shown

Title
GIF: Generative Inspiration for Face Recognition at Scale Saeed Ebrahimi Sahar Rahimi Ali Dabouei Srinjoy Das Jeremy M. Dawson Nasser M. Nasrabadi CVBM 122 0 0 05 May 2025
Inclusive Training Separation and Implicit Knowledge Interaction for Balanced Online Class-Incremental Learning Shunjie Wen Thomas Heinis Dong-Wan Choi CLL 44 0 0 29 Apr 2025
Surpassing Cosine Similarity for Multidimensional Comparisons: Dimension Insensitive Euclidean Metric F. Tessari Neville Hogan Neville Hogan 26 3 0 11 Jul 2024
Analyzing and Improving the Training Dynamics of Diffusion Models Tero Karras M. Aittala J. Lehtinen Janne Hellsten Timo Aila S. Laine 28 153 0 05 Dec 2023
Exploring the Sharpened Cosine Similarity Skyler Wu Fred Lu Edward Raff James Holt 11 2 0 25 Jul 2023
Large-scale Pre-trained Models are Surprisingly Strong in Incremental Novel Class Discovery Mingxuan Liu Subhankar Roy Zhun Zhong N. Sebe Elisa Ricci CLL SSL 32 10 0 28 Mar 2023
Continual Causal Inference with Incremental Observational Data Zhixuan Chu Ruopeng Li S. Rathbun Sheng R. Li CML 37 14 0 03 Mar 2023
Enhancing Few-shot Image Classification with Cosine Transformer Quang-Huy Nguyen Cuong Q. Nguyen Dung D. Le Hieu H. Pham ViT 19 12 0 13 Nov 2022
B-cos Networks: Alignment is All We Need for Interpretability Moritz D Boehle Mario Fritz Bernt Schiele 26 84 0 20 May 2022
MNet-Sim: A Multi-layered Semantic Similarity Network to Evaluate Sentence Similarity Manuela Nayantara Jeyaraj D. Kasthurirathna 11 3 0 09 Nov 2021
R4: A Framework for Route Representation and Route Recommendation Ran Cheng Chao Chen Longfei Xu Shen Li Lei Wang Hengbin Cui Kaikui Liu Xiaolong Li AI4TS 17 2 0 20 Oct 2021
A Unified Framework for Generalized Low-Shot Medical Image Segmentation with Scarce Data H. Cui Dong Wei Kai Ma Shi Gu Yefeng Zheng 12 39 0 18 Oct 2021
Essentials for Class Incremental Learning Sudhanshu Mittal Silvio Galesso Thomas Brox CLL 12 96 0 18 Feb 2021
Query-Key Normalization for Transformers Alex Henry Prudhvi Raj Dachapally S. Pawar Yuxuan Chen 12 75 0 08 Oct 2020
Review: Deep Learning in Electron Microscopy Jeffrey M. Ede 22 79 0 17 Sep 2020
TRIER: Template-Guided Neural Networks for Robust and Interpretable Sleep Stage Identification from EEG Recordings Taeheon Lee Jeonghwan Hwang Honggu Lee 25 7 0 10 Sep 2020
Transformers without Tears: Improving the Normalization of Self-Attention Toan Q. Nguyen Julian Salazar 36 224 0 14 Oct 2019
Hyperspherical Prototype Networks Pascal Mettes Elise van der Pol Cees G. M. Snoek 16 123 0 29 Jan 2019
Normalization in Training U-Net for 2D Biomedical Semantic Segmentation Xiao-Yun Zhou Guang-Zhong Yang 11 77 0 11 Sep 2018
The exploding gradient problem demystified - definition, prevalence, impact, origin, tradeoffs, and solutions George Philipp D. Song J. Carbonell ODL 19 46 0 15 Dec 2017
von Mises-Fisher Mixture Model-based Deep learning: Application to Face Verification Abul Hasnat Julien Bohné Jonathan Milgram S. Gentric Liming Luke Chen CVBM 26 91 0 13 Jun 2017
Feature Incay for Representation Regularization Yuhui Yuan Kuiyuan Yang Chao Zhang 16 16 0 29 May 2017