DisCo-CLIP: A Distributed Contrastive Loss for Memory Efficient CLIP
Training

DisCo-CLIP: A Distributed Contrastive Loss for Memory Efficient CLIP Training

Computer Vision and Pattern Recognition (CVPR), 2023

17 April 2023

Lei Zhang

ArXiv (abs)PDF HTML Github (58★)

Papers citing "DisCo-CLIP: A Distributed Contrastive Loss for Memory Efficient CLIP Training"

11 / 11 papers shown

Title
AmorLIP: Efficient Language-Image Pretraining via Amortization Haotian Sun Yitong Li Yuchen Zhuang Niao He Hanjun Dai Bo Dai VLM 292 1 0 25 May 2025
Breaking the Memory Barrier: Near Infinite Batch Size Scaling for Contrastive Loss Zesen Cheng Hang Zhang Kehan Li Sicong Leng Zhiqiang Hu Fei Wu Deli Zhao Xin Li Lidong Bing 119 2 0 22 Oct 2024
The Russian-focused embedders' exploration: ruMTEB benchmark and Russian embedding model designNorth American Chapter of the Association for Computational Linguistics (NAACL), 2024 Artem Snegirev Maria Tikhonova Anna Maksimova Alena Fenogenova Alexander Abramov 337 17 0 22 Aug 2024
FastCLIP: A Suite of Optimization Techniques to Accelerate CLIP Training with Limited Resources Xiyuan Wei Fanjiang Ye Ori Yonay Xingyu Chen Baixi Sun Dingwen Tao Tianbao Yang VLM CLIP 332 4 0 01 Jul 2024
Arctic-Embed: Scalable, Efficient, and Accurate Text Embedding Models Luke Merrick Danmei Xu Gaurav Nuti Daniel Campos 154 53 0 08 May 2024
Sparse Concept Bottleneck Models: Gumbel Tricks in Contrastive Learning Andrei Semenov Vladimir Ivanov Aleksandr Beznosikov Alexander Gasnikov 156 10 0 04 Apr 2024
$A$^{3}$lign-DFER: Pioneering Comprehensive Dynamic Affective Alignment for Dynamic Facial Expression Recognition with CLIP$ A $^{3}$ lign-DFER: Pioneering Comprehensive Dynamic Affective Alignment for Dynamic Facial Expression Recognition with CLIP Zeng Tao Yan Wang Junxiong Lin Haoran Wang Xinji Mai ... Ziheng Zhou Shaoqi Yan Qing Zhao Liyuan Han Wenqiang Zhang 146 17 0 07 Mar 2024
Spurious Feature Eraser: Stabilizing Test-Time Adaptation for Vision-Language Foundation Model Huan Ma Yan Zhu Changqing Zhang Peilin Zhao Baoyuan Wu Long-Kai Huang Qinghua Hu Bing Wu VLM 447 3 0 01 Mar 2024
CARZero: Cross-Attention Alignment for Radiology Zero-Shot Classification Zihang Jiang Qingsong Yao Zihang Jiang Rongsheng Wang Zhiyang He Xiaodong Tao S. Kevin Zhou MedIm 235 31 0 27 Feb 2024
Taiyi-Diffusion-XL: Advancing Bilingual Text-to-Image Generation with Large Vision-Language Model Support Xiaojun Wu Di Zhang Ruyi Gan Junyu Lu Ziwei Wu Renliang Sun Jiaxing Zhang Pingjian Zhang Yan Song VLM 187 14 0 26 Jan 2024
iDesigner: A High-Resolution and Complex-Prompt Following Text-to-Image Diffusion Model for Interior Design Ruyi Gan Xiaojun Wu Junyu Lu Yuanhe Tian Di Zhang ... Renliang Sun Chang Liu Jiaxing Zhang Pingjian Zhang Yan Song 404 4 0 07 Dec 2023