Scaling Deep Contrastive Learning Batch Size under Memory Limited Setup

18 January 2021

Papers citing "Scaling Deep Contrastive Learning Batch Size under Memory Limited Setup"

50 / 55 papers shown

Title
Breaking the Modality Barrier: Universal Embedding Learning with Multimodal LLMs Tiancheng Gu Kaicheng Yang Ziyong Feng Xingjun Wang Yanzhao Zhang Dingkun Long Yingda Chen Weidong Cai Jiankang Deng VLM 153 0 0 24 Apr 2025
IDMR: Towards Instance-Driven Precise Visual Correspondence in Multimodal Retrieval Bangwei Liu Yicheng Bao Shaohui Lin Xuhong Wang Xin Tan Y. Wang Yuan Xie Chaochao Lu 84 0 0 01 Apr 2025
ExpertRAG: Efficient RAG with Mixture of Experts -- Optimizing Context Retrieval for Adaptive LLM Responses Esmail Gumaan MoE 28 0 0 23 Mar 2025
OASIS: Order-Augmented Strategy for Improved Code Search Zuchen Gao Zizheng Zhan Xianming Li Erxin Yu Haotian Zhang Bin Chen Yuqun Zhang Jing Li 64 0 0 11 Mar 2025
GRITHopper: Decomposition-Free Multi-Hop Dense Retrieval Justus-Jonas Erker Nils Reimers Iryna Gurevych 58 0 0 10 Mar 2025
ABC: Achieving Better Control of Multimodal Embeddings using VLMs Benjamin Schneider Florian Kerschbaum Wenhu Chen 118 0 0 01 Mar 2025
Teaching Dense Retrieval Models to Specialize with Listwise Distillation and LLM Data Augmentation Manveer Singh Tamber Suleman Kazi Vivek Sourabh Jimmy J. Lin 62 1 0 27 Feb 2025
Multi-task retriever fine-tuning for domain-specific and efficient RAG Patrice Béchard Orlando Marquez Ayala 35 0 0 08 Jan 2025
VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks Ziyan Jiang Rui Meng Xinyi Yang Semih Yavuz Yingbo Zhou Wenhu Chen MLLM VLM 51 18 0 03 Jan 2025
LUSIFER: Language Universal Space Integration for Enhanced Multilingual Embeddings with Large Language Models Hieu Man Nghia Trung Ngo Viet Dac Lai Ryan Rossi Franck Dernoncourt T. Nguyen 142 0 0 01 Jan 2025
MATCHED: Multimodal Authorship-Attribution To Combat Human Trafficking in Escort-Advertisement Data V. Saxena Benjamin Bashpole Gijs van Dijck Gerasimos Spanakis 72 0 0 18 Dec 2024
CodeXEmbed: A Generalist Embedding Model Family for Multiligual and Multi-task Code Retrieval Y. Liu Rui Meng Shafiq R. Joty Silvio Savarese Caiming Xiong Yingbo Zhou Semih Yavuz 90 3 0 19 Nov 2024
MoRE: Multi-Modal Contrastive Pre-training with Transformers on X-Rays, ECGs, and Diagnostic Report Samrajya Thapa Koushik Howlader Subhankar Bhattacharjee Wei le MedIm 21 1 0 21 Oct 2024
Contextual Document Embeddings John X. Morris Alexander M. Rush 19 7 0 03 Oct 2024
Task-level Distributionally Robust Optimization for Large Language Model-based Dense Retrieval Guangyuan Ma Yongliang Ma Xing Wu Zhenpeng Su Ming Zhou Songlin Hu OOD 39 2 0 20 Aug 2024
PhysBERT: A Text Embedding Model for Physics Scientific Literature Thorsten Hellert Joao Montenegro Andrea Pollastro PINN AI4CE 17 4 0 18 Aug 2024
ULLME: A Unified Framework for Large Language Model Embeddings with Generation-Augmented Learning Hieu Man Nghia Trung Ngo Franck Dernoncourt Thien Huu Nguyen AI4TS 46 4 0 06 Aug 2024
Toward Exploring the Code Understanding Capabilities of Pre-trained Code Generation Models Jiayi Lin Yutao Xie Yue Yu Yibiao Yang Lei Zhang SyDa 19 0 0 18 Jun 2024
Repurposing Language Models into Embedding Models: Finding the Compute-Optimal Recipe Alicja Ziarko Albert Q. Jiang Bartosz Piotrowski Wenda Li M. Jamnik Piotr Miłoś 32 0 0 06 Jun 2024
DocReLM: Mastering Document Retrieval with Language Model Gengchen Wei Xinle Pang Tianning Zhang Yu Sun Xun Qian Chen Lin Han-Sen Zhong Wanli Ouyang RALM 36 0 0 19 May 2024
Dwell in the Beginning: How Language Models Embed Long Documents for Dense Retrieval Joao Coelho Bruno Martins João Magalhães Jamie Callan Chenyan Xiong RALM 32 4 0 05 Apr 2024
IISAN: Efficiently Adapting Multimodal Representation for Sequential Recommendation with Decoupled PEFT Junchen Fu Xuri Ge Xin Xin Alexandros Karatzoglou Ioannis Arapakis Jie Wang Joemon M. Jose 35 17 0 02 Apr 2024
Unsupervised Multilingual Dense Retrieval via Generative Pseudo Labeling Chao-Wei Huang †. Chen-AnLi †. Tsu-YuanHsu Chen-Yu Hsu Yun-Nung Chen RALM 35 1 0 06 Mar 2024
Repetition Improves Language Model Embeddings Jacob Mitchell Springer Suhas Kotha Daniel Fried Graham Neubig Aditi Raghunathan 40 29 0 23 Feb 2024
Benchmarking and Building Long-Context Retrieval Models with LoCo and M2-BERT Jon Saad-Falcon Daniel Y. Fu Simran Arora Neel Guha Christopher Ré RALM 32 16 0 12 Feb 2024
Domain Adaptation of Multilingual Semantic Search -- Literature Review Anna Bringmann Anastasia Zhukova VLM 30 0 0 05 Feb 2024
Nomic Embed: Training a Reproducible Long Context Text Embedder Zach Nussbaum John X. Morris Brandon Duderstadt Andriy Mulyar 19 94 0 02 Feb 2024
A Novel Information-Theoretic Objective to Disentangle Representations for Fair Classification Pierre Colombo Nathan Noiry Guillaume Staerman Pablo Piantanida FaML DRL 28 1 0 21 Oct 2023
Dual-Encoders for Extreme Multi-Label Classification Nilesh Gupta Devvrit Khatri A. S. Rawat Srinadh Bhojanapalli Prateek Jain Inderjit Dhillon VLM 36 3 0 16 Oct 2023
Language Models are Universal Embedders Xin Zhang Zehan Li Yanzhao Zhang Dingkun Long Pengjun Xie Meishan Zhang Min Zhang KELM ELM 35 6 0 12 Oct 2023
TinyCLIP: CLIP Distillation via Affinity Mimicking and Weight Inheritance Kan Wu Houwen Peng Zhenghong Zhou Bin Xiao Mengchen Liu ... Xi Xi Chen Xinggang Wang Hongyang Chao Han Hu VLM OODD 29 53 0 21 Sep 2023
CONVERSER: Few-Shot Conversational Dense Retrieval with Synthetic Data Generation Chao-Wei Huang Chen-Yu Hsu Tsung-Yuan Hsu Chen An Li Yun-Nung (Vivian) Chen 11 5 0 13 Sep 2023
Focused Transformer: Contrastive Training for Context Scaling Szymon Tworkowski Konrad Staniszewski Mikolaj Pacek Yuhuai Wu Henryk Michalewski Piotr Milo's 21 135 0 06 Jul 2023
DisCo-CLIP: A Distributed Contrastive Loss for Memory Efficient CLIP Training Yihao Chen Xianbiao Qi Jianan Wang Lei Zhang 18 16 0 17 Apr 2023
Generation-Augmented Query Expansion For Code Retrieval Dong Li Yelong Shen Ruoming Jin Yi Mao Kuan-Chieh Jackson Wang Weizhu Chen RALM 26 8 0 20 Dec 2022
Relational Sentence Embedding for Flexible Semantic Matching Bin Wang Haizhou Li 19 4 0 17 Dec 2022
MASTER: Multi-task Pre-trained Bottlenecked Masked Autoencoders are Better Dense Retrievers Kun Zhou Xiao Liu Yeyun Gong Wayne Xin Zhao Daxin Jiang Nan Duan Ji-Rong Wen 25 16 0 15 Dec 2022
Retrieval as Attention: End-to-end Learning of Retrieval and Reading within a Single Transformer Zhengbao Jiang Luyu Gao Jun Araki Haibo Ding Zhiruo Wang Jamie Callan Graham Neubig RALM 25 40 0 05 Dec 2022
Self-supervised Rewiring of Pre-trained Speech Encoders: Towards Faster Fine-tuning with Less Labels in Speech Processing Haomiao Yang Jinming Zhao Gholamreza Haffari Ehsan Shareghi 25 2 0 24 Oct 2022
SimANS: Simple Ambiguous Negatives Sampling for Dense Text Retrieval Kun Zhou Yeyun Gong Xiao Liu Wayne Xin Zhao Yelong Shen ... Jing Lu Rangan Majumder Ji-Rong Wen Nan Duan Weizhu Chen 34 33 0 21 Oct 2022
An Overview of the Data-Loader Landscape: Comparative Performance Analysis Iason Ofeidis Diego Kiedanski Leandros Tassiulas 13 7 0 27 Sep 2022
Federated Momentum Contrastive Clustering Runxuan Miao Erdem Koyuncu FedML 20 13 0 10 Jun 2022
Conditional Supervised Contrastive Learning for Fair Text Classification Jianfeng Chi Will Shand Yaodong Yu Kai-Wei Chang Han Zhao Yuan Tian FaML 41 14 0 23 May 2022
i-Code: An Integrative and Composable Multimodal Learning Framework Ziyi Yang Yuwei Fang Chenguang Zhu Reid Pryzant Dongdong Chen ... Bin Xiao Yuanxun Lu Takuya Yoshioka Michael Zeng Xuedong Huang 40 45 0 03 May 2022
C3: Continued Pretraining with Contrastive Weak Supervision for Cross Language Ad-Hoc Retrieval Eugene Yang Suraj Nair Ramraj Chandradevan Rebecca Iglesias-Flores Douglas W. Oard RALM CLL 22 19 0 25 Apr 2022
CharacterBERT and Self-Teaching for Improving the Robustness of Dense Retrievers on Queries with Typos Shengyao Zhuang Guido Zuccon OOD 11 30 0 01 Apr 2022
LaPraDoR: Unsupervised Pretrained Dense Retriever for Zero-Shot Text Retrieval Canwen Xu Daya Guo Nan Duan Julian McAuley RALM VLM 16 45 0 11 Mar 2022
Tevatron: An Efficient and Flexible Toolkit for Dense Retrieval Luyu Gao Xueguang Ma Jimmy J. Lin Jamie Callan 27 76 0 11 Mar 2022
SGPT: GPT Sentence Embeddings for Semantic Search Niklas Muennighoff RALM 22 175 0 17 Feb 2022
CodeRetriever: Unimodal and Bimodal Contrastive Learning for Code Search Xiaonan Li Yeyun Gong Yelong Shen Xipeng Qiu Hang Zhang Bolun Yao Weizhen Qi Daxin Jiang Weizhu Chen Nan Duan OffRL 21 27 0 26 Jan 2022