Fast, Effective, and Self-Supervised: Transforming Masked Language Models into Universal Lexical and Sentence Encoders

16 April 2021

Papers citing "Fast, Effective, and Self-Supervised: Transforming Masked Language Models into Universal Lexical and Sentence Encoders"

33 / 33 papers shown

Title
Enhancing User Sequence Modeling through Barlow Twins-based Self-Supervised Learning Yuhan Liu Lin Ning Neo Wu Karan Singhal Philip Mansfield D. Berlowitz Sushant Prakash Bradley Green SSL 54 0 0 02 May 2025
UniASM: Binary Code Similarity Detection without Fine-tuning Yeming Gu Hui Shu Fei Kang Fan Hu 64 10 0 21 Feb 2025
Interpretability Analysis of Domain Adapted Dense Retrievers Goksenin Yuksel Jaap Kamps FAtt 32 0 0 24 Jan 2025
News Without Borders: Domain Adaptation of Multilingual Sentence Embeddings for Cross-lingual News Recommendation Andreea Iana Fabian David Schmidt Goran Glavas Heiko Paulheim 63 3 0 20 Jan 2025
Event-enhanced Retrieval in Real-time Search Yanan Zhang Xiaoling Bai Tianhua Zhou 29 1 0 09 Apr 2024
Injecting Wiktionary to improve token-level contextual representations using contrastive learning Anna Mosolova Marie Candito Carlos Ramisch 24 0 0 12 Feb 2024
UNSEE: Unsupervised Non-contrastive Sentence Embeddings Ömer Veysel Çagatan SSL 21 0 0 27 Jan 2024
Robust Reinforcement Learning Objectives for Sequential Recommender Systems Melissa Mozifian Tristan Sylvain David E. Evans Li Meng OffRL 21 0 0 30 May 2023
Investigating Pre-trained Audio Encoders in the Low-Resource Condition Haomiao Yang Jinming Zhao Gholamreza Haffari Ehsan Shareghi 16 6 0 28 May 2023
EnCore: Fine-Grained Entity Typing by Pre-Training Entity Encoders on Coreference Chains Frank Mtumbuka Steven Schockaert 29 0 0 22 May 2023
Ultra-Fine Entity Typing with Prior Knowledge about Labels: A Simple Clustering Based Strategy Na Li Zied Bouraoui Steven Schockaert 27 9 0 22 May 2023
A Comprehensive Survey of Sentence Representations: From the BERT Epoch to the ChatGPT Era and Beyond Abhinav Ramesh Kashyap Thang-Tung Nguyen Viktor Schlegel Stefan Winkler See-Kiong Ng Soujanya Poria AI4TS 3DV SSL 34 6 0 22 May 2023
Reranking Overgenerated Responses for End-to-End Task-Oriented Dialogue Systems Songbo Hu Ivan Vulić Fangyu Liu Anna Korhonen 30 0 0 07 Nov 2022
Self-supervised Rewiring of Pre-trained Speech Encoders: Towards Faster Fine-tuning with Less Labels in Speech Processing Haomiao Yang Jinming Zhao Gholamreza Haffari Ehsan Shareghi 25 2 0 24 Oct 2022
Continual Learning by Modeling Intra-Class Variation L. Yu Tianyang Hu Lanqing Hong Zhen Liu Adrian Weller Weiyang Liu CLL 48 12 0 11 Oct 2022
Learning functional sections in medical conversations: iterative pseudo-labeling and human-in-the-loop approach Mengqian Wang Ilya Valmianski X. Amatriain Anitha Kannan 26 2 0 06 Oct 2022
Ranking-Enhanced Unsupervised Sentence Representation Learning Yeon Seonwoo Guoyin Wang Changmin Seo Sajal Choudhary Jiwei Li Xiang Li Puyang Xu Sunghyun Park Alice H. Oh SSL DRL AI4TS 53 15 0 09 Sep 2022
TweetNLP: Cutting-Edge Natural Language Processing for Social Media Jose Camacho-Collados Kiamehr Rezaee Talayeh Riahi Asahi Ushio Daniel Loureiro ... Eugenio Martínez-Cámara Gonzalo Medina T. Buhrmann Leonardo Neves Francesco Barbieri VLM AI4MH 24 129 0 29 Jun 2022
EASE: Entity-Aware Contrastive Learning of Sentence Embedding Sosuke Nishikawa Ryokan Ri Ikuya Yamada Yoshimasa Tsuruoka Isao Echizen 20 29 0 09 May 2022
Probing Cross-Lingual Lexical Knowledge from Multilingual Sentence Encoders Ivan Vulić Goran Glavavs Fangyu Liu Nigel Collier E. Ponti Anna Korhonen 17 8 0 30 Apr 2022
LaPraDoR: Unsupervised Pretrained Dense Retriever for Zero-Shot Text Retrieval Canwen Xu Daya Guo Nan Duan Julian McAuley RALM VLM 16 45 0 11 Mar 2022
A Mutually Reinforced Framework for Pretrained Sentence Embeddings Junhan Yang Zheng Liu Shitao Xiao Jianxun Lian Lijun Wu Defu Lian Guangzhong Sun Xing Xie SSL 11 2 0 28 Feb 2022
Sharpness-Aware Minimization with Dynamic Reweighting Wenxuan Zhou Fangyu Liu Huan Zhang Muhao Chen AAML 19 8 0 16 Dec 2021
GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrieval Kexin Wang Nandan Thakur Nils Reimers Iryna Gurevych VLM 19 149 0 14 Dec 2021
Prix-LM: Pretraining for Multilingual Knowledge Base Construction Wenxuan Zhou Fangyu Liu Ivan Vulić Nigel Collier Muhao Chen KELM 62 18 0 16 Oct 2021
Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations Fangyu Liu Yunlong Jiao Jordan Massiah Emine Yilmaz Serhii Havrylov SSL 87 29 0 27 Sep 2021
ESimCSE: Enhanced Sample Building Method for Contrastive Learning of Unsupervised Sentence Embedding Xing Wu Chaochen Gao Liangjun Zang Jizhong Han Zhongyuan Wang Songlin Hu SSL AILaw 31 129 0 09 Sep 2021
A Primer on Contrastive Pretraining in Language Processing: Methods, Lessons Learned and Perspectives Nils Rethmeier Isabelle Augenstein SSL VLM 85 90 0 25 Feb 2021
COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining Yu Meng Chenyan Xiong Payal Bajaj Saurabh Tiwary Paul N. Bennett Jiawei Han Xia Song 125 202 0 16 Feb 2021
Augmented SBERT: Data Augmentation Method for Improving Bi-Encoders for Pairwise Sentence Scoring Tasks Nandan Thakur Nils Reimers Johannes Daxenberger Iryna Gurevych 200 241 0 16 Oct 2020
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 297 6,950 0 20 Apr 2018
Word Translation Without Parallel Data Alexis Conneau Guillaume Lample MarcÁurelio Ranzato Ludovic Denoyer Hervé Jégou 169 1,635 0 11 Oct 2017
Efficient Estimation of Word Representations in Vector Space Tomáš Mikolov Kai Chen G. Corrado J. Dean 3DV 228 31,253 0 16 Jan 2013