ResearchTrend.AI
On the Sentence Embeddings from Pre-trained Language Models

On the Sentence Embeddings from Pre-trained Language Models

Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020
Bohan Li
Hao Zhou
Junxian He
Mingxuan Wang
Yiming Yang
Lei Li
ArXiv (abs)PDFHTMLGithub (533★)

Papers citing "On the Sentence Embeddings from Pre-trained Language Models"

50 / 83 papers shown
Title
CSE-SFP: Enabling Unsupervised Sentence Representation Learning via a Single Forward Pass
CSE-SFP: Enabling Unsupervised Sentence Representation Learning via a Single Forward PassAnnual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2025
Bowen Zhang
Zixin Song
Chunping Li
204
2
0
01 May 2025
LExT: Towards Evaluating Trustworthiness of Natural Language Explanations
LExT: Towards Evaluating Trustworthiness of Natural Language ExplanationsConference on Fairness, Accountability and Transparency (FAccT), 2025
Krithi Shailya
Shreya Rajpal
Gokul S Krishnan
Balaraman Ravindran
ELM
325
7
0
08 Apr 2025
Continuous Adversarial Text Representation Learning for Affective Recognition
Continuous Adversarial Text Representation Learning for Affective RecognitionDigital Signal Processing and Signal Processing Education Workshop (SPSPE), 2025
Seungah Son
Andrez Saurez
Dongsoo Har
184
1
0
28 Feb 2025
SEMDR: A Semantic-Aware Dual Encoder Model for Legal Judgment Prediction with Legal Clue Tracing
SEMDR: A Semantic-Aware Dual Encoder Model for Legal Judgment Prediction with Legal Clue TracingIEEE International Conference on Systems, Man and Cybernetics (SMC), 2024
Pengjie Liu
Wang Zhang
Yulong Ding
Xuefeng Zhang
Shuang-Hua Yang
AILaw
159
3
0
19 Aug 2024
Towards a Holistic Framework for Multimodal Large Language Models in Three-dimensional Brain CT Report Generation
Towards a Holistic Framework for Multimodal Large Language Models in Three-dimensional Brain CT Report Generation
Cheng-Yi Li
Kao-Jung Chang
Cheng-Fu Yang
Hsin-Yu Wu
Wenting Chen
...
Yu-Chun Chen
Shih-Pin Chen
J. Lirng
Kai-Wei Chang
Shih-Hwa Chiou
LM&MAMedIm
181
34
0
02 Jul 2024
An Efficient Self-Supervised Cross-View Training For Sentence Embedding
An Efficient Self-Supervised Cross-View Training For Sentence EmbeddingTransactions of the Association for Computational Linguistics (TACL), 2023
Peerat Limkonchotiwat
Wuttikorn Ponwitayarat
Lalita Lowphansirikul
Can Udomcharoenchaikit
Ekapol Chuangsuwanich
Sarana Nutanong
SSLAI4TS
201
5
0
06 Nov 2023
DebCSE: Rethinking Unsupervised Contrastive Sentence Embedding Learning in the Debiasing Perspective
DebCSE: Rethinking Unsupervised Contrastive Sentence Embedding Learning in the Debiasing PerspectiveInternational Conference on Information and Knowledge Management (CIKM), 2023
Pu Miao
Zeyao Du
Junlin Zhang
SSL
200
8
0
14 Sep 2023
Text Matching Improves Sequential Recommendation by Reducing Popularity Biases
Text Matching Improves Sequential Recommendation by Reducing Popularity BiasesInternational Conference on Information and Knowledge Management (CIKM), 2023
Zhenghao Liu
Senkun Mei
Chenyan Xiong
Xiaohua Li
Shi Yu
Zhiyuan Liu
Yu Gu
Ge Yu
231
36
0
27 Aug 2023
Challenging Decoder helps in Masked Auto-Encoder Pre-training for Dense Passage Retrieval
Challenging Decoder helps in Masked Auto-Encoder Pre-training for Dense Passage Retrieval
Zehan Li
Yanzhao Zhang
Dingkun Long
Pengjun Xie
RALM
211
3
0
22 May 2023
Distilling Semantic Concept Embeddings from Contrastively Fine-Tuned Language Models
Distilling Semantic Concept Embeddings from Contrastively Fine-Tuned Language ModelsAnnual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2023
Na Li
Hanane Kteich
Zied Bouraoui
Steven Schockaert
201
11
0
16 May 2023
Unsupervised Sentence Representation Learning with Frequency-induced Adversarial Tuning and Incomplete Sentence Filtering
Unsupervised Sentence Representation Learning with Frequency-induced Adversarial Tuning and Incomplete Sentence FilteringNeural Networks (Neural Netw.), 2023
Bing Wang
Ximing Li
Zhiyao Yang
Yuanyuan Guan
Jiayin Li
Sheng-sheng Wang
207
8
0
15 May 2023
Compressing Sentence Representation with maximum Coding Rate Reduction
Compressing Sentence Representation with maximum Coding Rate ReductionInternational Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), 2023
Domagoj Ševerdija
Tomislav Prusina
Antonio Jovanovic
Luka Borozan
Jurica Maltar
Domagoj Matijević
201
2
0
25 Apr 2023
Improving Speech Translation by Cross-Modal Multi-Grained Contrastive Learning
Improving Speech Translation by Cross-Modal Multi-Grained Contrastive LearningIEEE/ACM Transactions on Audio Speech and Language Processing (TASLP), 2023
Hao Zhang
Nianwen Si
Yaqi Chen
Wenlin Zhang
Xukui Yang
Dan Qu
Weiqiang Zhang
194
17
0
20 Apr 2023
ESimCSE Unsupervised Contrastive Learning Jointly with UDA Semi-Supervised Learning for Large Label System Text Classification Mode
ESimCSE Unsupervised Contrastive Learning Jointly with UDA Semi-Supervised Learning for Large Label System Text Classification Mode
Ruan Lu
Zhou Hangcheng
Ran Meng
Zhao Jin
Qin JiaoYu
Wei Feng
Wang ChenZi
198
1
0
19 Apr 2023
Graph2topic: an opensource topic modeling framework based on sentence embedding and community detection
Graph2topic: an opensource topic modeling framework based on sentence embedding and community detection
Leihan Zhang
Jiapeng Liu
Qiang Yan
211
2
0
13 Apr 2023
ESCL: Equivariant Self-Contrastive Learning for Sentence Representations
ESCL: Equivariant Self-Contrastive Learning for Sentence RepresentationsIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023
Jie Liu
Yixuan Liu
Xue Han
Chao Deng
Junlan Feng
SSL
154
3
0
09 Mar 2023
CTRLStruct: Dialogue Structure Learning for Open-Domain Response Generation
CTRLStruct: Dialogue Structure Learning for Open-Domain Response GenerationThe Web Conference (WWW), 2023
Congchi Yin
Pijian Li
Zhaochun Ren
177
12
0
02 Mar 2023
Weighted Sampling for Masked Language Modeling
Weighted Sampling for Masked Language ModelingIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023
Linhan Zhang
Qian Chen
Wen Wang
Chong Deng
Xin Cao
Kongzhang Hao
Yuxin Jiang
Wen Wang
229
5
0
28 Feb 2023
NoPPA: Non-Parametric Pairwise Attention Random Walk Model for Sentence Representation
NoPPA: Non-Parametric Pairwise Attention Random Walk Model for Sentence Representation
Xuansheng Wu
Zhiyi Zhao
Ninghao Liu
145
0
0
24 Feb 2023
Bag of Tricks for Effective Language Model Pretraining and Downstream Adaptation: A Case Study on GLUE
Bag of Tricks for Effective Language Model Pretraining and Downstream Adaptation: A Case Study on GLUE
Qihuang Zhong
Liang Ding
Keqin Peng
Juhua Liu
Bo Du
Li Shen
Yibing Zhan
Dacheng Tao
VLM
106
15
0
18 Feb 2023
Representation biases in sentence transformers
Representation biases in sentence transformersConference of the European Chapter of the Association for Computational Linguistics (EACL), 2023
Dmitry Nikolaev
Sebastian Padó
134
10
0
30 Jan 2023
Global Flood Prediction: a Multimodal Machine Learning Approach
Global Flood Prediction: a Multimodal Machine Learning Approach
C. Zeng
Dimitris Bertsimas
AI4CE
193
10
0
29 Jan 2023
MED-SE: Medical Entity Definition-based Sentence Embedding
MED-SE: Medical Entity Definition-based Sentence Embedding
Hyeonbin Hwang
Haanju Yoo
Yera Choi
MedIm
259
0
0
09 Dec 2022
L3Cube-MahaSBERT and HindSBERT: Sentence BERT Models and Benchmarking BERT Sentence Representations for Hindi and Marathi
L3Cube-MahaSBERT and HindSBERT: Sentence BERT Models and Benchmarking BERT Sentence Representations for Hindi and Marathi
Ananya Joshi
Aditi Kajale
Janhavi Gadre
Samruddhi Deode
Raviraj Joshi
205
17
0
21 Nov 2022
Embracing Ambiguity: Improving Similarity-oriented Tasks with Contextual Synonym Knowledge
Embracing Ambiguity: Improving Similarity-oriented Tasks with Contextual Synonym Knowledge
Yongqian Li
Jiaoyan Chen
Hai-Tao Zheng
Tianyu Yu
Xi Chen
Haitao Zheng
190
19
0
20 Nov 2022
An Efficient Active Learning Pipeline for Legal Text Classification
An Efficient Active Learning Pipeline for Legal Text Classification
Sepideh Mamooler
R. Lebret
Stéphane Massonnet
Karl Aberer
AILaw
157
6
0
15 Nov 2022
Using Large Pre-Trained Language Model to Assist FDA in Premarket Medical Device
Using Large Pre-Trained Language Model to Assist FDA in Premarket Medical Device
Zongzhe Xu
LM&MAMedIm
99
0
0
03 Nov 2022
BERT-Flow-VAE: A Weakly-supervised Model for Multi-Label Text Classification
BERT-Flow-VAE: A Weakly-supervised Model for Multi-Label Text ClassificationInternational Conference on Computational Linguistics (COLING), 2022
Ziwen Liu
J. Grau-Bové
Scott Orr
164
2
0
27 Oct 2022
Sentence Representation Learning with Generative Objective rather than Contrastive Objective
Sentence Representation Learning with Generative Objective rather than Contrastive ObjectiveConference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Bohong Wu
Hai Zhao
SSL
153
12
0
16 Oct 2022
Transparency Helps Reveal When Language Models Learn Meaning
Transparency Helps Reveal When Language Models Learn MeaningTransactions of the Association for Computational Linguistics (TACL), 2022
Zhaofeng Wu
William Merrill
Hao Peng
Iz Beltagy
Noah A. Smith
311
11
0
14 Oct 2022
Towards Structure-aware Paraphrase Identification with Phrase Alignment Using Sentence Encoders
Towards Structure-aware Paraphrase Identification with Phrase Alignment Using Sentence EncodersInternational Conference on Computational Linguistics (COLING), 2022
Qiwei Peng
David J. Weir
Julie Weeds
154
4
0
11 Oct 2022
Unsupervised Sentence Textual Similarity with Compositional Phrase Semantics
Unsupervised Sentence Textual Similarity with Compositional Phrase SemanticsInternational Conference on Computational Linguistics (COLING), 2022
Zihao Wang
Jiaheng Dou
Yong Zhang
OT
130
5
0
05 Oct 2022
Regularized Contrastive Learning of Semantic Search
Regularized Contrastive Learning of Semantic SearchNatural Language Processing and Chinese Computing (NLPCC), 2022
Mingxi Tan
Alexis Rolland
Andong Tian
97
0
0
27 Sep 2022
An Information Minimization Based Contrastive Learning Model for Unsupervised Sentence Embeddings Learning
An Information Minimization Based Contrastive Learning Model for Unsupervised Sentence Embeddings LearningInternational Conference on Computational Linguistics (COLING), 2022
Shaobin Chen
Jie Zhou
Yuling Sun
Liang He
SSL
131
11
0
22 Sep 2022
Don't Judge a Language Model by Its Last Layer: Contrastive Learning with Layer-Wise Attention Pooling
Don't Judge a Language Model by Its Last Layer: Contrastive Learning with Layer-Wise Attention PoolingInternational Conference on Computational Linguistics (COLING), 2022
Dongsuk Oh
Yejin Kim
Hodong Lee
Huimin Huang
Heu-Jeoung Lim
152
14
0
13 Sep 2022
Block-SCL: Blocking Matters for Supervised Contrastive Learning in Product Matching
Block-SCL: Blocking Matters for Supervised Contrastive Learning in Product Matching
Mario Almagro
David Jiménez-Cabello
Diego Ortego
Emilio Almazán
Eva Martínez
131
4
0
05 Jul 2022
Towards Universal Sequence Representation Learning for Recommender Systems
Towards Universal Sequence Representation Learning for Recommender SystemsKnowledge Discovery and Data Mining (KDD), 2022
Yupeng Hou
Shanlei Mu
Wayne Xin Zhao
Yaliang Li
Bolin Ding
Ji-Rong Wen
AI4TS
252
279
0
13 Jun 2022
Improving Contrastive Learning of Sentence Embeddings with Case-Augmented Positives and Retrieved Negatives
Improving Contrastive Learning of Sentence Embeddings with Case-Augmented Positives and Retrieved NegativesAnnual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2022
Wei Wang
Liangzhu Ge
Jingqiao Zhang
Cheng Yang
149
25
0
06 Jun 2022
E2S2: Encoding-Enhanced Sequence-to-Sequence Pretraining for Language Understanding and Generation
E2S2: Encoding-Enhanced Sequence-to-Sequence Pretraining for Language Understanding and GenerationIEEE Transactions on Knowledge and Data Engineering (TKDE), 2022
Qihuang Zhong
Liang Ding
Juhua Liu
Bo Du
Dacheng Tao
213
29
0
30 May 2022
Problems with Cosine as a Measure of Embedding Similarity for High Frequency Words
Problems with Cosine as a Measure of Embedding Similarity for High Frequency WordsAnnual Meeting of the Association for Computational Linguistics (ACL), 2022
Kaitlyn Zhou
Kawin Ethayarajh
Dallas Card
Dan Jurafsky
184
83
0
10 May 2022
Sentence-level Privacy for Document Embeddings
Sentence-level Privacy for Document EmbeddingsAnnual Meeting of the Association for Computational Linguistics (ACL), 2022
Casey Meehan
Khalil Mrini
Kamalika Chaudhuri
153
24
0
10 May 2022
Label Anchored Contrastive Learning for Language Understanding
Label Anchored Contrastive Learning for Language UnderstandingNorth American Chapter of the Association for Computational Linguistics (NAACL), 2022
Zhenyu Zhang
Yuming Zhao
Meng Chen
Xiaodong He
169
17
0
26 Apr 2022
Flow-Adapter Architecture for Unsupervised Machine Translation
Flow-Adapter Architecture for Unsupervised Machine TranslationAnnual Meeting of the Association for Computational Linguistics (ACL), 2022
Yihong Liu
Haris Jabbar
Hinrich Schütze
AI4CE
129
9
0
26 Apr 2022
DiffCSE: Difference-based Contrastive Learning for Sentence Embeddings
DiffCSE: Difference-based Contrastive Learning for Sentence EmbeddingsNorth American Chapter of the Association for Computational Linguistics (NAACL), 2022
Yung-Sung Chuang
Rumen Dangovski
Hongyin Luo
Yang Zhang
Shiyu Chang
M. Soljavcić
Shang-Wen Li
Anuj Kumar
Yoon Kim
James R. Glass
221
251
0
21 Apr 2022
Retrieval of Scientific and Technological Resources for Experts and Scholars
Retrieval of Scientific and Technological Resources for Experts and Scholars
Suyu Ouyang
Yingxia Shao
Ang Li
153
0
0
13 Apr 2022
Knowledge Graph and Accurate Portrait Construction of Scientific and Technological Academic Conferences
Knowledge Graph and Accurate Portrait Construction of Scientific and Technological Academic Conferences
Runyu Yu
Zhe Xue
Ang Li
88
0
0
11 Apr 2022
Semantic Similarity Computing for Scientific Academic Conferences fused with domain features
Semantic Similarity Computing for Scientific Academic Conferences fused with domain features
Runyu Yu
Yawen Li
Ang Li
116
1
0
21 Mar 2022
Contrastive Learning of Sociopragmatic Meaning in Social Media
Contrastive Learning of Sociopragmatic Meaning in Social MediaAnnual Meeting of the Association for Computational Linguistics (ACL), 2022
Chiyu Zhang
Muhammad Abdul-Mageed
Ganesh Jawahar
332
2
0
15 Mar 2022
Just Rank: Rethinking Evaluation with Word and Sentence Similarities
Just Rank: Rethinking Evaluation with Word and Sentence SimilaritiesAnnual Meeting of the Association for Computational Linguistics (ACL), 2022
Sijin Yu
C.-C. Jay Kuo
Haizhou Li
ELM
193
32
0
05 Mar 2022
Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning
Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation LearningNeural Information Processing Systems (NeurIPS), 2022
Weixin Liang
Yuhui Zhang
Yongchan Kwon
Serena Yeung
James Zou
VLM
422
588
0
03 Mar 2022