SentEval: An Evaluation Toolkit for Universal Sentence Representations

14 March 2018

Douwe Kiela

Papers citing "SentEval: An Evaluation Toolkit for Universal Sentence Representations"

50 / 107 papers shown

Title
ChemTEB: Chemical Text Embedding Benchmark, an Overview of Embedding Models Performance & Efficiency on a Specific Domain Ali Shiraee Kasmaee Mohammad Khodadad Mohammad Arshi Saloot Nick Sherck Stephen Dokas H. Mahyar Soheila Samiee ELM 168 0 0 30 Nov 2024
GenEOL: Harnessing the Generative Power of LLMs for Training-Free Sentence Embeddings Raghuveer Thirukovalluru Bhuwan Dhingra 34 2 0 18 Oct 2024
Pixology: Probing the Linguistic and Visual Capabilities of Pixel-based Language Models Kushal Tatariya Vladimir Araujo Thomas Bauwens Miryam de Lhoneux VLM 33 0 0 15 Oct 2024
GLOV: Guided Large Language Models as Implicit Optimizers for Vision Language Models Muhammad Jehanzeb Mirza Mengjie Zhao Zhuoyuan Mao Sivan Doveh Wei Lin ... Yuki Mitsufuji Horst Possegger Rogerio Feris Leonid Karlinsky James Glass VLM 84 1 0 08 Oct 2024
The Russian-focused embedders' exploration: ruMTEB benchmark and Russian embedding model design Artem Snegirev Maria Tikhonova Anna Maksimova Alena Fenogenova Alexander Abramov 28 4 0 22 Aug 2024
Can't Hide Behind the API: Stealing Black-Box Commercial Embedding Models Manveer Singh Tamber Jasper Xian Jimmy Lin MLAU SILM 148 0 0 13 Jun 2024
The Scandinavian Embedding Benchmarks: Comprehensive Assessment of Multilingual and Monolingual Text Embedding K. Enevoldsen Márton Kardos Niklas Muennighoff Kristoffer Laigaard Nielbo 37 9 0 04 Jun 2024
Unveiling Key Aspects of Fine-Tuning in Sentence Embeddings: A Representation Rank Analysis Euna Jung Jaeill Kim Jungmin Ko Jinwoo Park Wonjong Rhee 50 0 0 18 May 2024
Is Synthetic Image Useful for Transfer Learning? An Investigation into Data Generation, Volume, and Utilization Yuhang Li Xin Dong Chen Chen Jingtao Li Yuxin Wen Michael Spranger Lingjuan Lyu DiffM 30 4 0 28 Mar 2024
UNSEE: Unsupervised Non-contrastive Sentence Embeddings Ömer Veysel Çagatan SSL 24 0 0 27 Jan 2024
Some Like It Small: Czech Semantic Embedding Models for Industry Applications Jirí Bednár Jakub Náplava Petra Barancíková Ondrej Lisický 20 5 0 23 Nov 2023
BeLLM: Backward Dependency Enhanced Large Language Model for Sentence Embeddings Xianming Li Jing Li 45 10 0 09 Nov 2023
Understanding the Role of Input Token Characters in Language Models: How Does Information Loss Affect Performance? Ahmed Alajrami Katerina Margatina Nikolaos Aletras AAML 19 1 0 26 Oct 2023
The Skipped Beat: A Study of Sociopragmatic Understanding in LLMs for 64 Languages Chiyu Zhang Khai Duy Doan Qisheng Liao Muhammad Abdul-Mageed 36 6 0 23 Oct 2023
IDTraffickers: An Authorship Attribution Dataset to link and connect Potential Human-Trafficking Operations on Text Escort Advertisements V. Saxena Benjamin Bashpole Gijs Van Dijck Gerasimos Spanakis 40 2 0 09 Oct 2023
CoT-BERT: Enhancing Unsupervised Sentence Representation through Chain-of-Thought Bowen Zhang Kehua Chang Chunping Li SSL 32 6 0 20 Sep 2023
Benchmarking Procedural Language Understanding for Low-Resource Languages: A Case Study on Turkish Arda Uzunouglu Gözde Gül Sahin 23 4 0 13 Sep 2023
Scaling Sentence Embeddings with Large Language Models Ting Jiang Shaohan Huang Zhongzhi Luan Deqing Wang Fuzhen Zhuang LRM 42 40 0 31 Jul 2023
Instruction-following Evaluation through Verbalizer Manipulation Shiyang Li Jun Yan Hai Wang Zheng Tang Xiang Ren Vijay Srinivasan Hongxia Jin 33 25 0 20 Jul 2023
Morphosyntactic probing of multilingual BERT models Judit Ács Endre Hamerlik Roy Schwartz Noah A. Smith András Kornai 29 9 0 09 Jun 2023
A Comprehensive Survey of Sentence Representations: From the BERT Epoch to the ChatGPT Era and Beyond Abhinav Ramesh Kashyap Thang-Tung Nguyen Viktor Schlegel Stefan Winkler See-Kiong Ng Soujanya Poria AI4TS 3DV SSL 34 6 0 22 May 2023
Automated Few-shot Classification with Instruction-Finetuned Language Models Rami Aly Xingjian Shi Kaixiang Lin Aston Zhang A. Wilson 38 9 0 21 May 2023
Description-Based Text Similarity Shauli Ravfogel Valentina Pyatkin Amir D. N. Cohen Avshalom Manevich Yoav Goldberg 22 5 0 21 May 2023
Prompting with Pseudo-Code Instructions Mayank Mishra Prince Kumar Riyaz Ahmad Bhat V. Rudramurthy Danish Contractor Srikanth G. Tamilselvam 42 13 0 19 May 2023
Semantic Similarity Measure of Natural Language Text through Machine Learning and a Keyword-Aware Cross-Encoder-Ranking Summarizer -- A Case Study Using UCGIS GIS&T Body of Knowledge Yuanyuan Tian Wenwen Li Sizhe Wang Zhining Gu 16 3 0 17 May 2023
DLUE: Benchmarking Document Language Understanding Ruoxi Xu Hongyu Lin Xinyan Guan Xianpei Han Yingfei Sun Le Sun ELM 21 0 0 16 May 2023
Domain Mastery Benchmark: An Ever-Updating Benchmark for Evaluating Holistic Domain Knowledge of Large Language Model--A Preliminary Release Zhouhong Gu Xiaoxuan Zhu Haoning Ye Lin Zhang Zhuozhi Xiong Zihan Li Qi He Sihang Jiang Hongwei Feng Yanghua Xiao ELM ALM 47 2 0 23 Apr 2023
Rediscovering Hashed Random Projections for Efficient Quantization of Contextualized Sentence Embeddings Ulf A. Hamster Ji-Ung Lee Alexander Geyken Iryna Gurevych 21 0 0 13 Mar 2023
Detecting Contextomized Quotes in News Headlines by Contrastive Learning Seonyeong Song Hyeonho Song Kunwoo Park Jiyoung Han M. Cha 19 1 0 09 Feb 2023
Tsetlin Machine Embedding: Representing Words Using Logical Expressions Bimal Bhattarai Ole-Christoffer Granmo Lei Jiao Rohan Kumar Yadav Jivitesh Sharma NAI 11 12 0 02 Jan 2023
One Embedder, Any Task: Instruction-Finetuned Text Embeddings Hongjin Su Weijia Shi Jungo Kasai Yizhong Wang Yushi Hu Mari Ostendorf Wen-tau Yih Noah A. Smith Luke Zettlemoyer Tao Yu 27 278 0 19 Dec 2022
Revisiting Distance Metric Learning for Few-Shot Natural Language Classification Witold Sosnowski Anna Wróblewska Karolina Seweryn P. Gawrysiak 18 0 0 28 Nov 2022
Distance Metric Learning Loss Functions in Few-Shot Scenarios of Supervised Language Models Fine-Tuning Witold Sosnowski Karolina Seweryn Anna Wróblewska P. Gawrysiak 20 0 0 28 Nov 2022
50 Ways to Bake a Cookie: Mapping the Landscape of Procedural Texts Moran Mizrahi Dafna Shahaf DiffM 23 4 0 31 Oct 2022
Universal and Independent: Multilingual Probing Framework for Exhaustive Model Interpretation and Evaluation O. Serikov Vitaly Protasov E. Voloshina V. Knyazkova Tatiana Shavrina 29 3 0 24 Oct 2022
AugCSE: Contrastive Sentence Embedding with Diverse Augmentations Zilu Tang Muhammed Yusuf Kocyigit Derry Wijaya 35 8 0 20 Oct 2022
MTEB: Massive Text Embedding Benchmark Niklas Muennighoff Nouamane Tazi L. Magne Nils Reimers 28 370 0 13 Oct 2022
Analyzing Text Representations under Tight Annotation Budgets: Measuring Structural Alignment César González-Gutiérrez Audi Primadhanty Francesco Cazzaro A. Quattoni 28 0 0 11 Oct 2022
Unsupervised Sentence Textual Similarity with Compositional Phrase Semantics Zihao W. Wang Jiaheng Dou Yong Zhang OT 28 4 0 05 Oct 2022
Efficient Few-Shot Learning Without Prompts Lewis Tunstall Nils Reimers Unso Eun Seo Jo Luke Bates Daniel Korat Moshe Wasserblat Oren Pereg VLM 34 182 0 22 Sep 2022
Ranking-Enhanced Unsupervised Sentence Representation Learning Yeon Seonwoo Guoyin Wang Changmin Seo Sajal Choudhary Jiwei Li Xiang Li Puyang Xu Sunghyun Park Alice H. Oh SSL DRL AI4TS 53 15 0 09 Sep 2022
Masked Autoencoders As The Unified Learners For Pre-Trained Sentence Representation Alexander H. Liu Samuel J. Yang 24 5 0 30 Jul 2022
Knowledge Distillation of Transformer-based Language Models Revisited Chengqiang Lu Jianwei Zhang Yunfei Chu Zhengyu Chen Jingren Zhou Fei Wu Haiqing Chen Hongxia Yang VLM 25 10 0 29 Jun 2022
Evaluating Self-Supervised Learning for Molecular Graph Embeddings Hanchen Wang Jean Kaddour Shengchao Liu Jian Tang Joan Lasenby Qi Liu 27 20 0 16 Jun 2022
A Multi-level Supervised Contrastive Learning Framework for Low-Resource Natural Language Inference Shuang Li Xuming Hu Li Lin Aiwei Liu Lijie Wen Philip S. Yu 33 18 0 31 May 2022
E2S2: Encoding-Enhanced Sequence-to-Sequence Pretraining for Language Understanding and Generation Qihuang Zhong Liang Ding Juhua Liu Bo Du Dacheng Tao 41 27 0 30 May 2022
Parameter-Efficient and Student-Friendly Knowledge Distillation Jun Rao Xv Meng Liang Ding Shuhan Qi Dacheng Tao 37 46 0 28 May 2022
Unsupervised Attention-based Sentence-Level Meta-Embeddings from Contextualised Language Models Keigo Takahashi Danushka Bollegala 42 5 0 16 Apr 2022
Contextual Representation Learning beyond Masked Language Modeling Zhiyi Fu Wangchunshu Zhou Jingjing Xu Hao Zhou Lei Li 28 25 0 08 Apr 2022
How does the pre-training objective affect what large language models learn about linguistic properties? Ahmed Alajrami Nikolaos Aletras 23 20 0 20 Mar 2022