SentEval: An Evaluation Toolkit for Universal Sentence Representations

14 March 2018

Douwe Kiela

Papers citing "SentEval: An Evaluation Toolkit for Universal Sentence Representations"

50 / 110 papers shown

Title
How does the pre-training objective affect what large language models learn about linguistic properties? Ahmed Alajrami Nikolaos Aletras 26 20 0 20 Mar 2022
SCD: Self-Contrastive Decorrelation for Sentence Embeddings T. Klein Moin Nabi SSL 33 25 0 15 Mar 2022
Just Rank: Rethinking Evaluation with Word and Sentence Similarities Bin Wang C.-C. Jay Kuo Haizhou Li ELM 19 29 0 05 Mar 2022
Comparison and Combination of Sentence Embeddings Derived from Different Supervision Signals Hayato Tsukagoshi Ryohei Sasano Koichi Takeda 12 8 0 07 Feb 2022
Text and Code Embeddings by Contrastive Pre-Training Arvind Neelakantan Tao Xu Raul Puri Alec Radford Jesse Michael Han ... Tabarak Khan Toki Sherbakov Joanne Jang Peter Welinder Lilian Weng SSL AI4TS 218 422 0 24 Jan 2022
Towards Efficient NLP: A Standard Evaluation and A Strong Baseline Xiangyang Liu Tianxiang Sun Junliang He Jiawen Wu Lingling Wu Xinyu Zhang Hao Jiang Zhao Cao Xuanjing Huang Xipeng Qiu ELM 28 46 0 13 Oct 2021
The Inductive Bias of In-Context Learning: Rethinking Pretraining Example Design Yoav Levine Noam Wies Daniel Jannai D. Navon Yedid Hoshen Amnon Shashua AI4CE 32 36 0 09 Oct 2021
LexGLUE: A Benchmark Dataset for Legal Language Understanding in English Ilias Chalkidis Abhik Jana D. Hartung M. Bommarito Ion Androutsopoulos Daniel Martin Katz Nikolaos Aletras AILaw ELM 130 248 0 03 Oct 2021
A Temporal Variational Model for Story Generation David Wilmot Frank Keller DRL 35 8 0 14 Sep 2021
A Simple and Effective Method To Eliminate the Self Language Bias in Multilingual Representations Ziyi Yang Yinfei Yang Daniel Matthew Cer Eric F. Darve 30 22 0 10 Sep 2021
Augmenting BERT-style Models with Predictive Coding to Improve Discourse-level Representations Vladimir Araujo Andrés Villa Marcelo Mendoza Marie-Francine Moens Alvaro Soto 24 7 0 10 Sep 2021
Aligning Cross-lingual Sentence Representations with Dual Momentum Contrast Liang Wang Wei-Ye Zhao Jingming Liu 32 14 0 01 Sep 2021
LOT: A Story-Centric Benchmark for Evaluating Chinese Long Text Understanding and Generation Jian-Yu Guan Zhuoer Feng Yamei Chen Ru He Xiaoxi Mao Changjie Fan Minlie Huang 36 31 0 30 Aug 2021
Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Models Jianmo Ni Gustavo Hernández Ábrego Noah Constant Ji Ma Keith B. Hall Daniel Matthew Cer Yinfei Yang 46 527 0 19 Aug 2021
Czech News Dataset for Semantic Textual Similarity Jakub Sido Michal Seják O. Pražák Miloslav Konopík Václav Moravec 24 3 0 19 Aug 2021
Adversarial Training Helps Transfer Learning via Better Representations Zhun Deng Linjun Zhang Kailas Vodrahalli Kenji Kawaguchi James Y. Zou GAN 36 52 0 18 Jun 2021
CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmark Ningyu Zhang Mosha Chen Zhen Bi Xiaozhuan Liang Lei Li ... Jun Yan Hongying Zan Kunli Zhang Buzhou Tang Qingcai Chen LM&MA ELM 34 179 0 15 Jun 2021
Self-Guided Contrastive Learning for BERT Sentence Representations Taeuk Kim Kang Min Yoo Sang-goo Lee SSL 36 202 0 03 Jun 2021
ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer Yuanmeng Yan Rumei Li Sirui Wang Fuzheng Zhang Wei Yu Wu Weiran Xu SSL 37 546 0 25 May 2021
DefSent: Sentence Embeddings using Definition Sentences Hayato Tsukagoshi Ryohei Sasano Koichi Takeda 11 23 0 10 May 2021
Word2rate: training and evaluating multiple word embeddings as statistical transitions Gary Phua Shaowei Lin Dario Poletti 13 2 0 16 Apr 2021
Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little Koustuv Sinha Robin Jia Dieuwke Hupkes J. Pineau Adina Williams Douwe Kiela 45 243 0 14 Apr 2021
BERT: A Review of Applications in Natural Language Processing and Understanding M. V. Koroteev VLM 25 194 0 22 Mar 2021
CLEAR: Contrastive Learning for Sentence Representation Zhuofeng Wu Sinong Wang Jiatao Gu Madian Khabsa Fei Sun Hao Ma SSL 33 319 0 31 Dec 2020
Universal Sentence Representation Learning with Conditional Masked Language Model Ziyi Yang Yinfei Yang Daniel Matthew Cer Jax Law Eric F. Darve SSL 24 57 0 28 Dec 2020
GLGE: A New General Language Generation Evaluation Benchmark Dayiheng Liu Yu Yan Yeyun Gong Weizhen Qi Hang Zhang ... Jiancheng Lv Ruofei Zhang Winnie Wu Ming Zhou Nan Duan ELM 37 66 0 24 Nov 2020
Positional Artefacts Propagate Through Masked Language Model Embeddings Ziyang Luo Artur Kulmizev Xiaoxi Mao 24 41 0 09 Nov 2020
Know What You Don't Need: Single-Shot Meta-Pruning for Attention Heads Zhengyan Zhang Fanchao Qi Zhiyuan Liu Qun Liu Maosong Sun VLM 36 30 0 07 Nov 2020
On the Sentence Embeddings from Pre-trained Language Models Bohan Li Hao Zhou Junxian He Mingxuan Wang Yiming Yang Lei Li 8 213 0 02 Nov 2020
TweetEval: Unified Benchmark and Comparative Evaluation for Tweet Classification Francesco Barbieri Jose Camacho-Collados Leonardo Neves Luis Espinosa-Anke VLM 21 698 0 23 Oct 2020
Do Adversarially Robust ImageNet Models Transfer Better? Hadi Salman Andrew Ilyas Logan Engstrom Ashish Kapoor A. Madry 37 416 0 16 Jul 2020
DiscSense: Automated Semantic Analysis of Discourse Markers Damien Sileo Tim Van de Cruys Camille Pradel Philippe Muller 11 7 0 02 Jun 2020
AdapterFusion: Non-Destructive Task Composition for Transfer Learning Jonas Pfeiffer Aishwarya Kamath Andreas Rucklé Kyunghyun Cho Iryna Gurevych CLL MoMe 21 816 0 01 May 2020
Probing Linguistic Features of Sentence-Level Representations in Neural Relation Extraction Christoph Alt Aleksandra Gabryszak Leonhard Hennig NAI 13 34 0 17 Apr 2020
CLUE: A Chinese Language Understanding Evaluation Benchmark Liang Xu Hai Hu Xuanwei Zhang Lu Li Chenjie Cao ... Cong Yue Xinrui Zhang Zhen-Yi Yang Kyle Richardson Zhenzhong Lan ELM 33 377 0 13 Apr 2020
Embedding Compression with Isotropic Iterative Quantization Siyu Liao Jie Chen Yanzhi Wang Qinru Qiu Bo Yuan MQ 23 11 0 11 Jan 2020
Generalizing Natural Language Analysis through Span-relation Representations Zhengbao Jiang W. Xu Jun Araki Graham Neubig 30 60 0 10 Nov 2019
Sentence Meta-Embeddings for Unsupervised Semantic Textual Similarity Nina Poerner Ulli Waltinger Hinrich Schütze AI4TS 27 20 0 09 Nov 2019
Evaluation of Sentence Representations in Polish Slawomir Dadas Michal Perelkiewicz Rafal Poswiata 16 13 0 25 Oct 2019
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 86 19,422 0 23 Oct 2019
Discovering the Compositional Structure of Vector Representations with Role Learning Networks Paul Soulos R. Thomas McCoy Tal Linzen P. Smolensky CoGe 29 43 0 21 Oct 2019
Improving Sequence Modeling Ability of Recurrent Neural Networks via Sememes Yujia Qin Fanchao Qi Sicong Ouyang Zhiyuan Liu Cheng Yang Yasheng Wang Qun Liu Maosong Sun 28 5 0 20 Oct 2019
Universal Text Representation from BERT: An Empirical Study Xiaofei Ma Zhiguo Wang Patrick K. L. Ng Ramesh Nallapati Bing Xiang OOD 21 65 0 17 Oct 2019
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks Nils Reimers Iryna Gurevych 42 11,666 0 27 Aug 2019
Supervise Thyself: Examining Self-Supervised Representations in Interactive Environments Evan Racah C. Pal SSL 24 2 0 27 Jun 2019
Learning Compressed Sentence Representations for On-Device Text Processing Dinghan Shen Pengyu Cheng Dhanasekar Sundararaman Xinyuan Zhang Qian Yang Meng Tang Asli Celikyilmaz Lawrence Carin 18 22 0 19 Jun 2019
PyRobot: An Open-source Robotics Framework for Research and Benchmarking Adithyavairavan Murali Tao Chen Kalyan Vasudev Alwala Dhiraj Gandhi Lerrel Pinto Saurabh Gupta Abhinav Gupta 29 107 0 19 Jun 2019
Unsupervised State Representation Learning in Atari Ankesh Anand Evan Racah Sherjil Ozair Yoshua Bengio Marc-Alexandre Côté R. Devon Hjelm SSL 27 253 0 19 Jun 2019
BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questions Christopher Clark Kenton Lee Ming-Wei Chang Tom Kwiatkowski Michael Collins Kristina Toutanova 52 1,388 0 24 May 2019
Correlation Coefficients and Semantic Textual Similarity V. Zhelezniak Aleksandar Savkov April Shen Nils Y. Hammerla 19 50 0 19 May 2019