Contextual Representation Learning beyond Masked Language Modeling

Contextual Representation Learning beyond Masked Language Modeling

8 April 2022

Wangchunshu Zhou

Lei Li

Papers citing "Contextual Representation Learning beyond Masked Language Modeling"

18 / 18 papers shown

Title
Confidence Regularized Masked Language Modeling using Text Length Seunghyun Ji Soowon Lee 29 0 0 08 Apr 2025
SMI-Editor: Edit-based SMILES Language Model with Fragment-level Supervision Kangjie Zheng Siyue Liang Junwei Yang Bin Feng Zequn Liu Wei Ju Zhiping Xiao Ming Zhang 70 1 0 07 Dec 2024
Prompt-based Logical Semantics Enhancement for Implicit Discourse Relation Recognition Chenxu Wang Ping Jian Mu Huang 11 5 0 01 Nov 2023
Exploring the Landscape of Natural Language Processing Research Tim Schopf Karim Arabi Florian Matthes 21 13 0 20 Jul 2023
RARE: Robust Masked Graph Autoencoder Wenxuan Tu Qing Liao Sihang Zhou Xin Peng Chuan Ma Zhe Liu Xinwang Liu Zhiping Cai 29 12 0 04 Apr 2023
Cross-Modal Implicit Relation Reasoning and Aligning for Text-to-Image Person Retrieval Ding Jiang Mang Ye 19 140 0 22 Mar 2023
EDMAE: An Efficient Decoupled Masked Autoencoder for Standard View Identification in Pediatric Echocardiography Yiman Liu Xiaoxiang Han Tongtong Liang Bin Dong Jiajun Yuan Menghan Hu Qiaohong Liu Jiangang Chen Qingli Li Yuqi Zhang 19 5 0 27 Feb 2023
Aerial Image Object Detection With Vision Transformer Detector (ViTDet) Liya Wang A. Tien 37 7 0 28 Jan 2023
Adapting a Language Model While Preserving its General Knowledge Zixuan Ke Yijia Shao Haowei Lin Hu Xu Lei Shu Bin Liu KELM CLL VLM 25 20 0 21 Jan 2023
SESCORE2: Learning Text Generation Evaluation via Synthesizing Realistic Mistakes Wenda Xu Xian Qian Mingxuan Wang Lei Li William Yang Wang 18 10 0 19 Dec 2022
Multi-CLS BERT: An Efficient Alternative to Traditional Ensembling Haw-Shiuan Chang Ruei-Yao Sun Kathryn Ricci Andrew McCallum 37 14 0 10 Oct 2022
Write and Paint: Generative Vision-Language Models are Unified Modal Learners Shizhe Diao Wangchunshu Zhou Xinsong Zhang Jiawei Wang MLLM AI4CE 14 16 0 15 Jun 2022
Cross-View Language Modeling: Towards Unified Cross-Lingual Cross-Modal Pre-training Yan Zeng Wangchunshu Zhou Ao Luo Ziming Cheng Xinsong Zhang VLM 17 30 0 01 Jun 2022
VLUE: A Multi-Task Benchmark for Evaluating Vision-Language Models Wangchunshu Zhou Yan Zeng Shizhe Diao Xinsong Zhang CoGe VLM 21 13 0 30 May 2022
Cross-modal Contrastive Learning for Speech Translation Rong Ye Mingxuan Wang Lei Li SSL 19 84 0 05 May 2022
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 243 1,450 0 18 Mar 2020
A Mutual Information Maximization Perspective of Language Representation Learning Lingpeng Kong Cyprien de Masson dÁutume Wang Ling Lei Yu Zihang Dai Dani Yogatama SSL 212 165 0 18 Oct 2019
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 294 6,950 0 20 Apr 2018