ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1909.11942
  4. Cited By
ALBERT: A Lite BERT for Self-supervised Learning of Language
  Representations
v1v2v3v4v5v6 (latest)

ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

International Conference on Learning Representations (ICLR), 2019
26 September 2019
Zhenzhong Lan
Mingda Chen
Sebastian Goodman
Kevin Gimpel
Piyush Sharma
Radu Soricut
    SSLAIMat
ArXiv (abs)PDFHTMLGithub (3271★)

Papers citing "ALBERT: A Lite BERT for Self-supervised Learning of Language Representations"

50 / 3,048 papers shown
SKEP: Sentiment Knowledge Enhanced Pre-training for Sentiment Analysis
SKEP: Sentiment Knowledge Enhanced Pre-training for Sentiment Analysis
Hao Tian
Can Gao
Xinyan Xiao
Hao Liu
Bolei He
Hua Wu
Haifeng Wang
Feng Wu
232
267
0
12 May 2020
How Context Affects Language Models' Factual Predictions
How Context Affects Language Models' Factual Predictions
Fabio Petroni
Patrick Lewis
Aleksandra Piktus
Tim Rocktaschel
Yuxiang Wu
Alexander H. Miller
Sebastian Riedel
KELM
214
252
0
10 May 2020
schuBERT: Optimizing Elements of BERT
schuBERT: Optimizing Elements of BERT
A. Khetan
Zohar Karnin
197
32
0
09 May 2020
Modeling Document Interactions for Learning to Rank with Regularized
  Self-Attention
Modeling Document Interactions for Learning to Rank with Regularized Self-Attention
Shuo Sun
Kevin Duh
93
5
0
08 May 2020
Detecting East Asian Prejudice on Social Media
Detecting East Asian Prejudice on Social Media
Bertie Vidgen
Austin Botelho
David A. Broniatowski
E. Guest
Matthew Hall
Helen Z. Margetts
Rebekah Tromble
Zeerak Talat
Scott A. Hale
145
107
0
08 May 2020
Distilling Knowledge from Pre-trained Language Models via Text Smoothing
Distilling Knowledge from Pre-trained Language Models via Text Smoothing
Xing Wu
Zichen Liu
Xiangyang Zhou
Dianhai Yu
124
6
0
08 May 2020
SUPERT: Towards New Frontiers in Unsupervised Evaluation Metrics for
  Multi-Document Summarization
SUPERT: Towards New Frontiers in Unsupervised Evaluation Metrics for Multi-Document Summarization
Yang Gao
Wei Zhao
Steffen Eger
ELM
230
134
0
07 May 2020
The Cascade Transformer: an Application for Efficient Answer Sentence
  Selection
The Cascade Transformer: an Application for Efficient Answer Sentence SelectionAnnual Meeting of the Association for Computational Linguistics (ACL), 2020
Luca Soldaini
Alessandro Moschitti
169
45
0
05 May 2020
ESG2Risk: A Deep Learning Framework from ESG News to Stock Volatility
  Prediction
ESG2Risk: A Deep Learning Framework from ESG News to Stock Volatility PredictionSocial Science Research Network (SSRN), 2020
Tian Guo
N. Jamet
Valentin Betrix
Louis-Alexandre Piquet
E. Hauptmann
AIFin
104
35
0
05 May 2020
Establishing Baselines for Text Classification in Low-Resource Languages
Establishing Baselines for Text Classification in Low-Resource Languages
Jan Christian Blaise Cruz
C. Cheng
176
45
0
05 May 2020
ImpactCite: An XLNet-based method for Citation Impact Analysis
ImpactCite: An XLNet-based method for Citation Impact AnalysisInternational Conference on Agents and Artificial Intelligence (ICAART), 2020
Dominique Mercier
Syed Tahseen Raza Rizvi
Vikas Rajashekar
Andreas Dengel
Sheraz Ahmed
129
20
0
05 May 2020
CAiRE-COVID: A Question Answering and Query-focused Multi-Document
  Summarization System for COVID-19 Scholarly Information Management
CAiRE-COVID: A Question Answering and Query-focused Multi-Document Summarization System for COVID-19 Scholarly Information Management
Jane Polak Scowcroft
Yan Xu
Tiezheng Yu
Farhad Bin Siddique
Elham J. Barezi
Pascale Fung
RALM
138
31
0
04 May 2020
Physical reservoir computing -- An introductory perspective
Physical reservoir computing -- An introductory perspectiveJapanese Journal of Applied Physics (JJAP), 2020
Kohei Nakajima
197
362
0
03 May 2020
Towards Faithful Neural Table-to-Text Generation with Content-Matching
  Constraints
Towards Faithful Neural Table-to-Text Generation with Content-Matching ConstraintsAnnual Meeting of the Association for Computational Linguistics (ACL), 2020
Zhenyi Wang
Xiaoyang Wang
Bang An
Dong Yu
Changyou Chen
LMTD
333
88
0
03 May 2020
Teaching Machine Comprehension with Compositional Explanations
Teaching Machine Comprehension with Compositional ExplanationsFindings (Findings), 2020
Qinyuan Ye
Xiao Huang
Elizabeth Boschee
Xiang Ren
LRMReLM
328
36
0
02 May 2020
ForecastQA: A Question Answering Challenge for Event Forecasting with
  Temporal Text Data
ForecastQA: A Question Answering Challenge for Event Forecasting with Temporal Text DataAnnual Meeting of the Association for Computational Linguistics (ACL), 2020
Woojeong Jin
Rahul Khanna
Suji Kim
Dong-Ho Lee
Fred Morstatter
Aram Galstyan
Xiang Ren
AI4TS
346
48
0
02 May 2020
RICA: Evaluating Robust Inference Capabilities Based on Commonsense
  Axioms
RICA: Evaluating Robust Inference Capabilities Based on Commonsense AxiomsConference on Empirical Methods in Natural Language Processing (EMNLP), 2020
Pei Zhou
Rahul Khanna
Seyeon Lee
Bill Yuchen Lin
Mark A. Lemley
Jay Pujara
Xiang Ren
ReLM
487
39
0
02 May 2020
AVA: an Automatic eValuation Approach to Question Answering Systems
AVA: an Automatic eValuation Approach to Question Answering Systems
Thuy Vu
Alessandro Moschitti
140
15
0
02 May 2020
UnifiedQA: Crossing Format Boundaries With a Single QA System
UnifiedQA: Crossing Format Boundaries With a Single QA SystemFindings (Findings), 2020
Daniel Khashabi
Sewon Min
Tushar Khot
Ashish Sabharwal
Oyvind Tafjord
Peter Clark
Hannaneh Hajishirzi
632
799
0
02 May 2020
Connecting the Dots: A Knowledgeable Path Generator for Commonsense
  Question Answering
Connecting the Dots: A Knowledgeable Path Generator for Commonsense Question AnsweringFindings (Findings), 2020
Peifeng Wang
Nanyun Peng
Filip Ilievski
Pedro A. Szekely
Xiang Ren
203
93
0
02 May 2020
Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question
  Answering
Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question AnsweringConference on Empirical Methods in Natural Language Processing (EMNLP), 2020
Yanlin Feng
Xinyue Chen
Bill Yuchen Lin
Peifeng Wang
Jun Yan
Xiang Ren
LRMKELM
226
266
0
01 May 2020
Probing Contextual Language Models for Common Ground with Visual
  Representations
Probing Contextual Language Models for Common Ground with Visual Representations
Gabriel Ilharco
Rowan Zellers
Ali Farhadi
Hannaneh Hajishirzi
413
14
0
01 May 2020
When BERT Plays the Lottery, All Tickets Are Winning
When BERT Plays the Lottery, All Tickets Are WinningConference on Empirical Methods in Natural Language Processing (EMNLP), 2020
Sai Prasanna
Anna Rogers
Anna Rumshisky
MILM
307
200
0
01 May 2020
Topological Sort for Sentence Ordering
Topological Sort for Sentence OrderingAnnual Meeting of the Association for Computational Linguistics (ACL), 2020
Shrimai Prabhumoye
Ruslan Salakhutdinov
A. Black
176
54
0
01 May 2020
Visuo-Linguistic Question Answering (VLQA) Challenge
Visuo-Linguistic Question Answering (VLQA) Challenge
Shailaja Keyur Sampat
Yezhou Yang
Chitta Baral
CoGe
138
1
0
01 May 2020
Self-supervised Knowledge Triplet Learning for Zero-shot Question
  Answering
Self-supervised Knowledge Triplet Learning for Zero-shot Question AnsweringConference on Empirical Methods in Natural Language Processing (EMNLP), 2020
Pratyay Banerjee
Chitta Baral
249
67
0
01 May 2020
HERO: Hierarchical Encoder for Video+Language Omni-representation
  Pre-training
HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-trainingConference on Empirical Methods in Natural Language Processing (EMNLP), 2020
Linjie Li
Yen-Chun Chen
Yu Cheng
Zhe Gan
Licheng Yu
Jingjing Liu
MLLMVLMOffRLAI4TS
707
539
0
01 May 2020
A Matter of Framing: The Impact of Linguistic Formalism on Probing
  Results
A Matter of Framing: The Impact of Linguistic Formalism on Probing ResultsConference on Empirical Methods in Natural Language Processing (EMNLP), 2020
Ilia Kuznetsov
Iryna Gurevych
114
28
0
30 Apr 2020
Segatron: Segment-Aware Transformer for Language Modeling and
  Understanding
Segatron: Segment-Aware Transformer for Language Modeling and Understanding
Richard He Bai
Peng Shi
Jimmy J. Lin
Yuqing Xie
Luchen Tan
Kun Xiong
Wen Gao
Ming Li
158
8
0
30 Apr 2020
MuSe 2020 -- The First International Multimodal Sentiment Analysis in
  Real-life Media Challenge and Workshop
MuSe 2020 -- The First International Multimodal Sentiment Analysis in Real-life Media Challenge and Workshop
Lukas Stappen
Alice Baird
Georgios Rizos
Panagiotis Tzirakis
Xinchen Du
...
Adria Mallol-Ragolta
Björn W. Schuller
I. Lefter
Xiaoshi Zhong
Y. Kompatsiaris
171
13
0
30 Apr 2020
Enriched Pre-trained Transformers for Joint Slot Filling and Intent
  Detection
Enriched Pre-trained Transformers for Joint Slot Filling and Intent DetectionRecent Advances in Natural Language Processing (RANLP), 2020
Momchil Hardalov
Ivan Koychev
Preslav Nakov
VLM
169
20
0
30 Apr 2020
Question Rewriting for Conversational Question Answering
Question Rewriting for Conversational Question AnsweringWeb Search and Data Mining (WSDM), 2020
Svitlana Vakulenko
Shayne Longpre
Zhucheng Tu
R. Anantha
237
198
0
30 Apr 2020
RikiNet: Reading Wikipedia Pages for Natural Question Answering
RikiNet: Reading Wikipedia Pages for Natural Question AnsweringAnnual Meeting of the Association for Computational Linguistics (ACL), 2020
Dayiheng Liu
Yeyun Gong
Jie Fu
Yu Yan
Jiusheng Chen
Daxin Jiang
Jiancheng Lv
Nan Duan
RALM
159
58
0
30 Apr 2020
WT5?! Training Text-to-Text Models to Explain their Predictions
WT5?! Training Text-to-Text Models to Explain their Predictions
Sharan Narang
Colin Raffel
Katherine Lee
Adam Roberts
Noah Fiedel
Karishma Malkan
209
213
0
30 Apr 2020
Asking without Telling: Exploring Latent Ontologies in Contextual
  Representations
Asking without Telling: Exploring Latent Ontologies in Contextual RepresentationsConference on Empirical Methods in Natural Language Processing (EMNLP), 2020
Julian Michael
Jan A. Botha
Ian Tenney
321
44
0
29 Apr 2020
What Happens To BERT Embeddings During Fine-tuning?
What Happens To BERT Embeddings During Fine-tuning?BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP), 2020
Amil Merchant
Elahe Rahimtoroghi
Ellie Pavlick
Ian Tenney
244
206
0
29 Apr 2020
General Purpose Text Embeddings from Pre-trained Language Models for
  Scalable Inference
General Purpose Text Embeddings from Pre-trained Language Models for Scalable InferenceFindings (Findings), 2020
Jingfei Du
Myle Ott
Haoran Li
Xing Zhou
Veselin Stoyanov
AI4CE
130
10
0
29 Apr 2020
Zero-Shot Learning and its Applications from Autonomous Vehicles to
  COVID-19 Diagnosis: A Review
Zero-Shot Learning and its Applications from Autonomous Vehicles to COVID-19 Diagnosis: A ReviewIntelligent Medicine (IM), 2020
Mahdi Rezaei
Mahsa Shahidi
354
61
0
29 Apr 2020
Benchmarking Robustness of Machine Reading Comprehension Models
Benchmarking Robustness of Machine Reading Comprehension ModelsFindings (Findings), 2020
Chenglei Si
Ziqing Yang
Yiming Cui
Wentao Ma
Ting Liu
Shijin Wang
ELMAAML
226
44
0
29 Apr 2020
Knowledgeable Dialogue Reading Comprehension on Key Turns
Knowledgeable Dialogue Reading Comprehension on Key Turns
Junlong Li
Zhuosheng Zhang
Hai Zhao
231
1
0
29 Apr 2020
BURT: BERT-inspired Universal Representation from Twin Structure
BURT: BERT-inspired Universal Representation from Twin Structure
Yian Li
Hai Zhao
104
0
0
29 Apr 2020
Revisiting Pre-Trained Models for Chinese Natural Language Processing
Revisiting Pre-Trained Models for Chinese Natural Language ProcessingFindings (Findings), 2020
Yiming Cui
Wanxiang Che
Ting Liu
Bing Qin
Shijin Wang
Guoping Hu
374
796
0
29 Apr 2020
DomBERT: Domain-oriented Language Model for Aspect-based Sentiment
  Analysis
DomBERT: Domain-oriented Language Model for Aspect-based Sentiment AnalysisFindings (Findings), 2020
Hu Xu
Bing-Quan Liu
Lei Shu
Philip S. Yu
164
56
0
28 Apr 2020
ColBERT: Using BERT Sentence Embedding in Parallel Neural Networks for
  Computational Humor
ColBERT: Using BERT Sentence Embedding in Parallel Neural Networks for Computational HumorExpert systems with applications (ESWA), 2020
Issa Annamoradnejad
Gohar Zoghi
233
36
0
27 Apr 2020
Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less
  Forgetting
Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less ForgettingConference on Empirical Methods in Natural Language Processing (EMNLP), 2020
Sanyuan Chen
Yutai Hou
Yiming Cui
Wanxiang Che
Ting Liu
Xiangzhan Yu
KELMCLL
307
256
0
27 Apr 2020
Cross-lingual Information Retrieval with BERT
Cross-lingual Information Retrieval with BERT
Zhuolin Jiang
A. El-Jaroudi
William Hartmann
Damianos G. Karakos
Lingjun Zhao
142
61
0
24 Apr 2020
Probabilistically Masked Language Model Capable of Autoregressive
  Generation in Arbitrary Word Order
Probabilistically Masked Language Model Capable of Autoregressive Generation in Arbitrary Word Order
Yi-Lun Liao
Xin Jiang
Qun Liu
113
41
0
24 Apr 2020
UHH-LT at SemEval-2020 Task 12: Fine-Tuning of Pre-Trained Transformer
  Networks for Offensive Language Detection
UHH-LT at SemEval-2020 Task 12: Fine-Tuning of Pre-Trained Transformer Networks for Offensive Language Detection
Gregor Wiedemann
Seid Muhie Yimam
Christian Biemann
257
29
0
23 Apr 2020
DuReader_robust: A Chinese Dataset Towards Evaluating Robustness and
  Generalization of Machine Reading Comprehension in Real-World Applications
DuReader_robust: A Chinese Dataset Towards Evaluating Robustness and Generalization of Machine Reading Comprehension in Real-World Applications
Hongxuan Tang
Hongyu Li
Jing Liu
Yu Hong
Hua Wu
Haifeng Wang
122
22
0
23 Apr 2020
QURIOUS: Question Generation Pretraining for Text Generation
QURIOUS: Question Generation Pretraining for Text Generation
Shashi Narayan
Gonçalo Simães
Ji Ma
Hannah Craighead
Ryan T. McDonald
167
16
0
23 Apr 2020
Previous
123...5758596061
Next
Page 58 of 61
Pageof 61