ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

26 September 2019

Papers citing "ALBERT: A Lite BERT for Self-supervised Learning of Language Representations"

50 / 2,911 papers shown

Title
ViWikiFC: Fact-Checking for Vietnamese Wikipedia-Based Textual Knowledge Source Hung Tuan Le Long Truong To Manh Trong Nguyen Kiet Van Nguyen 35 3 0 13 May 2024
DEPTH: Discourse Education through Pre-Training Hierarchically Zachary Bamberger Ofek Glick Chaim Baskin Yonatan Belinkov 59 0 0 13 May 2024
Branching Narratives: Character Decision Points Detection Alexey Tikhonov 27 1 0 12 May 2024
ExplainableDetector: Exploring Transformer-based Language Modeling Approach for SMS Spam Detection with Explainability Analysis Mohammad Amaz Uddin Muhammad Nazrul Islam Leandros A. Maglaras Helge Janicke Iqbal H. Sarker 40 2 0 12 May 2024
SaudiBERT: A Large Language Model Pretrained on Saudi Dialect Corpora Faisal Qarah 36 4 0 10 May 2024
Similarity Guided Multimodal Fusion Transformer for Semantic Location Prediction in Social Media Zhizhen Zhang Ning Wang Haojie Li Zhihui Wang 29 0 0 09 May 2024
A review on discriminative self-supervised learning methods Nikolaos Giakoumoglou Tania Stathaki SSL 49 1 0 08 May 2024
Multi-level Shared Knowledge Guided Learning for Knowledge Graph Completion Yongxue Shan Jie Zhou Jie Peng Xin Zhou Jiaqian Yin Xiaodong Wang 34 2 0 08 May 2024
Switchable Decision: Dynamic Neural Generation Networks Shujian Zhang Korawat Tanwisuth Chengyue Gong Pengcheng He Mi Zhou BDL 36 0 0 07 May 2024
Revisiting character-level adversarial attacks Elias Abad Rocamora Yongtao Wu Fanghui Liu Grigorios G. Chrysos V. Cevher AAML 31 3 0 07 May 2024
LingML: Linguistic-Informed Machine Learning for Enhanced Fake News Detection Jasraj Singh Fang Liu Hong Xu Bee Chin Ng Wei Zhang AI4CE 16 0 0 07 May 2024
Exploring prompts to elicit memorization in masked language model-based named entity recognition Yuxi Xia Anastasiia Sedova Pedro Henrique Luz de Araujo Vasiliki Kougia Lisa Nussbaumer Benjamin Roth 23 1 0 05 May 2024
Enabling Patient-side Disease Prediction via the Integration of Patient Narratives Zhixiang Su Yinan Zhang Jiazheng Jing Jie Xiao Zhiqi Shen 17 0 0 05 May 2024
Hoaxpedia: A Unified Wikipedia Hoax Articles Dataset Hsuvas Borkakoty Luis Espinosa-Anke 28 1 0 03 May 2024
Exploiting ChatGPT for Diagnosing Autism-Associated Language Disorders and Identifying Distinct Features Chuanbo Hu Wenqi Li Mindi Ruan Xiangxu Yu Lynn K. Paul Shuo Wang Xin Li 20 3 0 03 May 2024
Large Language Models for UAVs: Current State and Pathways to the Future Shumaila Javaid Nasir Saeed Bin He 32 16 0 02 May 2024
Enhancing Language Models for Financial Relation Extraction with Named Entities and Part-of-Speech Menglin Li Kwan Hui Lim 38 0 0 02 May 2024
A Named Entity Recognition and Topic Modeling-based Solution for Locating and Better Assessment of Natural Disasters in Social Media Ayaz Mehmood Muhammad Tayyab Zamir Muhammad Asif Ayub Nasir Ahmad Kashif Ahmad 23 1 0 01 May 2024
EfficientASR: Speech Recognition Network Compression via Attention Redundancy and Chunk-Level FFN Optimization Jianzong Wang Ziqi Liang Xulong Zhang Ning Cheng Jing Xiao 30 0 0 30 Apr 2024
Enhancing Pre-Trained Generative Language Models with Question Attended Span Extraction on Machine Reading Comprehension Lin Ai Zheng Hui Zizhou Liu Julia Hirschberg 32 1 0 27 Apr 2024
Transfer Learning Enhanced Single-choice Decision for Multi-choice Question Answering Chenhao Cui Yufan Jiang Shuangzhi Wu Zhoujun Li FaML 19 0 0 27 Apr 2024
CoSD: Collaborative Stance Detection with Contrastive Heterogeneous Topic Graph Learning Yinghan Cheng Qi Zhang Chongyang Shi Liang Xiao Shufeng Hao Liang Hu 40 0 0 26 Apr 2024
Exploring Internal Numeracy in Language Models: A Case Study on ALBERT Ulme Wennberg G. Henter MILM 33 1 0 25 Apr 2024
Exploring Learngene via Stage-wise Weight Sharing for Initializing Variable-sized Models Shiyu Xia Wenxuan Zhu Xu Yang Xin Geng 29 1 0 25 Apr 2024
Learning Long-form Video Prior via Generative Pre-Training Jinheng Xie Jiajun Feng Zhaoxu Tian Kevin Qinghong Lin Yawen Huang ... Nanxu Gong Xu Zuo Jiaqi Yang Yefeng Zheng Mike Zheng Shou 33 6 0 24 Apr 2024
A Comprehensive Survey on Evaluating Large Language Model Applications in the Medical Industry Yining Huang Keke Tang Meilian Chen Boyuan Wang ELM LM&MA 19 14 0 24 Apr 2024
A Survey of Decomposition-Based Evolutionary Multi-Objective Optimization: Part II -- A Data Science Perspective Mingyu Huang Ke Li 31 0 0 22 Apr 2024
Embarrassingly Simple Unsupervised Aspect Based Sentiment Tuple Extraction Kevin Scaria Abyn Scaria Ben Scaria CoGe 21 0 0 21 Apr 2024
PEACH: Pretrained-embedding Explanation Across Contextual and Hierarchical Structure Feiqi Cao S. Han Hyunsuk Chung 24 0 0 21 Apr 2024
Explanation based Bias Decoupling Regularization for Natural Language Inference Jianxiang Zang Hui Liu 16 0 0 20 Apr 2024
Evaluating Subword Tokenization: Alien Subword Composition and OOV Generalization Challenge Khuyagbaatar Batsuren Ekaterina Vylomova Verna Dankers Tsetsuukhei Delgerbaatar Omri Uzan Yuval Pinter Gábor Bella 27 9 0 20 Apr 2024
Transformer-Based Classification Outcome Prediction for Multimodal Stroke Treatment Danqing Ma Meng Wang Ao Xiang Zongqing Qi Qin Yang 32 18 0 19 Apr 2024
EnriCo: Enriched Representation and Globally Constrained Inference for Entity and Relation Extraction Urchade Zaratiana Nadi Tomeh Yann Dauxais Pierre Holat Thierry Charnois 40 0 0 18 Apr 2024
GraphER: A Structure-aware Text-to-Graph Model for Entity and Relation Extraction Urchade Zaratiana Nadi Tomeh Niama El Khbir Pierre Holat Thierry Charnois 36 1 0 18 Apr 2024
Enhance Robustness of Language Models Against Variation Attack through Graph Integration Ziteng Xiong Lizhi Qing Yangyang Kang Jiawei Liu Hongsong Li Changlong Sun Xiaozhong Liu Wei Lu 14 1 0 18 Apr 2024
Dynamic Self-adaptive Multiscale Distillation from Pre-trained Multimodal Large Model for Efficient Cross-modal Representation Learning Zhengyang Liang Meiyu Liang Wei Huang Yawen Li Zhe Xue 26 1 0 16 Apr 2024
Referring Flexible Image Restoration Runwei Guan Rongsheng Hu Zhuhao Zhou Tianlang Xue Ka Lok Man Jeremy S. Smith Eng Gee Lim Weiping Ding Yutao Yue 32 0 0 16 Apr 2024
On the Effects of Fine-tuning Language Models for Text-Based Reinforcement Learning Mauricio G. Gruppi Soham Dan K. Murugesan Subhajit Chaudhury LLMAG 19 0 0 15 Apr 2024
Navigating the Landscape of Large Language Models: A Comprehensive Review and Analysis of Paradigms and Fine-Tuning Strategies Benjue Weng LM&MA 35 7 0 13 Apr 2024
VertAttack: Taking advantage of Text Classifiers' horizontal vision Jonathan Rusert AAML 35 1 0 12 Apr 2024
Emerging Property of Masked Token for Effective Pre-training Hyesong Choi Hunsang Lee Seyoung Joung Hyejin Park Jiyeong Kim Dongbo Min 36 9 0 12 Apr 2024
Salience-Based Adaptive Masking: Revisiting Token Dynamics for Enhanced Pre-training Hyesong Choi Hyejin Park Kwang Moo Yi Sungmin Cha Dongbo Min 34 9 0 12 Apr 2024
On Unified Prompt Tuning for Request Quality Assurance in Public Code Review Xinyu Chen Lin Li Rui Zhang Peng Liang 32 1 0 11 Apr 2024
CQIL: Inference Latency Optimization with Concurrent Computation of Quasi-Independent Layers Longwei Zou Qingyang Wang Han Zhao Jiangang Kong Yi Yang Yangdong Deng 26 0 0 10 Apr 2024
Dimensionality Reduction in Sentence Transformer Vector Databases with Fast Fourier Transform Vitaly Bulgakov Alec Segal 26 2 0 09 Apr 2024
AnchorAL: Computationally Efficient Active Learning for Large and Imbalanced Datasets Pietro Lesci Andreas Vlachos 31 2 0 08 Apr 2024
Chinese Sequence Labeling with Semi-Supervised Boundary-Aware Language Model Pre-training Longhui Zhang Dingkun Long Meishan Zhang Yanzhao Zhang Pengjun Xie Min Zhang 43 3 0 08 Apr 2024
OPSD: an Offensive Persian Social media Dataset and its baseline evaluations M. Safayani Amir Sartipi Amir Hossein Ahmadi Parniyan Jalali Amir Hossein Mansouri Mohammad Bisheh-Niasar Zahra Pourbahman 16 0 0 08 Apr 2024
Shortcut-connected Expert Parallelism for Accelerating Mixture-of-Experts Weilin Cai Juyong Jiang Le Qin Junwei Cui Sunghun Kim Jiayi Huang 50 7 0 07 Apr 2024
What Happens When Small Is Made Smaller? Exploring the Impact of Compression on Small Data Pretrained Language Models Busayo Awobade Mardiyyah Oduwole Steven Kolawole 44 0 0 06 Apr 2024