ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

26 September 2019

Papers citing "ALBERT: A Lite BERT for Self-supervised Learning of Language Representations"

50 / 2,911 papers shown

Title
Order-Based Pre-training Strategies for Procedural Text Understanding Abhilash Nandy Yash Kulkarni Pawan Goyal Niloy Ganguly 19 2 0 06 Apr 2024
A Morphology-Based Investigation of Positional Encodings Poulami Ghosh Shikhar Vashishth Raj Dabre Pushpak Bhattacharyya 24 1 0 06 Apr 2024
Multi-modal Learning for WebAssembly Reverse Engineering Hanxian Huang Jishen Zhao 29 2 0 04 Apr 2024
Robust Pronoun Fidelity with English LLMs: Are they Reasoning, Repeating, or Just Biased? Vagrant Gautam Eileen Bingert D. Zhu Anne Lauscher Dietrich Klakow 43 8 0 04 Apr 2024
Revisiting subword tokenization: A case study on affixal negation in large language models Thinh Hung Truong Yulia Otmakhova Karin Verspoor Trevor Cohn Timothy Baldwin 45 2 0 03 Apr 2024
Linear Attention Sequence Parallelism Weigao Sun Zhen Qin Dong Li Xuyang Shen Yu Qiao Yiran Zhong 68 2 0 03 Apr 2024
Semantic Augmentation in Images using Language Sahiti Yerramilli Jayant Sravan Tamarapalli Tanmay Girish Kulkarni Jonathan M Francis Eric Nyberg VLM DiffM 26 0 0 02 Apr 2024
Deconstructing In-Context Learning: Understanding Prompts via Corruption Namrata Shivagunde Vladislav Lialin Sherin Muckatira Anna Rumshisky 36 2 0 02 Apr 2024
Green AI: Exploring Carbon Footprints, Mitigation Strategies, and Trade Offs in Large Language Model Training Vivian Liu Yiqiao Yin 40 11 0 01 Apr 2024
Efficient Prompting Methods for Large Language Models: A Survey Kaiyan Chang Songcheng Xu Chenglong Wang Yingfeng Luo Tong Xiao Jingbo Zhu LRM 37 32 0 01 Apr 2024
Efficiently Distilling LLMs for Edge Applications Achintya Kundu Fabian Lim Aaron Chew L. Wynter Penny Chong Rhui Dih Lee 42 6 0 01 Apr 2024
CoUDA: Coherence Evaluation via Unified Data Augmentation Dawei Zhu Wenhao Wu Yifan Song Fangwei Zhu Ziqiang Cao Sujian Li 28 0 0 31 Mar 2024
Addressing Both Statistical and Causal Gender Fairness in NLP Models Hannah Chen Yangfeng Ji David E. Evans 26 2 0 30 Mar 2024
A Comprehensive Study on NLP Data Augmentation for Hate Speech Detection: Legacy Methods, BERT, and LLMs Md Saroar Jahan Mourad Oussalah D. Beddiar Jhuma Kabir Mim Nabil Arhab 19 6 0 30 Mar 2024
Classifying Conspiratorial Narratives At Scale: False Alarms and Erroneous Connections Ahmad Diab Rr. Nefriana Yu-Ru Lin 27 7 0 29 Mar 2024
The Future of Combating Rumors? Retrieval, Discrimination, and Generation Junhao Xu Longdi Xian Zening Liu Mingliang Chen Qiuyang Yin Fenghua Song 31 2 0 29 Mar 2024
New Semantic Task for the French Spoken Language Understanding MEDIA Benchmark Nadege Alavoine G. Laperriere Christophe Servan Sahar Ghannay Sophie Rosset VLM 29 0 0 28 Mar 2024
A Benchmark Evaluation of Clinical Named Entity Recognition in French N. Bannour Christophe Servan Aurélie Névéol Xavier Tannier 16 0 0 28 Mar 2024
mALBERT: Is a Compact Multilingual BERT Model Still Worth It? Christophe Servan Sahar Ghannay Sophie Rosset 30 0 0 27 Mar 2024
GPTs and Language Barrier: A Cross-Lingual Legal QA Examination Ha-Thanh Nguyen Hiroaki Yamada Ken Satoh ELM AILaw 26 0 0 26 Mar 2024
REFeREE: A REference-FREE Model-Based Metric for Text Simplification Yichen Huang Ekaterina Kochmar 45 1 0 26 Mar 2024
Opportunities and challenges in the application of large artificial intelligence models in radiology Liangrui Pan Zhenyu Zhao Ying Lu Kewei Tang Liyong Fu Qingchun Liang Shaoliang Peng LM&MA MedIm AI4CE 37 5 0 24 Mar 2024
VLUE: A New Benchmark and Multi-task Knowledge Transfer Learning for Vietnamese Natural Language Understanding Phong Nguyen-Thuan Do Son Quoc Tran Phu Gia Hoang Kiet Van Nguyen N. Nguyen ELM 48 3 0 23 Mar 2024
Enhancing Traffic Incident Management with Large Language Models: A Hybrid Machine Learning Approach for Severity Classification Artur Grigorev Khaled Saleh Yuming Ou Adriana-Simona Mihaita 18 5 0 20 Mar 2024
How Gender Interacts with Political Values: A Case Study on Czech BERT Models Adnan Al Ali Jindvrich Libovický 25 0 0 20 Mar 2024
Adaptive Ensembles of Fine-Tuned Transformers for LLM-Generated Text Detection Zhixin Lai Xuesheng Zhang Suiyao Chen DeLMO 33 30 0 20 Mar 2024
WaterVG: Waterway Visual Grounding based on Text-Guided Vision and mmWave Radar Runwei Guan Liye Jia Fengyufan Yang Shanliang Yao Erick Purwanto ... Eng Gee Lim Jeremy S. Smith Ka Lok Man Xuming Hu Yutao Yue 32 9 0 19 Mar 2024
Simple Hack for Transformers against Heavy Long-Text Classification on a Time- and Memory-Limited GPU Service Mirza Alim Mutasodirin Radityo Eko Prasojo Achmad F. Abka Hanif Rasyidi VLM 26 0 0 19 Mar 2024
Improving Generalizability of Extracting Social Determinants of Health Using Large Language Models through Prompt-tuning C.A.I. Peng Zehao Yu Kaleb E. Smith W. Lo‐Ciganic Jiang Bian Yonghui Wu LM&MA 32 1 0 19 Mar 2024
Large language models in 6G security: challenges and opportunities Tri Nguyen Huong Nguyen Ahmad Ijaz Saeid Sheikhi Athanasios V. Vasilakos Panos Kostakos ELM 22 7 0 18 Mar 2024
SSCAE -- Semantic, Syntactic, and Context-aware natural language Adversarial Examples generator J. Asl Mohammad H. Rafiei Manar Alohaly Daniel Takabi AAML SILM 21 3 0 18 Mar 2024
Metaphor Understanding Challenge Dataset for LLMs Xiaoyu Tong Rochelle Choenni Martha Lewis Ekaterina Shutova 43 8 0 18 Mar 2024
Semantic-Enhanced Representation Learning for Road Networks with Temporal Dynamics Yile Chen Xiucheng Li Gao Cong Zhifeng Bao Cheng Long 16 2 0 18 Mar 2024
A Modified Word Saliency-Based Adversarial Attack on Text Classification Models Hetvi Waghela Sneha Rakshit Jaydip Sen AAML 18 7 0 17 Mar 2024
Rethinking Multi-view Representation Learning via Distilled Disentangling Guanzhou Ke Bo Wang Xiaoli Wang Shengfeng He 34 3 0 16 Mar 2024
ATOM: Asynchronous Training of Massive Models for Deep Learning in a Decentralized Environment Xiaofeng Wu Jia Rao Wei Chen 28 2 0 15 Mar 2024
ST-LDM: A Universal Framework for Text-Grounded Object Generation in Real Images Xiangtian Xue Jiasong Wu Youyong Kong L. Senhadji Huazhong Shu DiffM 43 1 0 15 Mar 2024
FBPT: A Fully Binary Point Transformer Zhixing Hou Yuzhang Shang Yan Yan MQ 25 1 0 15 Mar 2024
depyf: Open the Opaque Box of PyTorch Compiler for Machine Learning Researchers Kaichao You Runsheng Bai Meng Cao Jianmin Wang Ion Stoica Mingsheng Long VLM 33 0 0 14 Mar 2024
Rethinking Referring Object Removal Xiangtian Xue Jiasong Wu Youyong Kong L. Senhadji Huazhong Shu DiffM 32 0 0 14 Mar 2024
Language models scale reliably with over-training and on downstream tasks S. Gadre Georgios Smyrnis Vaishaal Shankar Suchin Gururangan Mitchell Wortsman ... Y. Carmon Achal Dave Reinhard Heckel Niklas Muennighoff Ludwig Schmidt ALM ELM LRM 106 40 0 13 Mar 2024
Masked AutoDecoder is Effective Multi-Task Vision Generalist Han Qiu Jiaxing Huang Peng Gao Lewei Lu Xiaoqin Zhang Shijian Lu 43 4 0 12 Mar 2024
A Logical Pattern Memory Pre-trained Model for Entailment Tree Generation Li Yuan Yi Cai Haopeng Ren Jiexin Wang LRM 22 5 0 11 Mar 2024
LORS: Low-rank Residual Structure for Parameter-Efficient Network Stacking Jialin Li Qiang Nie Weifu Fu Yuhuan Lin Guangpin Tao Yong-Jin Liu Chengjie Wang 25 4 0 07 Mar 2024
On the Effectiveness of Distillation in Mitigating Backdoors in Pre-trained Encoder Tingxu Han Shenghan Huang Ziqi Ding Weisong Sun Yebo Feng ... Hanwei Qian Cong Wu Quanjun Zhang Yang Liu Zhenyu Chen 21 8 0 06 Mar 2024
A General and Flexible Multi-concept Parsing Framework for Multilingual Semantic Matching D. Yao Asaad Alghamdi Qingrong Xia Xiaoye Qu Xinyu Duan Zhefeng Wang Yi Zheng Baoxing Huai Peilun Cheng Zhou Zhao 24 0 0 05 Mar 2024
Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding Zhenyu (Allen) Zhang Runjin Chen Shiwei Liu Zhewei Yao Olatunji Ruwase Beidi Chen Xiaoxia Wu Zhangyang Wang 26 26 0 05 Mar 2024
A Tutorial on the Pretrain-Finetune Paradigm for Natural Language Processing Yu Wang Wen Qu 27 0 0 04 Mar 2024
Vision-Language Models for Medical Report Generation and Visual Question Answering: A Review Iryna Hartsock Ghulam Rasool 38 62 0 04 Mar 2024
How does Architecture Influence the Base Capabilities of Pre-trained Language Models? A Case Study Based on FFN-Wider Transformer Models Xin Lu Yanyan Zhao Bing Qin 48 0 0 04 Mar 2024