ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

26 September 2019

Papers citing "ALBERT: A Lite BERT for Self-supervised Learning of Language Representations"

50 / 2,911 papers shown

Title
Parallel Scaling Law for Language Models Mouxiang Chen Binyuan Hui Zeyu Cui Jiaxi Yang Dayiheng Liu Jianling Sun Junyang Lin Zhongxin Liu MoE LRM 31 0 0 15 May 2025
AI Greenferencing: Routing AI Inferencing to Green Modular Data Centers with Heron Tella Rajashekhar Reddy Palak Rohan Gandhi Anjaly Parayil Chaojie Zhang ... Liangcheng Yu Jayashree Mohan Srinivasan Iyengar Shivkumar Kalyanaraman Debopam Bhattacherjee 12 0 0 15 May 2025
Structural-Temporal Coupling Anomaly Detection with Dynamic Graph Transformer Chang Zong Yueting Zhuang Jian Shao Weiming Lu 31 0 0 13 May 2025
KDH-MLTC: Knowledge Distillation for Healthcare Multi-Label Text Classification Hajar Sakai Sarah Lam VLM 38 0 0 12 May 2025
A Survey on Collaborative Mechanisms Between Large and Small Language Models Yi Chen JiaHao Zhao HaoHao Han 33 0 0 12 May 2025
Learn to Think: Bootstrapping LLM Reasoning Capability Through Graph Learning Hang Gao Chenhao Zhang Tie Wang Junsuo Zhao Fengge Wu Changwen Zheng Huaping Liu LRM 29 0 0 09 May 2025
Prediction-powered estimators for finite population statistics in highly imbalanced textual data: Public hate crime estimation Hannes Waldetoft Jakob Torgander Måns Magnusson 27 0 0 05 May 2025
Parameter-Efficient Transformer Embeddings Henry Ndubuaku Mouad Talhi 24 0 0 04 May 2025
FineScope : Precision Pruning for Domain-Specialized Large Language Models Using SAE-Guided Self-Data Cultivation Chaitali Bhattacharyya Yeseong Kim 45 0 0 01 May 2025
MatMMFuse: Multi-Modal Fusion model for Material Property Prediction Abhiroop Bhattacharya Sylvain G. Cloutier AI4CE 41 0 0 30 Apr 2025
HMI: Hierarchical Knowledge Management for Efficient Multi-Tenant Inference in Pretrained Language Models J. Zhang J. Wang H. Li Lidan Shou Ke Chen Gang Chen Qin Xie Guiming Xie Xuejian Gong 33 0 0 24 Apr 2025
MOOSComp: Improving Lightweight Long-Context Compressor via Mitigating Over-Smoothing and Incorporating Outlier Scores Fengwei Zhou Jiafei Song Wenjin Jason Li Gengjian Xue Zhikang Zhao Yichao Lu Bailin Na 17 0 0 23 Apr 2025
HYPEROFA: Expanding LLM Vocabulary to New Languages via Hypernetwork-Based Embedding Initialization Enes Özeren Yihong Liu Hinrich Schütze 31 0 0 21 Apr 2025
Quantitative Clustering in Mean-Field Transformer Models Shi Chen Zhengjiang Lin Yury Polyanskiy Philippe Rigollet 31 0 0 20 Apr 2025
Q-FAKER: Query-free Hard Black-box Attack via Controlled Generation CheolWon Na YunSeok Choi Jee-Hyong Lee AAML 37 0 0 18 Apr 2025
WildFireCan-MMD: A Multimodal Dataset for Classification of User-Generated Content During Wildfires in Canada Braeden Sherritt Isar Nejadgholi Marzieh Amini VLM 44 0 0 17 Apr 2025
Out of Sight Out of Mind, Out of Sight Out of Mind: Measuring Bias in Language Models Against Overlooked Marginalized Groups in Regional Contexts Fatma Elsafoury David Hartmann 29 0 0 17 Apr 2025
A new training approach for text classification in Mental Health: LatentGLoss Korhan Sevinç AI4MH 21 0 0 09 Apr 2025
Exploring Gradient-Guided Masked Language Model to Detect Textual Adversarial Attacks Xiaomei Zhang Zhaoxi Zhang Yanjun Zhang Xufei Zheng L. Zhang Shengshan Hu Shirui Pan AAML 27 0 0 08 Apr 2025
Detecting Stereotypes and Anti-stereotypes the Correct Way Using Social Psychological Underpinnings Kaustubh Shivshankar Shejole Pushpak Bhattacharyya 26 0 0 04 Apr 2025
Pyramid-based Mamba Multi-class Unsupervised Anomaly Detection Nasar Iqbal Niki Martinel Mamba 48 0 0 04 Apr 2025
Multimodal Fusion and Vision-Language Models: A Survey for Robot Vision Xiaofeng Han Shunpeng Chen Zenghuang Fu Zhe Feng Lue Fan ... Li Guo Weiliang Meng Xiaopeng Zhang Rongtao Xu Shibiao Xu 63 1 0 03 Apr 2025
Advancing Semantic Caching for LLMs with Domain-Specific Embeddings and Synthetic Data Waris Gill Justin Cechmanek Tyler Hutcherson Srijith Rajamohan Jen Agarwal Muhammad Ali Gulzar Manvinder Singh Benoit Dion 35 0 0 03 Apr 2025
From Text to Graph: Leveraging Graph Neural Networks for Enhanced Explainability in NLP Fabio Yáñez-Romero Andrés Montoyo Armando Suárez Yoan Gutiérrez Ruslan Mitkov 41 0 0 02 Apr 2025
KernelDNA: Dynamic Kernel Sharing via Decoupled Naive Adapters Haiduo Huang Yadong Zhang Pengju Ren 49 0 0 30 Mar 2025
Evaluating Text-to-Image Synthesis with a Conditional Fréchet Distance Jaywon Koo J. Hernandez Moayed Haji-Ali Ziyan Yang Vicente Ordonez EGVM 67 0 0 27 Mar 2025
Cyborg Data: Merging Human with AI Generated Training Data Kai North Christopher Ormerod 37 0 0 26 Mar 2025
Unsupervised Acquisition of Discrete Grammatical Categories David Ph. Shakouri Crit Cremers Niels O. Schiller 40 0 0 24 Mar 2025
Detection of Somali-written Fake News and Toxic Messages on the Social Media Using Transformer-based Language Models Muhidin A. Mohamed Shuab D. Ahmed Yahye A. Isse Hanad M. Mohamed Fuad Mire Hassan Houssein A. Assowe 52 0 0 23 Mar 2025
Deceptive Humor: A Synthetic Multilingual Benchmark Dataset for Bridging Fabricated Claims with Humorous Content Sai Kartheek Reddy Kasu Shankar Biradar Sunil Saumya 60 0 0 20 Mar 2025
Model Hubs and Beyond: Analyzing Model Popularity, Performance, and Documentation Pritam Kadasi Sriman Reddy Srivathsa Vamsi Chaturvedula Rudranshu Sen Agnish Saha Soumavo Sikdar Sayani Sarkar Suhani Mittal Rohit Jindal Mayank Singh 48 0 0 19 Mar 2025
Unified Enhancement of the Generalization and Robustness of Language Models via Bi-Stage Optimization Y. Sun Juan Yin Juan Zhao Fan Zhang Yongheng Liu Hongji Chen 37 0 0 19 Mar 2025
DiT-Air: Revisiting the Efficiency of Diffusion Model Architecture Design in Text to Image Generation Chen Chen Rui Qian Wenze Hu Tsu-jui Fu Jialing Tong ... Lezhi Li Bowen Zhang A. Schwing Wei Liu Y. Yang 50 0 0 13 Mar 2025
Sentiment Analysis in SemEval: A Review of Sentiment Identification Approaches Bousselham EL HADDAOUI R. Chiheb R. Faizi A. E. Afia 44 0 0 13 Mar 2025
ARLED: Leveraging LED-based ARMAN Model for Abstractive Summarization of Persian Long Documents Samira Zangooei Amirhossein Darmani Hossein Farahmand Nezhad Laya Mahmoudi 37 0 0 13 Mar 2025
ReSi: A Comprehensive Benchmark for Representational Similarity Measures Max Klabunde Tassilo Wald Tobias Schumacher Klaus H. Maier-Hein Markus Strohmaier Adriana Iamnitchi AI4TS VLM 68 5 0 13 Mar 2025
Large Language Model as Meta-Surrogate for Data-Driven Many-Task Optimization: A Proof-of-Principle Study X. Zhang Yue-jiao Gong Jun Zhang 53 0 0 11 Mar 2025
A Survey on Knowledge-Oriented Retrieval-Augmented Generation Mingyue Cheng Yucong Luo Jie Ouyang Q. Liu Huijie Liu ... Bohou Zhang Jiawei Cao Jie Ma Daoyu Wang Enhong Chen 3DV 68 3 0 11 Mar 2025
Talk2PC: Enhancing 3D Visual Grounding through LiDAR and Radar Point Clouds Fusion for Autonomous Driving Runwei Guan Jianan Liu Ningwei Ouyang Daizong Liu Xiaolou Sun Lianqing Zheng Ming Xu Yutao Yue Hui Xiong 61 1 0 11 Mar 2025
CtrlRAG: Black-box Adversarial Attacks Based on Masked Language Models in Retrieval-Augmented Language Generation Runqi Sui AAML 32 0 0 10 Mar 2025
Gender Encoding Patterns in Pretrained Language Model Representations Mahdi Zakizadeh Mohammad Taher Pilehvar 43 0 0 09 Mar 2025
Fine-Grained Evaluation for Implicit Discourse Relation Recognition Xinyi Cai 37 0 0 07 Mar 2025
Layer-Specific Scaling of Positional Encodings for Superior Long-Context Modeling Zhenghua Wang Yiran Ding Changze Lv Zhibo Xu Tianlong Li Tianyuan Shi Xiaoqing Zheng Xuanjing Huang 43 0 0 06 Mar 2025
PriFFT: Privacy-preserving Federated Fine-tuning of Large Language Models via Hybrid Secret Sharing Zhichao You Xuewen Dong Ke Cheng Xutong Mu Jiaxuan Fu Shiyang Ma Qiang Qu Yulong Shen FedML 84 0 0 05 Mar 2025
One Model to Train them All: Hierarchical Self-Distillation for Enhanced Early Layer Embeddings Andrea Gurioli Federico Pennino João Monteiro Maurizio Gabbrielli 46 0 0 04 Mar 2025
Zero-Shot Complex Question-Answering on Long Scientific Documents Wanting Wang RALM 66 0 0 04 Mar 2025
EPEE: Towards Efficient and Effective Foundation Models in Biomedicine Zaifu Zhan Shuang Zhou Huixue Zhou Z. Liu Rui Zhang 37 1 0 03 Mar 2025
Neural ODE Transformers: Analyzing Internal Dynamics and Adaptive Fine-tuning Anh Tong Thanh Nguyen-Tang Dongeun Lee Duc Nguyen Toan M. Tran David Hall Cheongwoong Kang Jaesik Choi 33 0 0 03 Mar 2025
Efficient or Powerful? Trade-offs Between Machine Learning and Deep Learning for Mental Illness Detection on Social Media Zhanyi Ding Zhongyan Wang Yeyubei Zhang Yuchen Cao Yunchong Liu Xiaorui Shen Yexin Tian Jianglai Dai AI4MH 85 1 0 03 Mar 2025
TimesBERT: A BERT-Style Foundation Model for Time Series Understanding Haoran Zhang Yong Liu Yunzhong Qiu Haixuan Liu Zhongyi Pei Jianmin Wang Mingsheng Long AI4TS 40 0 0 28 Feb 2025