ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

26 September 2019

Papers citing "ALBERT: A Lite BERT for Self-supervised Learning of Language Representations"

50 / 2,911 papers shown

Title
Adversarial Evasion Attack Efficiency against Large Language Models João Vitorino Eva Maia Isabel Praça AAML 38 2 0 12 Jun 2024
Defining and Detecting Vulnerability in Human Evaluation Guidelines: A Preliminary Study Towards Reliable NLG Evaluation Jie Ruan Wenqing Wang Xiaojun Wan AAML ELM 21 3 0 12 Jun 2024
HOLMES: Hyper-Relational Knowledge Graphs for Multi-hop Question Answering using LLMs Pranoy Panda Ankush Agarwal Chaitanya Devaguptapu Manohar Kaul Prathosh A P RALM 27 10 0 10 Jun 2024
Emotion-Aware Speech Self-Supervised Representation Learning with Intensity Knowledge Rui Liu Zening Ma SSL 34 1 0 10 Jun 2024
Gentle-CLIP: Exploring Aligned Semantic In Low-Quality Multimodal Data With Soft Alignment Zijia Song Z. Zang Yelin Wang Guozheng Yang Jiangbin Zheng Kaicheng Yu Wanyu Chen Stan Z. Li 31 0 0 09 Jun 2024
Peer Review as A Multi-Turn and Long-Context Dialogue with Role-Based Interactions Cheng Tan Dongxin Lyu Siyuan Li Zhangyang Gao Jingxuan Wei Siqi Ma Zicheng Liu Stan Z. Li LLMAG 32 9 0 09 Jun 2024
Automata Extraction from Transformers Yihao Zhang Zeming Wei Meng Sun AI4CE 29 1 0 08 Jun 2024
Integrating Text and Image Pre-training for Multi-modal Algorithmic Reasoning Zijian Zhang Wei Liu 29 0 0 08 Jun 2024
BERTs are Generative In-Context Learners David Samuel 32 5 0 07 Jun 2024
DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effective for LMMs Lingchen Meng Jianwei Yang Rui Tian Xiyang Dai Zuxuan Wu Jianfeng Gao Yu-Gang Jiang VLM 22 8 0 06 Jun 2024
Pre-trained Transformer Uncovers Meaningful Patterns in Human Mobility Data Alameen Najjar 29 0 0 06 Jun 2024
A Survey on Medical Large Language Models: Technology, Application, Trustworthiness, and Future Directions Lei Liu Xiaoyan Yang Junchi Lei Xiaoyang Liu Yue Shen ... Peng Wei Jinjie Gu Zhixuan Chu Zhan Qin Kui Ren LM&MA AILaw 34 14 0 06 Jun 2024
RadBARTsum: Domain Specific Adaption of Denoising Sequence-to-Sequence Models for Abstractive Radiology Report Summarization Jinge Wu Abul Hasan Honghan Wu 26 0 0 05 Jun 2024
Language Model Can Do Knowledge Tracing: Simple but Effective Method to Integrate Language Model and Knowledge Tracing Task Unggi Lee Jiyeong Bae Dohee Kim Sookbun Lee Jaekwon Park Taekyung Ahn Gunho Lee Damji Stratton Hyeoncheol Kim AI4Ed KELM 16 9 0 05 Jun 2024
Using Self-supervised Learning Can Improve Model Fairness Sofia Yfantidou Dimitris Spathis Marios Constantinides Athena Vakali Daniele Quercia F. Kawsar 59 4 0 04 Jun 2024
Robust Interaction-based Relevance Modeling for Online E-Commerce and LLM-based Retrieval Ben Chen Huangyu Dai Xiang Ma Wen Jiang Wei Ning 19 0 0 04 Jun 2024
Towards Effective Time-Aware Language Representation: Exploring Enhanced Temporal Understanding in Language Models Jiexin Wang Adam Jatowt Yi Cai AI4CE 35 1 0 04 Jun 2024
It's a Feature, Not a Bug: Measuring Creative Fluidity in Image Generators Aditi Ramaswamy Melane Navaratnarajah Hana Chockler EGVM 34 0 0 03 Jun 2024
Reward-based Input Construction for Cross-document Relation Extraction Byeonghu Na Suhyeon Jo Yeongmin Kim Il-Chul Moon 25 0 0 31 May 2024
GAMedX: Generative AI-based Medical Entity Data Extractor Using Large Language Models Mohammed-Khalil Ghali Abdelrahman Farrag Hajar Sakai Hicham El Baz Yu Jin Sarah Lam LM&MA MedIm 32 8 0 31 May 2024
Entangled Relations: Leveraging NLI and Meta-analysis to Enhance Biomedical Relation Extraction William Hogan Jingbo Shang 13 0 0 31 May 2024
Unlocking the Potential of Large Language Models for Clinical Text Anonymization: A Comparative Study David Pissarra Isabel Curioso João Alveira Duarte Pereira Bruno Ribeiro Tomas Souper Vasco Gomes A. Carreiro Vitor Rolla 15 2 0 29 May 2024
On the Role of Attention Masks and LayerNorm in Transformers Xinyi Wu A. Ajorlou Yifei Wang Stefanie Jegelka Ali Jadbabaie 35 9 0 29 May 2024
Transformers Can Do Arithmetic with the Right Embeddings Sean McLeish Arpit Bansal Alex Stein Neel Jain John Kirchenbauer ... B. Kailkhura A. Bhatele Jonas Geiping Avi Schwarzschild Tom Goldstein 43 28 0 27 May 2024
BWArea Model: Learning World Model, Inverse Dynamics, and Policy for Controllable Language Generation Chengxing Jia Pengyuan Wang Ziniu Li Yi-Chen Li Zhilong Zhang Nan Tang Yang Yu OffRL 25 1 0 27 May 2024
Recent advances in text embedding: A Comprehensive Review of Top-Performing Methods on the MTEB Benchmark Hongliu Cao AI4TS 27 11 0 27 May 2024
SoK: Leveraging Transformers for Malware Analysis Pradip Kunwar Kshitiz Aryal Maanak Gupta Mahmoud Abdelsalam Elisa Bertino 90 0 0 27 May 2024
Tokenization Matters! Degrading Large Language Models through Challenging Their Tokenization Dixuan Wang Yanda Li Junyuan Jiang Zepeng Ding Ziqin Luo Guochao Jiang Jiaqing Liang Deqing Yang 27 11 0 27 May 2024
Cocktail: A Comprehensive Information Retrieval Benchmark with LLM-Generated Documents Integration Sunhao Dai Weihao Liu Yuqi Zhou Liang Pang Rongju Ruan Gang Wang Zhenhua Dong Jun Xu Jirong Wen 37 8 0 26 May 2024
Accelerating Transformers with Spectrum-Preserving Token Merging Hoai-Chau Tran D. M. Nguyen Duy M. Nguyen Trung Thanh Nguyen Ngan Le Pengtao Xie Daniel Sonntag James Y. Zou Binh T. Nguyen Mathias Niepert 32 8 0 25 May 2024
MoEUT: Mixture-of-Experts Universal Transformers Róbert Csordás Kazuki Irie Jürgen Schmidhuber Christopher Potts Christopher D. Manning MoE 42 5 0 25 May 2024
GPT is Not an Annotator: The Necessity of Human Annotation in Fairness Benchmark Construction Virginia K. Felkner Jennifer A. Thompson Jonathan May 32 9 0 24 May 2024
ETTrack: Enhanced Temporal Motion Predictor for Multi-Object Tracking Xudong Han Nobuyuki Oishi Yueying Tian Elif Ucurum R. Young C. Chatwin Philip Birch 30 3 0 24 May 2024
Optimizing Large Language Models for OpenAPI Code Completion Bohdan Petryshyn M. Lukoševičius LLMAG ALM 30 0 0 24 May 2024
Thinking Forward: Memory-Efficient Federated Finetuning of Language Models Kunjal Panchal Nisarg Parikh Sunav Choudhary Lijun Zhang Yuriy Brun Hui Guan 45 3 0 24 May 2024
CEEBERT: Cross-Domain Inference in Early Exit BERT Divya J. Bajpai M. Hanawal LRM 40 4 0 23 May 2024
Super Tiny Language Models Dylan Hillier Leon Guertler Cheston Tan Palaash Agrawal Ruirui Chen Bobby Cheng 48 3 0 23 May 2024
A Survey on Vision-Language-Action Models for Embodied AI Yueen Ma Zixing Song Yuzheng Zhuang Jianye Hao Irwin King LM&Ro 67 41 0 23 May 2024
WeatherFormer: A Pretrained Encoder Model for Learning Robust Weather Representations from Small Datasets Adib Hasan Mardavij Roozbehani M. Dahleh AI4TS 14 0 0 22 May 2024
Investigating Persuasion Techniques in Arabic: An Empirical Study Leveraging Large Language Models Abdurahmman Alzahrani Eyad Babkier Faisal Yanbaawi Firas Yanbaawi Hassan Alhuzali 41 0 0 21 May 2024
Talk2Radar: Bridging Natural Language with 4D mmWave Radar for 3D Referring Expression Comprehension Runwei Guan Ruixiao Zhang Ningwei Ouyang Jianan Liu Ka Lok Man ... Ming Xu Jeremy S. Smith Eng Gee Lim Yutao Yue Hui Xiong 46 9 0 21 May 2024
CReMa: Crisis Response through Computational Identification and Matching of Cross-Lingual Requests and Offers Shared on Social Media Rabindra Lamsal M. Read S. Karunasekera Muhammad Imran 21 3 0 20 May 2024
Case-Based Reasoning Approach for Solving Financial Question Answering Yikyung Kim Jay-Yoon Lee AIMat 19 0 0 18 May 2024
The Future of Large Language Model Pre-training is Federated Lorenzo Sani Alexandru Iacob Zeyu Cao Bill Marino Yan Gao ... Wanru Zhao William F. Shen Preslav Aleksandrov Xinchi Qiu Nicholas D. Lane AI4CE 33 12 0 17 May 2024
Large Language Model (LLM) for Telecommunications: A Comprehensive Survey on Principles, Key Techniques, and Opportunities Hao Zhou Chengming Hu Ye Yuan Yufei Cui Yili Jin ... Di Wu Xue Liu Charlie Zhang Xianbin Wang Jiangchuan Liu 35 57 0 17 May 2024
A survey on fairness of large language models in e-commerce: progress, application, and challenge Qingyang Ren Zilin Jiang Jinghan Cao Sijia Li Chiqu Li Yiyang Liu Shuning Huo Tiange He Yuan Chen AILaw FaML 35 6 0 15 May 2024
A Survey of Generative Techniques for Spatial-Temporal Data Mining Qianru Zhang Haixin Wang Cheng Long Liangcai Su Xingwei He ... Tailin Wu Hongzhi Yin S. Yiu Qi Tian Christian S. Jensen AI4TS 52 7 0 15 May 2024
A Survey on Transformers in NLP with Focus on Efficiency Wazib Ansar Saptarsi Goswami Amlan Chakrabarti MedIm 38 2 0 15 May 2024
Impact of Stickers on Multimodal Chat Sentiment Analysis and Intent Recognition: A New Task, Dataset and Baseline Yuanchen Shi Biao Ma Fang Kong 16 0 0 14 May 2024
A Decoupling and Aggregating Framework for Joint Extraction of Entities and Relations Yao Wang Xin Liu Weikun Kong Hai-tao Yu Teeradaj Racharak Kyoung-Sook Kim Le-Minh Nguyen 26 0 0 14 May 2024