ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1909.11942
  4. Cited By
ALBERT: A Lite BERT for Self-supervised Learning of Language
  Representations
v1v2v3v4v5v6 (latest)

ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

International Conference on Learning Representations (ICLR), 2019
26 September 2019
Zhenzhong Lan
Mingda Chen
Sebastian Goodman
Kevin Gimpel
Piyush Sharma
Radu Soricut
    SSLAIMat
ArXiv (abs)PDFHTMLGithub (3271★)

Papers citing "ALBERT: A Lite BERT for Self-supervised Learning of Language Representations"

50 / 3,048 papers shown
A Contrastive Framework with User, Item and Review Alignment for Recommendation
A Contrastive Framework with User, Item and Review Alignment for RecommendationWeb Search and Data Mining (WSDM), 2025
Hoang V. Dong
Yuan Fang
Hady W. Lauw
661
8
0
21 Jan 2025
Assessing and Enhancing the Robustness of Large Language Models with Task Structure Variations for Logical Reasoning
Assessing and Enhancing the Robustness of Large Language Models with Task Structure Variations for Logical ReasoningInternational Conference on Neural Information Processing (ICONIP), 2023
Qiming Bao
Gaël Gendron
A. Peng
Wanjun Zhong
N. Tan
Yang Chen
Michael Witbrock
Qingbin Liu
LRMELM
478
6
0
20 Jan 2025
Harnessing the Potential of Large Language Models in Modern Marketing Management: Applications, Future Directions, and Strategic Recommendations
Harnessing the Potential of Large Language Models in Modern Marketing Management: Applications, Future Directions, and Strategic Recommendations
Raha Aghaei
Ali A. Kiaei
Mahnaz Boush
Javad Vahidi
Mohammad Zavvar
Zeynab Barzegar
Mahan Rofoosheh
OffRL
255
4
0
18 Jan 2025
A Comprehensive Survey of Foundation Models in Medicine
A Comprehensive Survey of Foundation Models in MedicineIEEE Reviews in Biomedical Engineering (RBME), 2024
Wasif Khan
Seowung Leem
Kyle B. See
Joshua K. Wong
Shaoting Zhang
R. Fang
AI4CELM&MAVLM
766
71
0
17 Jan 2025
Bridging the Fairness Gap: Enhancing Pre-trained Models with LLM-Generated Sentences
Bridging the Fairness Gap: Enhancing Pre-trained Models with LLM-Generated SentencesIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2025
Liu Yu
Ludie Guo
Ping Kuang
Fan Zhou
253
4
0
12 Jan 2025
Multi-task Visual Grounding with Coarse-to-Fine Consistency Constraints
Multi-task Visual Grounding with Coarse-to-Fine Consistency ConstraintsAAAI Conference on Artificial Intelligence (AAAI), 2025
Ming Dai
Jian Li
Jiedong Zhuang
Xian Zhang
Wankou Yang
ObjD
369
13
0
12 Jan 2025
Finnish SQuAD: A Simple Approach to Machine Translation of Span Annotations
Finnish SQuAD: A Simple Approach to Machine Translation of Span Annotations
Emil Nuutinen
Iiro Rastas
Filip Ginter
180
3
0
10 Jan 2025
Merging Feed-Forward Sublayers for Compressed Transformers
Merging Feed-Forward Sublayers for Compressed Transformers
Neha Verma
Kenton W. Murray
Kevin Duh
AI4CE
373
0
0
10 Jan 2025
Clinical Insights: A Comprehensive Review of Language Models in Medicine
Clinical Insights: A Comprehensive Review of Language Models in MedicinePLOS Digital Health (PDH), 2024
Nikita Neveditsin
Pawan Lingras
V. Mago
LM&MA
529
17
0
08 Jan 2025
Trust Modeling in Counseling Conversations: A Benchmark Study
Aseem Srivastava
Zuhair Hasan Shaik
Tanmoy Chakraborty
Md. Shad Akhtar
180
2
0
06 Jan 2025
Decoding News Bias: Multi Bias Detection in News Articles
Decoding News Bias: Multi Bias Detection in News ArticlesInternational Conference on Natural Language Processing and Information Retrieval (ICNLPIR), 2024
Bhushan Santosh Shah
Deven Santosh Shah
Vahida Attar
218
4
0
05 Jan 2025
Swift Cross-Dataset Pruning: Enhancing Fine-Tuning Efficiency in Natural Language Understanding
Swift Cross-Dataset Pruning: Enhancing Fine-Tuning Efficiency in Natural Language UnderstandingInternational Conference on Computational Linguistics (COLING), 2025
Binh-Nguyen Nguyen
Yang He
255
2
0
05 Jan 2025
Toward Corpus Size Requirements for Training and Evaluating Depression Risk Models Using Spoken LanguageInterspeech (Interspeech), 2022
Tomek Rutowski
Amir Harati
Elizabeth Shriberg
Yang Lu
Piotr Chlebek
Ricardo Oliveira
246
11
0
03 Jan 2025
Efficient support ticket resolution using Knowledge Graphs
Sherwin Varghese
James Tian
79
0
0
03 Jan 2025
SAFE-MEME: Structured Reasoning Framework for Robust Hate Speech Detection in Memes
SAFE-MEME: Structured Reasoning Framework for Robust Hate Speech Detection in Memes
Palash Nandi
Shivam Sharma
Tanmoy Chakraborty
228
4
0
31 Dec 2024
Text Classification: Neural Networks VS Machine Learning Models VS Pre-trained Models
Text Classification: Neural Networks VS Machine Learning Models VS Pre-trained Models
Christos Petridis
VLM
318
5
0
31 Dec 2024
A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicine
A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in MedicineInformation Fusion (Inf. Fusion), 2024
Hanguang Xiao
Feizhong Zhou
Xianglong Liu
Tianqi Liu
Zhipeng Li
Xin Liu
Xiaoxuan Huang
AILawLM&MALRM
449
82
0
31 Dec 2024
AIGT: AI Generative Table Based on Prompt
AIGT: AI Generative Table Based on PromptInternational Conference on Computational Linguistics (COLING), 2024
Mingming Zhang
Zhiqing Xiao
Guoshan Lu
Sai Wu
Weiqiang Wang
Xing Fu
Can Yi
Junbo Zhao
LMTDVLM
227
3
0
24 Dec 2024
Adversarial Robustness through Dynamic Ensemble Learning
Adversarial Robustness through Dynamic Ensemble Learning
Hetvi Waghela
Jaydip Sen
Sneha Rakshit
AAML
251
1
0
20 Dec 2024
COSEE: Consistency-Oriented Signal-Based Early Exiting via Calibrated
  Sample Weighting Mechanism
COSEE: Consistency-Oriented Signal-Based Early Exiting via Calibrated Sample Weighting MechanismAAAI Conference on Artificial Intelligence (AAAI), 2024
Jianing He
Tao Gui
Hongyun Zhang
Qi Zhang
Usman Naseem
Duoqian Miao
326
3
0
17 Dec 2024
Unlocking LLMs: Addressing Scarce Data and Bias Challenges in Mental
  Health
Unlocking LLMs: Addressing Scarce Data and Bias Challenges in Mental Health
Vivek Kumar
Eirini Ntoutsi
Pushpraj Singh Rajawat
Giacomo Medda
Diego Reforgiato Recupero
AI4MH
263
6
0
17 Dec 2024
Bias Vector: Mitigating Biases in Language Models with Task Arithmetic
  Approach
Bias Vector: Mitigating Biases in Language Models with Task Arithmetic ApproachInternational Conference on Computational Linguistics (COLING), 2024
Daiki Shirafuji
Makoto Takenaka
Shinya Taguchi
LLMAG
263
11
0
16 Dec 2024
One Pixel is All I Need
One Pixel is All I Need
Deng Siqin
Zhou Xiaoyi
ViT
1.0K
0
0
14 Dec 2024
BinarySelect to Improve Accessibility of Black-Box Attack Research
BinarySelect to Improve Accessibility of Black-Box Attack ResearchInternational Conference on Computational Linguistics (COLING), 2024
Shatarupa Ghosh
Jonathan Rusert
AAML
391
1
0
13 Dec 2024
SMMF: Square-Matricized Momentum Factorization for Memory-Efficient
  Optimization
SMMF: Square-Matricized Momentum Factorization for Memory-Efficient OptimizationAAAI Conference on Artificial Intelligence (AAAI), 2024
Kwangryeol Park
Seulki Lee
182
1
0
12 Dec 2024
Coverage-based Fairness in Multi-document Summarization
Coverage-based Fairness in Multi-document SummarizationNorth American Chapter of the Association for Computational Linguistics (NAACL), 2024
Haoyuan Li
Yusen Zhang
Rui Zhang
Snigdha Chaturvedi
410
2
0
11 Dec 2024
KITE-DDI: A Knowledge graph Integrated Transformer Model for accurately
  predicting Drug-Drug Interaction Events from Drug SMILES and Biomedical
  Knowledge Graph
KITE-DDI: A Knowledge graph Integrated Transformer Model for accurately predicting Drug-Drug Interaction Events from Drug SMILES and Biomedical Knowledge GraphIEEE Access (IEEE Access), 2024
Azwad Tamir
Jiann-Shiun Yuan
183
2
0
08 Dec 2024
AntLM: Bridging Causal and Masked Language Models
AntLM: Bridging Causal and Masked Language Models
Xinru Yu
Bin Guo
Shiwei Luo
Jiadong Wang
Changzhi Sun
Man Lan
CLL
327
4
0
04 Dec 2024
Generative Language Models Potential for Requirement Engineering
  Applications: Insights into Current Strengths and Limitations
Generative Language Models Potential for Requirement Engineering Applications: Insights into Current Strengths and Limitations
Summra Saleem
Muhammad Nabeel Asim
L. V. Elst
Andreas Dengel
278
1
0
01 Dec 2024
DynRank: Improving Passage Retrieval with Dynamic Zero-Shot Prompting
  Based on Question Classification
DynRank: Improving Passage Retrieval with Dynamic Zero-Shot Prompting Based on Question Classification
Abdelrahman Abdallah
Jamshid Mozafari
Bhawna Piryani
Mohammed M. Abdelgwad
Adam Jatowt
372
2
0
30 Nov 2024
A Flexible Method for Behaviorally Measuring Alignment Between Human and Artificial Intelligence Using Representational Similarity Analysis
A Flexible Method for Behaviorally Measuring Alignment Between Human and Artificial Intelligence Using Representational Similarity Analysis
Mattson Ogg
Ritwik Bose
Jamie Scharf
Christopher Ratto
Michael Wolmetz
458
3
0
30 Nov 2024
Can bidirectional encoder become the ultimate winner for downstream
  applications of foundation models?
Can bidirectional encoder become the ultimate winner for downstream applications of foundation models?
Lewen Yang
Xuanyu Zhou
Juao Fan
Xinyi Xie
Shengxin Zhu
AI4CE
281
1
0
27 Nov 2024
What Differentiates Educational Literature? A Multimodal Fusion Approach
  of Transformers and Computational Linguistics
What Differentiates Educational Literature? A Multimodal Fusion Approach of Transformers and Computational Linguistics
Jordan J. Bird
410
0
0
26 Nov 2024
Dynamic Self-Distillation via Previous Mini-batches for Fine-tuning
  Small Language Models
Dynamic Self-Distillation via Previous Mini-batches for Fine-tuning Small Language Models
Y. Fu
Yin Yu
Xiaotian Han
Runchao Li
Xianxuan Long
Haotian Yu
Pan Li
SyDa
390
0
0
25 Nov 2024
Profiling Bias in LLMs: Stereotype Dimensions in Contextual Word Embeddings
Profiling Bias in LLMs: Stereotype Dimensions in Contextual Word Embeddings
Carolin M. Schuster
Maria-Alexandra Dinisor
Shashwat Ghatiwala
Georg Groh
364
3
0
25 Nov 2024
Is Training Data Quality or Quantity More Impactful to Small Language Model Performance?
Is Training Data Quality or Quantity More Impactful to Small Language Model Performance?
Aryan Sajith
Krishna Chaitanya Rao Kathala
254
4
0
24 Nov 2024
A Comparative Analysis of Transformer and LSTM Models for Detecting
  Suicidal Ideation on Reddit
A Comparative Analysis of Transformer and LSTM Models for Detecting Suicidal Ideation on RedditInternational Conference on Machine Learning and Applications (ICMLA), 2024
Khalid Hasan
Jamil Saquer
AI4MH
266
8
0
23 Nov 2024
IRLab@iKAT24: Learned Sparse Retrieval with Multi-aspect LLM Query
  Generation for Conversational Search
IRLab@iKAT24: Learned Sparse Retrieval with Multi-aspect LLM Query Generation for Conversational Search
Simon Lupart
Zahra Abbasiantaeb
Mohammad Aliannejadi
RALM
185
4
0
22 Nov 2024
FLARE: FP-Less PTQ and Low-ENOB ADC Based AMS-PiM for Error-Resilient,
  Fast, and Efficient Transformer Acceleration
FLARE: FP-Less PTQ and Low-ENOB ADC Based AMS-PiM for Error-Resilient, Fast, and Efficient Transformer Acceleration
Donghyeon Yi
Seoyoung Lee
Jongho Kim
Junyoung Kim
Sohmyung Ha
Ik Joon Chang
Minkyu Je
214
0
0
22 Nov 2024
BERT-Based Approach for Automating Course Articulation Matrix
  Construction with Explainable AI
BERT-Based Approach for Automating Course Articulation Matrix Construction with Explainable AI
Natenaile Asmamaw Shiferaw
Simpenzwe Honore Leandre
Aman Sinha
Dillip Rout
136
0
0
21 Nov 2024
Forecasting Future International Events: A Reliable Dataset for
  Text-Based Event Modeling
Forecasting Future International Events: A Reliable Dataset for Text-Based Event ModelingConference on Empirical Methods in Natural Language Processing (EMNLP), 2024
Daehoon Gwak
Junwoo Park
Minho Park
C. Park
Hyunchan Lee
E. Choi
Jaegul Choo
260
1
0
21 Nov 2024
Mitigating Gender Bias in Contextual Word Embeddings
Mitigating Gender Bias in Contextual Word Embeddings
Navya Yarrabelly
Vinay Damodaran
Feng-Guang Su
249
0
0
18 Nov 2024
New Emerged Security and Privacy of Pre-trained Model: a Survey and
  Outlook
New Emerged Security and Privacy of Pre-trained Model: a Survey and Outlook
Meng Yang
Tianqing Zhu
Chi Liu
Wanlei Zhou
Shui Yu
Philip S. Yu
AAMLELMPILM
309
2
0
12 Nov 2024
Clustering in Causal Attention Masking
Clustering in Causal Attention MaskingNeural Information Processing Systems (NeurIPS), 2024
Nikita Karagodin
Yury Polyanskiy
Philippe Rigollet
317
20
0
07 Nov 2024
PSformer: Parameter-efficient Transformer with Segment Attention for Time Series Forecasting
PSformer: Parameter-efficient Transformer with Segment Attention for Time Series Forecasting
Yanlong Wang
Jinfeng Xu
Fei Ma
Shao-Lun Huang
Danny Dongning Sun
Xiao-Ping Zhang
AI4TS
315
2
0
03 Nov 2024
Multi-Channel Hypergraph Contrastive Learning for Matrix Completion
Multi-Channel Hypergraph Contrastive Learning for Matrix Completion
Xiang Li
Changsheng Shui
Yanwei Yu
Chao Huang
Zhongying Zhao
291
0
0
02 Nov 2024
Human-inspired Perspectives: A Survey on AI Long-term Memory
Human-inspired Perspectives: A Survey on AI Long-term Memory
Zihong He
Fan Zhang
Hao Zheng
Fan Zhang
Matt Jones
Laurence Aitchison
X. Xu
Xinyi Zheng
Miao Liu
Junxiao Shen
585
8
0
01 Nov 2024
ProTransformer: Robustify Transformers via Plug-and-Play Paradigm
ProTransformer: Robustify Transformers via Plug-and-Play ParadigmNeural Information Processing Systems (NeurIPS), 2024
Zhichao Hou
Weizhi Gao
Yuchen Shen
Feiyi Wang
Xiaorui Liu
VLM
262
2
0
30 Oct 2024
Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRA
Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRAInternational Conference on Learning Representations (ICLR), 2024
Sangmin Bae
Adam Fisch
Hrayr Harutyunyan
Ziwei Ji
Seungyeon Kim
Tal Schuster
KELM
389
20
0
28 Oct 2024
Ensembling Finetuned Language Models for Text Classification
Ensembling Finetuned Language Models for Text Classification
Sebastian Pineda Arango
Maciej Janowski
Lennart Purucker
Arber Zela
Katharina Eggensperger
Josif Grabocka
217
2
0
25 Oct 2024
Previous
123456...596061
Next