Difference-Masking: Choosing What to Mask in Continued Pretraining

23 May 2023

Papers citing "Difference-Masking: Choosing What to Mask in Continued Pretraining"

4 / 4 papers shown

Title
KidLM: Advancing Language Models for Children -- Early Insights and Future Directions Mir Tafseer Nayeem Davood Rafiei ALM 23 3 0 04 Oct 2024
Efficient Vision-Language Pre-training by Cluster Masking Zihao Wei Zixuan Pan Andrew Owens VLM 21 6 0 14 May 2024
Salient Span Masking for Temporal Understanding Jeremy R. Cole Aditi Chaudhary Bhuwan Dhingra Partha P. Talukdar 21 11 0 22 Mar 2023
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 258 7,337 0 11 Nov 2021