Language Models on a Diet: Cost-Efficient Development of Encoders for
Closely-Related Languages via Additional Pretraining

Language Models on a Diet: Cost-Efficient Development of Encoders for Closely-Related Languages via Additional Pretraining

8 April 2024

Nikola Ljubesic

Vít Suchomel

Papers citing "Language Models on a Diet: Cost-Efficient Development of Encoders for Closely-Related Languages via Additional Pretraining"

5 / 5 papers shown

Title
Advancing MAPF towards the Real World: A Scalable Multi-Agent Realistic Testbed (SMART) Jingtian Yan Zhifei Li William Kang Yulun Zhang Stephen Smith Jiaoyang Li 43 0 0 03 Mar 2025
Improving Customer Service with Automatic Topic Detection in User Emails Bojana Bašaragin Darija Medvecki Gorana Gojić Milena Oparnica D. Mišković 57 0 0 26 Feb 2025
Generative Model for Less-Resourced Language with 1 billion parameters Domen Vreš Martin Božič Aljaž Potočnik Tomaž Martinčič Marko Robnik-Šikonja 26 1 0 09 Oct 2024
Breaking the Curse of Multilinguality with Cross-lingual Expert Language Models Terra Blevins Tomasz Limisiewicz Suchin Gururangan Margaret Li Hila Gonen Noah A. Smith Luke Zettlemoyer 42 22 0 19 Jan 2024
The ParlaSent Multilingual Training Dataset for Sentiment Identification in Parliamentary Proceedings Michal Mochtak Peter Rupnik Nikola Ljubesic AILaw 19 4 0 18 Sep 2023