FlauBERT: Unsupervised Language Model Pre-training for French

11 December 2019

Papers citing "FlauBERT: Unsupervised Language Model Pre-training for French"

35 / 35 papers shown

Title
Extraction multi-étiquettes de relations en utilisant des couches de Transformer Ngoc Luyen Le Gildas Tagny Ngompé 60 0 0 24 Feb 2025
Training Bilingual LMs with Data Constraints in the Targeted Language Skyler Seto Maartje ter Hoeve He Bai Natalie Schluter David Grangier 77 0 0 20 Nov 2024
A Benchmark Evaluation of Clinical Named Entity Recognition in French N. Bannour Christophe Servan Aurélie Névéol Xavier Tannier 16 0 0 28 Mar 2024
The DeepZen Speech Synthesis System for Blizzard Challenge 2023 C. Veaux R. Maia Spyridoula Papendreou 16 1 0 30 Aug 2023
Multiscale Contextual Learning for Speech Emotion Recognition in Emergency Call Center Conversations Théo Deschamps-Berger L. Lamel Laurence Devillers 19 2 0 28 Aug 2023
Cascaded Cross-Modal Transformer for Request and Complaint Detection Nicolae-Cătălin Ristea Radu Tudor Ionescu 18 3 0 27 Jul 2023
SwissBERT: The Multilingual Language Model for Switzerland Jannis Vamvas Johannes Graen Rico Sennrich 25 6 0 23 Mar 2023
Improving Transformer Performance for French Clinical Notes Classification Using Mixture of Experts on a Limited Dataset Thanh-Dung Le P. Jouvet R. Noumeir MoE MedIm 67 5 0 22 Mar 2023
Fillers in Spoken Language Understanding: Computational and Psycholinguistic Perspectives Tanvi Dinkar Chloé Clavel I. Vasilescu 16 10 0 25 Jan 2023
Ensembling Transformers for Cross-domain Automatic Term Extraction T. Hanh Matej Martinc Andraz Pelicon Antoine Doucet Senja Pollak 11 5 0 12 Dec 2022
An Easy-to-use and Robust Approach for the Differentially Private De-Identification of Clinical Textual Documents Yakini Tchouka Jean-François Couchot David Laiymani OOD 21 1 0 02 Nov 2022
Benchmarking Transformers-based models on French Spoken Language Understanding tasks Oralie Cattan Sahar Ghannay Christophe Servan Sophie Rosset 20 4 0 19 Jul 2022
A Spoken Drug Prescription Dataset in French for Spoken Language Understanding A. Kocabiyikoglu Franccois Portet Prudence Gibert H. Blanchon Jean-Marc Babouchkine Gaetan Gavazzi 11 2 0 17 Jul 2022
Multimodal E-Commerce Product Classification Using Hierarchical Fusion Tsegaye Misikir Tashu Sara Fattouh Peter Kiss Tomáš Horváth 22 1 0 07 Jul 2022
DistilCamemBERT: a distillation of the French model CamemBERT Cyrile Delestre Abibatou Amar 24 5 0 23 May 2022
You Are What You Write: Preserving Privacy in the Era of Large Language Models Richard Plant V. Giuffrida Dimitra Gkatzia PILM 15 19 0 20 Apr 2022
Mono vs Multilingual BERT for Hate Speech Detection and Text Classification: A Case Study in Marathi Abhishek Velankar H. Patil Raviraj Joshi 28 31 0 19 Apr 2022
mGPT: Few-Shot Learners Go Multilingual Oleh Shliazhko Alena Fenogenova Maria Tikhonova Vladislav Mikhailov Anastasia Kozlova Tatiana Shavrina 31 148 0 15 Apr 2022
CINO: A Chinese Minority Pre-trained Language Model Ziqing Yang Zihang Xu Yiming Cui Baoxin Wang Min-Bin Lin Dayong Wu Zhigang Chen 13 25 0 28 Feb 2022
Cedille: A large autoregressive French language model Martin Müller Florian Laurent 34 19 0 07 Feb 2022
Speech Resources in the Tamasheq Language Marcely Zanon Boito Fethi Bougares Florentin Barbier Souhir Gahbiche Loïc Barrault Mickael Rouvier Yannick Esteve 18 14 0 13 Jan 2022
Automatic Pharma News Categorization S. Adaszewski P. Kuner Ralf J. Jaeger OOD 11 3 0 28 Dec 2021
Are the Multilingual Models Better? Improving Czech Sentiment with Transformers Pavel Přibáň J. Steinberger 28 11 0 24 Aug 2021
Context-aware Adversarial Training for Name Regularity Bias in Named Entity Recognition Abbas Ghaddar Philippe Langlais Ahmad Rashid Mehdi Rezagholizadeh 30 42 0 24 Jul 2021
FLAT: An Optimized Dataflow for Mitigating Attention Bottlenecks Sheng-Chun Kao Suvinay Subramanian Gaurav Agrawal Amir Yazdanbakhsh T. Krishna 30 57 0 13 Jul 2021
A Primer on Pretrained Multilingual Language Models Sumanth Doddapaneni Gowtham Ramesh Mitesh M. Khapra Anoop Kunchukuttan Pratyush Kumar LRM 35 73 0 01 Jul 2021
Evaluation Of Word Embeddings From Large-Scale French Web Content Hadi Abdine Christos Xypolopoulos Moussa Kamal Eddine Michalis Vazirgiannis 25 6 0 05 May 2021
HerBERT: Efficiently Pretrained Transformer-based Language Model for Polish Robert Mroczkowski Piotr Rybak Alina Wróblewska Ireneusz Gawlik 14 81 0 04 May 2021
Czert -- Czech BERT-like Model for Language Representation Jakub Sido O. Pražák P. Pribán Jan Pasek Michal Seják Miloslav Konopík 8 43 0 24 Mar 2021
GLGE: A New General Language Generation Evaluation Benchmark Dayiheng Liu Yu Yan Yeyun Gong Weizhen Qi Hang Zhang ... Jiancheng Lv Ruofei Zhang Winnie Wu Ming Zhou Nan Duan ELM 35 66 0 24 Nov 2020
EstBERT: A Pretrained Language-Specific BERT for Estonian Hasan Tanvir Claudia Kittask Sandra Eiche Kairit Sirts 4 36 0 09 Nov 2020
PhoBERT: Pre-trained language models for Vietnamese Dat Quoc Nguyen A. Nguyen 162 341 0 02 Mar 2020
FQuAD: French Question Answering Dataset Martin d'Hoffschmidt Wacim Belblidia Tom Brendlé Quentin Heinrich Maxime Vidal 19 98 0 14 Feb 2020
BERTje: A Dutch BERT Model Wietse de Vries Andreas van Cranenburgh Arianna Bisazza Tommaso Caselli Gertjan van Noord Malvina Nissim VLM SSeg 11 291 0 19 Dec 2019
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 294 6,943 0 20 Apr 2018