DistilDoc: Knowledge Distillation for Visually-Rich Document Applications

DistilDoc: Knowledge Distillation for Visually-Rich Document Applications

12 June 2024

Jordy Van Landeghem

Matthew Blaschko

Marie-Francine Moens

Papers citing "DistilDoc: Knowledge Distillation for Visually-Rich Document Applications"

7 / 7 papers shown

Title
DocSum: Domain-Adaptive Pre-training for Document Abstractive Summarization Phan Phuong Mai Chau Souhail Bakkali Antoine Doucet 69 0 0 11 Dec 2024
Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes Lokesh Nagalapatti Chun-Liang Li Chih-Kuan Yeh Hootan Nakhost Yasuhisa Fujii Alexander Ratner Ranjay Krishna Chen-Yu Lee Tomas Pfister ALM 204 498 0 03 May 2023
SelfDocSeg: A Self-Supervised vision-based Approach towards Document Segmentation Subhajit Maity Sanket Biswas Siladittya Manna Ayan Banerjee Josep Lladós Saumik Bhattacharya Umapada Pal 34 5 0 01 May 2023
I-ViT: Integer-only Quantization for Efficient Vision Transformer Inference Zhikai Li Qingyi Gu MQ 41 94 0 04 Jul 2022
Distilling Knowledge via Knowledge Review Pengguang Chen Shu-Lin Liu Hengshuang Zhao Jiaya Jia 147 416 0 19 Apr 2021
LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understanding Yang Xu Yiheng Xu Tengchao Lv Lei Cui Furu Wei ... D. Florêncio Cha Zhang Wanxiang Che Min Zhang Lidong Zhou ViT MLLM 137 492 0 29 Dec 2020
FUNSD: A Dataset for Form Understanding in Noisy Scanned Documents Guillaume Jaume H. K. Ekenel Jean-Philippe Thiran 112 259 0 27 May 2019