Hierarchical Transformers for Long Document Classification

23 October 2019

Jesús Villalba

Najim Dehak

Papers citing "Hierarchical Transformers for Long Document Classification"

50 / 89 papers shown

Title
Iterative Counterfactual Data Augmentation Mitchell Plyler Min Chi 70 0 0 25 Feb 2025
QABISAR: Query-Article Bipartite Interactions for Statutory Article Retrieval T. Y. S. S. Santosh Hassan Sarwat Matthias Grabmair 67 0 0 01 Dec 2024
CTPD: Cross-Modal Temporal Pattern Discovery for Enhanced Multimodal Electronic Health Records Analysis Fuying Wang Feng Wu Yihan Tang Lequan Yu AI4TS 30 0 0 01 Nov 2024
No Argument Left Behind: Overlapping Chunks for Faster Processing of Arbitrarily Long Legal Texts Israel Campos Fama Bárbara Dias Bueno Alexandre Alcoforado Thomas Palmeira Ferraz Arnold Moya Anna Helena Reali Costa AILaw 19 0 0 24 Oct 2024
ChuLo: Chunk-Level Key Information Representation for Long Document Processing Yan Li Soyeon Caren Han Yue Dai Feiqi Cao 28 0 0 14 Oct 2024
Deformable NeRF using Recursively Subdivided Tetrahedra Zherui Qiu Chenqu Ren Kaiwen Song Xiaoyi Zeng Leyuan Yang Juyong Zhang 13 1 0 06 Oct 2024
Graph-tree Fusion Model with Bidirectional Information Propagation for Long Document Classification Sudipta Singha Roy Xindi Wang Robert E. Mercer Frank Rudzicz 19 0 0 03 Oct 2024
Leveraging Long-Context Large Language Models for Multi-Document Understanding and Summarization in Enterprise Applications Aditi Godbole Jabin Geevarghese George Smita Shandilya 24 3 0 27 Sep 2024
HLogformer: A Hierarchical Transformer for Representing Log Data Zhichao Hou Mina Ghashami Mikhail Kuznetsov MohamadAli Torkamani 23 0 0 29 Aug 2024
TempoFormer: A Transformer for Temporally-aware Representations in Change Detection Talia Tseriotou Adam Tsakalidis Maria Liakata 31 0 0 28 Aug 2024
Domain-specific long text classification from sparse relevant information Célia DĆruz J. Bereder Frédéric Precioso Michel Riveill 34 0 0 23 Aug 2024
Beyond Next Token Prediction: Patch-Level Training for Large Language Models Chenze Shao Fandong Meng Jie Zhou 46 1 0 17 Jul 2024
Hierarchical Multi-modal Transformer for Cross-modal Long Document Classification Tengfei Liu Yongli Hu Junbin Gao Yanfeng Sun Baocai Yin 28 0 0 14 Jul 2024
Block Transformer: Global-to-Local Language Modeling for Fast Inference Namgyu Ho Sangmin Bae Taehyeon Kim Hyunjik Jo Yireun Kim Tal Schuster Adam Fisch James Thorne Se-Young Yun 45 8 0 04 Jun 2024
Enriched BERT Embeddings for Scholarly Publication Classification Benjamin Wolff Eva Seidlmayer Konrad U. Förstner 23 3 0 07 May 2024
Investigating Text Shortening Strategy in BERT: Truncation vs Summarization Mirza Alim Mutasodirin Radityo Eko Prasojo 21 8 0 19 Mar 2024
Simple Hack for Transformers against Heavy Long-Text Classification on a Time- and Memory-Limited GPU Service Mirza Alim Mutasodirin Radityo Eko Prasojo Achmad F. Abka Hanif Rasyidi VLM 28 0 0 19 Mar 2024
NextLevelBERT: Masked Language Modeling with Higher-Level Representations for Long Documents Tamara Czinczoll Christoph Hones Maximilian Schall Gerard de Melo 35 2 0 27 Feb 2024
FuseMoE: Mixture-of-Experts Transformers for Fleximodal Fusion Xing Han Huy Nguyen Carl Harris Nhat Ho S. Saria MoE 77 16 0 05 Feb 2024
ULTRA: Unleash LLMs' Potential for Event Argument Extraction through Hierarchical Modeling and Pair-wise Self-Refinement Xinliang Frederick Zhang Carter Blum Temma Choji Shalin S Shah Alakananda Vempala 61 12 0 24 Jan 2024
HOT: Higher-Order Dynamic Graph Representation Learning with Efficient Transformers Maciej Besta Afonso Claudino Catarino Lukas Gianinazzi Nils Blach Piotr Nyczyk H. Niewiadomski Torsten Hoefler 35 6 0 30 Nov 2023
Breaking the Token Barrier: Chunking and Convolution for Efficient Long Text Classification with BERT Aman Jaiswal E. Milios VLM 13 7 0 31 Oct 2023
Interactive Distillation of Large Single-Topic Corpora of Scientific Papers N. Solovyev Ryan Barron Manish Bhattarai M. Eren Kim Ø. Rasmussen Boian S. Alexandrov 16 1 0 19 Sep 2023
A Hierarchical Neural Framework for Classification and its Explanation in Large Unstructured Legal Documents Nishchal Prasad M. Boughanem Taoufik Dkaki ELM AILaw 26 0 0 19 Sep 2023
LaFiCMIL: Rethinking Large File Classification from the Perspective of Correlated Multiple Instance Learning Tiezhu Sun Weiguo Pian N. Daoudi Kevin Allix Tegawende F. Bissyande Jacques Klein 31 1 0 30 Jul 2023
ARC-NLP at PAN 2023: Hierarchical Long Text Classification for Trigger Detection Umitcan Sahin Izzet Emre Kucukkaya Cagri Toraman 17 2 0 27 Jul 2023
Identifying Misinformation on YouTube through Transcript Contextual Analysis with Transformer Models Christos Christodoulou Nikos Salamanos Pantelitsa Leonidou Michail Papadakis Michael Sirivianos 14 2 0 22 Jul 2023
Can Model Fusing Help Transformers in Long Document Classification? An Empirical Study Damith Premasiri Tharindu Ranasinghe R. Mitkov VLM 29 1 0 18 Jul 2023
Attention over pre-trained Sentence Embeddings for Long Document Classification Amine Abdaoui Sourav Dutta 22 1 0 18 Jul 2023
RECAP: Retrieval-Enhanced Context-Aware Prefix Encoder for Personalized Dialogue Response Generation Shuai Liu Hyundong Justin Cho Marjorie Freedman Xuezhe Ma Jonathan May 27 26 0 12 Jun 2023
Recurrent Attention Networks for Long-text Modeling Xianming Li Zongxi Li Xiaotian Luo Haoran Xie Xing Lee Yingbin Zhao Fu Lee Wang Qing Li RALM 28 15 0 12 Jun 2023
Examining risks of racial biases in NLP tools for child protective services Anjalie Field Amanda Coston Nupoor Gandhi Alexandra Chouldechova Emily Putnam-Hornstein David Steier Yulia Tsvetkov 31 13 0 30 May 2023
DLUE: Benchmarking Document Language Understanding Ruoxi Xu Hongyu Lin Xinyan Guan Xianpei Han Yingfei Sun Le Sun ELM 24 0 0 16 May 2023
A General-Purpose Multilingual Document Encoder Onur Galoglu Robert Litschko Goran Glavas 31 2 0 11 May 2023
HiPool: Modeling Long Documents Using Graph Neural Networks Irene Z Li Aosong Feng Dragomir R. Radev Rex Ying 17 5 0 05 May 2023
Leveraging BERT Language Model for Arabic Long Document Classification Muhammad Al-Qurishi 16 0 0 04 May 2023
Covidia: COVID-19 Interdisciplinary Academic Knowledge Graph Cheng Deng Jiaxin Ding Luoyi Fu Weinan Zhang Xinbing Wang Cheng Zhou 16 2 0 14 Apr 2023
Automatic ICD-10 Code Association: A Challenging Task on French Clinical Texts Yakini Tchouka Jean-François Couchot David Laiymani Philippe Selles Azzedine Rahmani 25 3 0 06 Apr 2023
Multidimensional Perceptron for Efficient and Explainable Long Text Classification Yexiang Wang Yating Zhang Xiaozhong Liu Changlong Sun 8 0 0 04 Apr 2023
Finding the Needle in a Haystack: Unsupervised Rationale Extraction from Long Text Classifiers Kamil Bujel Andrew Caines H. Yannakoudakis Marek Rei AI4TS 19 1 0 14 Mar 2023
A Survey on Long Text Modeling with Transformers Zican Dong Tianyi Tang Lunyi Li Wayne Xin Zhao VLM 21 54 0 28 Feb 2023
Efficient Joint Learning for Clinical Named Entity Recognition and Relation Extraction Using Fourier Networks: A Use Case in Adverse Drug Events A. Yazdani D. Proios H. Rouhizadeh Douglas Teodoro 21 7 0 08 Feb 2023
Finding the Law: Enhancing Statutory Article Retrieval via Graph Neural Networks Antoine Louis Gijs van Dijck Gerasimos Spanakis AILaw 21 9 0 30 Jan 2023
A Comparative Study of Pretrained Language Models for Long Clinical Text Yikuan Li R. M. Wehbe F. Ahmad Hanyin Wang Yuan Luo LM&MA ELM VLM MedIm 26 79 0 27 Jan 2023
Hawk: An Industrial-strength Multi-label Document Classifier Arshad Javeed 34 1 0 15 Jan 2023
NEEDED: Introducing Hierarchical Transformer to Eye Diseases Diagnosis Xuesong Ye Meng Xiao Zhiyuan Ning Weiwei Dai Wenjuan Cui Yi Du Yuanchun Zhou 25 9 0 27 Dec 2022
Assessing the Impact of Sequence Length Learning on Classification Tasks for Transformer Encoder Models Jean-Thomas Baillargeon Luc Lamontagne 35 1 0 16 Dec 2022
Mortality Prediction Models with Clinical Notes Using Sparse Attention at the Word and Sentence Levels Miguel Rios A. Abu-Hanna 16 0 0 12 Dec 2022
An Automatic ICD Coding Network Using Partition-Based Label Attention Daeseong Kim Haanju Yoo Sewon Kim 22 5 0 15 Nov 2022
Improving Medical Predictions by Irregular Multimodal Electronic Health Records Modeling Xinlu Zhang Shiyang Li Zhiyu Zoey Chen Xifeng Yan Linda R. Petzold AI4TS 51 26 0 18 Oct 2022