An Exploration of Hierarchical Attention Transformers for Efficient Long Document Classification

11 October 2022

Ilias Chalkidis

Xiang Dai

Manos Fergadiotis

Prodromos Malakasiotis

Desmond Elliott

ArXiv PDF HTML

Papers citing "An Exploration of Hierarchical Attention Transformers for Efficient Long Document Classification"

27 / 27 papers shown

Title
Towards Long Context Hallucination Detection Siyi Liu Kishaloy Halder Zheng Qi Wei Xiao Nikolaos Pappas Phu Mon Htut Neha Anna John Yassine Benajiba Dan Roth HILM 70 0 0 28 Apr 2025
Graph-tree Fusion Model with Bidirectional Information Propagation for Long Document Classification Sudipta Singha Roy Xindi Wang Robert E. Mercer Frank Rudzicz 14 0 0 03 Oct 2024
InterACT: Inter-dependency Aware Action Chunking with Hierarchical Attention Transformers for Bimanual Manipulation Andrew Lee Ian Chuang Ling-Yuan Chen Iman Soltani 26 6 0 12 Sep 2024
An alternative formulation of attention pooling function in translation Eddie Conti 18 0 0 23 Aug 2024
HDT: Hierarchical Document Transformer Haoyu He Markus Flicke Jan Buchmann Iryna Gurevych Andreas Geiger 20 0 0 11 Jul 2024
DAIC-WOZ: On the Validity of Using the Therapist's prompts in Automatic Depression Detection from Clinical Interviews Sergio Burdisso Ernesto Reyes-Ramírez Esaú Villatoro-Tello Fernando Sánchez-Vega Adrian Pastor Lopez-Monroy P. Motlícek 19 8 0 22 Apr 2024
Exploring Large Language Models and Hierarchical Frameworks for Classification of Large Unstructured Legal Documents Nishchal Prasad M. Boughanem T. Dkaki AILaw ELM 19 4 0 11 Mar 2024
Modeling the Quality of Dialogical Explanations Milad Alshomary Felix Lange Meisam Booshehri Meghdut Sengupta Philipp Cimiano Henning Wachsmuth 22 2 0 01 Mar 2024
Towards Explainability and Fairness in Swiss Judgement Prediction: Benchmarking on a Multilingual Dataset Santosh T.Y.S.S Nina Baumgartner Matthias Sturmer Matthias Grabmair Joel Niklaus ELM AILaw 26 2 0 26 Feb 2024
A Picture is Worth More Than 77 Text Tokens: Evaluating CLIP-Style Models on Dense Captions Jack Urbanek Florian Bordes Pietro Astolfi Mary Williamson Vasu Sharma Adriana Romero Soriano CLIP 3DV 20 41 0 14 Dec 2023
Recursion in Recursion: Two-Level Nested Recursion for Length Generalization with Scalability Jishnu Ray Chowdhury Cornelia Caragea 19 5 0 08 Nov 2023
VECHR: A Dataset for Explainable and Robust Classification of Vulnerability Type in the European Court of Human Rights Shanshan Xu Leon Staufer Santosh T.Y.S.S O. Ichim Corina Heri Matthias Grabmair 11 0 0 17 Oct 2023
An End-to-End System for Reproducibility Assessment of Source Code Repositories via Their Readmes Eyüp Kaan Akdeniz Selma Tekir Malik Nizar Asad Al Hinnawi SyDa 12 0 0 14 Oct 2023
Hallucination Reduction in Long Input Text Summarization Gregor Lenz Ronit Mandal Abhishek Agarwal Debarshi Kumar Sanyal HILM 13 8 0 28 Sep 2023
A Hierarchical Neural Framework for Classification and its Explanation in Large Unstructured Legal Documents Nishchal Prasad M. Boughanem Taoufik Dkaki ELM AILaw 11 0 0 19 Sep 2023
Large Language Model Prompt Chaining for Long Legal Document Classification Dietrich Trautmann ELM AILaw 8 10 0 08 Aug 2023
LogPrécis: Unleashing Language Models for Automated Malicious Log Analysis Matteo Boffa R. Valentim L. Vassio Danilo Giordano Idilio Drago Marco Mellia Zied Ben-Houidi 11 6 0 17 Jul 2023
Efficient Document Embeddings via Self-Contrastive Bregman Divergence Learning Daniel Saggau Mina Rezaei Bernd Bischl Ilias Chalkidis SSL MedIm 9 2 0 25 May 2023
A General-Purpose Multilingual Document Encoder Onur Galoglu Robert Litschko Goran Glavas 16 1 0 11 May 2023
A Survey on Long Text Modeling with Transformers Zican Dong Tianyi Tang Lunyi Li Wayne Xin Zhao VLM 6 52 0 28 Feb 2023
Leveraging Task Dependency and Contrastive Learning for Case Outcome Classification on European Court of Human Rights Cases Santosh T.Y.S.S Santosh T.Y.S.S Phillip Kemper Matthias Grabmair AILaw 26 13 0 01 Feb 2023
Zero-shot Transfer of Article-aware Legal Outcome Classification for European Court of Human Rights Cases Santosh T.Y.S.S O. Ichim Matthias Grabmair AILaw 11 16 0 01 Feb 2023
ContractNLI: A Dataset for Document-level Natural Language Inference for Contracts Yuta Koreeda Christopher D. Manning AILaw 84 96 0 05 Oct 2021
LexGLUE: A Benchmark Dataset for Legal Language Understanding in English Ilias Chalkidis Abhik Jana D. Hartung M. Bommarito Ion Androutsopoulos Daniel Martin Katz Nikolaos Aletras AILaw ELM 120 244 0 03 Oct 2021
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 246 1,982 0 28 Jul 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 220 3,054 0 23 Jan 2020
Neural Legal Judgment Prediction in English Ilias Chalkidis Ion Androutsopoulos Nikolaos Aletras AILaw ELM 98 279 0 05 Jun 2019