Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequences

27 January 2022

Papers citing "Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequences"

8 / 8 papers shown

Title
Training Ultra Long Context Language Model with Fully Pipelined Distributed Transformer Jinghan Yao Sam Ade Jacobs Masahiro Tanaka Olatunji Ruwase A. Shafi D. Panda 23 2 0 30 Aug 2024
Using LLMs to label medical papers according to the CIViC evidence model Markus Hisch Xing David Wang 18 0 0 05 Jul 2024
FAIIR: Building Toward A Conversational AI Agent Assistant for Youth Mental Health Service Provision Stephen Obadinma Alia Lachana M. Norman Jocelyn Rankin Joanna Yu Xiaodan Zhu Darren Mastropaolo D. Pandya Roxana Sultan Elham Dolatabadi AI4MH 19 1 0 28 May 2024
FuseMoE: Mixture-of-Experts Transformers for Fleximodal Fusion Xing Han Huy Nguyen Carl Harris Nhat Ho S. Saria MoE 39 16 0 05 Feb 2024
CPLLM: Clinical Prediction with Large Language Models Ofir Ben Shoham Nadav Rappoport LM&MA 11 24 0 20 Sep 2023
Parameter-Efficient Fine-Tuning of LLaMA for the Clinical Domain Aryo Pradipta Gema Pasquale Minervini Luke Daines Tom Hope Beatrice Alex LM&MA ALM 14 40 0 06 Jul 2023
DARE: Towards Robust Text Explanations in Biomedical and Healthcare Applications Adam Ivankay Mattia Rigotti P. Frossard OOD MedIm 8 1 0 05 Jul 2023
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 246 1,982 0 28 Jul 2020