FairLex: A Multilingual Benchmark for Evaluating Fairness in Legal Text Processing

14 March 2022

Sebastian Felix Schwemer

Anders Søgaard

AILaw

ArXiv PDF HTML

Papers citing "FairLex: A Multilingual Benchmark for Evaluating Fairness in Legal Text Processing"

40 / 40 papers shown

Title
LegalBench.PT: A Benchmark for Portuguese Law Beatriz Canaverde Telmo Pessoa Pires Leonor Melo Ribeiro Andre F. T. Martins AILaw ELM 62 0 0 22 Feb 2025
LegalViz: Legal Text Visualization by Text To Diagram Generation Eri Onami Taiki Miyanishi Koki Maeda Shuhei Kurita AILaw 66 1 0 10 Feb 2025
Natural Language Processing for the Legal Domain: A Survey of Tasks, Datasets, Models, and Challenges Farid Ariai Gianluca Demartini ELM AILaw VLM 36 4 0 25 Oct 2024
Do Large Language Models Have an English Accent? Evaluating and Improving the Naturalness of Multilingual LLMs Yanzhu Guo Simone Conia Zelin Zhou Min Li Saloni Potdar Henry Xiao 33 1 0 21 Oct 2024
LexSumm and LexT5: Benchmarking and Modeling Legal Summarization Tasks in English T. Y. S. S. Santosh Cornelius Weiss Matthias Grabmair AILaw ELM 47 2 0 12 Oct 2024
Developing a Pragmatic Benchmark for Assessing Korean Legal Language Understanding in Large Language Models Yeeun Kim Young Rok Choi Eunkyung Choi Jinhwan Choi H. Park Wonseok Hwang ELM AILaw 28 0 0 11 Oct 2024
The Craft of Selective Prediction: Towards Reliable Case Outcome Classification -- An Empirical Study on European Court of Human Rights Cases T. Y. S. S. Santosh Irtiza Chowdhury Shanshan Xu Matthias Grabmair AILaw 20 0 0 27 Sep 2024
Incorporating Precedents for Legal Judgement Prediction on European Court of Human Rights Cases T. Y. S. S. Santosh Mohamed Hesham Elganayni Stanisław Sójka Matthias Grabmair AILaw 19 1 0 27 Sep 2024
FairFlow: An Automated Approach to Model-based Counterfactual Data Augmentation For NLP E. Tokpo T. Calders 14 1 0 23 Jul 2024
IL-TUR: Benchmark for Indian Legal Text Understanding and Reasoning Abhinav Joshi Shounak Paul Akshat Sharma Pawan Goyal Saptarshi Ghosh Ashutosh Modi AILaw ELM 26 7 0 07 Jul 2024
Teaching LLMs to Abstain across Languages via Multilingual Feedback Shangbin Feng Weijia Shi Yike Wang Wenxuan Ding Orevaoghene Ahia Shuyue Stella Li Vidhisha Balachandran Sunayana Sitaram Yulia Tsvetkov 65 4 0 22 Jun 2024
Towards Supporting Legal Argumentation with NLP: Is More Data Really All You Need? T. Y. S. S Santosh Kevin D. Ashley Katie Atkinson Matthias Grabmair ELM AILaw 27 1 0 16 Jun 2024
Continual Learning of Large Language Models: A Comprehensive Survey Haizhou Shi Zihao Xu Hengyi Wang Weiyi Qin Wenyuan Wang Yibin Wang Zifeng Wang Sayna Ebrahimi Hao Wang CLL KELM LRM 37 62 0 25 Apr 2024
Are Compressed Language Models Less Subgroup Robust? Leonidas Gee Andrea Zugarini Novi Quadrianto 21 1 0 26 Mar 2024
Towards Explainability and Fairness in Swiss Judgement Prediction: Benchmarking on a Multilingual Dataset Santosh T.Y.S.S Nina Baumgartner Matthias Sturmer Matthias Grabmair Joel Niklaus ELM AILaw 26 6 0 26 Feb 2024
Through the Lens of Split Vote: Exploring Disagreement, Difficulty and Calibration in Legal Case Outcome Classification Shanshan Xu Santosh T.Y.S.S O. Ichim Barbara Plank Matthias Grabmair 17 4 0 11 Feb 2024
MELO: Enhancing Model Editing with Neuron-Indexed Dynamic LoRA Lang Yu Qin Chen Jie Zhou Liang He KELM 13 45 0 19 Dec 2023
A Survey on Knowledge Editing of Neural Networks Vittorio Mazzia Alessandro Pedrani Andrea Caciolai Kay Rottmann Davide Bernardi KELM 12 24 0 30 Oct 2023
Do Not Harm Protected Groups in Debiasing Language Representation Models Chloe Qinyu Zhu Rickard Stureborg Brandon Fain 14 0 0 27 Oct 2023
On the Interplay between Fairness and Explainability Stephanie Brandl Emanuele Bugliarello Ilias Chalkidis FaML 25 4 0 25 Oct 2023
Knowledge Editing for Large Language Models: A Survey Song Wang Yaochen Zhu Haochen Liu Zaiyi Zheng Chen Chen Jundong Li KELM 66 132 0 24 Oct 2023
Empowering Refugee Claimants and their Lawyers: Using Machine Learning to Examine Decision-Making in Refugee Law Claire Barale 16 0 0 22 Aug 2023
Bringing order into the realm of Transformer-based language models for artificial intelligence and law C. M. Greco Andrea Tagarelli AILaw 14 19 0 10 Aug 2023
Being Right for Whose Right Reasons? Terne Sasha Thorn Jakobsen Laura Cabello Anders Søgaard 19 10 0 01 Jun 2023
Revisiting non-English Text Simplification: A Unified Multilingual Benchmark Michael Joseph Ryan Tarek Naous Wei-ping Xu 24 24 0 25 May 2023
LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model Development Ilias Chalkidis Nicolas Garneau Catalina Goanta Daniel Martin Katz Anders Søgaard AILaw ELM 17 56 0 12 May 2023
On the Independence of Association Bias and Empirical Fairness in Language Models Laura Cabello Anna Katrine van Zee Anders Søgaard 24 25 0 20 Apr 2023
Leveraging Task Dependency and Contrastive Learning for Case Outcome Classification on European Court of Human Rights Cases Santosh T.Y.S.S Santosh T.Y.S.S Phillip Kemper Matthias Grabmair AILaw 40 13 0 01 Feb 2023
Zero-shot Transfer of Article-aware Legal Outcome Classification for European Court of Human Rights Cases Santosh T.Y.S.S O. Ichim Matthias Grabmair AILaw 11 17 0 01 Feb 2023
Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors Thomas Hartvigsen S. Sankaranarayanan Hamid Palangi Yoon Kim Marzyeh Ghassemi KELM 14 143 0 20 Nov 2022
Knowledge is Power: Understanding Causality Makes Legal judgment Prediction Models More Generalizable and Robust Haotian Chen Lingwei Zhang Yiran Liu Fanchao Chen Yang Yu AILaw ELM 22 5 0 06 Nov 2022
Deconfounding Legal Judgment Prediction for European Court of Human Rights Cases Towards Better Alignment with Experts Santosh T.Y.S.S Shanshan Xu O. Ichim Matthias Grabmair 16 26 0 25 Oct 2022
On Learning Fairness and Accuracy on Multiple Subgroups Changjian Shui Gezheng Xu Qi Chen Jiaqi Li Charles X. Ling Tal Arbel Boyu Wang Christian Gagné 37 37 0 19 Oct 2022
Systematic Evaluation of Predictive Fairness Xudong Han Aili Shen Trevor Cohn Timothy Baldwin Lea Frermann 19 7 0 17 Oct 2022
A Multi-Task Benchmark for Korean Legal Language Understanding and Judgement Prediction Wonseok Hwang Dongjun Lee Kyoungyeon Cho Han-Yuan Lee Minjoon Seo ELM AILaw 19 40 0 10 Jun 2022
LexGLUE: A Benchmark Dataset for Legal Language Understanding in English Ilias Chalkidis Abhik Jana D. Hartung M. Bommarito Ion Androutsopoulos Daniel Martin Katz Nikolaos Aletras AILaw ELM 123 247 0 03 Oct 2021
On Measures of Biases and Harms in NLP Sunipa Dev Emily Sheng Jieyu Zhao Aubrie Amstutz Jiao Sun ... M. Sanseverino Jiin Kim Akihiro Nishi Nanyun Peng Kai-Wei Chang 17 80 0 07 Aug 2021
Out-of-Distribution Generalization via Risk Extrapolation (REx) David M. Krueger Ethan Caballero J. Jacobsen Amy Zhang Jonathan Binas Dinghuai Zhang Rémi Le Priol Aaron Courville OOD 215 898 0 02 Mar 2020
A Survey on Bias and Fairness in Machine Learning Ninareh Mehrabi Fred Morstatter N. Saxena Kristina Lerman Aram Galstyan SyDa FaML 294 4,187 0 23 Aug 2019
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 294 6,943 0 20 Apr 2018