LEGAL-BERT: The Muppets straight out of Law School

6 October 2020

Ilias Chalkidis

Manos Fergadiotis

Prodromos Malakasiotis

Papers citing "LEGAL-BERT: The Muppets straight out of Law School"

37 / 37 papers shown

Title
Towards Effective Time-Aware Language Representation: Exploring Enhanced Temporal Understanding in Language Models Jiexin Wang Adam Jatowt Yi Cai AI4CE 39 1 0 04 Jun 2024
Pretrained Generative Language Models as General Learning Frameworks for Sequence-Based Tasks Ben Fauber 32 2 0 08 Feb 2024
INACIA: Integrating Large Language Models in Brazilian Audit Courts: Opportunities and Challenges J. Pereira Andre Assumpcao J. Trecenti Luiz Airosa Caio Lente Jhonatan Cléto Guilherme Dobins Rodrigo Nogueira Luis Mitchell R. Lotufo 37 2 0 10 Jan 2024
Multi-Defendant Legal Judgment Prediction via Hierarchical Reasoning Yougang Lyu Jitai Hao Zihan Wang Kai Zhao Shen Gao Pengjie Ren Zhumin Chen Fang Wang Zhaochun Ren AILaw 27 9 0 10 Dec 2023
Learning Representations on Logs for AIOps Pranjal Gupta Harshit Kumar Debanjana Kar Karan Bhukar Pooja Aggarwal P. Mohapatra 45 11 0 18 Aug 2023
Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Survey Chen Ling Xujiang Zhao Jiaying Lu Chengyuan Deng Can Zheng ... Chris White Quanquan Gu Jian Pei Carl Yang Liang Zhao ALM 33 126 0 30 May 2023
LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond Philippe Laban Wojciech Kry'sciñski Divyansh Agarwal Alexander R. Fabbri Caiming Xiong Chenyu You Chien-Sheng Wu ALM HILM 38 33 0 23 May 2023
AGI for Agriculture Guoyu Lu Sheng Li Gengchen Mai Jin Sun Dajiang Zhu ... R. Xu Daniel Petti Changying Li Tianming Liu Changying Li AI4CE 48 17 0 12 Apr 2023
Making a Computational Attorney Dell Zhang Frank Schilder Jack G. Conrad Masoud Makrehchi David von Rickenbach Isabelle Moulinier 27 1 0 07 Mar 2023
Adopting the Multi-answer Questioning Task with an Auxiliary Metric for Extreme Multi-label Text Classification Utilizing the Label Hierarchy Li Wang Y. Teh M. Al-garadi 20 2 0 02 Mar 2023
Lightweight Transformers for Clinical Natural Language Processing Omid Rohanian Mohammadmahdi Nouriborji Hannah Jauncey Samaneh Kouchaki Isaric Clinical Characterisation Group Lei A. Clifton L. Merson David Clifton MedIm LM&MA 29 12 0 09 Feb 2023
Zero-Shot Learning for Requirements Classification: An Exploratory Study Waad Alhoshan Alessio Ferrari Liping Zhao VLM 19 39 0 09 Feb 2023
Zero-shot Transfer of Article-aware Legal Outcome Classification for European Court of Human Rights Cases Santosh T.Y.S.S O. Ichim Matthias Grabmair AILaw 32 17 0 01 Feb 2023
Investigating Strategies for Clause Recommendation Sagar Joshi Sumanth Balaji Jerrin Thomas Aparna Garimella Vasudeva Varma AILaw 15 1 0 21 Jan 2023
The Effects of In-domain Corpus Size on pre-training BERT Chris Sanchez Zheyu Zhang AI4CE 16 4 0 15 Dec 2022
Legal Prompting: Teaching a Language Model to Think Like a Lawyer Fang Yu Lee Quartey Frank Schilder ELM LRM 18 64 0 02 Dec 2022
Using Selective Masking as a Bridge between Pre-training and Fine-tuning Tanish Lad Himanshu Maheshwari Shreyas Kottukkal R. Mamidi 24 3 0 24 Nov 2022
An Efficient Active Learning Pipeline for Legal Text Classification Sepideh Mamooler R. Lebret Stéphane Massonnet Karl Aberer AILaw 27 4 0 15 Nov 2022
Privacy-Preserving Models for Legal Natural Language Processing Ying Yin Ivan Habernal PILM AILaw 11 8 0 05 Nov 2022
Are Sample-Efficient NLP Models More Robust? Nelson F. Liu Ananya Kumar Percy Liang Robin Jia VLM OOD 30 6 0 12 Oct 2022
Spread Love Not Hate: Undermining the Importance of Hateful Pre-training for Hate Speech Detection Omkar Gokhale Aditya Kane Shantanu Patankar Tanmay Chavan Raviraj Joshi VLM 35 7 0 09 Oct 2022
Law Informs Code: A Legal Informatics Approach to Aligning Artificial Intelligence with Humans John J. Nay ELM AILaw 88 27 0 14 Sep 2022
On the Role of Negative Precedent in Legal Outcome Prediction Josef Valvoda Ryan Cotterell Simone Teufel ELM AILaw 31 29 0 17 Aug 2022
SsciBERT: A Pre-trained Language Model for Social Science Texts Si Shen Jiang-fu Liu Litao Lin Ying Huang Lin Zhang Changting Liu Yu Feng Dongbo Wang 11 27 0 09 Jun 2022
Unsupervised Law Article Mining based on Deep Pre-Trained Language Representation Models with Application to the Italian Civil Code Andrea Tagarelli Andrea Simeri AILaw 31 44 0 02 Dec 2021
Building Chinese Biomedical Language Models via Multi-Level Text Discrimination Quan Wang Songtai Dai Benfeng Xu Yajuan Lyu Yong Zhu Hua Wu Haifeng Wang 71 14 0 14 Oct 2021
The Unreasonable Effectiveness of the Baseline: Discussing SVMs in Legal Text Classification Benjamin Clavié Marc Alphonsus ELM AILaw 37 10 0 15 Sep 2021
Learning Bill Similarity with Annotated and Augmented Corpora of Bills Jiseon Kim Elden Griggs In Song Kim Alice Oh AILaw 20 5 0 14 Sep 2021
Question Answering over Electronic Devices: A New Benchmark Dataset and a Multi-Task Learning based QA Framework Abhilash Nandy Soumya Sharma Shubham Maddhashiya K. Sachdeva Pawan Goyal Niloy Ganguly 30 17 0 13 Sep 2021
IndoBERTweet: A Pretrained Language Model for Indonesian Twitter with Effective Domain-Specific Vocabulary Initialization Fajri Koto Jey Han Lau Timothy Baldwin VLM 55 82 0 10 Sep 2021
PyEuroVoc: A Tool for Multilingual Legal Document Classification with EuroVoc Descriptors Andrei-Marius Avram V. Pais D. Tufis AILaw VLM 29 17 0 02 Aug 2021
Language Identification of Hindi-English tweets using code-mixed BERT M. Z. Ansari M. Beg Tanvir Ahmad Mohd Jazib Khan Ghazali Wasim 45 14 0 02 Jul 2021
Linguistically Informed Masking for Representation Learning in the Patent Domain Sophia Althammer Mark Buckley Sebastian Hofstatter Allan Hanbury 45 11 0 10 Jun 2021
Lawformer: A Pre-trained Language Model for Chinese Legal Long Documents Chaojun Xiao Xueyu Hu Zhiyuan Liu Cunchao Tu Maosong Sun AILaw ELM 48 230 0 09 May 2021
Evaluating Pre-Trained Models for User Feedback Analysis in Software Engineering: A Study on Classification of App-Reviews M. Hadi Fatemeh H. Fard 26 30 0 12 Apr 2021
Neural Legal Judgment Prediction in English Ilias Chalkidis Ion Androutsopoulos Nikolaos Aletras AILaw ELM 123 327 0 05 Jun 2019
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 304 6,996 0 20 Apr 2018