LEGAL-BERT: The Muppets straight out of Law School

6 October 2020

Ilias Chalkidis

Manos Fergadiotis

Prodromos Malakasiotis

Papers citing "LEGAL-BERT: The Muppets straight out of Law School"

37 / 37 papers shown

Title
Towards Effective Time-Aware Language Representation: Exploring Enhanced Temporal Understanding in Language Models Jiexin Wang Adam Jatowt Yi Cai AI4CE 37 1 0 04 Jun 2024
Pretrained Generative Language Models as General Learning Frameworks for Sequence-Based Tasks Ben Fauber 32 2 0 08 Feb 2024
INACIA: Integrating Large Language Models in Brazilian Audit Courts: Opportunities and Challenges J. Pereira Andre Assumpcao J. Trecenti Luiz Airosa Caio Lente Jhonatan Cléto Guilherme Dobins Rodrigo Nogueira Luis Mitchell R. Lotufo 34 2 0 10 Jan 2024
Multi-Defendant Legal Judgment Prediction via Hierarchical Reasoning Yougang Lyu Jitai Hao Zihan Wang Kai Zhao Shen Gao Pengjie Ren Zhumin Chen Fang Wang Zhaochun Ren AILaw 27 9 0 10 Dec 2023
Learning Representations on Logs for AIOps Pranjal Gupta Harshit Kumar Debanjana Kar Karan Bhukar Pooja Aggarwal P. Mohapatra 45 11 0 18 Aug 2023
Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Survey Chen Ling Xujiang Zhao Jiaying Lu Chengyuan Deng Can Zheng ... Chris White Quanquan Gu Jian Pei Carl Yang Liang Zhao ALM 33 126 0 30 May 2023
LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond Philippe Laban Wojciech Kry'sciñski Divyansh Agarwal Alexander R. Fabbri Caiming Xiong Shafiq Joty Chien-Sheng Wu ALM HILM 35 33 0 23 May 2023
AGI for Agriculture Guoyu Lu Sheng Li Gengchen Mai Jin Sun Dajiang Zhu ... R. Xu Daniel Petti Changying Li Tianming Liu Changying Li AI4CE 48 17 0 12 Apr 2023
Making a Computational Attorney Dell Zhang Frank Schilder Jack G. Conrad Masoud Makrehchi David von Rickenbach Isabelle Moulinier 24 1 0 07 Mar 2023
Adopting the Multi-answer Questioning Task with an Auxiliary Metric for Extreme Multi-label Text Classification Utilizing the Label Hierarchy Li Wang Y. Teh M. Al-garadi 20 2 0 02 Mar 2023
Lightweight Transformers for Clinical Natural Language Processing Omid Rohanian Mohammadmahdi Nouriborji Hannah Jauncey Samaneh Kouchaki Isaric Clinical Characterisation Group Lei A. Clifton L. Merson David A. Clifton MedIm LM&MA 24 12 0 09 Feb 2023
Zero-Shot Learning for Requirements Classification: An Exploratory Study Waad Alhoshan Alessio Ferrari Liping Zhao VLM 17 39 0 09 Feb 2023
Zero-shot Transfer of Article-aware Legal Outcome Classification for European Court of Human Rights Cases Santosh T.Y.S.S O. Ichim Matthias Grabmair AILaw 32 17 0 01 Feb 2023
Investigating Strategies for Clause Recommendation Sagar Joshi Sumanth Balaji Jerrin Thomas Aparna Garimella Vasudeva Varma AILaw 13 1 0 21 Jan 2023
The Effects of In-domain Corpus Size on pre-training BERT Chris Sanchez Zheyu Zhang AI4CE 16 4 0 15 Dec 2022
Legal Prompting: Teaching a Language Model to Think Like a Lawyer Fang Yu Lee Quartey Frank Schilder ELM LRM 18 64 0 02 Dec 2022
Using Selective Masking as a Bridge between Pre-training and Fine-tuning Tanish Lad Himanshu Maheshwari Shreyas Kottukkal R. Mamidi 24 3 0 24 Nov 2022
An Efficient Active Learning Pipeline for Legal Text Classification Sepideh Mamooler R. Lebret Stéphane Massonnet Karl Aberer AILaw 27 4 0 15 Nov 2022
Privacy-Preserving Models for Legal Natural Language Processing Ying Yin Ivan Habernal PILM AILaw 11 8 0 05 Nov 2022
Are Sample-Efficient NLP Models More Robust? Nelson F. Liu Ananya Kumar Percy Liang Robin Jia VLM OOD 30 6 0 12 Oct 2022
Spread Love Not Hate: Undermining the Importance of Hateful Pre-training for Hate Speech Detection Omkar Gokhale Aditya Kane Shantanu Patankar Tanmay Chavan Raviraj Joshi VLM 35 7 0 09 Oct 2022
Law Informs Code: A Legal Informatics Approach to Aligning Artificial Intelligence with Humans John J. Nay ELM AILaw 88 27 0 14 Sep 2022
On the Role of Negative Precedent in Legal Outcome Prediction Josef Valvoda Ryan Cotterell Simone Teufel ELM AILaw 31 29 0 17 Aug 2022
SsciBERT: A Pre-trained Language Model for Social Science Texts Si Shen Jiang-fu Liu Litao Lin Ying Huang Lin Zhang Changting Liu Yu Feng Dongbo Wang 11 27 0 09 Jun 2022
Unsupervised Law Article Mining based on Deep Pre-Trained Language Representation Models with Application to the Italian Civil Code Andrea Tagarelli Andrea Simeri AILaw 31 44 0 02 Dec 2021
Building Chinese Biomedical Language Models via Multi-Level Text Discrimination Quan Wang Songtai Dai Benfeng Xu Yajuan Lyu Yong Zhu Hua Wu Haifeng Wang 71 14 0 14 Oct 2021
The Unreasonable Effectiveness of the Baseline: Discussing SVMs in Legal Text Classification Benjamin Clavié Marc Alphonsus ELM AILaw 37 10 0 15 Sep 2021
Learning Bill Similarity with Annotated and Augmented Corpora of Bills Jiseon Kim Elden Griggs In Song Kim Alice Oh AILaw 20 5 0 14 Sep 2021
Question Answering over Electronic Devices: A New Benchmark Dataset and a Multi-Task Learning based QA Framework Abhilash Nandy Soumya Sharma Shubham Maddhashiya K. Sachdeva Pawan Goyal Niloy Ganguly 30 17 0 13 Sep 2021
IndoBERTweet: A Pretrained Language Model for Indonesian Twitter with Effective Domain-Specific Vocabulary Initialization Fajri Koto Jey Han Lau Timothy Baldwin VLM 55 82 0 10 Sep 2021
PyEuroVoc: A Tool for Multilingual Legal Document Classification with EuroVoc Descriptors Andrei-Marius Avram V. Pais D. Tufis AILaw VLM 24 17 0 02 Aug 2021
Language Identification of Hindi-English tweets using code-mixed BERT M. Z. Ansari M. Beg Tanvir Ahmad Mohd Jazib Khan Ghazali Wasim 45 14 0 02 Jul 2021
Linguistically Informed Masking for Representation Learning in the Patent Domain Sophia Althammer Mark Buckley Sebastian Hofstatter Allan Hanbury 42 11 0 10 Jun 2021
Lawformer: A Pre-trained Language Model for Chinese Legal Long Documents Chaojun Xiao Xueyu Hu Zhiyuan Liu Cunchao Tu Maosong Sun AILaw ELM 48 229 0 09 May 2021
Evaluating Pre-Trained Models for User Feedback Analysis in Software Engineering: A Study on Classification of App-Reviews M. Hadi Fatemeh H. Fard 26 30 0 12 Apr 2021
Neural Legal Judgment Prediction in English Ilias Chalkidis Ion Androutsopoulos Nikolaos Aletras AILaw ELM 123 327 0 05 Jun 2019
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 299 6,996 0 20 Apr 2018