Automated Mining of Leaderboards for Empirical AI Research

31 August 2021

Papers citing "Automated Mining of Leaderboards for Empirical AI Research"

14 / 14 papers shown

Title
Efficient Performance Tracking: Leveraging Large Language Models for Automated Construction of Scientific Leaderboards Furkan Şahinuç Thy Thy Tran Yulia Grishina Yufang Hou Bei Chen Iryna Gurevych 16 6 0 19 Sep 2024
On the Workflows and Smells of Leaderboard Operations (LBOps): An Exploratory Study of Foundation Model Leaderboards Zhimin Zhao A. A. Bangash F. Côgo Bram Adams Ahmed E. Hassan 46 0 0 04 Jul 2024
Effective Context Selection in LLM-based Leaderboard Generation: An Empirical Study Salomon Kabongo Jennifer D'Souza Sören Auer 20 3 0 06 Jun 2024
Large Language Models for Scientific Information Extraction: An Empirical Study for Virology Mahsa Shamsabadi Jennifer D'Souza Sören Auer 18 6 0 18 Jan 2024
LEGOBench: Scientific Leaderboard Generation Benchmark Shruti Singh Shoaib Alam Husain Malwat Mayank Singh ELM 15 1 0 11 Jan 2024
GSAP-NER: A Novel Task, Corpus, and Baseline for Scholarly Entity Extraction Focused on Machine Learning Models and Datasets Wolfgang Otto Matthäus Zloch Lu Gan Saurav Karmakar Stefan Dietze 17 8 0 16 Nov 2023
All Data on the Table: Novel Dataset and Benchmark for Cross-Modality Scientific Information Extraction Yuhan Li Jian Wu Zhiwei Yu Börje F. Karlsson Wei Shen Manabu Okumura Chin-Yew Lin 11 1 0 14 Nov 2023
Enhancing AI Research Paper Analysis: Methodology Component Extraction using Factored Transformer-based Sequence Modeling Approach Madhusudan Ghosh Debasis Ganguly Partha Basuchowdhuri S. Naskar 13 0 0 05 Nov 2023
ORKG-Leaderboards: A Systematic Workflow for Mining Leaderboards as a Knowledge Graph Salomon Kabongo KABENAMUALU Jennifer D'Souza Sören Auer 28 18 0 10 May 2023
Zero-shot Entailment of Leaderboards for Empirical AI Research Salomon Kabongo KABENAMUALU Jennifer D'Souza Sören Auer 17 9 0 29 Mar 2023
Clustering Semantic Predicates in the Open Research Knowledge Graph Omar Arab Oghli Jennifer D'Souza Sören Auer 42 1 0 05 Oct 2022
Overview of STEM Science as Process, Method, Material, and Data Named Entities Jennifer D'Souza 11 1 0 24 May 2022
Computer Science Named Entity Recognition in the Open Research Knowledge Graph Jennifer D'Souza Sören Auer 6 13 0 28 Mar 2022
Cross-Domain Multi-Task Learning for Sequential Sentence Classification in Research Papers Arthur Brack Anett Hoppe Pascal Buschermöhle Ralph Ewerth 8 14 0 11 Feb 2021