v1v2 (latest)

Adapting Pretrained Language Models for Citation Classification via Self-Supervised Contrastive Learning

20 May 2025

Papers citing "Adapting Pretrained Language Models for Citation Classification via Self-Supervised Contrastive Learning"

25 / 25 papers shown

Title
HLM-Cite: Hybrid Language Model Workflow for Text-based Scientific Citation Prediction Qianyue Hao Jingyang Fan Fengli Xu Jian Yuan Yong Li 67 9 0 10 Oct 2024
Fine-Tuned 'Small' LLMs (Still) Significantly Outperform Zero-Shot Generative AI Models in Text Classification Martin Juan José Bucher Marco Martini ALM AI4MH 125 36 0 12 Jun 2024
Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey Zeyu Han Chao Gao Jinyang Liu Jeff Zhang Sai Qian Zhang 303 403 0 21 Mar 2024
PST-Bench: Tracing and Benchmarking the Source of Publications Fanjin Zhang Kun Cao Yukuo Cen Jifan Yu Da Yin Jie Tang 47 9 0 25 Feb 2024
Citance-Contextualized Summarization of Scientific Papers S. Syed Ahmad Dawar Hakimi Khalid Al Khatib Martin Potthast 121 6 0 04 Nov 2023
Lost in the Middle: How Language Models Use Long Contexts Nelson F. Liu Kevin Lin John Hewitt Ashwin Paranjape Michele Bevilacqua Fabio Petroni Percy Liang RALM 134 1,662 0 06 Jul 2023
Pre-training Multi-task Contrastive Learning Models for Scientific Literature Understanding Yu Zhang Hao Cheng Zhihong Shen Xiaodong Liu Yejiang Wang Jianfeng Gao 88 14 0 23 May 2023
Patton: Language Model Pretraining on Text-Rich Networks Bowen Jin Wentao Zhang Yu Zhang Yu Meng Xinyang Zhang Qi Zhu Jiawei Han VLM 110 46 0 20 May 2023
Tell Me How to Survey: Literature Review Made Simple with Automatic Reading Path Generation Jiayuan Ding Tong Xiang Zijing Ou Wangyang Zuo Ruihui Zhao Chenghua Lin Yefeng Zheng Bang Liu 69 5 0 12 Oct 2021
Cutting Down on Prompts and Parameters: Simple Few-Shot Learning with Language Models Robert L Logan IV Ivana Balavzević Eric Wallace Fabio Petroni Sameer Singh Sebastian Riedel VPVLM 106 212 0 24 Jun 2021
CLEAR: Contrastive Learning for Sentence Representation Zhuofeng Wu Sinong Wang Jiatao Gu Madian Khabsa Fei Sun Hao Ma SSL 82 324 0 31 Dec 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 1.1K 42,651 0 28 May 2020
SPECTER: Document-level Representation Learning using Citation-informed Transformers Arman Cohan Sergey Feldman Iz Beltagy Doug Downey Daniel S. Weld AI4TS 135 561 0 15 Apr 2020
Longformer: The Long-Document Transformer Iz Beltagy Matthew E. Peters Arman Cohan RALM VLM 224 4,109 0 10 Apr 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 431 18,968 0 13 Feb 2020
Structural Scaffolds for Citation Intent Classification in Scientific Publications Arman Cohan Bridger Waleed Ammar Madeleine van Zuylen Field Cady 79 253 0 02 Apr 2019
SciBERT: A Pretrained Language Model for Scientific Text Iz Beltagy Kyle Lo Arman Cohan 235 2,996 0 26 Mar 2019
Parameter-Efficient Transfer Learning for NLP N. Houlsby A. Giurgiu Stanislaw Jastrzebski Bruna Morrone Quentin de Laroussilhe Andrea Gesmundo Mona Attariyan Sylvain Gelly 238 4,549 0 02 Feb 2019
EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks Jason W. Wei Kai Zou 119 1,965 0 31 Jan 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.9K 95,554 0 11 Oct 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 446 10,386 0 10 Jul 2018
Deep contextualized word representations Matthew E. Peters Mark Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer NAI 298 11,576 0 15 Feb 2018
Improved Regularization of Convolutional Neural Networks with Cutout Terrance Devries Graham W. Taylor 177 3,783 0 15 Aug 2017
Scientific document summarization via citation contextualization and scientific discourse Arman Cohan Nazli Goharian 204 96 0 12 Jun 2017
Supervised Learning of Universal Sentence Representations from Natural Language Inference Data Alexis Conneau Douwe Kiela Holger Schwenk Loïc Barrault Antoine Bordes AI4TS SSL 254 2,106 0 05 May 2017