ProGen2: Exploring the Boundaries of Protein Language Models

ProGen2: Exploring the Boundaries of Protein Language Models

27 June 2022

Erik Nijkamp

Jeffrey A. Ruffolo

Eli N. Weinstein

Papers citing "ProGen2: Exploring the Boundaries of Protein Language Models"

14 / 14 papers shown

Title
Large Language Models in Bioinformatics: A Survey Z. Wang Zikang Wang Jiyue Jiang Pengan Chen Xiangyu Shi Yu-Hu Li AI4CE LM&MA 56 1 0 06 Mar 2025
Preference optimization of protein language models as a multi-objective binder design paradigm Pouria A. Mistani Venkatesh Mysore 22 6 0 07 Mar 2024
Materials Informatics Transformer: A Language Model for Interpretable Materials Properties Prediction Hongshuo Huang Rishikesh Magar Chang Xu A. Farimani AI4CE 25 4 0 30 Aug 2023
Multi-level Protein Representation Learning for Blind Mutational Effect Prediction Y. Tan Bingxin Zhou Yuanhong Jiang Yu Wang Liang Hong 21 2 0 08 Jun 2023
Is novelty predictable? Clara Fannjiang Jennifer Listgarten AI4CE 10 14 0 01 Jun 2023
Accurate and Definite Mutational Effect Prediction with Lightweight Equivariant Graph Neural Networks Bingxin Zhou Outongyi Lv Kai Yi Xinye Xiong P. Tan Liang Hong Yu Wang 20 4 0 13 Apr 2023
BloombergGPT: A Large Language Model for Finance Shijie Wu Ozan Irsoy Steven Lu Vadim Dabravolski Mark Dredze Sebastian Gehrmann P. Kambadur David S. Rosenberg Gideon Mann AIFin 51 780 0 30 Mar 2023
ProtST: Multi-Modality Learning of Protein Sequences and Biomedical Texts Minghao Xu Xinyu Yuan Santiago Miret Jian Tang AI4TS 17 93 0 28 Jan 2023
Ankh: Optimized Protein Language Model Unlocks General-Purpose Modelling Ahmed Elnaggar Hazem Essam Wafaa Salah-Eldin Walid Moustafa Mohamed Elkerdawy Charlotte Rochereau B. Rost 153 84 0 16 Jan 2023
Generative Antibody Design for Complementary Chain Pairing Sequences through Encoder-Decoder Language Model S. K. Chu K. Wei AI4CE 19 7 0 06 Jan 2023
SESNet: sequence-structure feature-integrated deep learning method for data-efficient protein engineering Mingchen Li Liqi Kang Y. Xiong Yu Wang Guisheng Fan P. Tan Liang Hong 16 22 0 29 Dec 2022
Tranception: protein fitness prediction with autoregressive transformers and inference-time retrieval Pascal Notin M. Dias J. Frazer Javier Marchena-Hurtado Aidan N. Gomez D. Marks Y. Gal 53 174 0 27 May 2022
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 226 4,424 0 23 Jan 2020
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism M. Shoeybi M. Patwary Raul Puri P. LeGresley Jared Casper Bryan Catanzaro MoE 243 1,815 0 17 Sep 2019