ProGen: Language Modeling for Protein Generation

8 March 2020

Papers citing "ProGen: Language Modeling for Protein Generation"

31 / 31 papers shown

Title
BioMaze: Benchmarking and Enhancing Large Language Models for Biological Pathway Reasoning Haiteng Zhao Chang Ma FangZhi Xu Lingpeng Kong Zhi-Hong Deng LRM 44 2 0 23 Feb 2025
A Comprehensive Survey of Foundation Models in Medicine Wasif Khan Seowung Leem Kyle B. See Joshua K. Wong Shaoting Zhang R. Fang AI4CE LM&MA VLM 102 18 0 17 Jan 2025
MAMMAL -- Molecular Aligned Multi-Modal Architecture and Language Yoel Shoshan Moshiko Raboh Michal Ozery-Flato Vadim Ratner Alex Golts ... Sharon Kurant Joseph A. Morrone Parthasarathy Suryanarayanan Michal Rosen-Zvi Efrat Hexter 26 1 0 28 Oct 2024
Metalic: Meta-Learning In-Context with Protein Language Models Jacob Beck Shikha Surana Manus McAuliffe Oliver Bent Thomas D. Barrett Juan Jose Garau Luis Paul Duckworth AI4CE 28 0 0 10 Oct 2024
Is novelty predictable? Clara Fannjiang Jennifer Listgarten AI4CE 17 14 0 01 Jun 2023
Improving Autoregressive NLP Tasks via Modular Linearized Attention Victor Agostinelli Lizhong Chen 22 1 0 17 Apr 2023
On Pre-trained Language Models for Antibody Danqing Wang Fei Ye Zhou Hao 33 10 0 28 Jan 2023
ProtST: Multi-Modality Learning of Protein Sequences and Biomedical Texts Minghao Xu Xinyu Yuan Santiago Miret Jian Tang AI4TS 25 94 0 28 Jan 2023
Ankh: Optimized Protein Language Model Unlocks General-Purpose Modelling Ahmed Elnaggar Hazem Essam Wafaa Salah-Eldin Walid Moustafa Mohamed Elkerdawy Charlotte Rochereau B. Rost 153 86 0 16 Jan 2023
Generative Antibody Design for Complementary Chain Pairing Sequences through Encoder-Decoder Language Model S. K. Chu K. Wei AI4CE 19 7 0 06 Jan 2023
A Survey on Protein Representation Learning: Retrospect and Prospect Lirong Wu Yu-Feng Huang H. Lin Stan Z. Li AI4TS 26 12 0 31 Dec 2022
Unsupervised language models for disease variant prediction Allan Zhou Nicholas C. Landolfi Daniel C. O’Neill 14 0 0 07 Dec 2022
Multi-segment preserving sampling for deep manifold sampler Daniel Berenberg Jae Hyeon Lee S. Kelow Ji Won Park Andrew Watkins Vladimir Gligorijević Richard Bonneau Stephen Ra Kyunghyun Cho MedIm 13 5 0 09 May 2022
Few Shot Protein Generation Soumya Ram Tristan Bepler 21 6 0 03 Apr 2022
Protein language models trained on multiple sequence alignments learn phylogenetic relationships Umberto Lupo Damiano Sgarbossa Anne-Florence Bitbol 19 34 0 29 Mar 2022
Improving Molecular Representation Learning with Metric Learning-enhanced Optimal Transport Fang Wu Nicolas Courty Shuting Jin Stan Z. Li OOD OT 13 8 0 13 Feb 2022
Compute Trends Across Three Eras of Machine Learning J. Sevilla Lennart Heim A. Ho T. Besiroglu Marius Hobbhahn Pablo Villalobos 20 269 0 11 Feb 2022
Pre-training Co-evolutionary Protein Representation via A Pairwise Masked Language Model Liang He Shizhuo Zhang Lijun Wu Huanhuan Xia Fusong Ju ... Jianwei Zhu Pan Deng Bin Shao Tao Qin Tie-Yan Liu 18 31 0 29 Oct 2021
Cross-lingual Transfer of Monolingual Models Evangelia Gogoulou Ariel Ekgren T. Isbister Magnus Sahlgren 27 16 0 15 Sep 2021
Deep Generative Modeling for Protein Design Alexey Strokach Philip M. Kim AI4CE 179 90 0 31 Aug 2021
Deep Extrapolation for Attribute-Enhanced Generation Alvin Chan Ali Madani Ben Krause Nikhil Naik 19 24 0 07 Jul 2021
A Generative Model for Raw Audio Using Transformer Architectures Prateek Verma C. Chafe 8 28 0 30 Jun 2021
Fold2Seq: A Joint Sequence(1D)-Fold(3D) Embedding-based Generative Model for Protein Design Yue Cao Payel Das Vijil Chenthamarakshan Pin-Yu Chen Igor Melnyk Yang Shen 24 45 0 24 Jun 2021
Protein sequence-to-structure learning: Is this the end(-to-end revolution)? É. Laine Stephan Eismann A. Elofsson Sergei Grudinin OOD 3DV 15 34 0 16 May 2021
Protein sequence design with deep generative models Zachary Wu Kadina E. Johnston F. Arnold Kevin Kaichuang Yang 11 134 0 09 Apr 2021
Profile Prediction: An Alignment-Based Pre-Training Task for Protein Sequence Models Pascal Sturmfels Jesse Vig Ali Madani Nazneen Rajani 8 24 0 01 Dec 2020
AdaLead: A simple and robust adaptive greedy search algorithm for sequence design Sam Sinai Richard Wang Alexander Whatley Stewart Slocum Elina Locane Eric D. Kelsic 17 77 0 05 Oct 2020
Rethinking Attention with Performers K. Choromanski Valerii Likhosherstov David Dohan Xingyou Song Andreea Gane ... Afroz Mohiuddin Lukasz Kaiser David Belanger Lucy J. Colwell Adrian Weller 8 1,517 0 30 Sep 2020
BERTology Meets Biology: Interpreting Attention in Protein Language Models Jesse Vig Ali Madani L. Varshney Caiming Xiong R. Socher Nazneen Rajani 15 288 0 26 Jun 2020
A Survey of Deep Learning for Scientific Discovery M. Raghu Erica Schmidt OOD AI4CE 35 120 0 26 Mar 2020
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism M. Shoeybi M. Patwary Raul Puri P. LeGresley Jared Casper Bryan Catanzaro MoE 245 1,817 0 17 Sep 2019