Tranception: protein fitness prediction with autoregressive transformers
and inference-time retrieval

Tranception: protein fitness prediction with autoregressive transformers and inference-time retrieval

27 May 2022

Javier Marchena-Hurtado

Papers citing "Tranception: protein fitness prediction with autoregressive transformers and inference-time retrieval"

11 / 11 papers shown

Title
MassSpecGym: A benchmark for the discovery and identification of molecules Roman Bushuiev Anton Bushuiev Niek F. de Jonge A. Young Fleming Kretschmer ... Justin J. J. van der Hooft Michael A. Stravs Sebastian Böcker Josef Sivic Tomáš Pluskal 41 4 0 17 Feb 2025
Life-Code: Central Dogma Modeling with Multi-Omics Sequence Unification Zicheng Liu Siyuan Li Zhiyuan Chen Lei Xin Fang Wu Chang Yu Qirong Yang Yucheng Guo Y. Yang Stan Z. Li SyDa AI4CE 82 0 0 11 Feb 2025
Metalic: Meta-Learning In-Context with Protein Language Models Jacob Beck Shikha Surana Manus McAuliffe Oliver Bent Thomas D. Barrett Juan Jose Garau Luis Paul Duckworth AI4CE 23 0 0 10 Oct 2024
ProteinGPT: Multimodal LLM for Protein Property Prediction and Structure Understanding Yijia Xiao Edward Sun Yiqiao Jin Qifan Wang Wei Wang 29 9 0 21 Aug 2024
Kermut: Composite kernel regression for protein variant effects Peter Mørch Groth Mads Herbert Kerrn Lars Olsen Jesper Salomon Wouter Boomsma 21 2 0 09 Apr 2024
ProtChatGPT: Towards Understanding Proteins with Large Language Models Chao Wang Hehe Fan Ruijie Quan Yi Yang 21 12 0 15 Feb 2024
Multi-level Protein Representation Learning for Blind Mutational Effect Prediction Y. Tan Bingxin Zhou Yuanhong Jiang Yu Wang Liang Hong 13 2 0 08 Jun 2023
A Text-guided Protein Design Framework Shengchao Liu Yanjing Li Zhuoxinran Li A. Gitter Yutao Zhu ... Arvind Ramanathan Chaowei Xiao Jian Tang Hongyu Guo Anima Anandkumar 40 60 0 09 Feb 2023
Primer: Searching for Efficient Transformers for Language Modeling David R. So Wojciech Mañke Hanxiao Liu Zihang Dai Noam M. Shazeer Quoc V. Le VLM 83 149 0 17 Sep 2021
Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation Ofir Press Noah A. Smith M. Lewis 234 690 0 27 Aug 2021
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 220 3,054 0 23 Jan 2020