How to prepare your task head for finetuning

How to prepare your task head for finetuning

11 February 2023

Yi Ren

Danica J. Sutherland

Papers citing "How to prepare your task head for finetuning"

18 / 18 papers shown

Title
Training Strategies for Efficient Embodied Reasoning William Chen Suneel Belkhale Suvir Mirchandani Oier Mees Danny Driess Karl Pertsch Sergey Levine OffRL LRM 23 0 0 13 May 2025
Overcoming Vocabulary Constraints with Pixel-level Fallback Jonas F. Lotz Hendra Setiawan Stephan Peitz Yova Kementchedjhieva 40 0 0 02 Apr 2025
Visual Fourier Prompt Tuning Runjia Zeng Cheng Han Qifan Wang Chunshu Wu Tong Geng Lifu Huang Ying Nian Wu Dongfang Liu VPVLM VLM 50 6 0 02 Nov 2024
Understanding Simplicity Bias towards Compositional Mappings via Learning Dynamics Yi Ren Danica J. Sutherland CoGe 32 3 0 15 Sep 2024
Understanding Linear Probing then Fine-tuning Language Models from NTK Perspective Akiyoshi Tomihari Issei Sato 30 4 0 27 May 2024
Feature Alignment: Rethinking Efficient Active Learning via Proxy in the Context of Pre-trained Models Ziting Wen Oscar Pizarro Stefan B. Williams 23 0 0 02 Mar 2024
Domain-Aware Fine-Tuning: Enhancing Neural Network Adaptability Seokhyeon Ha S. Jung Jungwook Lee 14 3 0 15 Aug 2023
E^2VPT: An Effective and Efficient Approach for Visual Prompt Tuning Cheng Han Qifan Wang Yiming Cui Zhiwen Cao Wenguan Wang Siyuan Qi Dongfang Liu VPVLM VLM 17 46 0 25 Jul 2023
Guiding The Last Layer in Federated Learning with Pre-Trained Models G. Legate Nicolas Bernier Lucas Page-Caccia Edouard Oyallon Eugene Belilovsky FedML 11 8 0 06 Jun 2023
Synaptic Weight Distributions Depend on the Geometry of Plasticity Roman Pogodin Jonathan H. Cornford Arna Ghosh Gauthier Gidel Guillaume Lajoie Blake A. Richards 23 4 0 30 May 2023
First-order ANIL learns linear representations despite misspecified latent dimension Oğuz Kaan Yüksel Etienne Boursier Nicolas Flammarion 30 0 0 02 Mar 2023
UZH_CLyp at SemEval-2023 Task 9: Head-First Fine-Tuning and ChatGPT Data Generation for Cross-Lingual Learning in Tweet Intimacy Prediction Andrianos Michail Stefanos Konstantinou Simon Clematide 15 20 0 02 Mar 2023
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 305 7,434 0 11 Nov 2021
Pre-training Molecular Graph Representation with 3D Geometry Shengchao Liu Hanchen Wang Weiyang Liu Joan Lasenby Hongyu Guo Jian Tang 120 302 0 07 Oct 2021
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 267 3,371 0 09 Mar 2020
Bag of Tricks for Image Classification with Convolutional Neural Networks Tong He Zhi-Li Zhang Hang Zhang Zhongyue Zhang Junyuan Xie Mu Li 221 1,399 0 04 Dec 2018
MoleculeNet: A Benchmark for Molecular Machine Learning Zhenqin Wu Bharath Ramsundar Evan N. Feinberg Joseph Gomes C. Geniesse Aneesh S. Pappu K. Leswing Vijay S. Pande OOD 172 1,775 0 02 Mar 2017
Efficient Estimation of Word Representations in Vector Space Tomáš Mikolov Kai Chen G. Corrado J. Dean 3DV 239 31,257 0 16 Jan 2013