EfficientViT: Multi-Scale Linear Attention for High-Resolution Dense Prediction

29 May 2022

Han Cai

Junyan Li

Muyan Hu

Chuang Gan

Song Han

ArXiv PDF HTML

Papers citing "EfficientViT: Multi-Scale Linear Attention for High-Resolution Dense Prediction"

25 / 25 papers shown

Title
ORXE: Orchestrating Experts for Dynamically Configurable Efficiency Qingyuan Wang Guoxin Wang B. Cardiff Deepu John 31 0 0 07 May 2025
LiVOS: Light Video Object Segmentation with Gated Linear Matching Qin Liu Jianfeng Wang Z. Yang Linjie Li Kevin Qinghong Lin Marc Niethammer Lijuan Wang VOS 47 1 0 05 Nov 2024
Exploring the design space of deep-learning-based weather forecasting systems Shoaib Ahmed Siddiqui Jean Kossaifi Boris Bonev Christopher Choy Jan Kautz David M. Krueger Kamyar Azizzadenesheli AI4CE OOD 20 3 0 09 Oct 2024
On Efficient Variants of Segment Anything Model: A Survey Xiaorui Sun J. Liu H. Shen Xiaofeng Zhu Ping Hu VLM 43 4 0 07 Oct 2024
PHI-S: Distribution Balancing for Label-Free Multi-Teacher Distillation Mike Ranzinger Jon Barker Greg Heinrich Pavlo Molchanov Bryan Catanzaro Andrew Tao 28 4 0 02 Oct 2024
UNIT: Unifying Image and Text Recognition in One Vision Encoder Yi Zhu Yanpeng Zhou Chunwei Wang Yang Cao Jianhua Han Lu Hou Hang Xu ViT VLM 29 4 0 06 Sep 2024
Onboard Satellite Image Classification for Earth Observation: A Comparative Study of ViT Models Thanh-Dung Le Vu Nguyen Ha T. Nguyen G. Eappen P. Thiruvasagam ... J. L. González-Rios Luis M. Garces-Socarras Symeon Chatzinotas Juan Carlos Merlano-Duncan Symeon Chatzinotas 29 4 0 05 Sep 2024
PADRe: A Unifying Polynomial Attention Drop-in Replacement for Efficient Vision Transformer Pierre-David Létourneau Manish Kumar Singh Hsin-Pai Cheng Shizhong Han Yunxiao Shi Dalton Jones M. H. Langston Hong Cai Fatih Porikli 32 0 0 16 Jul 2024
Lite-SAM Is Actually What You Need for Segment Everything Jianhai Fu Yuanjie Yu Ningchuan Li Yi Zhang Qichao Chen Jianping Xiong Jun Yin Zhiyu Xiang VLM 29 4 0 12 Jul 2024
LOGCAN++: Adaptive Local-global class-aware network for semantic segmentation of remote sensing imagery Xiaowen Ma Rongrong Lian Zhenkai Wu Hongbo Guo Mengting Ma Sensen Wu Zhenhong Du Siyang Song Wei Zhang 32 4 0 24 Jun 2024
ToSA: Token Selective Attention for Efficient Vision Transformers Manish Kumar Singh R. Yasarla Hong Cai Mingu Lee Fatih Porikli 47 0 0 13 Jun 2024
U-DiTs: Downsample Tokens in U-Shaped Diffusion Transformers Yuchuan Tian Zhijun Tu Hanting Chen Jie Hu Chao Xu Yunhe Wang 31 16 0 04 May 2024
Tiny Models are the Computational Saver for Large Models Qingyuan Wang B. Cardiff Antoine Frappé Benoît Larras Deepu John 29 2 0 26 Mar 2024
Reinforcement Learning as a Parsimonious Alternative to Prediction Cascades: A Case Study on Image Segmentation Bharat Srikishan Anika Tabassum S. Allu Ramakrishnan Kannan Nikhil Muralidhar 31 1 0 19 Feb 2024
SqueezeSAM: User friendly mobile interactive segmentation Bala Varadarajan Bilge Soran Forrest N. Iandola Xiaoyu Xiang Yunyang Xiong Lemeng Wu Chenchen Zhu Raghuraman Krishnamoorthi Vikas Chandra VLM 24 2 0 11 Dec 2023
AM-RADIO: Agglomerative Vision Foundation Model -- Reduce All Domains Into One Michael Ranzinger Greg Heinrich Jan Kautz Pavlo Molchanov VLM 26 42 0 10 Dec 2023
LoG-CAN: local-global Class-aware Network for semantic segmentation of remote sensing images Xiaowen Ma Mengting Ma Chenlu Hu Zhiyuan Song Zi-Shu Zhao Tian Feng Wei Zhang 33 12 0 14 Mar 2023
Hydra Attention: Efficient Attention with Many Heads Daniel Bolya Cheng-Yang Fu Xiaoliang Dai Peizhao Zhang Judy Hoffman 99 76 0 15 Sep 2022
MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer Sachin Mehta Mohammad Rastegari ViT 189 1,200 0 05 Oct 2021
Mobile-Former: Bridging MobileNet and Transformer Yinpeng Chen Xiyang Dai Dongdong Chen Mengchen Liu Xiaoyi Dong Lu Yuan Zicheng Liu ViT 172 474 0 12 Aug 2021
Deep High-Resolution Representation Learning for Visual Recognition Jingdong Wang Ke Sun Tianheng Cheng Borui Jiang Chaorui Deng ... Yadong Mu Mingkui Tan Xinggang Wang Wenyu Liu Bin Xiao 190 3,516 0 20 Aug 2019
A Style-Based Generator Architecture for Generative Adversarial Networks Tero Karras S. Laine Timo Aila 262 10,320 0 12 Dec 2018
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications Andrew G. Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand M. Andreetto Hartwig Adam 3DH 948 20,471 0 17 Apr 2017
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 264 5,319 0 05 Nov 2016
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation Vijay Badrinarayanan Alex Kendall R. Cipolla SSeg 429 15,595 0 02 Nov 2015