A Simple Multi-Modality Transfer Learning Baseline for Sign Language Translation

8 March 2022

Papers citing "A Simple Multi-Modality Transfer Learning Baseline for Sign Language Translation"

47 / 47 papers shown

Title
MixSignGraph: A Sign Sequence is Worth Mixed Graphs of Nodes Shiwei Gan Yafeng Yin Zhiwei Jiang Hongkai Wen Lei Xie Sanglu Lu SLR 37 0 0 16 Apr 2025
ADAT: Time-Series-Aware Adaptive Transformer Architecture for Sign Language Translation Nada Shahin Leila Ismail SLR 39 0 0 16 Apr 2025
Sign Language Translation using Frame and Event Stream: Benchmark Dataset and Algorithms X. Wang Y. Li Fuling Wang Bo Jiang Y. Wang Yonghong Tian Jin Tang Bin Luo SLR 74 0 0 09 Mar 2025
Deep Understanding of Sign Language for Sign to Subtitle Alignment Youngjoon Jang Jeongsoo Choi Junseok Ahn Joon Son Chung SLR 69 0 0 05 Mar 2025
Co-creation for Sign Language Processing and Machine Translation Lisa Lepp D. Shterionov M. D. Sisto Grzegorz Chrupała SLR 56 0 0 03 Mar 2025
Large Multimodal Models for Low-Resource Languages: A Survey Marian Lupascu Ana-Cristina Rogoz Mihai-Sorin Stupariu Radu Tudor Ionescu 51 1 0 08 Feb 2025
Using Pre-trained LLMs for Multivariate Time Series Forecasting Malcolm Wolff Shenghao Yang Kari Torkkola Michael W. Mahoney AI4TS AIFin 36 1 0 10 Jan 2025
Beyond Words: AuralLLM and SignMST-C for Sign Language Production and Bidirectional Accessibility Yulong Li Yuxuan Zhang Feilong Tang M. Zhou Zhixiang Lu ... Jionglong Su Chong Li Yifang Wang Imran Razzak Jionglong Su SLR 30 0 0 01 Jan 2025
DiffSLT: Enhancing Diversity in Sign Language Translation via Diffusion Model JiHwan Moon Jihoon Park Jungeun Kim Jongseong Bae Hyeongwoo Jeon Ha Young Kim 83 1 0 26 Nov 2024
Leveraging the Power of MLLMs for Gloss-Free Sign Language Translation Jungeun Kim Hyeongwoo Jeon Jongseong Bae Ha Young Kim SLR 75 0 0 25 Nov 2024
Signformer is all you need: Towards Edge AI for Sign Language Eta Yang SLR 77 0 0 19 Nov 2024
Event Stream based Sign Language Translation: A High-Definition Benchmark Dataset and A New Algorithm Xiao Wang Yao Rong Fuling Wang Jianing Li Lin Zhu Bo Jiang Yaowei Wang SLR 24 0 0 20 Aug 2024
$C${^2}$RL: Content and Context Representation Learning for Gloss-free Sign Language Translation and Retrieval$ C ${^2}$ RL: Content and Context Representation Learning for Gloss-free Sign Language Translation and Retrieval Zhigang Chen Benjia Zhou Yiqing Huang Jun Wan Yibo Hu Hailin Shi Yanyan Liang Zhen Lei Du Zhang VLM SLR 21 1 0 19 Aug 2024
Scaling up Multimodal Pre-training for Sign Language Understanding Wengang Zhou Weichao Zhao Hezhen Hu Zecheng Li Houqiang Li SLR 26 3 0 16 Aug 2024
EvSign: Sign Language Recognition and Translation with Streaming Events Pengyu Zhang Hao Yin Zeren Wang Wenyue Chen Shengming Li Dong Wang Huchuan Lu Xu Jia SLR 33 6 0 17 Jul 2024
Scaling Sign Language Translation Biao Zhang Garrett Tanzer Orhan Firat LRM VLM SLR 29 1 0 16 Jul 2024
Improving Gloss-free Sign Language Translation by Reducing Representation Density Jinhui Ye Xing Wang Wenxiang Jiao Junwei Liang Hui Xiong 41 6 0 23 May 2024
Continuous Sign Language Recognition with Adapted Conformer via Unsupervised Pretraining Neena Aloysius M. Geetha Prema Nedungadi SLR 19 2 0 20 May 2024
Sign2GPT: Leveraging Large Language Models for Gloss-Free Sign Language Translation Ryan Wong Necati Cihan Camgöz Richard Bowden SLR 40 19 0 07 May 2024
E-TSL: A Continuous Educational Turkish Sign Language Dataset with Baseline Methods Sükrü Öztürk H. Keles SLR 14 0 0 05 May 2024
CorrNet+: Sign Language Recognition and Translation via Spatial-Temporal Correlation Lianyu Hu Wei Feng Liqing Gao Zekang Liu Liang Wan SLR 27 3 0 17 Apr 2024
LLMs are Good Sign Language Translators Jia Gong Lin Geng Foo Yixuan He Hossein Rahmani Jun Liu SLR 63 24 0 01 Apr 2024
SignVTCL: Multi-Modal Continuous Sign Language Recognition Enhanced by Visual-Textual Contrastive Learning Hao Chen Jiaze Wang Ziyu Guo Jinpeng Li Donghao Zhou Bian Wu Chenyong Guan Guangyong Chen Pheng-Ann Heng 22 5 0 22 Jan 2024
A Simple Baseline for Spoken Language to Sign Language Translation with 3D Avatars Ronglai Zuo Fangyun Wei Zenggui Chen Brian Mak Jiaolong Yang Xin Tong SLR 25 4 0 09 Jan 2024
VK-G2T: Vision and Context Knowledge enhanced Gloss2Text Liqiang Jing Xuemeng Song Xinxing Zu Na Zheng Zhongzhou Zhao Liqiang Nie SLR 17 0 0 15 Dec 2023
Neural Sign Actors: A diffusion model for 3D sign language production from text V. Baltatzis Rolandos Alexandros Potamias Evangelos Ververas Guanxiong Sun Jiankang Deng S. Zafeiriou DiffM 18 13 0 05 Dec 2023
SlowFast Network for Continuous Sign Language Recognition Junseok Ahn Youngjoon Jang Joon Son Chung SLR 14 9 0 21 Sep 2023
Self-Supervised Video Transformers for Isolated Sign Language Recognition Marcelo Sandoval-Castaneda Yanhong Li D. Brentari Karen Livescu Gregory Shakhnarovich SLR 8 1 0 02 Sep 2023
Sign Language Translation with Iterative Prototype Huijie Yao Wen-gang Zhou Hao Feng Hezhen Hu Hao Zhou Houqiang Li SLR 11 7 0 23 Aug 2023
Improving Continuous Sign Language Recognition with Cross-Lingual Signs Fangyun Wei Yutong Chen SLR 11 26 0 21 Aug 2023
Is context all you need? Scaling Neural Sign Language Translation to Large Domains of Discourse Ozge Mercanoglu Sincan Necati Cihan Camgöz Richard Bowden SLR 11 7 0 18 Aug 2023
Gloss-free Sign Language Translation: Improving from Visual-Language Pretraining Benjia Zhou Zhigang Chen Albert Clapés Jun Wan Yanyan Liang Sergio Escalera Zhen Lei Du Zhang SLR 21 45 0 27 Jul 2023
Gloss Attention for Gloss-free Sign Language Translation Aoxiong Yin Tianyun Zhong Lilian H. Y. Tang Weike Jin Tao Jin Zhou Zhao SLR 14 36 0 14 Jul 2023
Gloss-Free End-to-End Sign Language Translation Kezhou Lin Xiaohan Wang Linchao Zhu Ke Sun Bang Zhang Yezhou Yang SLR 17 17 0 22 May 2023
Cross-modality Data Augmentation for End-to-End Sign Language Translation Jinhui Ye Wenxiang Jiao Xing Wang Zhaopeng Tu Hui Xiong SLR 11 21 0 18 May 2023
SLTUNET: A Simple Unified Model for Sign Language Translation Biao Zhang Mathias Müller Rico Sennrich SLR 37 31 0 02 May 2023
Sign Language Translation from Instructional Videos Laia Tarrés Gerard I. Gállego A. Duarte Jordi Torres Xavier Giró-i-Nieto SLR 11 30 0 13 Apr 2023
Towards Automated Urban Planning: When Generative and ChatGPT-like AI Meets Urban Planning Dongjie Wang Chang-Tien Lu Yanjie Fu AI4CE 8 23 0 08 Apr 2023
CiCo: Domain-Aware Sign Language Retrieval via Cross-Lingual Contrastive Learning Yiting Cheng Fangyun Wei Jianmin Bao Dong Chen Wenqian Zhang SLR 11 28 0 22 Mar 2023
Natural Language-Assisted Sign Language Recognition Ronglai Zuo Fangyun Wei Brian Mak SLR 8 35 0 21 Mar 2023
CVT-SLR: Contrastive Visual-Textual Transformation for Sign Language Recognition with Variational Alignment Jiangbin Zheng Yile Wang Cheng Tan Siyuan Li Ge Wang Jun-Xiong Xia Yidong Chen Stan Z. Li SLR 17 61 0 10 Mar 2023
Improving Continuous Sign Language Recognition with Consistency Constraints and Signer Removal Ronglai Zuo Brian Mak SLR 13 17 0 26 Dec 2022
Self-supervised and Weakly Supervised Contrastive Learning for Frame-wise Action Representations Minghao Chen Renbo Tu Chenxi Huang Yuqi Lin Boxi Wu Deng Cai SSL AI4TS 16 1 0 06 Dec 2022
Two-Stream Network for Sign Language Recognition and Translation Yutong Chen Ronglai Zuo Fangyun Wei Yu-Huan Wu Shujie Liu Brian Mak SLR 15 117 0 02 Nov 2022
A Token-level Contrastive Framework for Sign Language Translation Biao Fu Peigen Ye Liang Zhang Pei-Ju Yu Cong Hu Yidong Chen X. Shi SLR 20 14 0 11 Apr 2022
Frame-wise Action Representations for Long Videos via Sequence Contrastive Learning Minghao Chen Fangyun Wei Chong Li Deng Cai AI4TS 26 22 0 28 Mar 2022
VinVL: Revisiting Visual Representations in Vision-Language Models Pengchuan Zhang Xiujun Li Xiaowei Hu Jianwei Yang Lei Zhang Lijuan Wang Yejin Choi Jianfeng Gao ObjD VLM 252 157 0 02 Jan 2021