Sign Language Transformers: Joint End-to-end Sign Language Recognition and Translation

30 March 2020

Papers citing "Sign Language Transformers: Joint End-to-end Sign Language Recognition and Translation"

50 / 54 papers shown

Title
ELMI: Interactive and Intelligent Sign Language Translation of Lyrics for Song Signing Suhyeon Yoo Khai-Nghi Truong Young-Ho Kim 53 0 0 24 Feb 2025
Sign Language Sense Disambiguation Jana Grimm Miriam Winkler Oliver Kraus Tanalp Agustoslu SLR 14 0 0 13 Sep 2024
Improving Gloss-free Sign Language Translation by Reducing Representation Density Jinhui Ye Xing Wang Wenxiang Jiao Junwei Liang Hui Xiong 43 6 0 23 May 2024
Sign Stitching: A Novel Approach to Sign Language Production Harry Walsh Ben Saunders Richard Bowden 44 3 0 13 May 2024
E-TSL: A Continuous Educational Turkish Sign Language Dataset with Baseline Methods Sükrü Öztürk H. Keles SLR 24 0 0 05 May 2024
SkelCap: Automated Generation of Descriptive Text from Skeleton Keypoint Sequences Ali Emre Keskin H. Keles SLR 33 0 0 05 May 2024
Improving Continuous Sign Language Recognition with Adapted Image Models Lianyu Hu Tongkai Shi Liqing Gao Zekang Liu Wei Feng VLM 20 5 0 12 Apr 2024
Continuous Sign Language Recognition Based on Motor attention mechanism and frame-level Self-distillation Qidan Zhu Jing Li Fei Yuan Quan Gan SLR 45 3 0 29 Feb 2024
SignVTCL: Multi-Modal Continuous Sign Language Recognition Enhanced by Visual-Textual Contrastive Learning Hao Chen Jiaze Wang Ziyu Guo Jinpeng Li Donghao Zhou Bian Wu Chenyong Guan Guangyong Chen Pheng-Ann Heng 25 5 0 22 Jan 2024
A Simple Baseline for Spoken Language to Sign Language Translation with 3D Avatars Ronglai Zuo Fangyun Wei Zenggui Chen Brian Mak Jiaolong Yang Xin Tong SLR 32 4 0 09 Jan 2024
SlowFast Network for Continuous Sign Language Recognition Junseok Ahn Youngjoon Jang Joon Son Chung SLR 33 10 0 21 Sep 2023
Autoregressive Sign Language Production: A Gloss-Free Approach with Discrete Representations Eui Jun Hwang Huije Lee Jong C. Park SLR 29 6 0 21 Sep 2023
Bornil: An open-source sign language data crowdsourcing platform for AI enabled dialect-agnostic communication Shahriar Elahi Dhruvo Mohammad Akhlaqur Rahman M. Mandal Md. Istiak Hossain Shihab A. A. N. Ansary ... Sejuti Rahman Sayma Sultana Chowdhury Sabbir Ahmed Chowdhury Farig Sadeque Asif Sushmit 18 1 0 29 Aug 2023
Improving Continuous Sign Language Recognition with Cross-Lingual Signs Fangyun Wei Yutong Chen SLR 20 28 0 21 Aug 2023
Learnt Contrastive Concept Embeddings for Sign Recognition Ryan Wong Necati Cihan Camgöz Richard Bowden 19 5 0 18 Aug 2023
Gloss Alignment Using Word Embeddings Harry Walsh Ozge Mercanoglu Sincan Ben Saunders Richard Bowden 19 1 0 08 Aug 2023
Gloss-free Sign Language Translation: Improving from Visual-Language Pretraining Benjia Zhou Zhigang Chen Albert Clapés Jun Wan Yanyan Liang Sergio Escalera Zhen Lei Du Zhang SLR 28 47 0 27 Jul 2023
Gloss Attention for Gloss-free Sign Language Translation Aoxiong Yin Tianyun Zhong Lilian H. Y. Tang Weike Jin Tao Jin Zhou Zhao SLR 16 37 0 14 Jul 2023
Sign Language Translation from Instructional Videos Laia Tarrés Gerard I. Gállego A. Duarte Jordi Torres Xavier Giró-i-Nieto SLR 19 30 0 13 Apr 2023
StepNet: Spatial-temporal Part-aware Network for Isolated Sign Language Recognition Xi Shen Zhedong Zheng Yi Yang SLR 22 13 0 25 Dec 2022
Ham2Pose: Animating Sign Language Notation into Pose Sequences Rotem Shalev-Arkushin Amit Moryossef Ohad Fried SLR 30 19 0 24 Nov 2022
Weakly-supervised Fingerspelling Recognition in British Sign Language Videos Prajwal K R Hannah Bull Liliane Momeni Samuel Albanie Gül Varol Andrew Zisserman 21 14 0 16 Nov 2022
Sentence-Level Sign Language Recognition Framework Atra Akandeh SLR 16 3 0 13 Nov 2022
Two-Stream Network for Sign Language Recognition and Translation Yutong Chen Ronglai Zuo Fangyun Wei Yu-Huan Wu Shujie Liu Brian Mak SLR 26 118 0 02 Nov 2022
Leveraging Graph-based Cross-modal Information Fusion for Neural Sign Language Translation Jiangbin Zheng Siyuan Li Cheng Tan Chong Wu Yidong Chen Stan Z. Li SLR 24 7 0 01 Nov 2022
Clean Text and Full-Body Transformer: Microsoft's Submission to the WMT22 Shared Task on Sign Language Translation S. Dey Abhilash Pal Cyrine Chaabani Oscar Koller SLR 15 5 0 24 Oct 2022
Machine Translation between Spoken Languages and Signed Languages Represented in SignWriting Zifan Jiang Amit Moryossef Mathias Müller Sarah Ebling 18 22 0 11 Oct 2022
Combining Efficient and Precise Sign Language Recognition: Good pose estimation library is all you need Matyáš Boháček Zhuo Cao M. Hrúz 14 0 0 30 Sep 2022
Topic Detection in Continuous Sign Language Videos Álvaro Budria Laia Tarrés Gerard I. Gállego Francesc Moreno-Noguer Jordi Torres Xavier Giró-i-Nieto SLR VLM 33 1 0 01 Sep 2022
G2P-DDM: Generating Sign Pose Sequence from Gloss Sequence with Discrete Diffusion Model Pan Xie Qipeng Zhang Zexian Li Hao Tang Yao Du Xiaohui Hu DiffM 36 12 0 19 Aug 2022
AFT-VO: Asynchronous Fusion Transformers for Multi-View Visual Odometry Estimation Nimet Kaygusuz Oscar Alejandro Mendez Maldonado Richard Bowden 12 5 0 26 Jun 2022
Multimodal Learning with Transformers: A Survey P. Xu Xiatian Zhu David A. Clifton ViT 50 525 0 13 Jun 2022
Scaling up sign spotting through sign language dictionaries Gül Varol Liliane Momeni Samuel Albanie Triantafyllos Afouras Andrew Zisserman 21 14 0 09 May 2022
A Transformer-Based Contrastive Learning Approach for Few-Shot Sign Language Recognition Silvan Ferreira Esdras Costa M. Dahia J. Rocha SLR 14 1 0 05 Apr 2022
A Simple Multi-Modality Transfer Learning Baseline for Sign Language Translation Yutong Chen Fangyun Wei Xiao Sun Zhirong Wu Stephen Lin SLR 24 98 0 08 Mar 2022
Including Facial Expressions in Contextual Embeddings for Sign Language Generation Carla Viegas Mert Inan Lorna C. Quandt Malihe Alikhani SLR 23 14 0 11 Feb 2022
Consistent 3D Hand Reconstruction in Video via self-supervised Learning Zhigang Tu Zhishen Huang Yujin Chen Di Kang Linchao Bao Bisheng Yang Junsong Yuan 3DH 39 39 0 24 Jan 2022
Video Transformers: A Survey Javier Selva A. S. Johansen Sergio Escalera Kamal Nasrollahi T. Moeslund Albert Clapés ViT 22 103 0 16 Jan 2022
Towards Zero-shot Sign Language Recognition Yunus Can Bilge R. G. Cinbis Nazli Ikizler-Cinbis SLR 17 36 0 15 Jan 2022
Sign Language Video Retrieval with Free-Form Textual Queries A. Duarte Samuel Albanie Xavier Giró-i-Nieto Gül Varol SLR 29 29 0 07 Jan 2022
Skeletal Graph Self-Attention: Embedding a Skeleton Inductive Bias into Sign Language Production Ben Saunders Necati Cihan Camgöz Richard Bowden SLR 29 17 0 06 Dec 2021
SignBERT: Pre-Training of Hand-Model-Aware Representation for Sign Language Recognition Hezhen Hu Weichao Zhao Wen-gang Zhou Yuechen Wang Houqiang Li ViT 22 63 0 11 Oct 2021
Stochastic Transformer Networks with Linear Competing Units: Application to end-to-end SL Translation Andreas Voskou Konstantinos P. Panousis D. Kosmopoulos Dimitris N. Metaxas S. Chatzis SLR 28 43 0 01 Sep 2021
Mixed SIGNals: Sign Language Production via a Mixture of Motion Primitives Ben Saunders Necati Cihan Camgöz Richard Bowden SLR 25 50 0 23 Jul 2021
AnonySIGN: Novel Human Appearance Synthesis for Sign Language Video Anonymisation Ben Saunders Necati Cihan Camgöz Richard Bowden 17 30 0 22 Jul 2021
Improving Sign Language Translation with Monolingual Data by Sign Back-Translation Hao Zhou Wen-gang Zhou Weizhen Qi Junfu Pu Houqiang Li SLR 27 180 0 26 May 2021
MOTR: End-to-End Multiple-Object Tracking with Transformer Fangao Zeng Bin Dong Cheng Chen Tiancai Wang X. Zhang Yichen Wei VOT 19 498 0 07 May 2021
Pose-Guided Sign Language Video GAN with Dynamic Lambda Christopher Kissel Christopher Kümmel Dennis Ritter Kristian Hildebrand SLR 14 6 0 06 May 2021
Evaluating the Immediate Applicability of Pose Estimation for Sign Language Recognition Amit Moryossef Ioannis Tsochantaridis Joe Dinn Necati Cihan Camgöz Richard Bowden Tao Jiang Annette Rios Gonzales Mathias Müller Sarah Ebling SLR 14 51 0 20 Apr 2021
Continuous 3D Multi-Channel Sign Language Production via Progressive Transformers and Mixture Density Networks Ben Saunders Necati Cihan Camgöz Richard Bowden SLR 25 77 0 11 Mar 2021