Using 3D Convolutional Neural Networks to Learn Spatiotemporal Features for Automatic Surgical Gesture Recognition in Video

26 July 2019

Jürgen Weitz

Stefanie Speidel

ArXiv (abs)PDF HTML

Papers citing "Using 3D Convolutional Neural Networks to Learn Spatiotemporal Features for Automatic Surgical Gesture Recognition in Video"

36 / 36 papers shown

Title
Machine Learning-Based Automated Assessment of Intracorporeal Suturing in Laparoscopic Fundoplication Shekhar Madhav Khairnar Huu Phong Nguyen Alexis Desir Carla Holcomb Daniel J. Scott Ganesh Sankaranarayanan 202 1 0 16 Dec 2024
Think Step by Step: Chain-of-Gesture Prompting for Error Detection in Robotic Surgical Videos Zhimin Shao Jialang Xu Danail Stoyanov E. Mazomenos Yueming Jin LRM 99 9 0 27 Jun 2024
Dark Transformer: A Video Transformer for Action Recognition in the Dark Anwaar Ulhaq ViT 72 0 0 25 Jun 2024
SEDMamba: Enhancing Selective State Space Modelling with Bottleneck Mechanism and Fine-to-Coarse Temporal Fusion for Efficient Error Detection in Robot-Assisted Surgery Jialang Xu Nazir Sirajudeen M. Boal Nader K Francis Danail Stoyanov E. Mazomenos Mamba 97 3 0 22 Jun 2024
Zero-shot Prompt-based Video Encoder for Surgical Gesture Recognition Mingxing Rao Yinhong Qin Soheil Kolouri Jie Ying Wu Daniel Moyer MedIm 78 1 0 28 Mar 2024
Multimodal Transformers for Real-Time Surgical Activity Prediction Keshara Weerasinghe Seyed Hamid Reza Roodabeh Kay Hutchinson H. Alemzadeh 87 3 0 11 Mar 2024
Encoding Surgical Videos as Latent Spatiotemporal Graphs for Object and Anatomy-Driven Reasoning Aditya Murali Deepak Alapatt Pietro Mascagni Armine Vardazaryan Alain Garcia Nariaki Okamoto Didier Mutter N. Padoy MedIm 89 15 0 11 Dec 2023
Surgical Temporal Action-aware Network with Sequence Regularization for Phase Recognition Zhen Chen Yuhao Zhai Jun Zhang Jinqiao Wang 144 9 0 21 Nov 2023
GLSFormer: Gated - Long, Short Sequence Transformer for Step Recognition in Surgical Videos Nisarg A. Shah S. Sikder S. Vedula Vishal M. Patel ViT MedIm 116 8 0 20 Jul 2023
Towards Surgical Context Inference and Translation to Gestures Kay Hutchinson Zongyu Li Ian Reyes H. Alemzadeh 93 4 0 28 Feb 2023
Weakly Supervised Temporal Convolutional Networks for Fine-grained Surgical Activity Recognition Sanat Ramesh Diego DallÁlba Cristians Gonzalez Tong Yu Pietro Mascagni Didier Mutter J. Marescaux Paolo Fiorini N. Padoy MedIm 95 6 0 21 Feb 2023
Latent Graph Representations for Critical View of Safety Assessment Aditya Murali Deepak Alapatt Pietro Mascagni Armine Vardazaryan Alain Garcia Nariaki Okamoto Didier Mutter N. Padoy MedIm 174 33 0 08 Dec 2022
Adversarial Domain Adaptation for Action Recognition Around the Clock Anwaar Ulhaq 99 4 0 25 Oct 2022
Bounded Future MS-TCN++ for surgical gesture recognition Adam Goldbraikh Netanell Avisdris Carla M. Pugh S. Laufer 73 6 0 29 Sep 2022
A comprehensive survey on recent deep learning-based methods applied to surgical data Mansoor Ali Rafael Martinez Garcia Peña Gilberto Ochoa-Ruiz Sharib Ali 177 6 0 03 Sep 2022
Know your sensORs -- A Modality Study For Surgical Action Classification Lennart Bastian Tobias Czempiel C. Heiliger K. Karcz U. Eck Benjamin Busam Nassir Navab 111 8 0 16 Mar 2022
On the Pitfalls of Batch Normalization for End-to-End Video Learning: A Study on Surgical Workflow Analysis Dominik Rivoir Isabel Funke Stefanie Speidel 148 20 0 15 Mar 2022
Human Gaze Guided Attention for Surgical Activity Recognition Abdishakour Awale Duygu Sarikaya 74 0 0 09 Mar 2022
Less is More: Surgical Phase Recognition from Timestamp Supervision Xinpeng Ding Xinjian Yan Zixun Wang Wei Zhao Jian Zhuang Xiaowei Xu Xiaomeng Li MedIm 127 18 0 16 Feb 2022
PEg TRAnsfer Workflow recognition challenge report: Does multi-modal data improve recognition? Arnaud Huaulmé Kanako Harada Quang-Minh Nguyen Bogyu Park Seungbum Hong ... Yuto Ishikawa Yuriko Harai Satoshi Kondo M. Mitsuishi Pierre Jannin 69 9 0 11 Feb 2022
Surgical Instruction Generation with Transformers Jinglu Zhang Y. Nie Jian Chang Jiangning Zhang MedIm 109 13 0 14 Jul 2021
Surgical Gesture Recognition Based on Bidirectional Multi-Layer Independently RNN with Explainable Spatial Feature Extraction Dandan Zhang Ruoxi Wang Benny Lo 72 12 0 02 May 2021
Temporal Memory Relation Network for Workflow Recognition from Surgical Video Yueming Jin Yonghao Long Cheng Chen Zixu Zhao Qi Dou Pheng-Ann Heng 167 99 0 30 Mar 2021
MIcro-Surgical Anastomose Workflow recognition challenge report Arnaud Huaulmé Duygu Sarikaya Kévin Le Mut Fabien Despinoy Yonghao Long ... Pablo Arbelaez Wolfgang Reiter M. Mitsuishi K. Harada Pierre Jannin 73 39 0 24 Mar 2021
Future Frame Prediction for Robot-assisted Surgery Xiaojie Gao Yueming Jin Zixu Zhao Qi Dou Pheng-Ann Heng MedIm 85 14 0 18 Mar 2021
Trans-SVNet: Accurate Phase Recognition from Surgical Videos via Hybrid Embedding Aggregation Transformer Xiaojie Gao Yueming Jin Yonghao Long Qi Dou Pheng-Ann Heng MedIm 157 123 0 17 Mar 2021
Surgical Visual Domain Adaptation: Results from the MICCAI 2020 SurgVisDom Challenge Aneeq Zia Kiran D. Bhattacharyya Xi Liu Ziheng Wang S. Kondo ... Raabid Hussain Lena Maier-Hein Danail Stoyanov Stefanie Speidel A. Jarc 88 20 0 26 Feb 2021
Multi-Task Temporal Convolutional Networks for Joint Recognition of Surgical Phases and Steps in Gastric Bypass Procedures Sanat Ramesh Diego DallÁlba Cristians Gonzalez Tong Yu Pietro Mascagni Didier Mutter J. Marescaux Paolo Fiorini N. Padoy 90 79 0 24 Feb 2021
Learning Invariant Representation of Tasks for Robust Surgical State Estimation Yidan Qin M. Allan Yisong Yue J. W. Burdick M. Azizian OOD 54 8 0 18 Feb 2021
Gesture Recognition in Robotic Surgery: a Review Beatrice van Amsterdam Matthew J. Clarkson Danail Stoyanov 138 101 0 29 Jan 2021
Multi-frame Feature Aggregation for Real-time Instrument Segmentation in Endoscopic Video Shan Lin Fangbo Qin Haonan Peng Randall Bly K. Moe Blake Hannaford 103 20 0 17 Nov 2020
Relational Graph Learning on Visual and Kinematics Embeddings for Accurate Gesture Recognition in Robotic Surgery Yonghao Long Jinlin Wu Bo Lu Yueming Jin Mathias Unberath Yunhui Liu Pheng Ann Heng Qi Dou 127 39 0 03 Nov 2020
Symmetric Dilated Convolution for Surgical Gesture Recognition Jinglu Zhang Y. Nie Yao Lyu Hailin Li Jian Chang Xiaosong Yang Jiangning Zhang MedIm 169 22 0 13 Jul 2020
Deep learning with 4D spatio-temporal data representations for OCT-based force estimation N. Gessert M. Bengs M. Schlüter Alexander Schlaefer 76 24 0 20 May 2020
Multi-Task Recurrent Neural Network for Surgical Gesture Recognition and Progress Prediction Beatrice van Amsterdam Matthew J. Clarkson Danail Stoyanov 138 40 0 10 Mar 2020
Towards Generalizable Surgical Activity Recognition Using Spatial Temporal Graph Convolutional Networks Duygu Sarikaya Pierre Jannin 145 19 0 11 Jan 2020