Mr. S. M. Kamrul Hasan Profile

S. M. Kamrul Hasan

at Rochester Institute of Technology

SPIE Involvement:

Author

Publications (5)

SPIE Journal Paper | 29 August 2023

Inpainting surgical occlusion from laparoscopic video sequences for robot-assisted interventions

S. M. Kamrul Hasan, Richard A. Simon, Cristian A. Linte

JMI, Vol. 10, Issue 04, 045002, (August 2023) https://doi.org/10.1117/12.10.1117/1.JMI.10.4.045002

KEYWORDS: Image segmentation, Equipment, Video, Laparoscopy, Interpolation, Visualization, Surgery, Education and training, Convolution, Endoscopy

Read Abstract +

PurposeMedical technology for minimally invasive surgery has undergone a paradigm shift with the introduction of robot-assisted surgery. However, it is very difficult to track the position of the surgical tools in a surgical scene, so it is crucial to accurately detect and identify surgical tools. This task can be aided by deep learning-based semantic segmentation of surgical video frames. Furthermore, due to the limited working and viewing areas of these surgical instruments, there is a higher chance of complications from tissue injuries (e.g., tissue scars and tears).ApproachWith the aid of digital inpainting algorithms, we present an application that uses image segmentation to remove surgical instruments from laparoscopic/endoscopic video. We employ a modified U-Net architecture (U-NetPlus) to segment the surgical instruments. It consists of a redesigned decoder and a pre-trained VGG11 or VGG16 encoder. The decoder was modified by substituting an up-sampling operation based on nearest-neighbor interpolation for the transposed convolution operation. Furthermore, these interpolation weights do not need to be learned to perform upsampling, which eliminates the artifacts generated by the transposed convolution. In addition, we use a very fast and adaptable data augmentation technique to further enhance performance. The instrument segmentation mask is filled in (i.e., inpainted) by the tool removal algorithms using the previously acquired tool segmentation masks and either previous instrument-containing frames or instrument-free reference frames.ResultsWe have shown the effectiveness of the proposed surgical tool segmentation/removal algorithms on a robotic instrument dataset from the MICCAI 2015 and 2017 EndoVis Challenge. We report a 90.20% DICE for binary segmentation, a 76.26% DICE for instrument part segmentation, and a 46.07% DICE for instrument type (i.e., all instruments) segmentation on the MICCAI 2017 challenge dataset using our U-NetPlus architecture, outperforming the results of earlier techniques used and tested on these data. In addition, we demonstrated the successful execution of the tool removal algorithm from surgical tool-free videos that contained moving surgical tools that were generated artificially.ConclusionsOur application successfully separates and eliminates the surgical tool to reveal a view of the background tissue that was otherwise hidden by the tool, producing results that are visually similar to the actual data.

Proceedings Article | 3 April 2023 Poster + Paper

Investigating the impact of class-dependent label noise in medical image classification

Bidur Khanal, S.M. Kamrul Hasan, Bishesh Khanal, Cristian A. Linte

Proceedings Volume 12464, 1246437 (2023) https://doi.org/10.1117/12.2654420

KEYWORDS: Medical imaging, Image classification, Education and training, Visualization, Performance modeling, Visual process modeling, Image segmentation, Data modeling, Image resolution, Histopathology

Read Abstract +

Proceedings Article | 4 April 2022 Presentation + Paper

Calibration of cine MRI segmentation probability for uncertainty estimation using a multi-task cross-task learning architecture

S. M. Kamrul Hasan, Cristian Linte

Proceedings Volume 12034, 120340T (2022) https://doi.org/10.1117/12.2612269

KEYWORDS: Uncertainty analysis, Image segmentation, Magnetic resonance imaging, Calibration, Medical imaging, Data modeling, Neural networks, Error analysis

Read Abstract +