Document Type
Article
Publication Date
3-1-2021
Publication Title
Journal of Medical Robotics Research
Abstract
While robot-assisted minimally invasive surgery (RMIS) procedures afford a variety of benefits over open surgery and manual laparoscopic operations (including increased tool dexterity, reduced patient pain, incision size, trauma and recovery time, and lower infection rates [1], lack of spatial awareness remains an issue. Typical laparoscopic imaging can lack sufficient depth cues and haptic feedback, if provided, rarely reflects realistic tissue-tool interactions. This work is part of a larger ongoing research effort to reconstruct 3D surfaces using multiple viewpoints in RMIS to increase visual perception. The manual placement and adjustment of multicamera systems in RMIS are nonideal and prone to error [2], and other autonomous approaches focus on tool tracking and do not consider reconstruction of the surgical scene [3,4,5]. The group's previous work investigated a novel, context-aware autonomous camera positioning method [6], which incorporated both tool location and scene coverage for multiple camera viewpoint adjustments. In this paper, the authors expand upon this prior work by implementing a streamlined deep reinforcement learning approach between optimal viewpoints calculated using the prior method [6] which encourages discovery of otherwise unobserved and additional camera viewpoints. Combining the framework and robustness of the previous work with the efficiency and additional viewpoints of the augmentations presented here results in improved performance and scene coverage promising towards real-time implementation.
Keywords
3D reconstruction, deep reinforcement learning, machine vision, Robot-assisted minimally invasive surgery
Volume
6
Issue
1-2
DOI
10.1142/S2424905X21400031
ISSN
2424905X
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.
Recommended Citation
Su, Yun Hsuan; Huang, Kevin; and Hannaford, Blake, "Multicamera 3D Viewpoint Adjustment for Robotic Surgery via Deep Reinforcement Learning" (2021). Engineering: Faculty Publications, Smith College, Northampton, MA.
https://scholarworks.smith.edu/egr_facpubs/132
Comments
Archived as published. Open access article.