Combination Technology of SLAM And VR For Minimally Invasive Surgery

Abstract

With the development of the internet, the combination technology of SLAM and AR is becoming increasingly important in various fields. Simultaneous localization and mapping (SLAM) and augmented reality (AR) have been used separately in surgeries. AR techniques can help surgeons see the patient's internal anatomy in conjunction with laparoscopic video images and it’s convenient for hand-eye coordination. However, only use AR technology in minimally invasive surgery still has some disadvantages, like the view is limited by the camera and geometric deformation. Using SLAM for surgery, on the other hand, offers advantages such as potential improvements in accuracy and the estimation of dynamic information, along with the ability to infer deformation and stiffness. In this paper, the principles of SLAM and AR technology will be introduced first, then the combined technology will be talked about how to use in the minimally invasive surgery and finally about how to improve the recent method in minimally invasive surgery. This essay will have important value about SLAM and AR’s research and applying.