Stereoscopic Augmented Reality System for Supervised Training on Minimal Invasive Surgery Robots

Florin-Octavian Matu, Mikkel Thøgersen, Bo Galsgaard, Martin Møller Jensen, Martin Kraus

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

6 Citations (Scopus)

Abstract

Training in the use of robot-assisted surgery systems is necessary before a surgeon is able to perform procedures using these systems because the setup is very different from manual procedures. In addition, surgery robots are highly expensive to both acquire and maintain --- thereby entailing the need for efficient training. When training with the robot, the communication between the trainer and the trainee is limited, since the trainee often cannot see the trainer.
To overcome this issue, this paper proposes an Augmented Reality (AR) system where the trainer is controlling two virtual robotic arms. These arms are virtually superimposed on the video feed to the trainee, and can therefore be used to demonstrate and perform various tasks for the trainee. Furthermore, the trainer is presented with a 3D image through a stereoscopic display. Because of the added depth perception, this enables the trainer to better guide and help the trainee.
A prototype has been developed using low-cost materials and the system has been evaluated by surgeons at Aalborg University Hospital. User feedback indicated that a 3D display for the trainer is very useful as it enables the trainer to better monitor the procedure, and thereby enhances the training experience. The virtual overlay was also found to work as a good and illustrative approach for enhanced communication. However, the delay of the prototype made it difficult to use for actual training.
Original languageEnglish
Title of host publicationProceedings of the 2014 Virtual Reality International Conference (VRIC 2014)
Number of pages4
Place of PublicationLaval, France
PublisherAssociation for Computing Machinery
Publication date2014
Pages33:1--33:4
Article number33
ISBN (Electronic)978-1-4503-2626-1
DOIs
Publication statusPublished - 2014
EventVRIC 2014: Proceedings of the 2014 Virtual Reality International Conference - Laval, France
Duration: 9 Apr 201411 Apr 2014

Conference

ConferenceVRIC 2014
CountryFrance
CityLaval
Period09/04/201411/04/2014

Keywords

  • augmented reality
  • medical training
  • minimal invasive surgery
  • stereoscopic displays
  • virtual reality

Fingerprint

Dive into the research topics of 'Stereoscopic Augmented Reality System for Supervised Training on Minimal Invasive Surgery Robots'. Together they form a unique fingerprint.

Cite this