Measuring the Latency of an Augmented Reality System for Robot-Assisted Minimally Invasive Surgery

Martin Kibsgaard Jørgensen, Martin Kraus

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

6 Citations (Scopus)

Abstract

Minimal latency is important for augmented reality systems and teleoperation interfaces as even small increases in latency can affect user performance. Previously, we have developed an augmented reality system that can overlay stereoscopic video streams with computer graphics in order to improve visual communication in training for robot-assisted minimally invasive surgery with da Vinci surgical systems. To make sure that our augmented reality system provides the best possible user experience, we investigated the video latency of the da Vinci surgical system and how the components of our system affect the overall latency. To measure the photon-to-photon latency, we used a microcontroller to determine the time between the activation of a lightemitting diode in front of the endoscopic camera and the corresponding increase in intensity of the surgeon's display as measured by a phototransistor. The latency of the da Vinci S surgical system was on average 62 ms. None of the components of our overlay system (separately or combined) significantly affected the latency. However, the latency of the assistant's monitor increased by 14 ms. Passing the video streams through CPU or GPU memory increased the latency to 147 ms and 256 ms, respectively.
Original languageEnglish
Title of host publicationConference on Computer Vision, Imaging and Computer Graphics Theory and Applications : GRAPP, (VISIGRAPP 2017)
Volume1
PublisherSCITEPRESS Digital Library
Publication date2017
Pages321-326
ISBN (Electronic)978-989-758-224-0
DOIs
Publication statusPublished - 2017
EventThe 12th Internmational Joint Conference on Computer Vision, Imaging and Computer Graphics theory and Applications -
Duration: 1 Jan 2017 → …

Conference

ConferenceThe 12th Internmational Joint Conference on Computer Vision, Imaging and Computer Graphics theory and Applications
Period01/01/2017 → …

Fingerprint

Dive into the research topics of 'Measuring the Latency of an Augmented Reality System for Robot-Assisted Minimally Invasive Surgery'. Together they form a unique fingerprint.

Cite this