Optimal State Estimation for DNN Visual Servoing Systems with Detection Loss

Christian Tranholm Novrup, Thomas Kjær Nowak, Daniel Ortiz Arroyo, Simon Lennart Sahlin, Petar Durdevic

Publikation: Bidrag til bog/antologi/rapport/konference proceedingKonferenceartikel i proceedingForskningpeer review

Abstract

The introduction of deep learning techniques, such
as object detection in visual servoing systems, has produced
more sophisticated robotic systems capable of working in
unknown environments. However, the interaction between the
object detection network and the controller, when detection loss
occurs, has received little attention. In this paper, we investigate
a way of mitigating the effect of detection loss in VSNN systems.
In our approach detection losses are modeled as a Bernoulli
random variable and integrated into the state space model of
the dynamic system. To mitigate the effect of detection loss,
we propose a variation of a Kalman filter, that artificially
inflates the measurement noise covariance when detection loss
occurs. The Kalman filter was implemented on a 6DOF robotic
manipulator with an eye-in-hand configuration with YOLOv5
as the object detection network. The results show, that the
proposed Kalman filter decreases the effects of detection losses
and significantly improves performance compared to having a
standard Kalman filter, and not having a state estimator at
all. The benefit of our approach is especially noticeable when
detection loss occurs frequently and for relatively long periods
of time
OriginalsprogEngelsk
Titel2023 11th International Conference on Control, Mechatronics and Automation, ICCMA 2023
Antal sider6
ForlagIEEE
Publikationsdato2023
Sider1-6
Artikelnummer10375025
ISBN (Elektronisk)979-8-3503-1568-4
DOI
StatusUdgivet - 2023
Begivenhed2023 11th International Conference on Control, Mechatronics and Automation (ICCMA) - Grimstad, Norge
Varighed: 1 nov. 20233 nov. 2023

Konference

Konference2023 11th International Conference on Control, Mechatronics and Automation (ICCMA)
Land/OmrådeNorge
ByGrimstad
Periode01/11/202303/11/2023
NavnInternational Conference on Control, Mechatronics and Automation
ISSN2837-5149

Fingeraftryk

Dyk ned i forskningsemnerne om 'Optimal State Estimation for DNN Visual Servoing Systems with Detection Loss'. Sammen danner de et unikt fingeraftryk.

Citationsformater