A Natural Language-enabled Virtual Assistant for Human-Robot Interaction in Industrial Environments

Chen LI*, Dimitrios Chrysostomou, Hongji Yang

*Kontaktforfatter

Publikation: Bidrag til bog/antologi/rapport/konference proceedingKonferenceartikel i proceedingForskningpeer review

26 Downloads (Pure)

Abstract

This paper introduces a natural language-enabled virtual assistant (VA), called Max, developed to enhance human-robot interaction (HRI) with industrial robots. Regardless of the numerous natural language interfaces already available for commercial use and social robots, most VAs remain tightly bound to a specific robotic system. Besides, they lack a natural and efficient human-robot communication protocol to advance the user experience and the required robustness for use on the industrial floor. Therefore, the proposed framework is designed based on three key elements. A Client-Server style architecture that provides a centralised solution for managing and controlling various types of robots deployed on the shop floor. A communication protocol inspired by human-human conversation strategies, i.e., lexical-semantic strategy and general diversion strategy, is used to guide Max's response generation. These conversation strategies are embedded in Max's architecture to improve the engagement of the operators during the execution of industrial tasks. Finally, the state-of-the-art pre-trained model, Bidirectional Encoder Representations from Transformers (BERT), is fine-tuned to support a highly accurate prediction of requested intents from the operator and robot services. Multiple experiments were conducted for validating Max's performance in a real industrial environment.
OriginalsprogEngelsk
TitelIEEE International Conference on Software Quality, Reliability and Security
Antal sider6
ForlagIEEE
Publikationsdato2022
Sider673-678
ISBN (Elektronisk)979-8-3503-1991-0
DOI
StatusUdgivet - 2022
BegivenhedIEEE International Conference on Software Quality, Reliability and Security - Guangzhou, Kina
Varighed: 5 dec. 20229 dec. 2022
Konferencens nummer: 22
https://qrs22.techconf.org/

Konference

KonferenceIEEE International Conference on Software Quality, Reliability and Security
Nummer22
Land/OmrådeKina
ByGuangzhou
Periode05/12/202209/12/2022
Internetadresse

Fingeraftryk

Dyk ned i forskningsemnerne om 'A Natural Language-enabled Virtual Assistant for Human-Robot Interaction in Industrial Environments'. Sammen danner de et unikt fingeraftryk.

Citationsformater