Multimodal Desktop Interaction: The Face –Object-Gesture–Voice Example

Nikolas Vidakis; Anastasios Vlasopoulos; Tsampikos Kounalakis; Petros Varchalamas; Michalis Dimitriou; Gregory Kalliatakis; Efthimios Syntychakis; John Christofakis; Georgios Triantafyllidis

doi:10.1109/ICDSP.2013.6622782

Multimodal Desktop Interaction: The Face –Object-Gesture–Voice Example

Nikolas Vidakis, Anastasios Vlasopoulos, Tsampikos Kounalakis, Petros Varchalamas, Michalis Dimitriou, Gregory Kalliatakis, Efthimios Syntychakis, John Christofakis, Georgios Triantafyllidis

Publikation: Bidrag til bog/antologi/rapport/konference proceeding › Konferenceartikel i proceeding › Forskning › peer review

3 Citationer (Scopus)

676 Downloads (Pure)

Abstrakt

This paper presents a natural user interface system
based on multimodal human computer interaction, which
operates as an intermediate module between the user and the
operating system. The aim of this work is to demonstrate a
multimodal system which gives users the ability to interact with
desktop applications using face, objects, voice and gestures.
These human behaviors constitute the input qualifiers to the
system. Microsoft Kinect multi-sensor was utilized as input
device in order to succeed the natural user interaction, mainly
due to the multimodal capabilities offered by this device. We
demonstrate scenarios which contain all the functions and
capabilities of our system from the perspective of natural user
interaction.

Originalsprog	Engelsk
Titel	18th International Conference on Digital Signal Processing (DSP)
Redaktører	Athanasios Skodras
Antal sider	8
Forlag	Wiley-IEEE press
Publikationsdato	2013
ISBN (Trykt)	978-1-4673-5807-1
DOI	https://doi.org/10.1109/ICDSP.2013.6622782
Status	Udgivet - 2013
Begivenhed	International conference on Digital Signal Processing - Fira, Grækenland Varighed: 1 jul. 2013 → 3 jul. 2013 Konferencens nummer: 18 http://dsp2013.dspconferences.org/

Konference

Konference	International conference on Digital Signal Processing
Nummer	18
Land	Grækenland
By	Fira
Periode	01/07/2013 → 03/07/2013
Internetadresse	http://dsp2013.dspconferences.org/

Navn	International Conference on Digital Signal Processing proceedings
ISSN	1546-1874

Adgang til dokumentet

10.1109/ICDSP.2013.6622782

PID2695443Accepteret manuskript, 1,3 MB

http://dsp2013.dspconferences.org/

Fingeraftryk Dyk ned i forskningsemnerne om 'Multimodal Desktop Interaction: The Face –Object-Gesture–Voice Example'. Sammen danner de et unikt fingeraftryk.

Citationsformater

Vidakis, N., Vlasopoulos, A., Kounalakis, T., Varchalamas, P., Dimitriou, M., Kalliatakis, G., Syntychakis, E., Christofakis, J., & Triantafyllidis, G. (2013). Multimodal Desktop Interaction: The Face –Object-Gesture–Voice Example. I A. Skodras (red.), 18th International Conference on Digital Signal Processing (DSP) Wiley-IEEE press. International Conference on Digital Signal Processing proceedings https://doi.org/10.1109/ICDSP.2013.6622782

Vidakis, Nikolas ; Vlasopoulos, Anastasios ; Kounalakis, Tsampikos ; Varchalamas, Petros ; Dimitriou, Michalis ; Kalliatakis, Gregory ; Syntychakis, Efthimios ; Christofakis, John ; Triantafyllidis, Georgios. / Multimodal Desktop Interaction: The Face –Object-Gesture–Voice Example. 18th International Conference on Digital Signal Processing (DSP). red. / Athanasios Skodras. Wiley-IEEE press, 2013. (International Conference on Digital Signal Processing proceedings).

@inproceedings{16d443fa9eac4ae8899a0b96dbc3e0c3,

title = "Multimodal Desktop Interaction: The Face –Object-Gesture–Voice Example",

abstract = "This paper presents a natural user interface systembased on multimodal human computer interaction, whichoperates as an intermediate module between the user and theoperating system. The aim of this work is to demonstrate amultimodal system which gives users the ability to interact withdesktop applications using face, objects, voice and gestures.These human behaviors constitute the input qualifiers to thesystem. Microsoft Kinect multi-sensor was utilized as inputdevice in order to succeed the natural user interaction, mainlydue to the multimodal capabilities offered by this device. Wedemonstrate scenarios which contain all the functions andcapabilities of our system from the perspective of natural userinteraction.",

author = "Nikolas Vidakis and Anastasios Vlasopoulos and Tsampikos Kounalakis and Petros Varchalamas and Michalis Dimitriou and Gregory Kalliatakis and Efthimios Syntychakis and John Christofakis and Georgios Triantafyllidis",

year = "2013",

doi = "10.1109/ICDSP.2013.6622782",

language = "English",

isbn = "978-1-4673-5807-1",

series = "International Conference on Digital Signal Processing proceedings",

editor = "Athanasios Skodras",

booktitle = "18th International Conference on Digital Signal Processing (DSP)",

publisher = "Wiley-IEEE press",

address = "United States",

note = "null ; Conference date: 01-07-2013 Through 03-07-2013",

url = "http://dsp2013.dspconferences.org/",

}

Vidakis, N, Vlasopoulos, A, Kounalakis, T, Varchalamas, P, Dimitriou, M, Kalliatakis, G, Syntychakis, E, Christofakis, J & Triantafyllidis, G 2013, Multimodal Desktop Interaction: The Face –Object-Gesture–Voice Example. i A Skodras (red.), 18th International Conference on Digital Signal Processing (DSP). Wiley-IEEE press, International Conference on Digital Signal Processing proceedings, International conference on Digital Signal Processing, Fira, Grækenland, 01/07/2013. https://doi.org/10.1109/ICDSP.2013.6622782

Multimodal Desktop Interaction: The Face –Object-Gesture–Voice Example. / Vidakis, Nikolas; Vlasopoulos, Anastasios; Kounalakis, Tsampikos; Varchalamas, Petros; Dimitriou, Michalis; Kalliatakis, Gregory; Syntychakis, Efthimios; Christofakis, John; Triantafyllidis, Georgios.

18th International Conference on Digital Signal Processing (DSP). red. / Athanasios Skodras. Wiley-IEEE press, 2013. (International Conference on Digital Signal Processing proceedings).

Publikation: Bidrag til bog/antologi/rapport/konference proceeding › Konferenceartikel i proceeding › Forskning › peer review

TY - GEN

T1 - Multimodal Desktop Interaction: The Face –Object-Gesture–Voice Example

AU - Vidakis, Nikolas

AU - Vlasopoulos, Anastasios

AU - Kounalakis, Tsampikos

AU - Varchalamas, Petros

AU - Dimitriou, Michalis

AU - Kalliatakis, Gregory

AU - Syntychakis, Efthimios

AU - Christofakis, John

AU - Triantafyllidis, Georgios

N1 - Conference code: 18

PY - 2013

Y1 - 2013

N2 - This paper presents a natural user interface systembased on multimodal human computer interaction, whichoperates as an intermediate module between the user and theoperating system. The aim of this work is to demonstrate amultimodal system which gives users the ability to interact withdesktop applications using face, objects, voice and gestures.These human behaviors constitute the input qualifiers to thesystem. Microsoft Kinect multi-sensor was utilized as inputdevice in order to succeed the natural user interaction, mainlydue to the multimodal capabilities offered by this device. Wedemonstrate scenarios which contain all the functions andcapabilities of our system from the perspective of natural userinteraction.

AB - This paper presents a natural user interface systembased on multimodal human computer interaction, whichoperates as an intermediate module between the user and theoperating system. The aim of this work is to demonstrate amultimodal system which gives users the ability to interact withdesktop applications using face, objects, voice and gestures.These human behaviors constitute the input qualifiers to thesystem. Microsoft Kinect multi-sensor was utilized as inputdevice in order to succeed the natural user interaction, mainlydue to the multimodal capabilities offered by this device. Wedemonstrate scenarios which contain all the functions andcapabilities of our system from the perspective of natural userinteraction.

U2 - 10.1109/ICDSP.2013.6622782

DO - 10.1109/ICDSP.2013.6622782

M3 - Article in proceeding

SN - 978-1-4673-5807-1

T3 - International Conference on Digital Signal Processing proceedings

BT - 18th International Conference on Digital Signal Processing (DSP)

A2 - Skodras, Athanasios

PB - Wiley-IEEE press

Y2 - 1 July 2013 through 3 July 2013

ER -

Vidakis N, Vlasopoulos A, Kounalakis T, Varchalamas P, Dimitriou M, Kalliatakis G et al. Multimodal Desktop Interaction: The Face –Object-Gesture–Voice Example. I Skodras A, red., 18th International Conference on Digital Signal Processing (DSP). Wiley-IEEE press. 2013. (International Conference on Digital Signal Processing proceedings). https://doi.org/10.1109/ICDSP.2013.6622782