A Multimodal Interaction Framework for Blended Learning

Nikolaos Vidakis, Konstantinos Kalafatis, Georgios Triantafyllidis

Publikation: Bidrag til bog/antologi/rapport/konference proceedingKonferenceartikel i proceedingForskningpeer review

Resumé

Humans interact with each other by utilizing the five basic senses as input modalities, whereas sounds, gestures, facial expressions etc. are utilized as output modalities. Multimodal interaction is also used between humans and their surrounding environment, although enhanced with further senses such as equilibrioception and the sense of balance. Computer interfaces that are considered as a different environment that human can interact with, lack of input and output amalgamation in order to provide a close to natural interaction. Multimodal human-computer interaction has sought to provide alternative means of communication with an application, which will be more natural than the traditional “windows, icons, menus, pointer” (WIMP) style. Despite the great amount of devices in existence, most applications make use of a very limited set of modalities, most notably speech and touch. This paper describes a
multimodal framework enabling deployment of a vast variety of modalities, tailored appropriately for use in blended learning environment.
OriginalsprogEngelsk
TitelInteractivity, Game Creation, Design, Learning, and Innovation : 5th International Conference, ArtsIT 2016, and First International Conference, DLI 2016, Esbjerg, Denmark, May 2-3, 2016, Proceedings
RedaktørerAnthony L. Brooks, Eva Brooks
ForlagSpringer
Publikationsdato2017
Sider205-211
ISBN (Trykt)978-3-319-55833-2
ISBN (Elektronisk)978-3-319-55834-9
DOI
StatusUdgivet - 2017
Begivenhed1st EAI International Conference on Design, Learning & Innovation - Esbjerg campus of Aalborg University, Esbjerg, Danmark
Varighed: 2 maj 20164 maj 2016
http://designlearninginnovation.org/

Konference

Konference1st EAI International Conference on Design, Learning & Innovation
LokationEsbjerg campus of Aalborg University
LandDanmark
ByEsbjerg
Periode02/05/201604/05/2016
Internetadresse
NavnLecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST
Vol/bind196
ISSN1867-8211

Fingerprint

Human computer interaction
Interfaces (computer)
Acoustic waves
Communication

Citer dette

Vidakis, N., Kalafatis, K., & Triantafyllidis, G. (2017). A Multimodal Interaction Framework for Blended Learning. I A. L. Brooks, & E. Brooks (red.), Interactivity, Game Creation, Design, Learning, and Innovation: 5th International Conference, ArtsIT 2016, and First International Conference, DLI 2016, Esbjerg, Denmark, May 2-3, 2016, Proceedings (s. 205-211). Springer. Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, Bind. 196 https://doi.org/10.1007/978-3-319-55834-9_24
Vidakis, Nikolaos ; Kalafatis, Konstantinos ; Triantafyllidis, Georgios. / A Multimodal Interaction Framework for Blended Learning. Interactivity, Game Creation, Design, Learning, and Innovation: 5th International Conference, ArtsIT 2016, and First International Conference, DLI 2016, Esbjerg, Denmark, May 2-3, 2016, Proceedings. red. / Anthony L. Brooks ; Eva Brooks. Springer, 2017. s. 205-211 (Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, Bind 196).
@inproceedings{cca108d03b044b11bb5526f84596ad67,
title = "A Multimodal Interaction Framework for Blended Learning",
abstract = "Humans interact with each other by utilizing the five basic senses as input modalities, whereas sounds, gestures, facial expressions etc. are utilized as output modalities. Multimodal interaction is also used between humans and their surrounding environment, although enhanced with further senses such as equilibrioception and the sense of balance. Computer interfaces that are considered as a different environment that human can interact with, lack of input and output amalgamation in order to provide a close to natural interaction. Multimodal human-computer interaction has sought to provide alternative means of communication with an application, which will be more natural than the traditional “windows, icons, menus, pointer” (WIMP) style. Despite the great amount of devices in existence, most applications make use of a very limited set of modalities, most notably speech and touch. This paper describes amultimodal framework enabling deployment of a vast variety of modalities, tailored appropriately for use in blended learning environment.",
author = "Nikolaos Vidakis and Konstantinos Kalafatis and Georgios Triantafyllidis",
year = "2017",
doi = "10.1007/978-3-319-55834-9_24",
language = "English",
isbn = "978-3-319-55833-2",
series = "Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST",
publisher = "Springer",
pages = "205--211",
editor = "Brooks, {Anthony L.} and Eva Brooks",
booktitle = "Interactivity, Game Creation, Design, Learning, and Innovation",
address = "Germany",

}

Vidakis, N, Kalafatis, K & Triantafyllidis, G 2017, A Multimodal Interaction Framework for Blended Learning. i AL Brooks & E Brooks (red), Interactivity, Game Creation, Design, Learning, and Innovation: 5th International Conference, ArtsIT 2016, and First International Conference, DLI 2016, Esbjerg, Denmark, May 2-3, 2016, Proceedings. Springer, Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, bind 196, s. 205-211, Esbjerg, Danmark, 02/05/2016. https://doi.org/10.1007/978-3-319-55834-9_24

A Multimodal Interaction Framework for Blended Learning. / Vidakis, Nikolaos; Kalafatis, Konstantinos; Triantafyllidis, Georgios.

Interactivity, Game Creation, Design, Learning, and Innovation: 5th International Conference, ArtsIT 2016, and First International Conference, DLI 2016, Esbjerg, Denmark, May 2-3, 2016, Proceedings. red. / Anthony L. Brooks; Eva Brooks. Springer, 2017. s. 205-211 (Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, Bind 196).

Publikation: Bidrag til bog/antologi/rapport/konference proceedingKonferenceartikel i proceedingForskningpeer review

TY - GEN

T1 - A Multimodal Interaction Framework for Blended Learning

AU - Vidakis, Nikolaos

AU - Kalafatis, Konstantinos

AU - Triantafyllidis, Georgios

PY - 2017

Y1 - 2017

N2 - Humans interact with each other by utilizing the five basic senses as input modalities, whereas sounds, gestures, facial expressions etc. are utilized as output modalities. Multimodal interaction is also used between humans and their surrounding environment, although enhanced with further senses such as equilibrioception and the sense of balance. Computer interfaces that are considered as a different environment that human can interact with, lack of input and output amalgamation in order to provide a close to natural interaction. Multimodal human-computer interaction has sought to provide alternative means of communication with an application, which will be more natural than the traditional “windows, icons, menus, pointer” (WIMP) style. Despite the great amount of devices in existence, most applications make use of a very limited set of modalities, most notably speech and touch. This paper describes amultimodal framework enabling deployment of a vast variety of modalities, tailored appropriately for use in blended learning environment.

AB - Humans interact with each other by utilizing the five basic senses as input modalities, whereas sounds, gestures, facial expressions etc. are utilized as output modalities. Multimodal interaction is also used between humans and their surrounding environment, although enhanced with further senses such as equilibrioception and the sense of balance. Computer interfaces that are considered as a different environment that human can interact with, lack of input and output amalgamation in order to provide a close to natural interaction. Multimodal human-computer interaction has sought to provide alternative means of communication with an application, which will be more natural than the traditional “windows, icons, menus, pointer” (WIMP) style. Despite the great amount of devices in existence, most applications make use of a very limited set of modalities, most notably speech and touch. This paper describes amultimodal framework enabling deployment of a vast variety of modalities, tailored appropriately for use in blended learning environment.

U2 - 10.1007/978-3-319-55834-9_24

DO - 10.1007/978-3-319-55834-9_24

M3 - Article in proceeding

SN - 978-3-319-55833-2

T3 - Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST

SP - 205

EP - 211

BT - Interactivity, Game Creation, Design, Learning, and Innovation

A2 - Brooks, Anthony L.

A2 - Brooks, Eva

PB - Springer

ER -

Vidakis N, Kalafatis K, Triantafyllidis G. A Multimodal Interaction Framework for Blended Learning. I Brooks AL, Brooks E, red., Interactivity, Game Creation, Design, Learning, and Innovation: 5th International Conference, ArtsIT 2016, and First International Conference, DLI 2016, Esbjerg, Denmark, May 2-3, 2016, Proceedings. Springer. 2017. s. 205-211. (Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, Bind 196). https://doi.org/10.1007/978-3-319-55834-9_24