A Multimodal Interaction Framework for Blended Learning

Publikation: Forskning - peer reviewKonferenceartikel i proceeding

Abstrakt

Humans interact with each other by utilizing the five basic senses as input modalities, whereas sounds, gestures, facial expressions etc. are utilized as output modalities. Multimodal interaction is also used between humans and their surrounding environment, although enhanced with further senses such as equilibrioception and the sense of balance. Computer interfaces that are considered as a different environment that human can interact with, lack of input and output amalgamation in order to provide a close to natural interaction. Multimodal human-computer interaction has sought to provide alternative means of communication with an application, which will be more natural than the traditional “windows, icons, menus, pointer” (WIMP) style. Despite the great amount of devices in existence, most applications make use of a very limited set of modalities, most notably speech and touch. This paper describes a
multimodal framework enabling deployment of a vast variety of modalities, tailored appropriately for use in blended learning environment.
Luk

Detaljer

Humans interact with each other by utilizing the five basic senses as input modalities, whereas sounds, gestures, facial expressions etc. are utilized as output modalities. Multimodal interaction is also used between humans and their surrounding environment, although enhanced with further senses such as equilibrioception and the sense of balance. Computer interfaces that are considered as a different environment that human can interact with, lack of input and output amalgamation in order to provide a close to natural interaction. Multimodal human-computer interaction has sought to provide alternative means of communication with an application, which will be more natural than the traditional “windows, icons, menus, pointer” (WIMP) style. Despite the great amount of devices in existence, most applications make use of a very limited set of modalities, most notably speech and touch. This paper describes a
multimodal framework enabling deployment of a vast variety of modalities, tailored appropriately for use in blended learning environment.
OriginalsprogEngelsk
TitelInteractivity, Game Creation, Design, Learning, and Innovation, ArtsIT 2016 : 1st EAI International Conference on Design, Learning & Innovation
Vol/bind196
ForlagSpringer
Publikationsdato2017
Sider205-211
ISBN (Trykt)978-3-319-55833-2
ISBN (Elektronisk)978-3-319-55834-9
DOI
StatusUdgivet - 2017
PublikationsartForskning
Peer reviewJa
Begivenhed1st EAI International Conference on Design, Learning & Innovation - Esbjerg campus of Aalborg University, Esbjerg, Danmark
Varighed: 2 maj 20164 maj 2016
http://designlearninginnovation.org/

Konference

Konference1st EAI International Conference on Design, Learning & Innovation
LokationEsbjerg campus of Aalborg University
LandDanmark
ByEsbjerg
Periode02/05/201604/05/2016
Internetadresse
SerieLecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST
Vol/bind196
ISSN1867-8211
ID: 241179457