A Kinect-Based Framework For Better User Experience in Real-Time Audiovisual Content Manipulation

Emmanouil Potetsianakis, Emmanouil Ksylakis, Georgios Triantafyllidis

Publikation: Bidrag til bog/antologi/rapport/konference proceedingKonferenceartikel i proceedingForskningpeer review

3 Citationer (Scopus)

Resumé

Applications for real-time multimedia content production, because of their delay-sensitive nature, require fast and precise control by the user. This is commonly achieved by specialized physical controllers that are application-specific with steep learning curves. In our work, we propose using the inputs from Microsoft Kinect as a controller interface. Originally introduced as a peripheral of XBox, Kinect is a multimodal device equipped with RGB Camera, Depth Sensor and Microphone Array. We use those inputs in order to provide a non-tactile controller abstraction to the user, targeting multimedia content creation. Current Kinect-based solutions, try to recognize natural gestures of the user, and classify them as controller actions. The novelty of our implementation is that instead of extracting gesture features, we directly map the inputs from the Kinect to a suitable set of values for the multimedia application. By removing the gesture recognition concept, we are able to create a generic and lightweight framework, with a clear interface to the user. We examine the usability of the framework through the development and evaluation, of a Kinect-controlled real-time multimedia application.
OriginalsprogEngelsk
TitelProceedings of International Conference on Telecommunications and Multimedia (TEMU)
ForlagIEEE Press
Publikationsdato2014
Sider238-242
ISBN (Trykt)978-1-4799-3200-9
DOI
StatusUdgivet - 2014
BegivenhedInternational Conference on Telecommunications and Multimedia (TEMU) - Heraklion, Grækenland
Varighed: 28 jul. 201430 jul. 2014

Konference

KonferenceInternational Conference on Telecommunications and Multimedia (TEMU)
LandGrækenland
ByHeraklion
Periode28/07/201430/07/2014

Fingerprint

Controllers
Gesture recognition
Microphones
Cameras
Sensors

Citer dette

Potetsianakis, E., Ksylakis, E., & Triantafyllidis, G. (2014). A Kinect-Based Framework For Better User Experience in Real-Time Audiovisual Content Manipulation. I Proceedings of International Conference on Telecommunications and Multimedia (TEMU) (s. 238-242). IEEE Press. https://doi.org/10.1109/TEMU.2014.6917767
Potetsianakis, Emmanouil ; Ksylakis, Emmanouil ; Triantafyllidis, Georgios. / A Kinect-Based Framework For Better User Experience in Real-Time Audiovisual Content Manipulation. Proceedings of International Conference on Telecommunications and Multimedia (TEMU). IEEE Press, 2014. s. 238-242
@inproceedings{9092c762f7b048d1b60fe0dace4018fb,
title = "A Kinect-Based Framework For Better User Experience in Real-Time Audiovisual Content Manipulation",
abstract = "Applications for real-time multimedia content production, because of their delay-sensitive nature, require fast and precise control by the user. This is commonly achieved by specialized physical controllers that are application-specific with steep learning curves. In our work, we propose using the inputs from Microsoft Kinect as a controller interface. Originally introduced as a peripheral of XBox, Kinect is a multimodal device equipped with RGB Camera, Depth Sensor and Microphone Array. We use those inputs in order to provide a non-tactile controller abstraction to the user, targeting multimedia content creation. Current Kinect-based solutions, try to recognize natural gestures of the user, and classify them as controller actions. The novelty of our implementation is that instead of extracting gesture features, we directly map the inputs from the Kinect to a suitable set of values for the multimedia application. By removing the gesture recognition concept, we are able to create a generic and lightweight framework, with a clear interface to the user. We examine the usability of the framework through the development and evaluation, of a Kinect-controlled real-time multimedia application.",
author = "Emmanouil Potetsianakis and Emmanouil Ksylakis and Georgios Triantafyllidis",
year = "2014",
doi = "10.1109/TEMU.2014.6917767",
language = "English",
isbn = "978-1-4799-3200-9",
pages = "238--242",
booktitle = "Proceedings of International Conference on Telecommunications and Multimedia (TEMU)",
publisher = "IEEE Press",

}

Potetsianakis, E, Ksylakis, E & Triantafyllidis, G 2014, A Kinect-Based Framework For Better User Experience in Real-Time Audiovisual Content Manipulation. i Proceedings of International Conference on Telecommunications and Multimedia (TEMU). IEEE Press, s. 238-242, Heraklion, Grækenland, 28/07/2014. https://doi.org/10.1109/TEMU.2014.6917767

A Kinect-Based Framework For Better User Experience in Real-Time Audiovisual Content Manipulation. / Potetsianakis, Emmanouil; Ksylakis, Emmanouil; Triantafyllidis, Georgios.

Proceedings of International Conference on Telecommunications and Multimedia (TEMU). IEEE Press, 2014. s. 238-242.

Publikation: Bidrag til bog/antologi/rapport/konference proceedingKonferenceartikel i proceedingForskningpeer review

TY - GEN

T1 - A Kinect-Based Framework For Better User Experience in Real-Time Audiovisual Content Manipulation

AU - Potetsianakis, Emmanouil

AU - Ksylakis, Emmanouil

AU - Triantafyllidis, Georgios

PY - 2014

Y1 - 2014

N2 - Applications for real-time multimedia content production, because of their delay-sensitive nature, require fast and precise control by the user. This is commonly achieved by specialized physical controllers that are application-specific with steep learning curves. In our work, we propose using the inputs from Microsoft Kinect as a controller interface. Originally introduced as a peripheral of XBox, Kinect is a multimodal device equipped with RGB Camera, Depth Sensor and Microphone Array. We use those inputs in order to provide a non-tactile controller abstraction to the user, targeting multimedia content creation. Current Kinect-based solutions, try to recognize natural gestures of the user, and classify them as controller actions. The novelty of our implementation is that instead of extracting gesture features, we directly map the inputs from the Kinect to a suitable set of values for the multimedia application. By removing the gesture recognition concept, we are able to create a generic and lightweight framework, with a clear interface to the user. We examine the usability of the framework through the development and evaluation, of a Kinect-controlled real-time multimedia application.

AB - Applications for real-time multimedia content production, because of their delay-sensitive nature, require fast and precise control by the user. This is commonly achieved by specialized physical controllers that are application-specific with steep learning curves. In our work, we propose using the inputs from Microsoft Kinect as a controller interface. Originally introduced as a peripheral of XBox, Kinect is a multimodal device equipped with RGB Camera, Depth Sensor and Microphone Array. We use those inputs in order to provide a non-tactile controller abstraction to the user, targeting multimedia content creation. Current Kinect-based solutions, try to recognize natural gestures of the user, and classify them as controller actions. The novelty of our implementation is that instead of extracting gesture features, we directly map the inputs from the Kinect to a suitable set of values for the multimedia application. By removing the gesture recognition concept, we are able to create a generic and lightweight framework, with a clear interface to the user. We examine the usability of the framework through the development and evaluation, of a Kinect-controlled real-time multimedia application.

U2 - 10.1109/TEMU.2014.6917767

DO - 10.1109/TEMU.2014.6917767

M3 - Article in proceeding

SN - 978-1-4799-3200-9

SP - 238

EP - 242

BT - Proceedings of International Conference on Telecommunications and Multimedia (TEMU)

PB - IEEE Press

ER -

Potetsianakis E, Ksylakis E, Triantafyllidis G. A Kinect-Based Framework For Better User Experience in Real-Time Audiovisual Content Manipulation. I Proceedings of International Conference on Telecommunications and Multimedia (TEMU). IEEE Press. 2014. s. 238-242 https://doi.org/10.1109/TEMU.2014.6917767