A Kinect-Based Framework For Better User Experience in Real-Time Audiovisual Content Manipulation

Emmanouil Potetsianakis, Emmanouil Ksylakis, Georgios Triantafyllidis

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

3 Citations (Scopus)

Abstract

Applications for real-time multimedia content production, because of their delay-sensitive nature, require fast and precise control by the user. This is commonly achieved by specialized physical controllers that are application-specific with steep learning curves. In our work, we propose using the inputs from Microsoft Kinect as a controller interface. Originally introduced as a peripheral of XBox, Kinect is a multimodal device equipped with RGB Camera, Depth Sensor and Microphone Array. We use those inputs in order to provide a non-tactile controller abstraction to the user, targeting multimedia content creation. Current Kinect-based solutions, try to recognize natural gestures of the user, and classify them as controller actions. The novelty of our implementation is that instead of extracting gesture features, we directly map the inputs from the Kinect to a suitable set of values for the multimedia application. By removing the gesture recognition concept, we are able to create a generic and lightweight framework, with a clear interface to the user. We examine the usability of the framework through the development and evaluation, of a Kinect-controlled real-time multimedia application.
Original languageEnglish
Title of host publicationProceedings of International Conference on Telecommunications and Multimedia (TEMU)
PublisherIEEE Press
Publication date2014
Pages238-242
ISBN (Print)978-1-4799-3200-9
DOIs
Publication statusPublished - 2014
EventInternational Conference on Telecommunications and Multimedia (TEMU) - Heraklion, Greece
Duration: 28 Jul 201430 Jul 2014

Conference

ConferenceInternational Conference on Telecommunications and Multimedia (TEMU)
CountryGreece
CityHeraklion
Period28/07/201430/07/2014

Fingerprint

Controllers
Gesture recognition
Microphones
Cameras
Sensors

Cite this

Potetsianakis, E., Ksylakis, E., & Triantafyllidis, G. (2014). A Kinect-Based Framework For Better User Experience in Real-Time Audiovisual Content Manipulation. In Proceedings of International Conference on Telecommunications and Multimedia (TEMU) (pp. 238-242). IEEE Press. https://doi.org/10.1109/TEMU.2014.6917767
Potetsianakis, Emmanouil ; Ksylakis, Emmanouil ; Triantafyllidis, Georgios. / A Kinect-Based Framework For Better User Experience in Real-Time Audiovisual Content Manipulation. Proceedings of International Conference on Telecommunications and Multimedia (TEMU). IEEE Press, 2014. pp. 238-242
@inproceedings{9092c762f7b048d1b60fe0dace4018fb,
title = "A Kinect-Based Framework For Better User Experience in Real-Time Audiovisual Content Manipulation",
abstract = "Applications for real-time multimedia content production, because of their delay-sensitive nature, require fast and precise control by the user. This is commonly achieved by specialized physical controllers that are application-specific with steep learning curves. In our work, we propose using the inputs from Microsoft Kinect as a controller interface. Originally introduced as a peripheral of XBox, Kinect is a multimodal device equipped with RGB Camera, Depth Sensor and Microphone Array. We use those inputs in order to provide a non-tactile controller abstraction to the user, targeting multimedia content creation. Current Kinect-based solutions, try to recognize natural gestures of the user, and classify them as controller actions. The novelty of our implementation is that instead of extracting gesture features, we directly map the inputs from the Kinect to a suitable set of values for the multimedia application. By removing the gesture recognition concept, we are able to create a generic and lightweight framework, with a clear interface to the user. We examine the usability of the framework through the development and evaluation, of a Kinect-controlled real-time multimedia application.",
author = "Emmanouil Potetsianakis and Emmanouil Ksylakis and Georgios Triantafyllidis",
year = "2014",
doi = "10.1109/TEMU.2014.6917767",
language = "English",
isbn = "978-1-4799-3200-9",
pages = "238--242",
booktitle = "Proceedings of International Conference on Telecommunications and Multimedia (TEMU)",
publisher = "IEEE Press",

}

Potetsianakis, E, Ksylakis, E & Triantafyllidis, G 2014, A Kinect-Based Framework For Better User Experience in Real-Time Audiovisual Content Manipulation. in Proceedings of International Conference on Telecommunications and Multimedia (TEMU). IEEE Press, pp. 238-242, International Conference on Telecommunications and Multimedia (TEMU), Heraklion, Greece, 28/07/2014. https://doi.org/10.1109/TEMU.2014.6917767

A Kinect-Based Framework For Better User Experience in Real-Time Audiovisual Content Manipulation. / Potetsianakis, Emmanouil; Ksylakis, Emmanouil; Triantafyllidis, Georgios.

Proceedings of International Conference on Telecommunications and Multimedia (TEMU). IEEE Press, 2014. p. 238-242.

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

TY - GEN

T1 - A Kinect-Based Framework For Better User Experience in Real-Time Audiovisual Content Manipulation

AU - Potetsianakis, Emmanouil

AU - Ksylakis, Emmanouil

AU - Triantafyllidis, Georgios

PY - 2014

Y1 - 2014

N2 - Applications for real-time multimedia content production, because of their delay-sensitive nature, require fast and precise control by the user. This is commonly achieved by specialized physical controllers that are application-specific with steep learning curves. In our work, we propose using the inputs from Microsoft Kinect as a controller interface. Originally introduced as a peripheral of XBox, Kinect is a multimodal device equipped with RGB Camera, Depth Sensor and Microphone Array. We use those inputs in order to provide a non-tactile controller abstraction to the user, targeting multimedia content creation. Current Kinect-based solutions, try to recognize natural gestures of the user, and classify them as controller actions. The novelty of our implementation is that instead of extracting gesture features, we directly map the inputs from the Kinect to a suitable set of values for the multimedia application. By removing the gesture recognition concept, we are able to create a generic and lightweight framework, with a clear interface to the user. We examine the usability of the framework through the development and evaluation, of a Kinect-controlled real-time multimedia application.

AB - Applications for real-time multimedia content production, because of their delay-sensitive nature, require fast and precise control by the user. This is commonly achieved by specialized physical controllers that are application-specific with steep learning curves. In our work, we propose using the inputs from Microsoft Kinect as a controller interface. Originally introduced as a peripheral of XBox, Kinect is a multimodal device equipped with RGB Camera, Depth Sensor and Microphone Array. We use those inputs in order to provide a non-tactile controller abstraction to the user, targeting multimedia content creation. Current Kinect-based solutions, try to recognize natural gestures of the user, and classify them as controller actions. The novelty of our implementation is that instead of extracting gesture features, we directly map the inputs from the Kinect to a suitable set of values for the multimedia application. By removing the gesture recognition concept, we are able to create a generic and lightweight framework, with a clear interface to the user. We examine the usability of the framework through the development and evaluation, of a Kinect-controlled real-time multimedia application.

U2 - 10.1109/TEMU.2014.6917767

DO - 10.1109/TEMU.2014.6917767

M3 - Article in proceeding

SN - 978-1-4799-3200-9

SP - 238

EP - 242

BT - Proceedings of International Conference on Telecommunications and Multimedia (TEMU)

PB - IEEE Press

ER -

Potetsianakis E, Ksylakis E, Triantafyllidis G. A Kinect-Based Framework For Better User Experience in Real-Time Audiovisual Content Manipulation. In Proceedings of International Conference on Telecommunications and Multimedia (TEMU). IEEE Press. 2014. p. 238-242 https://doi.org/10.1109/TEMU.2014.6917767