Talk2Me: A Framework for Device–to–Device Augmented Reality Social Network

Jiayu Shu, Sokol Kosta, Rui Zheng, Pan Hui

Publikation: Bidrag til bog/antologi/rapport/konference proceedingKonferenceartikel i proceedingForskningpeer review

3 Citationer (Scopus)

Resumé

The continuous proliferation of mobile and wearable smart devices, together with their increasing computational power and multitude of sensors, has given birth to innovative applications that enhance the world with virtual layers of processed information. In this paper, we present Talk2Me, an augmented reality social network framework that enables users to disseminate information in a distributed way and view others’ information instantly. Talk2Me advertises users’
messages, together with their face–signature, to every nearby device in a Device–to–Device fashion. When a user looks at nearby persons through her camera–enabled wearable devices (e.g., Google Glass), the framework automatically extracts the face–signature of the person of interest, compares it with the previously captured signatures, and presents the information shared by this person to the user. We design and implement Talk2Me to be lightweight, given that it runs on mobile devices with limited power. We analyze different content dissemination strategies to find the best protocol that yields reliable and fast
information–spreading, while reducing the number of packets and containing the energy consumption on the devices. We design a novel face recognition algorithm for this specific scenario with a small number of face features and limited computing capability.
Evaluation results of the prototype with real users and extensive simulations validate the performance and usability of our design, showing the potentials of the augmented reality social network framework in real–world scenarios.
OriginalsprogEngelsk
TitelIEEE International Conference on Pervasive Computing and Communications (PerCom ’18)
Antal sider10
Udgivelses stedAthens, Greece
ForlagIEEE
Publikationsdato19 mar. 2018
Sider1-10
ISBN (Trykt)978-1-5386-3225-3
ISBN (Elektronisk)978-1-5386-3224-6
DOI
StatusUdgivet - 19 mar. 2018
BegivenhedIEEE International Conference on Pervasive Computing and Communications - Athens, Grækenland
Varighed: 19 mar. 201823 mar. 2018
http://percom.org/Previous/ST2018/

Konference

KonferenceIEEE International Conference on Pervasive Computing and Communications
LandGrækenland
ByAthens
Periode19/03/201823/03/2018
Internetadresse

Fingerprint

Augmented reality
Face recognition
Mobile devices
Energy utilization
Glass
Sensors

Citer dette

Shu, J., Kosta, S., Zheng, R., & Hui, P. (2018). Talk2Me: A Framework for Device–to–Device Augmented Reality Social Network. I IEEE International Conference on Pervasive Computing and Communications (PerCom ’18) (s. 1-10). Athens, Greece: IEEE. https://doi.org/10.1109/PERCOM.2018.8444578
Shu, Jiayu ; Kosta, Sokol ; Zheng, Rui ; Hui, Pan. / Talk2Me : A Framework for Device–to–Device Augmented Reality Social Network. IEEE International Conference on Pervasive Computing and Communications (PerCom ’18). Athens, Greece : IEEE, 2018. s. 1-10
@inproceedings{8a23e35ab3034fdab3db279663c8dd09,
title = "Talk2Me: A Framework for Device–to–Device Augmented Reality Social Network",
abstract = "The continuous proliferation of mobile and wearable smart devices, together with their increasing computational power and multitude of sensors, has given birth to innovative applications that enhance the world with virtual layers of processed information. In this paper, we present Talk2Me, an augmented reality social network framework that enables users to disseminate information in a distributed way and view others’ information instantly. Talk2Me advertises users’messages, together with their face–signature, to every nearby device in a Device–to–Device fashion. When a user looks at nearby persons through her camera–enabled wearable devices (e.g., Google Glass), the framework automatically extracts the face–signature of the person of interest, compares it with the previously captured signatures, and presents the information shared by this person to the user. We design and implement Talk2Me to be lightweight, given that it runs on mobile devices with limited power. We analyze different content dissemination strategies to find the best protocol that yields reliable and fastinformation–spreading, while reducing the number of packets and containing the energy consumption on the devices. We design a novel face recognition algorithm for this specific scenario with a small number of face features and limited computing capability.Evaluation results of the prototype with real users and extensive simulations validate the performance and usability of our design, showing the potentials of the augmented reality social network framework in real–world scenarios.",
author = "Jiayu Shu and Sokol Kosta and Rui Zheng and Pan Hui",
year = "2018",
month = "3",
day = "19",
doi = "10.1109/PERCOM.2018.8444578",
language = "English",
isbn = "978-1-5386-3225-3",
pages = "1--10",
booktitle = "IEEE International Conference on Pervasive Computing and Communications (PerCom ’18)",
publisher = "IEEE",
address = "United States",

}

Shu, J, Kosta, S, Zheng, R & Hui, P 2018, Talk2Me: A Framework for Device–to–Device Augmented Reality Social Network. i IEEE International Conference on Pervasive Computing and Communications (PerCom ’18). IEEE, Athens, Greece, s. 1-10, Athens, Grækenland, 19/03/2018. https://doi.org/10.1109/PERCOM.2018.8444578

Talk2Me : A Framework for Device–to–Device Augmented Reality Social Network. / Shu, Jiayu; Kosta, Sokol; Zheng, Rui; Hui, Pan.

IEEE International Conference on Pervasive Computing and Communications (PerCom ’18). Athens, Greece : IEEE, 2018. s. 1-10.

Publikation: Bidrag til bog/antologi/rapport/konference proceedingKonferenceartikel i proceedingForskningpeer review

TY - GEN

T1 - Talk2Me

T2 - A Framework for Device–to–Device Augmented Reality Social Network

AU - Shu, Jiayu

AU - Kosta, Sokol

AU - Zheng, Rui

AU - Hui, Pan

PY - 2018/3/19

Y1 - 2018/3/19

N2 - The continuous proliferation of mobile and wearable smart devices, together with their increasing computational power and multitude of sensors, has given birth to innovative applications that enhance the world with virtual layers of processed information. In this paper, we present Talk2Me, an augmented reality social network framework that enables users to disseminate information in a distributed way and view others’ information instantly. Talk2Me advertises users’messages, together with their face–signature, to every nearby device in a Device–to–Device fashion. When a user looks at nearby persons through her camera–enabled wearable devices (e.g., Google Glass), the framework automatically extracts the face–signature of the person of interest, compares it with the previously captured signatures, and presents the information shared by this person to the user. We design and implement Talk2Me to be lightweight, given that it runs on mobile devices with limited power. We analyze different content dissemination strategies to find the best protocol that yields reliable and fastinformation–spreading, while reducing the number of packets and containing the energy consumption on the devices. We design a novel face recognition algorithm for this specific scenario with a small number of face features and limited computing capability.Evaluation results of the prototype with real users and extensive simulations validate the performance and usability of our design, showing the potentials of the augmented reality social network framework in real–world scenarios.

AB - The continuous proliferation of mobile and wearable smart devices, together with their increasing computational power and multitude of sensors, has given birth to innovative applications that enhance the world with virtual layers of processed information. In this paper, we present Talk2Me, an augmented reality social network framework that enables users to disseminate information in a distributed way and view others’ information instantly. Talk2Me advertises users’messages, together with their face–signature, to every nearby device in a Device–to–Device fashion. When a user looks at nearby persons through her camera–enabled wearable devices (e.g., Google Glass), the framework automatically extracts the face–signature of the person of interest, compares it with the previously captured signatures, and presents the information shared by this person to the user. We design and implement Talk2Me to be lightweight, given that it runs on mobile devices with limited power. We analyze different content dissemination strategies to find the best protocol that yields reliable and fastinformation–spreading, while reducing the number of packets and containing the energy consumption on the devices. We design a novel face recognition algorithm for this specific scenario with a small number of face features and limited computing capability.Evaluation results of the prototype with real users and extensive simulations validate the performance and usability of our design, showing the potentials of the augmented reality social network framework in real–world scenarios.

UR - http://www.scopus.com/inward/record.url?scp=85053440144&partnerID=8YFLogxK

U2 - 10.1109/PERCOM.2018.8444578

DO - 10.1109/PERCOM.2018.8444578

M3 - Article in proceeding

SN - 978-1-5386-3225-3

SP - 1

EP - 10

BT - IEEE International Conference on Pervasive Computing and Communications (PerCom ’18)

PB - IEEE

CY - Athens, Greece

ER -

Shu J, Kosta S, Zheng R, Hui P. Talk2Me: A Framework for Device–to–Device Augmented Reality Social Network. I IEEE International Conference on Pervasive Computing and Communications (PerCom ’18). Athens, Greece: IEEE. 2018. s. 1-10 https://doi.org/10.1109/PERCOM.2018.8444578