TeleHuman2: A cylindrical light field teleconferencing system for life-size 3D human telepresence

Dan Gotsch; Xujing Zhang; Timothy Merritt; Roel Vertegaal

doi:10.1145/3173574.3174096

TeleHuman2: A cylindrical light field teleconferencing system for life-size 3D human telepresence

Dan Gotsch, Xujing Zhang, Timothy Merritt, Roel Vertegaal

Research output: Contribution to book/anthology/report/conference proceeding › Article in proceeding › Research › peer-review

19 Citations (Scopus)

Abstract

For telepresence to support the richness of multiparty conversations, it is important to convey motion parallax and stereoscopy without head-worn apparatus. TeleHuman2 is a "hologrammatic" telepresence system that conveys fullbody 3D video of interlocutors using a human-sized cylindrical light field display. For rendering, the system uses an array of projectors mounted above the heads of participants in a ring around a retroreflective cylinder. Unique angular renditions are calculated from streaming depth video captured at the remote location. Projected images are retro-reflected into the eyes of local participants, at 1.3° intervals providing angular renditions simultaneously for left and right eyes of all onlookers, which conveys motion parallax and stereoscopy without head-worn apparatus or head tracking. Our technical evaluation of the angular accuracy of the system demonstrates that the error in judging the angle of a remote arrow object represented in TeleHuman2 is within 1 degree, and not significantly different from similar judgments of a collocated arrow object.

Original language	English
Title of host publication	CHI 2018 - Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems : Engage with CHI
Volume	2018-April
Publisher	Association for Computing Machinery
Publication date	20 Apr 2018
ISBN (Electronic)	9781450356206, 9781450356213
DOIs	https://doi.org/10.1145/3173574.3174096
Publication status	Published - 20 Apr 2018
Event	2018 CHI Conference on Human Factors in Computing Systems, CHI 2018 - Palais des Congrès de Montréal, Montreal, Canada Duration: 21 Apr 2018 → 26 Apr 2018

Conference

Conference	2018 CHI Conference on Human Factors in Computing Systems, CHI 2018
Location	Palais des Congrès de Montréal
Country/Territory	Canada
City	Montreal
Period	21/04/2018 → 26/04/2018
Sponsor	ACM SIGCHI

Keywords

3D video
Cylindrical display
Hologram
Light field
Motion parallax
Telepresence
Videoconference

Access to Document

10.1145/3173574.3174096

AUB Link

Search for the material in Aalborg University Library's search engine

Cite this

@inproceedings{46e261e4599a4d0fb0aa8ba6aea4490b,

title = "TeleHuman2: A cylindrical light field teleconferencing system for life-size 3D human telepresence",

abstract = "For telepresence to support the richness of multiparty conversations, it is important to convey motion parallax and stereoscopy without head-worn apparatus. TeleHuman2 is a {"}hologrammatic{"} telepresence system that conveys fullbody 3D video of interlocutors using a human-sized cylindrical light field display. For rendering, the system uses an array of projectors mounted above the heads of participants in a ring around a retroreflective cylinder. Unique angular renditions are calculated from streaming depth video captured at the remote location. Projected images are retro-reflected into the eyes of local participants, at 1.3° intervals providing angular renditions simultaneously for left and right eyes of all onlookers, which conveys motion parallax and stereoscopy without head-worn apparatus or head tracking. Our technical evaluation of the angular accuracy of the system demonstrates that the error in judging the angle of a remote arrow object represented in TeleHuman2 is within 1 degree, and not significantly different from similar judgments of a collocated arrow object.",

keywords = "3D video, Cylindrical display, Hologram, Light field, Motion parallax, Telepresence, Videoconference",

author = "Dan Gotsch and Xujing Zhang and Timothy Merritt and Roel Vertegaal",

year = "2018",

month = apr,

day = "20",

doi = "10.1145/3173574.3174096",

language = "English",

volume = "2018-April",

booktitle = "CHI 2018 - Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems",

publisher = "Association for Computing Machinery",

address = "United States",

note = "2018 CHI Conference on Human Factors in Computing Systems, CHI 2018, CHI '18 ; Conference date: 21-04-2018 Through 26-04-2018",

}

Gotsch, D, Zhang, X, Merritt, T & Vertegaal, R 2018, TeleHuman2: A cylindrical light field teleconferencing system for life-size 3D human telepresence. in CHI 2018 - Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems: Engage with CHI. vol. 2018-April, Association for Computing Machinery, 2018 CHI Conference on Human Factors in Computing Systems, CHI 2018, Montreal, Canada, 21/04/2018. https://doi.org/10.1145/3173574.3174096

TeleHuman2: A cylindrical light field teleconferencing system for life-size 3D human telepresence. / Gotsch, Dan; Zhang, Xujing; Merritt, Timothy et al.
CHI 2018 - Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems: Engage with CHI. Vol. 2018-April Association for Computing Machinery, 2018.

Research output: Contribution to book/anthology/report/conference proceeding › Article in proceeding › Research › peer-review

TY - GEN

T1 - TeleHuman2

T2 - 2018 CHI Conference on Human Factors in Computing Systems, CHI 2018

AU - Gotsch, Dan

AU - Zhang, Xujing

AU - Merritt, Timothy

AU - Vertegaal, Roel

PY - 2018/4/20

Y1 - 2018/4/20

N2 - For telepresence to support the richness of multiparty conversations, it is important to convey motion parallax and stereoscopy without head-worn apparatus. TeleHuman2 is a "hologrammatic" telepresence system that conveys fullbody 3D video of interlocutors using a human-sized cylindrical light field display. For rendering, the system uses an array of projectors mounted above the heads of participants in a ring around a retroreflective cylinder. Unique angular renditions are calculated from streaming depth video captured at the remote location. Projected images are retro-reflected into the eyes of local participants, at 1.3° intervals providing angular renditions simultaneously for left and right eyes of all onlookers, which conveys motion parallax and stereoscopy without head-worn apparatus or head tracking. Our technical evaluation of the angular accuracy of the system demonstrates that the error in judging the angle of a remote arrow object represented in TeleHuman2 is within 1 degree, and not significantly different from similar judgments of a collocated arrow object.

AB - For telepresence to support the richness of multiparty conversations, it is important to convey motion parallax and stereoscopy without head-worn apparatus. TeleHuman2 is a "hologrammatic" telepresence system that conveys fullbody 3D video of interlocutors using a human-sized cylindrical light field display. For rendering, the system uses an array of projectors mounted above the heads of participants in a ring around a retroreflective cylinder. Unique angular renditions are calculated from streaming depth video captured at the remote location. Projected images are retro-reflected into the eyes of local participants, at 1.3° intervals providing angular renditions simultaneously for left and right eyes of all onlookers, which conveys motion parallax and stereoscopy without head-worn apparatus or head tracking. Our technical evaluation of the angular accuracy of the system demonstrates that the error in judging the angle of a remote arrow object represented in TeleHuman2 is within 1 degree, and not significantly different from similar judgments of a collocated arrow object.

KW - 3D video

KW - Cylindrical display

KW - Hologram

KW - Light field

KW - Motion parallax

KW - Telepresence

KW - Videoconference

UR - http://www.scopus.com/inward/record.url?scp=85046934642&partnerID=8YFLogxK

U2 - 10.1145/3173574.3174096

DO - 10.1145/3173574.3174096

M3 - Article in proceeding

AN - SCOPUS:85046934642

VL - 2018-April

BT - CHI 2018 - Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems

PB - Association for Computing Machinery

Y2 - 21 April 2018 through 26 April 2018

ER -

TeleHuman2: A cylindrical light field teleconferencing system for life-size 3D human telepresence

Abstract

Conference

Keywords

Access to Document

AUB Link

Other files and links

Fingerprint

Cite this