Outdoor Illumination Estimation for Mobile Augmented Reality: Real-Time Analysis of Shadow and Lit Surfaces to Measure the Daylight Illumination

Claus Brøndgaard Madsen, Fulvio Bertolini

Publikation: Bidrag til bog/antologi/rapport/konference proceedingKonferenceartikel i proceedingForskningpeer review

Resumé

A realistic illumination model in Augmented Reality (AR) applications is crucial for perceiving virtual ob-jects as real. In order to correctly blend digital content with the physical world it is necessary to measure,in real time, the illumination present in the scene surrounding the user. The paper proposes a novel solutionfor real-time estimation of outdoor illumination conditions, based on the video stream from the camera onhandheld devices. The problem is formulated in a radiometric framework, showing how the reflected radiancefrom the surface maps to pixel values, and how the reflected radiance relates to surface reflectance and theillumination environment. From this we derive how to estimate the color and intensity of the sun and skyillumination, respectively, using areas in the video stream that are in direct sunlight and in shadow. The pre-sented approach allows for rendering augmentations that adapt in real-time to dynamically changing outdoorillumination condition.
OriginalsprogEngelsk
TitelProceedings: GRAPP 2020 - 15th International Conference on Computer Graphics Theory and Applications
Antal sider10
ForlagInstitute for Systems and Technologies of Information, Control and Communication
Publikationsdato28 feb. 2020
StatusUdgivet - 28 feb. 2020
BegivenhedGRAPP 2020 - 15th International Conference on Computer Graphics Theory and Applications - Volletta, Malta
Varighed: 27 feb. 202029 feb. 2020
Konferencens nummer: 15

Konference

KonferenceGRAPP 2020 - 15th International Conference on Computer Graphics Theory and Applications
Nummer15
LandMalta
ByVolletta
Periode27/02/202029/02/2020

Fingerprint

Augmented reality
Lighting
Sun
Pixels
Cameras
Color

Citer dette

Madsen, C. B., & Bertolini, F. (2020). Outdoor Illumination Estimation for Mobile Augmented Reality: Real-Time Analysis of Shadow and Lit Surfaces to Measure the Daylight Illumination. I Proceedings: GRAPP 2020 - 15th International Conference on Computer Graphics Theory and Applications Institute for Systems and Technologies of Information, Control and Communication.
Madsen, Claus Brøndgaard ; Bertolini, Fulvio. / Outdoor Illumination Estimation for Mobile Augmented Reality : Real-Time Analysis of Shadow and Lit Surfaces to Measure the Daylight Illumination. Proceedings: GRAPP 2020 - 15th International Conference on Computer Graphics Theory and Applications. Institute for Systems and Technologies of Information, Control and Communication, 2020.
@inproceedings{e26858d2a8ac4f5684bc7fd960a27a62,
title = "Outdoor Illumination Estimation for Mobile Augmented Reality: Real-Time Analysis of Shadow and Lit Surfaces to Measure the Daylight Illumination",
abstract = "A realistic illumination model in Augmented Reality (AR) applications is crucial for perceiving virtual ob-jects as real. In order to correctly blend digital content with the physical world it is necessary to measure,in real time, the illumination present in the scene surrounding the user. The paper proposes a novel solutionfor real-time estimation of outdoor illumination conditions, based on the video stream from the camera onhandheld devices. The problem is formulated in a radiometric framework, showing how the reflected radiancefrom the surface maps to pixel values, and how the reflected radiance relates to surface reflectance and theillumination environment. From this we derive how to estimate the color and intensity of the sun and skyillumination, respectively, using areas in the video stream that are in direct sunlight and in shadow. The pre-sented approach allows for rendering augmentations that adapt in real-time to dynamically changing outdoorillumination condition.",
keywords = "Augmented Reality",
author = "Madsen, {Claus Br{\o}ndgaard} and Fulvio Bertolini",
year = "2020",
month = "2",
day = "28",
language = "English",
booktitle = "Proceedings: GRAPP 2020 - 15th International Conference on Computer Graphics Theory and Applications",
publisher = "Institute for Systems and Technologies of Information, Control and Communication",

}

Madsen, CB & Bertolini, F 2020, Outdoor Illumination Estimation for Mobile Augmented Reality: Real-Time Analysis of Shadow and Lit Surfaces to Measure the Daylight Illumination. i Proceedings: GRAPP 2020 - 15th International Conference on Computer Graphics Theory and Applications. Institute for Systems and Technologies of Information, Control and Communication, GRAPP 2020 - 15th International Conference on Computer Graphics Theory and Applications, Volletta, Malta, 27/02/2020.

Outdoor Illumination Estimation for Mobile Augmented Reality : Real-Time Analysis of Shadow and Lit Surfaces to Measure the Daylight Illumination. / Madsen, Claus Brøndgaard; Bertolini, Fulvio.

Proceedings: GRAPP 2020 - 15th International Conference on Computer Graphics Theory and Applications. Institute for Systems and Technologies of Information, Control and Communication, 2020.

Publikation: Bidrag til bog/antologi/rapport/konference proceedingKonferenceartikel i proceedingForskningpeer review

TY - GEN

T1 - Outdoor Illumination Estimation for Mobile Augmented Reality

T2 - Real-Time Analysis of Shadow and Lit Surfaces to Measure the Daylight Illumination

AU - Madsen, Claus Brøndgaard

AU - Bertolini, Fulvio

PY - 2020/2/28

Y1 - 2020/2/28

N2 - A realistic illumination model in Augmented Reality (AR) applications is crucial for perceiving virtual ob-jects as real. In order to correctly blend digital content with the physical world it is necessary to measure,in real time, the illumination present in the scene surrounding the user. The paper proposes a novel solutionfor real-time estimation of outdoor illumination conditions, based on the video stream from the camera onhandheld devices. The problem is formulated in a radiometric framework, showing how the reflected radiancefrom the surface maps to pixel values, and how the reflected radiance relates to surface reflectance and theillumination environment. From this we derive how to estimate the color and intensity of the sun and skyillumination, respectively, using areas in the video stream that are in direct sunlight and in shadow. The pre-sented approach allows for rendering augmentations that adapt in real-time to dynamically changing outdoorillumination condition.

AB - A realistic illumination model in Augmented Reality (AR) applications is crucial for perceiving virtual ob-jects as real. In order to correctly blend digital content with the physical world it is necessary to measure,in real time, the illumination present in the scene surrounding the user. The paper proposes a novel solutionfor real-time estimation of outdoor illumination conditions, based on the video stream from the camera onhandheld devices. The problem is formulated in a radiometric framework, showing how the reflected radiancefrom the surface maps to pixel values, and how the reflected radiance relates to surface reflectance and theillumination environment. From this we derive how to estimate the color and intensity of the sun and skyillumination, respectively, using areas in the video stream that are in direct sunlight and in shadow. The pre-sented approach allows for rendering augmentations that adapt in real-time to dynamically changing outdoorillumination condition.

KW - Augmented Reality

M3 - Article in proceeding

BT - Proceedings: GRAPP 2020 - 15th International Conference on Computer Graphics Theory and Applications

PB - Institute for Systems and Technologies of Information, Control and Communication

ER -

Madsen CB, Bertolini F. Outdoor Illumination Estimation for Mobile Augmented Reality: Real-Time Analysis of Shadow and Lit Surfaces to Measure the Daylight Illumination. I Proceedings: GRAPP 2020 - 15th International Conference on Computer Graphics Theory and Applications. Institute for Systems and Technologies of Information, Control and Communication. 2020