Spatially-Varying Diffuse Reflectance Capture Using Irradiance Map Rendering for Image-Based Modeling Applications

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

56 Downloads (Pure)

Abstract

Image-based 3D modelling using Structure-form-Motion (SfM) has
matured significantly over the last decade. Standard SfM methods
create the object’s texture from the appearance of the physical object
at the time of acquisition. We propose a method for acquiring
the diffuse per-point reflectance of the modelled object, as part of
the image acquisition work flow, only adding one extra captured
image and an irradiance rendering step, making it easy for anyone
to digitize physical objects to create 3D content for AR/VR using
only consumer grade hardware. Current state of the art of spatially
varying reflectance capture requires either large, expensive, and
purpose built setups or are optimization based approaches, whereas
the proposed approach is model based.
This paper proposes adding a render of irradiance with modelled
camera and light source, using off the shelf hardware for image capture. The key element is taking two images at each imaging location:
one with just the ambient illumination conditions, and one where the
light from an on-camera flash is included. It is demonstrated how to
get the ambient illumination to cancel out, and by assuming Lambertian materials, render the irradiance corresponding to the flash-only
image, enabling computation of spatially varying diffuse reflectance
rather than appearance. Qualitative results demonstrate the added
realism of the modelled objects when used as assets in renders under
varying illumination conditions, including limited outdoor scenarios.
Quantitative tests demonstrate that the reflectance can be estimated
correctly to within a few percent even in cases with severe un-even
ambient illumination.
Original languageEnglish
Title of host publication2019 IEEE International Symposium on Mixed and Augmented Reality
Number of pages9
PublisherIEEE Computer Society Press
Publication date2020
Pages46-54
Article number8943701
ISBN (Print)1554-7868
ISBN (Electronic)978-1-7281-0987-9
DOIs
Publication statusPublished - 2020
Event2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2019) - Beijing, China
Duration: 14 Oct 201915 Nov 2019
http://www.ismar19.org

Conference

Conference2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2019)
CountryChina
CityBeijing
Period14/10/201915/11/2019
Internet address
SeriesIEEE International Symposium on Mixed and Augmented Reality (ISMAR)
ISSN1554-7868

Keywords

  • Albedo generation
  • Diffuse Reflectance
  • Diffuse albedo
  • Image Based Modeling
  • Image based 3D modelling
  • Irradiance map Rendering
  • Reflectance
  • SfM
  • Spatially Varying

Fingerprint

Dive into the research topics of 'Spatially-Varying Diffuse Reflectance Capture Using Irradiance Map Rendering for Image-Based Modeling Applications'. Together they form a unique fingerprint.

Cite this