Demo: GLEAM – An illumination estimation framework for real-time photorealistic augmented reality on mobile devices

Siddhant Prakash, Alireza Bahremand, Linda D. Nguyen, Robert LiKamWa

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

Mixed reality mobile platforms attempt to co-locate virtual scenes with physical environments, towards creating immersive user experiences. However, to create visual harmony between virtual and physical spaces, the virtual scene must be accurately illuminated with realistic lighting that matches the physical environment. To this end, we design GLEAM, a framework that provides robust illumination estimation in real-time by integrating physical light-probe estimation with current mobile AR systems. We present a demo implementation of GLEAM by means of an AR application that estimates environmental illumination and renders the scene with real-time illumination updates. We demonstrate the efficacy of GLEAM’s estimation against a current commercial status quo solution, Apple’s ARKit, with the same application.

Original languageEnglish (US)
Title of host publicationMobiSys 2019 - Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services
PublisherAssociation for Computing Machinery, Inc
Pages659-660
Number of pages2
ISBN (Electronic)9781450366618
DOIs
StatePublished - Jun 12 2019
Event17th ACM International Conference on Mobile Systems, Applications, and Services, MobiSys 2019 - Seoul, Korea, Republic of
Duration: Jun 17 2019Jun 21 2019

Publication series

NameMobiSys 2019 - Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services

Conference

Conference17th ACM International Conference on Mobile Systems, Applications, and Services, MobiSys 2019
CountryKorea, Republic of
CitySeoul
Period6/17/196/21/19

    Fingerprint

Keywords

  • Augmented reality
  • Geometry
  • Image processing
  • Image-based lighting
  • Light estimation
  • Light probe
  • Lighting models

ASJC Scopus subject areas

  • Computer Science Applications
  • Computer Networks and Communications

Cite this

Prakash, S., Bahremand, A., Nguyen, L. D., & LiKamWa, R. (2019). Demo: GLEAM – An illumination estimation framework for real-time photorealistic augmented reality on mobile devices. In MobiSys 2019 - Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services (pp. 659-660). (MobiSys 2019 - Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services). Association for Computing Machinery, Inc. https://doi.org/10.1145/3307334.3328570