Demo: GLEAM – An illumination estimation framework for real-time photorealistic augmented reality on mobile devices

Siddhant Prakash, Alireza Bahremand, Linda D. Nguyen, Robert LiKamWa

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Mixed reality mobile platforms attempt to co-locate virtual scenes with physical environments, towards creating immersive user experiences. However, to create visual harmony between virtual and physical spaces, the virtual scene must be accurately illuminated with realistic lighting that matches the physical environment. To this end, we design GLEAM, a framework that provides robust illumination estimation in real-time by integrating physical light-probe estimation with current mobile AR systems. We present a demo implementation of GLEAM by means of an AR application that estimates environmental illumination and renders the scene with real-time illumination updates. We demonstrate the efficacy of GLEAM’s estimation against a current commercial status quo solution, Apple’s ARKit, with the same application.

Original languageEnglish (US)
Title of host publicationMobiSys 2019 - Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services
PublisherAssociation for Computing Machinery, Inc
Pages659-660
Number of pages2
ISBN (Electronic)9781450366618
DOIs
StatePublished - Jun 12 2019
Event17th ACM International Conference on Mobile Systems, Applications, and Services, MobiSys 2019 - Seoul, Korea, Republic of
Duration: Jun 17 2019Jun 21 2019

Publication series

NameMobiSys 2019 - Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services

Conference

Conference17th ACM International Conference on Mobile Systems, Applications, and Services, MobiSys 2019
CountryKorea, Republic of
CitySeoul
Period6/17/196/21/19

Fingerprint

Augmented reality
Mobile devices
Lighting

Keywords

  • Augmented reality
  • Geometry
  • Image processing
  • Image-based lighting
  • Light estimation
  • Light probe
  • Lighting models

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications

Cite this

Prakash, S., Bahremand, A., Nguyen, L. D., & LiKamWa, R. (2019). Demo: GLEAM – An illumination estimation framework for real-time photorealistic augmented reality on mobile devices. In MobiSys 2019 - Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services (pp. 659-660). (MobiSys 2019 - Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services). Association for Computing Machinery, Inc. https://doi.org/10.1145/3307334.3328570

Demo : GLEAM – An illumination estimation framework for real-time photorealistic augmented reality on mobile devices. / Prakash, Siddhant; Bahremand, Alireza; Nguyen, Linda D.; LiKamWa, Robert.

MobiSys 2019 - Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services. Association for Computing Machinery, Inc, 2019. p. 659-660 (MobiSys 2019 - Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Prakash, S, Bahremand, A, Nguyen, LD & LiKamWa, R 2019, Demo: GLEAM – An illumination estimation framework for real-time photorealistic augmented reality on mobile devices. in MobiSys 2019 - Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services. MobiSys 2019 - Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services, Association for Computing Machinery, Inc, pp. 659-660, 17th ACM International Conference on Mobile Systems, Applications, and Services, MobiSys 2019, Seoul, Korea, Republic of, 6/17/19. https://doi.org/10.1145/3307334.3328570
Prakash S, Bahremand A, Nguyen LD, LiKamWa R. Demo: GLEAM – An illumination estimation framework for real-time photorealistic augmented reality on mobile devices. In MobiSys 2019 - Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services. Association for Computing Machinery, Inc. 2019. p. 659-660. (MobiSys 2019 - Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services). https://doi.org/10.1145/3307334.3328570
Prakash, Siddhant ; Bahremand, Alireza ; Nguyen, Linda D. ; LiKamWa, Robert. / Demo : GLEAM – An illumination estimation framework for real-time photorealistic augmented reality on mobile devices. MobiSys 2019 - Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services. Association for Computing Machinery, Inc, 2019. pp. 659-660 (MobiSys 2019 - Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services).
@inproceedings{8e011aae359c43858f5404c5e49b767e,
title = "Demo: GLEAM – An illumination estimation framework for real-time photorealistic augmented reality on mobile devices",
abstract = "Mixed reality mobile platforms attempt to co-locate virtual scenes with physical environments, towards creating immersive user experiences. However, to create visual harmony between virtual and physical spaces, the virtual scene must be accurately illuminated with realistic lighting that matches the physical environment. To this end, we design GLEAM, a framework that provides robust illumination estimation in real-time by integrating physical light-probe estimation with current mobile AR systems. We present a demo implementation of GLEAM by means of an AR application that estimates environmental illumination and renders the scene with real-time illumination updates. We demonstrate the efficacy of GLEAM’s estimation against a current commercial status quo solution, Apple’s ARKit, with the same application.",
keywords = "Augmented reality, Geometry, Image processing, Image-based lighting, Light estimation, Light probe, Lighting models",
author = "Siddhant Prakash and Alireza Bahremand and Nguyen, {Linda D.} and Robert LiKamWa",
year = "2019",
month = "6",
day = "12",
doi = "10.1145/3307334.3328570",
language = "English (US)",
series = "MobiSys 2019 - Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services",
publisher = "Association for Computing Machinery, Inc",
pages = "659--660",
booktitle = "MobiSys 2019 - Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services",

}

TY - GEN

T1 - Demo

T2 - GLEAM – An illumination estimation framework for real-time photorealistic augmented reality on mobile devices

AU - Prakash, Siddhant

AU - Bahremand, Alireza

AU - Nguyen, Linda D.

AU - LiKamWa, Robert

PY - 2019/6/12

Y1 - 2019/6/12

N2 - Mixed reality mobile platforms attempt to co-locate virtual scenes with physical environments, towards creating immersive user experiences. However, to create visual harmony between virtual and physical spaces, the virtual scene must be accurately illuminated with realistic lighting that matches the physical environment. To this end, we design GLEAM, a framework that provides robust illumination estimation in real-time by integrating physical light-probe estimation with current mobile AR systems. We present a demo implementation of GLEAM by means of an AR application that estimates environmental illumination and renders the scene with real-time illumination updates. We demonstrate the efficacy of GLEAM’s estimation against a current commercial status quo solution, Apple’s ARKit, with the same application.

AB - Mixed reality mobile platforms attempt to co-locate virtual scenes with physical environments, towards creating immersive user experiences. However, to create visual harmony between virtual and physical spaces, the virtual scene must be accurately illuminated with realistic lighting that matches the physical environment. To this end, we design GLEAM, a framework that provides robust illumination estimation in real-time by integrating physical light-probe estimation with current mobile AR systems. We present a demo implementation of GLEAM by means of an AR application that estimates environmental illumination and renders the scene with real-time illumination updates. We demonstrate the efficacy of GLEAM’s estimation against a current commercial status quo solution, Apple’s ARKit, with the same application.

KW - Augmented reality

KW - Geometry

KW - Image processing

KW - Image-based lighting

KW - Light estimation

KW - Light probe

KW - Lighting models

UR - http://www.scopus.com/inward/record.url?scp=85069202987&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85069202987&partnerID=8YFLogxK

U2 - 10.1145/3307334.3328570

DO - 10.1145/3307334.3328570

M3 - Conference contribution

AN - SCOPUS:85069202987

T3 - MobiSys 2019 - Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services

SP - 659

EP - 660

BT - MobiSys 2019 - Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services

PB - Association for Computing Machinery, Inc

ER -