Characterizing the reconfiguration latency of image sensor resolution on android devices

Jinhan Hu, Jianan Yang, Vraj Delhivala, Robert LiKamWa

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations

Abstract

Advances in vision processing have ignited a proliferation of mobile vision applications, including augmented reality. However, limited by the inability to rapidly reconfigure sensor operation for performance-efficiency tradeoffs, high power consumption causes vision applications to drain the device’s battery. To explore the potential impact of enabling rapid reconfiguration, we use a case study around marker-based pose estimation to understand the relationship between image frame resolution, task accuracy, and energy efficiency. Our case study motivates that to balance energy efficiency and task accuracy, the application needs to dynamically and frequently reconfigure sensor resolution. To explore the latency bottlenecks to sensor resolution reconfiguration, we define and profile the end-to-end reconfiguration latency and frame-to-frame latency of changing capture resolution on a Google LG Nexus 5X device. We identify three major sources of sensor resolution reconfiguration latency in current Android systems: (i) sequential configuration patterns, (ii) expensive system calls, and (iii) imaging pipeline delay. Based on our intuitions, we propose a redesign of the Android camera system to mitigate the sources of latency. Enabling smooth transitions between sensor configurations will unlock new classes of adaptive-resolution vision applications.

Original languageEnglish (US)
Title of host publicationHotMobile 2018 - Proceedings of the 19th International Workshop on Mobile Computing Systems and Applications
PublisherAssociation for Computing Machinery, Inc
Pages81-86
Number of pages6
ISBN (Electronic)9781450356305
DOIs
StatePublished - Feb 12 2018
Event19th International Workshop on Mobile Computing Systems and Applications, HotMobile 2018 - Tempe, United States
Duration: Feb 12 2018Feb 13 2018

Publication series

NameHotMobile 2018 - Proceedings of the 19th International Workshop on Mobile Computing Systems and Applications
Volume2018-February

Conference

Conference19th International Workshop on Mobile Computing Systems and Applications, HotMobile 2018
CountryUnited States
CityTempe
Period2/12/182/13/18

Keywords

  • Camera system
  • Image sensor
  • Mobile devices
  • Operating system optimization
  • Reconfiguration

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Science Applications
  • Software
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Characterizing the reconfiguration latency of image sensor resolution on android devices'. Together they form a unique fingerprint.

  • Cite this

    Hu, J., Yang, J., Delhivala, V., & LiKamWa, R. (2018). Characterizing the reconfiguration latency of image sensor resolution on android devices. In HotMobile 2018 - Proceedings of the 19th International Workshop on Mobile Computing Systems and Applications (pp. 81-86). (HotMobile 2018 - Proceedings of the 19th International Workshop on Mobile Computing Systems and Applications; Vol. 2018-February). Association for Computing Machinery, Inc. https://doi.org/10.1145/3177102.3177109