Sky pixel detection in outdoor imagery using an adaptive algorithm and machine learning

Kerry A. Nice, Jasper S. Wijnands, Ariane Middel, Jingcheng Wang, Yiming Qiu, Nan Zhao, Jason Thompson, Gideon D.P.A. Aschwanden, Haifeng Zhao, Mark Stevenson

Research output: Contribution to journalArticle

Abstract

Computer vision techniques enable automated detection of sky pixels in outdoor imagery. In urban climate, sky detection is an important first step in gathering information about urban morphology and sky view factors. However, obtaining accurate results remains challenging and becomes even more complex using imagery captured under a variety of lighting and weather conditions. To address this problem, we present a new sky pixel detection system demonstrated to produce accurate results using a wide range of outdoor imagery types. Images are processed using a selection of mean-shift segmentation, K-means clustering, and Sobel filters to mark sky pixels in the scene. The algorithm for a specific image is chosen by a convolutional neural network, trained with 25,000 images from the Skyfinder data set, reaching 82% accuracy for the top three classes. This selection step allows the sky marking to follow an adaptive process and to use different techniques and parameters to best suit a particular image. An evaluation of fourteen different techniques and parameter sets shows that no single technique can perform with high accuracy across varied Skyfinder and Google Street View data sets. However, by using our adaptive process, large increases in accuracy are observed. The resulting system is shown to perform better than other published techniques.

Original languageEnglish (US)
Article number100572
JournalUrban Climate
Volume31
DOIs
StatePublished - Mar 2020

Keywords

  • Google street view
  • Machine learning
  • Sky pixel detection
  • Sky view factor
  • Skyfinder
  • WUDAPT

ASJC Scopus subject areas

  • Geography, Planning and Development
  • Environmental Science (miscellaneous)
  • Urban Studies
  • Atmospheric Science

Fingerprint Dive into the research topics of 'Sky pixel detection in outdoor imagery using an adaptive algorithm and machine learning'. Together they form a unique fingerprint.

  • Cite this

    Nice, K. A., Wijnands, J. S., Middel, A., Wang, J., Qiu, Y., Zhao, N., Thompson, J., Aschwanden, G. D. P. A., Zhao, H., & Stevenson, M. (2020). Sky pixel detection in outdoor imagery using an adaptive algorithm and machine learning. Urban Climate, 31, [100572]. https://doi.org/10.1016/j.uclim.2019.100572