Direct inference on compressive measurements using convolutional neural networks

Suhas Lohit, Kuldeep Kulkarni, Pavan Turaga

Research output: Chapter in Book/Report/Conference proceedingConference contribution

39 Scopus citations

Abstract

Compressive imagers, e.g. the single-pixel camera (SPC), acquire measurements in the form of random projections of the scene instead of pixel intensities. Compressive Sensing (CS) theory allows accurate reconstruction of the image even from a small number of such projections. However, in practice, most reconstruction algorithms perform poorly at low measurement rates and are computationally very expensive. But perfect reconstruction is not the goal of high-level computer vision applications. Instead, we are interested in only determining certain properties of the image. Recent work has shown that effective inference is possible directly from the compressive measurements, without reconstruction, using correlational features. In this paper, we show that convolutional neural networks (CNNs) can be employed to extract discriminative non-linear features directly from CS measurements. Using these features, we demonstrate that effective high-level inference can be performed. Experimentally, using hand written digit recognition (MNIST dataset) and image recognition (ImageNet) as examples, we show that recognition is possible even at low measurement rates of about 0.1.

Original languageEnglish (US)
Title of host publication2016 IEEE International Conference on Image Processing, ICIP 2016 - Proceedings
PublisherIEEE Computer Society
Pages1913-1917
Number of pages5
Volume2016-August
ISBN (Electronic)9781467399616
DOIs
StatePublished - Aug 3 2016
Event23rd IEEE International Conference on Image Processing, ICIP 2016 - Phoenix, United States
Duration: Sep 25 2016Sep 28 2016

Other

Other23rd IEEE International Conference on Image Processing, ICIP 2016
CountryUnited States
CityPhoenix
Period9/25/169/28/16

Keywords

  • Compressive sensing
  • Neural networks

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition
  • Signal Processing

Fingerprint Dive into the research topics of 'Direct inference on compressive measurements using convolutional neural networks'. Together they form a unique fingerprint.

  • Cite this

    Lohit, S., Kulkarni, K., & Turaga, P. (2016). Direct inference on compressive measurements using convolutional neural networks. In 2016 IEEE International Conference on Image Processing, ICIP 2016 - Proceedings (Vol. 2016-August, pp. 1913-1917). [7532691] IEEE Computer Society. https://doi.org/10.1109/ICIP.2016.7532691