TY - GEN
T1 - Direct inference on compressive measurements using convolutional neural networks
AU - Lohit, Suhas
AU - Kulkarni, Kuldeep
AU - Turaga, Pavan
N1 - Funding Information:
This work was supported by ONR Grant N00014-12-1-0124 sub-award Z868302.
PY - 2016/8/3
Y1 - 2016/8/3
N2 - Compressive imagers, e.g. the single-pixel camera (SPC), acquire measurements in the form of random projections of the scene instead of pixel intensities. Compressive Sensing (CS) theory allows accurate reconstruction of the image even from a small number of such projections. However, in practice, most reconstruction algorithms perform poorly at low measurement rates and are computationally very expensive. But perfect reconstruction is not the goal of high-level computer vision applications. Instead, we are interested in only determining certain properties of the image. Recent work has shown that effective inference is possible directly from the compressive measurements, without reconstruction, using correlational features. In this paper, we show that convolutional neural networks (CNNs) can be employed to extract discriminative non-linear features directly from CS measurements. Using these features, we demonstrate that effective high-level inference can be performed. Experimentally, using hand written digit recognition (MNIST dataset) and image recognition (ImageNet) as examples, we show that recognition is possible even at low measurement rates of about 0.1.
AB - Compressive imagers, e.g. the single-pixel camera (SPC), acquire measurements in the form of random projections of the scene instead of pixel intensities. Compressive Sensing (CS) theory allows accurate reconstruction of the image even from a small number of such projections. However, in practice, most reconstruction algorithms perform poorly at low measurement rates and are computationally very expensive. But perfect reconstruction is not the goal of high-level computer vision applications. Instead, we are interested in only determining certain properties of the image. Recent work has shown that effective inference is possible directly from the compressive measurements, without reconstruction, using correlational features. In this paper, we show that convolutional neural networks (CNNs) can be employed to extract discriminative non-linear features directly from CS measurements. Using these features, we demonstrate that effective high-level inference can be performed. Experimentally, using hand written digit recognition (MNIST dataset) and image recognition (ImageNet) as examples, we show that recognition is possible even at low measurement rates of about 0.1.
KW - Compressive sensing
KW - Neural networks
UR - http://www.scopus.com/inward/record.url?scp=85006837039&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85006837039&partnerID=8YFLogxK
U2 - 10.1109/ICIP.2016.7532691
DO - 10.1109/ICIP.2016.7532691
M3 - Conference contribution
AN - SCOPUS:85006837039
T3 - Proceedings - International Conference on Image Processing, ICIP
SP - 1913
EP - 1917
BT - 2016 IEEE International Conference on Image Processing, ICIP 2016 - Proceedings
PB - IEEE Computer Society
T2 - 23rd IEEE International Conference on Image Processing, ICIP 2016
Y2 - 25 September 2016 through 28 September 2016
ER -