Comparison of deep learning and conventional demosaicing algorithms for mastcam images

Chiman Kwan, Bryan Chou, James F. Bell

Research output: Contribution to journalArticle

8 Scopus citations

Abstract

Bayer pattern filters have been used in many commercial digital cameras. In National Aeronautics and Space Administration’s (NASA) mast camera (Mastcam) imaging system, onboard the Mars Science Laboratory (MSL) rover Curiosity, a Bayer pattern filter is being used to capture the RGB (red, green, and blue) color of scenes on Mars. The Mastcam has two cameras: left and right. The right camera has three times better resolution than that of the left. It is well known that demosaicing introduces color and zipper artifacts. Here, we present a comparative study of demosaicing results using conventional and deep learning algorithms. Sixteen left and 15 right Mastcam images were used in our experiments. Due to a lack of ground truth images for Mastcam data from Mars, we compared the various algorithms using a blind image quality assessment model. It was observed that no one algorithm can work the best for all images. In particular, a deep learning-based algorithm worked the best for the right Mastcam images and a conventional algorithm achieved the best results for the left Mastcam images. Moreover, subjective evaluation of five demosaiced Mastcam images was also used to compare the various algorithms.

Original languageEnglish (US)
Article number308
JournalElectronics (Switzerland)
Volume8
Issue number3
DOIs
StatePublished - Mar 2019

Keywords

  • Curiosity rover
  • Debayering
  • Deep learning
  • Demosaicing
  • Fusion
  • Image enhancement
  • Mastcam

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Signal Processing
  • Hardware and Architecture
  • Computer Networks and Communications
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Comparison of deep learning and conventional demosaicing algorithms for mastcam images'. Together they form a unique fingerprint.

  • Cite this