Volume estimation using food specific shape templates in mobile image-based dietary assessment

Junghoon Chae, Insoo Woo, Sung Ye Kim, Ross Maciejewski, Fengging Zhu, Edward J. Delp, Carol J. Boushey, David S. Ebert

Research output: Chapter in Book/Report/Conference proceedingConference contribution

43 Citations (Scopus)

Abstract

As obesity concerns mount, dietary assessment methods for prevention and intervention are being developed. These methods include recording, cataloging and analyzing daily dietary records to monitor energy and nutrient intakes. Given the ubiquity of mobile devices with built-in cameras, one possible means of improving dietary assessment is through photographing foods and inputting these images into a system that can determine the nutrient content of foods in the images. One of the critical issues in such the image-based dietary assessment tool is the accurate and consistent estimation of food portion sizes. The objective of our study is to automatically estimate food volumes through the use of food specific shape templates. In our system, users capture food images using a mobile phone camera. Based on information (i.e., food name and code) determined through food segmentation and classification of the food images, our system choose a particular food template shape corresponding to each segmented food. Finally, our system reconstructs the three-dimensional properties of the food shape from a single image by extracting feature points in order to size the food shape template. By employing this template-based approach, our system automatically estimates food portion size, providing a consistent method for estimation food volume.

Original languageEnglish (US)
Title of host publicationProceedings of SPIE - The International Society for Optical Engineering
Volume7873
DOIs
StatePublished - 2011
Externally publishedYes
EventComputational Imaging IX - San Francisco, CA, United States
Duration: Jan 24 2011Jan 25 2011

Other

OtherComputational Imaging IX
CountryUnited States
CitySan Francisco, CA
Period1/24/111/25/11

Fingerprint

food
Template
templates
Nutrients
Camera
Obesity
Consistent Estimation
Feature Point
Mobile Phone
Mobile Devices
Estimate
nutrients
Monitor
Segmentation
Choose
Three-dimensional
Cameras
cameras
obesity
Energy

Keywords

  • Dietary assessment
  • Food volume estimation
  • Mobile image
  • Shape templates

ASJC Scopus subject areas

  • Applied Mathematics
  • Computer Science Applications
  • Electrical and Electronic Engineering
  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics

Cite this

Chae, J., Woo, I., Kim, S. Y., Maciejewski, R., Zhu, F., Delp, E. J., ... Ebert, D. S. (2011). Volume estimation using food specific shape templates in mobile image-based dietary assessment. In Proceedings of SPIE - The International Society for Optical Engineering (Vol. 7873). [78730K] https://doi.org/10.1117/12.876669

Volume estimation using food specific shape templates in mobile image-based dietary assessment. / Chae, Junghoon; Woo, Insoo; Kim, Sung Ye; Maciejewski, Ross; Zhu, Fengging; Delp, Edward J.; Boushey, Carol J.; Ebert, David S.

Proceedings of SPIE - The International Society for Optical Engineering. Vol. 7873 2011. 78730K.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Chae, J, Woo, I, Kim, SY, Maciejewski, R, Zhu, F, Delp, EJ, Boushey, CJ & Ebert, DS 2011, Volume estimation using food specific shape templates in mobile image-based dietary assessment. in Proceedings of SPIE - The International Society for Optical Engineering. vol. 7873, 78730K, Computational Imaging IX, San Francisco, CA, United States, 1/24/11. https://doi.org/10.1117/12.876669
Chae J, Woo I, Kim SY, Maciejewski R, Zhu F, Delp EJ et al. Volume estimation using food specific shape templates in mobile image-based dietary assessment. In Proceedings of SPIE - The International Society for Optical Engineering. Vol. 7873. 2011. 78730K https://doi.org/10.1117/12.876669
Chae, Junghoon ; Woo, Insoo ; Kim, Sung Ye ; Maciejewski, Ross ; Zhu, Fengging ; Delp, Edward J. ; Boushey, Carol J. ; Ebert, David S. / Volume estimation using food specific shape templates in mobile image-based dietary assessment. Proceedings of SPIE - The International Society for Optical Engineering. Vol. 7873 2011.
@inproceedings{b20a709872084c9ebc3cfed0f6bcb38e,
title = "Volume estimation using food specific shape templates in mobile image-based dietary assessment",
abstract = "As obesity concerns mount, dietary assessment methods for prevention and intervention are being developed. These methods include recording, cataloging and analyzing daily dietary records to monitor energy and nutrient intakes. Given the ubiquity of mobile devices with built-in cameras, one possible means of improving dietary assessment is through photographing foods and inputting these images into a system that can determine the nutrient content of foods in the images. One of the critical issues in such the image-based dietary assessment tool is the accurate and consistent estimation of food portion sizes. The objective of our study is to automatically estimate food volumes through the use of food specific shape templates. In our system, users capture food images using a mobile phone camera. Based on information (i.e., food name and code) determined through food segmentation and classification of the food images, our system choose a particular food template shape corresponding to each segmented food. Finally, our system reconstructs the three-dimensional properties of the food shape from a single image by extracting feature points in order to size the food shape template. By employing this template-based approach, our system automatically estimates food portion size, providing a consistent method for estimation food volume.",
keywords = "Dietary assessment, Food volume estimation, Mobile image, Shape templates",
author = "Junghoon Chae and Insoo Woo and Kim, {Sung Ye} and Ross Maciejewski and Fengging Zhu and Delp, {Edward J.} and Boushey, {Carol J.} and Ebert, {David S.}",
year = "2011",
doi = "10.1117/12.876669",
language = "English (US)",
isbn = "9780819484109",
volume = "7873",
booktitle = "Proceedings of SPIE - The International Society for Optical Engineering",

}

TY - GEN

T1 - Volume estimation using food specific shape templates in mobile image-based dietary assessment

AU - Chae, Junghoon

AU - Woo, Insoo

AU - Kim, Sung Ye

AU - Maciejewski, Ross

AU - Zhu, Fengging

AU - Delp, Edward J.

AU - Boushey, Carol J.

AU - Ebert, David S.

PY - 2011

Y1 - 2011

N2 - As obesity concerns mount, dietary assessment methods for prevention and intervention are being developed. These methods include recording, cataloging and analyzing daily dietary records to monitor energy and nutrient intakes. Given the ubiquity of mobile devices with built-in cameras, one possible means of improving dietary assessment is through photographing foods and inputting these images into a system that can determine the nutrient content of foods in the images. One of the critical issues in such the image-based dietary assessment tool is the accurate and consistent estimation of food portion sizes. The objective of our study is to automatically estimate food volumes through the use of food specific shape templates. In our system, users capture food images using a mobile phone camera. Based on information (i.e., food name and code) determined through food segmentation and classification of the food images, our system choose a particular food template shape corresponding to each segmented food. Finally, our system reconstructs the three-dimensional properties of the food shape from a single image by extracting feature points in order to size the food shape template. By employing this template-based approach, our system automatically estimates food portion size, providing a consistent method for estimation food volume.

AB - As obesity concerns mount, dietary assessment methods for prevention and intervention are being developed. These methods include recording, cataloging and analyzing daily dietary records to monitor energy and nutrient intakes. Given the ubiquity of mobile devices with built-in cameras, one possible means of improving dietary assessment is through photographing foods and inputting these images into a system that can determine the nutrient content of foods in the images. One of the critical issues in such the image-based dietary assessment tool is the accurate and consistent estimation of food portion sizes. The objective of our study is to automatically estimate food volumes through the use of food specific shape templates. In our system, users capture food images using a mobile phone camera. Based on information (i.e., food name and code) determined through food segmentation and classification of the food images, our system choose a particular food template shape corresponding to each segmented food. Finally, our system reconstructs the three-dimensional properties of the food shape from a single image by extracting feature points in order to size the food shape template. By employing this template-based approach, our system automatically estimates food portion size, providing a consistent method for estimation food volume.

KW - Dietary assessment

KW - Food volume estimation

KW - Mobile image

KW - Shape templates

UR - http://www.scopus.com/inward/record.url?scp=79953002788&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79953002788&partnerID=8YFLogxK

U2 - 10.1117/12.876669

DO - 10.1117/12.876669

M3 - Conference contribution

SN - 9780819484109

VL - 7873

BT - Proceedings of SPIE - The International Society for Optical Engineering

ER -