S2NI: A mobile platform for nutrition monitoring from spoken data

Niloofar Hezarjaribi, Cody A. Reynolds, Drew T. Miller, Naomi Chaytor, Hassan Ghasemzadeh

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Scopus citations

Abstract

Diet and physical activity are important lifestyle and behavioral factors in self-management and prevention of many chronic diseases. Mobile sensors such as accelerometers have been used in the past to objectively measure physical activity or detect eating time. Diet monitoring, however, still relies on self-recorded data by end users where individuals use mobile devices for recording nutrition intake by either entering text or taking images. Such approaches have shown low adherence in technology adoption and achieve only moderate accuracy. In this paper, we propose development and validation of Speech-to-Nutrient-Information (S2NI), a comprehensive nutrition monitoring system that combines speech processing, natural language processing, and text mining in a unified platform to extract nutrient information such as calorie intake from spoken data. After converting the voice data to text, we identify food name and portion size information within the text. We then develop a tiered matching algorithm to search the food name in our nutrition database and to accurately compute calorie intake. Due to its pervasive nature and ease of use, S2NI enables users to report their diet routine more frequently and at anytime through their smartphone. We evaluate S2NI using real data collected with 10 participants. Our experimental results show that S2NI achieves 80.6% accuracy in computing calorie intake.

Original languageEnglish (US)
Title of host publication2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1991-1994
Number of pages4
ISBN (Electronic)9781457702204
DOIs
StatePublished - Oct 13 2016
Externally publishedYes
Event38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2016 - Orlando, United States
Duration: Aug 16 2016Aug 20 2016

Publication series

NameProceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
Volume2016-October
ISSN (Print)1557-170X

Other

Other38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2016
Country/TerritoryUnited States
CityOrlando
Period8/16/168/20/16

ASJC Scopus subject areas

  • Signal Processing
  • Biomedical Engineering
  • Computer Vision and Pattern Recognition
  • Health Informatics

Fingerprint

Dive into the research topics of 'S2NI: A mobile platform for nutrition monitoring from spoken data'. Together they form a unique fingerprint.

Cite this