MT-Diet: Automated smartphone based diet assessment with infrared images

Junghyo Lee; Ayan Banerjee; Sandeep Gupta

doi:10.1109/PERCOM.2016.7456506

MT-Diet: Automated smartphone based diet assessment with infrared images

Junghyo Lee, Ayan Banerjee, Sandeep Gupta

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

16 Scopus citations

Abstract

In this paper, we propose MT-Diet, a smartphone-based automated diet monitoring system that interfaces a thermal camera with a smartphone and identifies types of food consumed at the click of a button. The system uses thermal maps of a food plate to increase accuracy of segmentation and extraction of food parts, and combines thermal and visual images to improve accuracy in the detection of cooked food. Test results on 80 different types of cooked food show that MT-Diet can isolate food parts with an accuracy of 97.5% and determine the type of food with an accuracy of 88.93%, which is a significant improvement (nearly 25%) over the state-of-the-art.

Original language	English (US)
Title of host publication	2016 IEEE International Conference on Pervasive Computing and Communications, PerCom 2016
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781467387798
DOIs	https://doi.org/10.1109/PERCOM.2016.7456506
State	Published - Apr 19 2016
Event	14th IEEE International Conference on Pervasive Computing and Communications, PerCom 2016 - Sydney, Australia Duration: Mar 14 2016 → Mar 19 2016

Publication series

Name	2016 IEEE International Conference on Pervasive Computing and Communications, PerCom 2016

Other

Other	14th IEEE International Conference on Pervasive Computing and Communications, PerCom 2016
Country/Territory	Australia
City	Sydney
Period	3/14/16 → 3/19/16

ASJC Scopus subject areas

Computer Networks and Communications
Computer Science Applications
Human-Computer Interaction

Access to Document

10.1109/PERCOM.2016.7456506

Cite this

Lee, J., Banerjee, A., & Gupta, S. (2016). MT-Diet: Automated smartphone based diet assessment with infrared images. In 2016 IEEE International Conference on Pervasive Computing and Communications, PerCom 2016 Article 7456506 (2016 IEEE International Conference on Pervasive Computing and Communications, PerCom 2016). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/PERCOM.2016.7456506

MT-Diet: Automated smartphone based diet assessment with infrared images. / Lee, Junghyo; Banerjee, Ayan ; Gupta, Sandeep.
2016 IEEE International Conference on Pervasive Computing and Communications, PerCom 2016. Institute of Electrical and Electronics Engineers Inc., 2016. 7456506 (2016 IEEE International Conference on Pervasive Computing and Communications, PerCom 2016).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Lee, J, Banerjee, A & Gupta, S 2016, MT-Diet: Automated smartphone based diet assessment with infrared images. in 2016 IEEE International Conference on Pervasive Computing and Communications, PerCom 2016., 7456506, 2016 IEEE International Conference on Pervasive Computing and Communications, PerCom 2016, Institute of Electrical and Electronics Engineers Inc., 14th IEEE International Conference on Pervasive Computing and Communications, PerCom 2016, Sydney, Australia, 3/14/16. https://doi.org/10.1109/PERCOM.2016.7456506

Lee J, Banerjee A , Gupta S. MT-Diet: Automated smartphone based diet assessment with infrared images. In 2016 IEEE International Conference on Pervasive Computing and Communications, PerCom 2016. Institute of Electrical and Electronics Engineers Inc. 2016. 7456506. (2016 IEEE International Conference on Pervasive Computing and Communications, PerCom 2016). doi: 10.1109/PERCOM.2016.7456506

Lee, Junghyo ; Banerjee, Ayan ; Gupta, Sandeep. / MT-Diet : Automated smartphone based diet assessment with infrared images. 2016 IEEE International Conference on Pervasive Computing and Communications, PerCom 2016. Institute of Electrical and Electronics Engineers Inc., 2016. (2016 IEEE International Conference on Pervasive Computing and Communications, PerCom 2016).

@inproceedings{fbe0597c5d6a48698130e64e35f2a824,

title = "MT-Diet: Automated smartphone based diet assessment with infrared images",

abstract = "In this paper, we propose MT-Diet, a smartphone-based automated diet monitoring system that interfaces a thermal camera with a smartphone and identifies types of food consumed at the click of a button. The system uses thermal maps of a food plate to increase accuracy of segmentation and extraction of food parts, and combines thermal and visual images to improve accuracy in the detection of cooked food. Test results on 80 different types of cooked food show that MT-Diet can isolate food parts with an accuracy of 97.5% and determine the type of food with an accuracy of 88.93%, which is a significant improvement (nearly 25%) over the state-of-the-art.",

author = "Junghyo Lee and Ayan Banerjee and Sandeep Gupta",

note = "Publisher Copyright: {\textcopyright} 2016 IEEE.; 14th IEEE International Conference on Pervasive Computing and Communications, PerCom 2016 ; Conference date: 14-03-2016 Through 19-03-2016",

year = "2016",

month = apr,

day = "19",

doi = "10.1109/PERCOM.2016.7456506",

language = "English (US)",

series = "2016 IEEE International Conference on Pervasive Computing and Communications, PerCom 2016",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "2016 IEEE International Conference on Pervasive Computing and Communications, PerCom 2016",

}

TY - GEN

T1 - MT-Diet

T2 - 14th IEEE International Conference on Pervasive Computing and Communications, PerCom 2016

AU - Lee, Junghyo

AU - Banerjee, Ayan

AU - Gupta, Sandeep

PY - 2016/4/19

Y1 - 2016/4/19

N2 - In this paper, we propose MT-Diet, a smartphone-based automated diet monitoring system that interfaces a thermal camera with a smartphone and identifies types of food consumed at the click of a button. The system uses thermal maps of a food plate to increase accuracy of segmentation and extraction of food parts, and combines thermal and visual images to improve accuracy in the detection of cooked food. Test results on 80 different types of cooked food show that MT-Diet can isolate food parts with an accuracy of 97.5% and determine the type of food with an accuracy of 88.93%, which is a significant improvement (nearly 25%) over the state-of-the-art.

AB - In this paper, we propose MT-Diet, a smartphone-based automated diet monitoring system that interfaces a thermal camera with a smartphone and identifies types of food consumed at the click of a button. The system uses thermal maps of a food plate to increase accuracy of segmentation and extraction of food parts, and combines thermal and visual images to improve accuracy in the detection of cooked food. Test results on 80 different types of cooked food show that MT-Diet can isolate food parts with an accuracy of 97.5% and determine the type of food with an accuracy of 88.93%, which is a significant improvement (nearly 25%) over the state-of-the-art.

UR - http://www.scopus.com/inward/record.url?scp=84969135850&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84969135850&partnerID=8YFLogxK

U2 - 10.1109/PERCOM.2016.7456506

DO - 10.1109/PERCOM.2016.7456506

M3 - Conference contribution

AN - SCOPUS:84969135850

T3 - 2016 IEEE International Conference on Pervasive Computing and Communications, PerCom 2016

BT - 2016 IEEE International Conference on Pervasive Computing and Communications, PerCom 2016

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 14 March 2016 through 19 March 2016

ER -

MT-Diet: Automated smartphone based diet assessment with infrared images

Abstract

Publication series

Other

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this