Your face your heart: Secure mobile face authentication with photoplethysmograms

Yimin Chen, Jingchao Sun, Xiaocong Jin, Tao Li, Rui Zhang, Yanchao Zhang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

Face authentication emerges as a powerful method for preventing unauthorized access to mobile devices. It is, however, vulnerable to photo-based forgery attacks (PFA) and videobased forgery attacks (VFA), in which the adversary exploits a photo or video containing the user's frontal face. Effective defenses against PFA and VFA often rely on liveness detection, which seeks to find a live indicator that the submitted face photo or video of the legitimate user is indeed captured in real time. In this paper, we propose FaceHeart, a novel and practical face authentication system for mobile devices. FaceHeart simultaneously takes a face video with the front camera and a fingertip video with the rear camera on COTS mobile devices. It then achieves liveness detection by comparing the two photoplethysmograms independently extracted from the face and fingertip videos, which should be highly consistent if the two videos are for the same live person and taken at the same time. As photoplethysmograms are closely tied to human cardiac activity and almost impossible to forge or control, FaceHeart is strongly resilient to PFA and VFA. Extensive user experiments on Samsung Galaxy S5 have confirmed the high efficacy and efficiency of FaceHeart.

Original languageEnglish (US)
Title of host publicationINFOCOM 2017 - IEEE Conference on Computer Communications
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781509053360
DOIs
StatePublished - Oct 2 2017
Event2017 IEEE Conference on Computer Communications, INFOCOM 2017 - Atlanta, United States
Duration: May 1 2017May 4 2017

Other

Other2017 IEEE Conference on Computer Communications, INFOCOM 2017
CountryUnited States
CityAtlanta
Period5/1/175/4/17

Fingerprint

Mobile devices
Authentication
Cameras
Galaxies
Experiments

ASJC Scopus subject areas

  • Computer Science(all)
  • Electrical and Electronic Engineering

Cite this

Chen, Y., Sun, J., Jin, X., Li, T., Zhang, R., & Zhang, Y. (2017). Your face your heart: Secure mobile face authentication with photoplethysmograms. In INFOCOM 2017 - IEEE Conference on Computer Communications [8057220] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/INFOCOM.2017.8057220

Your face your heart : Secure mobile face authentication with photoplethysmograms. / Chen, Yimin; Sun, Jingchao; Jin, Xiaocong; Li, Tao; Zhang, Rui; Zhang, Yanchao.

INFOCOM 2017 - IEEE Conference on Computer Communications. Institute of Electrical and Electronics Engineers Inc., 2017. 8057220.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Chen, Y, Sun, J, Jin, X, Li, T, Zhang, R & Zhang, Y 2017, Your face your heart: Secure mobile face authentication with photoplethysmograms. in INFOCOM 2017 - IEEE Conference on Computer Communications., 8057220, Institute of Electrical and Electronics Engineers Inc., 2017 IEEE Conference on Computer Communications, INFOCOM 2017, Atlanta, United States, 5/1/17. https://doi.org/10.1109/INFOCOM.2017.8057220
Chen Y, Sun J, Jin X, Li T, Zhang R, Zhang Y. Your face your heart: Secure mobile face authentication with photoplethysmograms. In INFOCOM 2017 - IEEE Conference on Computer Communications. Institute of Electrical and Electronics Engineers Inc. 2017. 8057220 https://doi.org/10.1109/INFOCOM.2017.8057220
Chen, Yimin ; Sun, Jingchao ; Jin, Xiaocong ; Li, Tao ; Zhang, Rui ; Zhang, Yanchao. / Your face your heart : Secure mobile face authentication with photoplethysmograms. INFOCOM 2017 - IEEE Conference on Computer Communications. Institute of Electrical and Electronics Engineers Inc., 2017.
@inproceedings{de128b0ec86d41cebe199d5e4b54153e,
title = "Your face your heart: Secure mobile face authentication with photoplethysmograms",
abstract = "Face authentication emerges as a powerful method for preventing unauthorized access to mobile devices. It is, however, vulnerable to photo-based forgery attacks (PFA) and videobased forgery attacks (VFA), in which the adversary exploits a photo or video containing the user's frontal face. Effective defenses against PFA and VFA often rely on liveness detection, which seeks to find a live indicator that the submitted face photo or video of the legitimate user is indeed captured in real time. In this paper, we propose FaceHeart, a novel and practical face authentication system for mobile devices. FaceHeart simultaneously takes a face video with the front camera and a fingertip video with the rear camera on COTS mobile devices. It then achieves liveness detection by comparing the two photoplethysmograms independently extracted from the face and fingertip videos, which should be highly consistent if the two videos are for the same live person and taken at the same time. As photoplethysmograms are closely tied to human cardiac activity and almost impossible to forge or control, FaceHeart is strongly resilient to PFA and VFA. Extensive user experiments on Samsung Galaxy S5 have confirmed the high efficacy and efficiency of FaceHeart.",
author = "Yimin Chen and Jingchao Sun and Xiaocong Jin and Tao Li and Rui Zhang and Yanchao Zhang",
year = "2017",
month = "10",
day = "2",
doi = "10.1109/INFOCOM.2017.8057220",
language = "English (US)",
booktitle = "INFOCOM 2017 - IEEE Conference on Computer Communications",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
address = "United States",

}

TY - GEN

T1 - Your face your heart

T2 - Secure mobile face authentication with photoplethysmograms

AU - Chen, Yimin

AU - Sun, Jingchao

AU - Jin, Xiaocong

AU - Li, Tao

AU - Zhang, Rui

AU - Zhang, Yanchao

PY - 2017/10/2

Y1 - 2017/10/2

N2 - Face authentication emerges as a powerful method for preventing unauthorized access to mobile devices. It is, however, vulnerable to photo-based forgery attacks (PFA) and videobased forgery attacks (VFA), in which the adversary exploits a photo or video containing the user's frontal face. Effective defenses against PFA and VFA often rely on liveness detection, which seeks to find a live indicator that the submitted face photo or video of the legitimate user is indeed captured in real time. In this paper, we propose FaceHeart, a novel and practical face authentication system for mobile devices. FaceHeart simultaneously takes a face video with the front camera and a fingertip video with the rear camera on COTS mobile devices. It then achieves liveness detection by comparing the two photoplethysmograms independently extracted from the face and fingertip videos, which should be highly consistent if the two videos are for the same live person and taken at the same time. As photoplethysmograms are closely tied to human cardiac activity and almost impossible to forge or control, FaceHeart is strongly resilient to PFA and VFA. Extensive user experiments on Samsung Galaxy S5 have confirmed the high efficacy and efficiency of FaceHeart.

AB - Face authentication emerges as a powerful method for preventing unauthorized access to mobile devices. It is, however, vulnerable to photo-based forgery attacks (PFA) and videobased forgery attacks (VFA), in which the adversary exploits a photo or video containing the user's frontal face. Effective defenses against PFA and VFA often rely on liveness detection, which seeks to find a live indicator that the submitted face photo or video of the legitimate user is indeed captured in real time. In this paper, we propose FaceHeart, a novel and practical face authentication system for mobile devices. FaceHeart simultaneously takes a face video with the front camera and a fingertip video with the rear camera on COTS mobile devices. It then achieves liveness detection by comparing the two photoplethysmograms independently extracted from the face and fingertip videos, which should be highly consistent if the two videos are for the same live person and taken at the same time. As photoplethysmograms are closely tied to human cardiac activity and almost impossible to forge or control, FaceHeart is strongly resilient to PFA and VFA. Extensive user experiments on Samsung Galaxy S5 have confirmed the high efficacy and efficiency of FaceHeart.

UR - http://www.scopus.com/inward/record.url?scp=85034038501&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85034038501&partnerID=8YFLogxK

U2 - 10.1109/INFOCOM.2017.8057220

DO - 10.1109/INFOCOM.2017.8057220

M3 - Conference contribution

AN - SCOPUS:85034038501

BT - INFOCOM 2017 - IEEE Conference on Computer Communications

PB - Institute of Electrical and Electronics Engineers Inc.

ER -