Intrinsic 3D Dynamic Surface Tracking based on Dynamic Ricci Flow and Teichmüller Map

Xiaokang Yu, Na Lei, Yalin Wang, Xianfeng Gu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

3D dynamic surface tracking is an important research problem and plays a vital role in many computer vision and medical imaging applications. However, it is still challenging to efficiently register surface sequences which has large deformations and strong noise. In this paper, we propose a novel automatic method for non-rigid 3D dynamic surface tracking with surface Ricci flow and Teichmiiller map methods. According to quasi-conformal Teichmiiller theory, the Techmüller map minimizes the maximal dilation so that our method is able to automatically register surfaces with large deformations. Besides, the adoption of Delaunay triangulation and quadrilateral meshes makes our method applicable to low quality meshes. In our work, the 3D dynamic surfaces are acquired by a high speed 3D scanner. We first identified sparse surface features using machine learning methods in the texture space. Then we assign landmark features with different curvature settings and the Riemannian metric of the surface is computed by the dynamic Ricci flow method, such that all the curvatures are concentrated on the feature points and the surface is flat everywhere else. The registration among frames is computed by the Teichmiiller mappings, which aligns the feature points with least angle distortions. We apply our new method to multiple sequences of 3D facial surfaces with large expression deformations and compare them with two other state-of-the-art tracking methods. The effectiveness of our method is demonstrated by the clearly improved accuracy and efficiency.

Original languageEnglish (US)
Title of host publicationProceedings - 2017 IEEE International Conference on Computer Vision, ICCV 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages5400-5408
Number of pages9
Volume2017-October
ISBN (Electronic)9781538610329
DOIs
StatePublished - Dec 22 2017
Event16th IEEE International Conference on Computer Vision, ICCV 2017 - Venice, Italy
Duration: Oct 22 2017Oct 29 2017

Other

Other16th IEEE International Conference on Computer Vision, ICCV 2017
CountryItaly
CityVenice
Period10/22/1710/29/17

Fingerprint

Medical imaging
Triangulation
Computer vision
Learning systems
Textures

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition

Cite this

Yu, X., Lei, N., Wang, Y., & Gu, X. (2017). Intrinsic 3D Dynamic Surface Tracking based on Dynamic Ricci Flow and Teichmüller Map. In Proceedings - 2017 IEEE International Conference on Computer Vision, ICCV 2017 (Vol. 2017-October, pp. 5400-5408). [8237838] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICCV.2017.576

Intrinsic 3D Dynamic Surface Tracking based on Dynamic Ricci Flow and Teichmüller Map. / Yu, Xiaokang; Lei, Na; Wang, Yalin; Gu, Xianfeng.

Proceedings - 2017 IEEE International Conference on Computer Vision, ICCV 2017. Vol. 2017-October Institute of Electrical and Electronics Engineers Inc., 2017. p. 5400-5408 8237838.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Yu, X, Lei, N, Wang, Y & Gu, X 2017, Intrinsic 3D Dynamic Surface Tracking based on Dynamic Ricci Flow and Teichmüller Map. in Proceedings - 2017 IEEE International Conference on Computer Vision, ICCV 2017. vol. 2017-October, 8237838, Institute of Electrical and Electronics Engineers Inc., pp. 5400-5408, 16th IEEE International Conference on Computer Vision, ICCV 2017, Venice, Italy, 10/22/17. https://doi.org/10.1109/ICCV.2017.576
Yu X, Lei N, Wang Y, Gu X. Intrinsic 3D Dynamic Surface Tracking based on Dynamic Ricci Flow and Teichmüller Map. In Proceedings - 2017 IEEE International Conference on Computer Vision, ICCV 2017. Vol. 2017-October. Institute of Electrical and Electronics Engineers Inc. 2017. p. 5400-5408. 8237838 https://doi.org/10.1109/ICCV.2017.576
Yu, Xiaokang ; Lei, Na ; Wang, Yalin ; Gu, Xianfeng. / Intrinsic 3D Dynamic Surface Tracking based on Dynamic Ricci Flow and Teichmüller Map. Proceedings - 2017 IEEE International Conference on Computer Vision, ICCV 2017. Vol. 2017-October Institute of Electrical and Electronics Engineers Inc., 2017. pp. 5400-5408
@inproceedings{725ee8982d774e6db76548ba7dde69a8,
title = "Intrinsic 3D Dynamic Surface Tracking based on Dynamic Ricci Flow and Teichm{\"u}ller Map",
abstract = "3D dynamic surface tracking is an important research problem and plays a vital role in many computer vision and medical imaging applications. However, it is still challenging to efficiently register surface sequences which has large deformations and strong noise. In this paper, we propose a novel automatic method for non-rigid 3D dynamic surface tracking with surface Ricci flow and Teichmiiller map methods. According to quasi-conformal Teichmiiller theory, the Techm{\"u}ller map minimizes the maximal dilation so that our method is able to automatically register surfaces with large deformations. Besides, the adoption of Delaunay triangulation and quadrilateral meshes makes our method applicable to low quality meshes. In our work, the 3D dynamic surfaces are acquired by a high speed 3D scanner. We first identified sparse surface features using machine learning methods in the texture space. Then we assign landmark features with different curvature settings and the Riemannian metric of the surface is computed by the dynamic Ricci flow method, such that all the curvatures are concentrated on the feature points and the surface is flat everywhere else. The registration among frames is computed by the Teichmiiller mappings, which aligns the feature points with least angle distortions. We apply our new method to multiple sequences of 3D facial surfaces with large expression deformations and compare them with two other state-of-the-art tracking methods. The effectiveness of our method is demonstrated by the clearly improved accuracy and efficiency.",
author = "Xiaokang Yu and Na Lei and Yalin Wang and Xianfeng Gu",
year = "2017",
month = "12",
day = "22",
doi = "10.1109/ICCV.2017.576",
language = "English (US)",
volume = "2017-October",
pages = "5400--5408",
booktitle = "Proceedings - 2017 IEEE International Conference on Computer Vision, ICCV 2017",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Intrinsic 3D Dynamic Surface Tracking based on Dynamic Ricci Flow and Teichmüller Map

AU - Yu, Xiaokang

AU - Lei, Na

AU - Wang, Yalin

AU - Gu, Xianfeng

PY - 2017/12/22

Y1 - 2017/12/22

N2 - 3D dynamic surface tracking is an important research problem and plays a vital role in many computer vision and medical imaging applications. However, it is still challenging to efficiently register surface sequences which has large deformations and strong noise. In this paper, we propose a novel automatic method for non-rigid 3D dynamic surface tracking with surface Ricci flow and Teichmiiller map methods. According to quasi-conformal Teichmiiller theory, the Techmüller map minimizes the maximal dilation so that our method is able to automatically register surfaces with large deformations. Besides, the adoption of Delaunay triangulation and quadrilateral meshes makes our method applicable to low quality meshes. In our work, the 3D dynamic surfaces are acquired by a high speed 3D scanner. We first identified sparse surface features using machine learning methods in the texture space. Then we assign landmark features with different curvature settings and the Riemannian metric of the surface is computed by the dynamic Ricci flow method, such that all the curvatures are concentrated on the feature points and the surface is flat everywhere else. The registration among frames is computed by the Teichmiiller mappings, which aligns the feature points with least angle distortions. We apply our new method to multiple sequences of 3D facial surfaces with large expression deformations and compare them with two other state-of-the-art tracking methods. The effectiveness of our method is demonstrated by the clearly improved accuracy and efficiency.

AB - 3D dynamic surface tracking is an important research problem and plays a vital role in many computer vision and medical imaging applications. However, it is still challenging to efficiently register surface sequences which has large deformations and strong noise. In this paper, we propose a novel automatic method for non-rigid 3D dynamic surface tracking with surface Ricci flow and Teichmiiller map methods. According to quasi-conformal Teichmiiller theory, the Techmüller map minimizes the maximal dilation so that our method is able to automatically register surfaces with large deformations. Besides, the adoption of Delaunay triangulation and quadrilateral meshes makes our method applicable to low quality meshes. In our work, the 3D dynamic surfaces are acquired by a high speed 3D scanner. We first identified sparse surface features using machine learning methods in the texture space. Then we assign landmark features with different curvature settings and the Riemannian metric of the surface is computed by the dynamic Ricci flow method, such that all the curvatures are concentrated on the feature points and the surface is flat everywhere else. The registration among frames is computed by the Teichmiiller mappings, which aligns the feature points with least angle distortions. We apply our new method to multiple sequences of 3D facial surfaces with large expression deformations and compare them with two other state-of-the-art tracking methods. The effectiveness of our method is demonstrated by the clearly improved accuracy and efficiency.

UR - http://www.scopus.com/inward/record.url?scp=85041913512&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85041913512&partnerID=8YFLogxK

U2 - 10.1109/ICCV.2017.576

DO - 10.1109/ICCV.2017.576

M3 - Conference contribution

AN - SCOPUS:85041913512

VL - 2017-October

SP - 5400

EP - 5408

BT - Proceedings - 2017 IEEE International Conference on Computer Vision, ICCV 2017

PB - Institute of Electrical and Electronics Engineers Inc.

ER -