DeepSSH: Deep Semantic Structured Hashing for Explainable Person Re-Identification

Ya Zhao, Sihui Luo, Yezhou Yang, Mingli Song

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

For large collections of gallery images captured by sparsely distributed cameras, we often employ hashing based approaches to enhance the efficiency of person re-identification (re-id). However, these hashing based approaches fail to provide semantically explainable encoding in solving the re-id problem, which makes it infeasible to identify the correct matches in the collection by just using a semantic query. To overcome this limitation, we propose a new deep hashing network called Deep Semantic Structured Hashing (DeepSSH) to obtain the semantic structured representation of human. In the proposed DeepSSH framework, both the mid-level human attributes and the high-level ID labels are used to learn a deep hashing network. Then, based on the obtained semantic structured hash code and the attribute labels, we learn a decoder to find the partial hash code corresponding to the specified attributes. Finally, a new grain scalable re-id framework is constructed to support semantic query of a person by providing partial or full semantic description of a person instead of the whole photo. Experimental results show that DeepSSH is comparable with state-of-the-art hashing-based person re-id approaches, and the experiment in semantic analysis shows that our hash code owns semantic meaning indeed.

Original languageEnglish (US)
Title of host publication2018 IEEE International Conference on Image Processing, ICIP 2018 - Proceedings
PublisherIEEE Computer Society
Pages1653-1657
Number of pages5
ISBN (Electronic)9781479970612
DOIs
StatePublished - Aug 29 2018
Event25th IEEE International Conference on Image Processing, ICIP 2018 - Athens, Greece
Duration: Oct 7 2018Oct 10 2018

Publication series

NameProceedings - International Conference on Image Processing, ICIP
ISSN (Print)1522-4880

Conference

Conference25th IEEE International Conference on Image Processing, ICIP 2018
CountryGreece
CityAthens
Period10/7/1810/10/18

Fingerprint

Semantics
Labels
Cameras
Experiments

Keywords

  • CNN
  • Hashing
  • Person re-identification

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition
  • Signal Processing

Cite this

Zhao, Y., Luo, S., Yang, Y., & Song, M. (2018). DeepSSH: Deep Semantic Structured Hashing for Explainable Person Re-Identification. In 2018 IEEE International Conference on Image Processing, ICIP 2018 - Proceedings (pp. 1653-1657). [8451107] (Proceedings - International Conference on Image Processing, ICIP). IEEE Computer Society. https://doi.org/10.1109/ICIP.2018.8451107

DeepSSH : Deep Semantic Structured Hashing for Explainable Person Re-Identification. / Zhao, Ya; Luo, Sihui; Yang, Yezhou; Song, Mingli.

2018 IEEE International Conference on Image Processing, ICIP 2018 - Proceedings. IEEE Computer Society, 2018. p. 1653-1657 8451107 (Proceedings - International Conference on Image Processing, ICIP).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Zhao, Y, Luo, S, Yang, Y & Song, M 2018, DeepSSH: Deep Semantic Structured Hashing for Explainable Person Re-Identification. in 2018 IEEE International Conference on Image Processing, ICIP 2018 - Proceedings., 8451107, Proceedings - International Conference on Image Processing, ICIP, IEEE Computer Society, pp. 1653-1657, 25th IEEE International Conference on Image Processing, ICIP 2018, Athens, Greece, 10/7/18. https://doi.org/10.1109/ICIP.2018.8451107
Zhao Y, Luo S, Yang Y, Song M. DeepSSH: Deep Semantic Structured Hashing for Explainable Person Re-Identification. In 2018 IEEE International Conference on Image Processing, ICIP 2018 - Proceedings. IEEE Computer Society. 2018. p. 1653-1657. 8451107. (Proceedings - International Conference on Image Processing, ICIP). https://doi.org/10.1109/ICIP.2018.8451107
Zhao, Ya ; Luo, Sihui ; Yang, Yezhou ; Song, Mingli. / DeepSSH : Deep Semantic Structured Hashing for Explainable Person Re-Identification. 2018 IEEE International Conference on Image Processing, ICIP 2018 - Proceedings. IEEE Computer Society, 2018. pp. 1653-1657 (Proceedings - International Conference on Image Processing, ICIP).
@inproceedings{017f4c33d941442d83ae1f9ff0cd7611,
title = "DeepSSH: Deep Semantic Structured Hashing for Explainable Person Re-Identification",
abstract = "For large collections of gallery images captured by sparsely distributed cameras, we often employ hashing based approaches to enhance the efficiency of person re-identification (re-id). However, these hashing based approaches fail to provide semantically explainable encoding in solving the re-id problem, which makes it infeasible to identify the correct matches in the collection by just using a semantic query. To overcome this limitation, we propose a new deep hashing network called Deep Semantic Structured Hashing (DeepSSH) to obtain the semantic structured representation of human. In the proposed DeepSSH framework, both the mid-level human attributes and the high-level ID labels are used to learn a deep hashing network. Then, based on the obtained semantic structured hash code and the attribute labels, we learn a decoder to find the partial hash code corresponding to the specified attributes. Finally, a new grain scalable re-id framework is constructed to support semantic query of a person by providing partial or full semantic description of a person instead of the whole photo. Experimental results show that DeepSSH is comparable with state-of-the-art hashing-based person re-id approaches, and the experiment in semantic analysis shows that our hash code owns semantic meaning indeed.",
keywords = "CNN, Hashing, Person re-identification",
author = "Ya Zhao and Sihui Luo and Yezhou Yang and Mingli Song",
year = "2018",
month = "8",
day = "29",
doi = "10.1109/ICIP.2018.8451107",
language = "English (US)",
series = "Proceedings - International Conference on Image Processing, ICIP",
publisher = "IEEE Computer Society",
pages = "1653--1657",
booktitle = "2018 IEEE International Conference on Image Processing, ICIP 2018 - Proceedings",

}

TY - GEN

T1 - DeepSSH

T2 - Deep Semantic Structured Hashing for Explainable Person Re-Identification

AU - Zhao, Ya

AU - Luo, Sihui

AU - Yang, Yezhou

AU - Song, Mingli

PY - 2018/8/29

Y1 - 2018/8/29

N2 - For large collections of gallery images captured by sparsely distributed cameras, we often employ hashing based approaches to enhance the efficiency of person re-identification (re-id). However, these hashing based approaches fail to provide semantically explainable encoding in solving the re-id problem, which makes it infeasible to identify the correct matches in the collection by just using a semantic query. To overcome this limitation, we propose a new deep hashing network called Deep Semantic Structured Hashing (DeepSSH) to obtain the semantic structured representation of human. In the proposed DeepSSH framework, both the mid-level human attributes and the high-level ID labels are used to learn a deep hashing network. Then, based on the obtained semantic structured hash code and the attribute labels, we learn a decoder to find the partial hash code corresponding to the specified attributes. Finally, a new grain scalable re-id framework is constructed to support semantic query of a person by providing partial or full semantic description of a person instead of the whole photo. Experimental results show that DeepSSH is comparable with state-of-the-art hashing-based person re-id approaches, and the experiment in semantic analysis shows that our hash code owns semantic meaning indeed.

AB - For large collections of gallery images captured by sparsely distributed cameras, we often employ hashing based approaches to enhance the efficiency of person re-identification (re-id). However, these hashing based approaches fail to provide semantically explainable encoding in solving the re-id problem, which makes it infeasible to identify the correct matches in the collection by just using a semantic query. To overcome this limitation, we propose a new deep hashing network called Deep Semantic Structured Hashing (DeepSSH) to obtain the semantic structured representation of human. In the proposed DeepSSH framework, both the mid-level human attributes and the high-level ID labels are used to learn a deep hashing network. Then, based on the obtained semantic structured hash code and the attribute labels, we learn a decoder to find the partial hash code corresponding to the specified attributes. Finally, a new grain scalable re-id framework is constructed to support semantic query of a person by providing partial or full semantic description of a person instead of the whole photo. Experimental results show that DeepSSH is comparable with state-of-the-art hashing-based person re-id approaches, and the experiment in semantic analysis shows that our hash code owns semantic meaning indeed.

KW - CNN

KW - Hashing

KW - Person re-identification

UR - http://www.scopus.com/inward/record.url?scp=85062910775&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85062910775&partnerID=8YFLogxK

U2 - 10.1109/ICIP.2018.8451107

DO - 10.1109/ICIP.2018.8451107

M3 - Conference contribution

AN - SCOPUS:85062910775

T3 - Proceedings - International Conference on Image Processing, ICIP

SP - 1653

EP - 1657

BT - 2018 IEEE International Conference on Image Processing, ICIP 2018 - Proceedings

PB - IEEE Computer Society

ER -