Interpretable partitioned embedding for intelligent multi-item fashion outfit composition

Zunlei Feng, Zhenyun Yu, Yongcheng Jing, Sai Wu, Mingli Song, Yezhou Yang, Junxiao Jiang

Research output: Contribution to journalArticle

Abstract

Intelligent fashion outfit composition has become more popular in recent years. Some deep-learning-based approaches reveal competitive composition. However, the uninterpretable characteristic makes such a deep-learning-based approach fail to meet the businesses', designers', and consumers' urges to comprehend the importance of different attributes in an outfit composition. To realize interpretable and intelligent multi-item fashion outfit compositions, we propose a partitioned embedding network to learn interpretable embeddings from clothing items. The network contains two vital components: attribute partition module and partition adversarial module. In the attribute partition module, multiple attribute labels are adopted to ensure that different parts of the overall embedding correspond to different attributes. In the partition adversarial module, adversarial operations are adopted to achieve the independence of different parts. With the interpretable and partitioned embedding, we then construct an outfit-composition graph and an attribute matching map. Extensive experiments demonstrate that (1) the partitioned embedding have unmingled parts that correspond to different attributes and (2) outfits recommended by our model are more desirable in comparison with the existing methods.

Original languageEnglish (US)
Article number61
JournalACM Transactions on Multimedia Computing, Communications and Applications
Volume15
Issue number2s
DOIs
StatePublished - Aug 2019

Keywords

  • Adversarial
  • Embedding
  • Interpretable
  • Outfit composition

ASJC Scopus subject areas

  • Hardware and Architecture
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Interpretable partitioned embedding for intelligent multi-item fashion outfit composition'. Together they form a unique fingerprint.

  • Cite this