A Deep Multimodal Adversarial Cycle Consistent Network for Smart Enterprise System

A Deep Multimodal Adversarial Cycle Consistent Network for Smart Enterprise System

Abstract:

Nowadays, much research leverages the clustering to mine commercial patterns from data in enterprise systems. However, previous methods cannot fully consider local structures and global topology of data, which may cause the degradation of clustering performance. To address the challenges, a deep multimodal adversarial cycle-consistent network (DMACCN) is proposed to mine intrinsic patterns of data, which can capture the local structures from instance reconstructions and the global topology from adversarial games. Specifically, DMACCN is designed as an adversarial encoding-decoding architecture composed of the modality specific-encoder, the modality-common fusion network, the cycle-consistent modality-specific generator, and the modality-fusion discriminator, which can fully fuse complementary information of data. Then, an adversarial cycle-consistent loss is devised to guide the clustering pattern mining from complementary information of data, which can align semantics between modalities and capture clustering structures of instances. The two components collaborate in a seamless manner to capture accurate commercial patterns. Finally, extensive experimental results on four datasets show DMACCN greatly outperforms the comparison methods.