Attention-Aware Encoder-Decoder Neural Networks for Heterogeneous Graphs of Things

Recent trend focuses on using heterogeneous graph of things (HGoT) to represent things and their relations in the Internet of Things, thereby facilitating the applying of advanced learning frameworks, i.e., deep learning (DL). Nevertheless, this is a challenging task since the existing DL models are hard to accurately express the complex semantics and attributes for those heterogeneous nodes and links in HGoT. To address this issue, we develop attention-aware encoder-decoder graph neural networks for HGoT, termed as HGAED. Specifically, we utilize the attention-based separate-and-merge method to improve the accuracy, and leverage the encoder-decoder architecture for implementation. In the heart of HGAED, the separate-and-merge processes can be encapsulated into encoding and decoding blocks. Then, blocks are stacked for constructing an encoder-decoder architecture to jointly and hierarchically fuse heterogeneous structures and contents of nodes. Extensive experiments on three real-world datasets demonstrate the superior performance of HGAED over state-of-the-art baselines.

Automated summary

The recent trend focuses on using heterogeneous graphs for facilitating the application of deep learning in the Internet of Things, but existing models struggle to accurately represent complex semantics and attributes. To address this challenge, attention-aware encoder-decoder graph neural network called HGAED has been developed to improve accuracy using attention-based separate-and-merge method and encoder-decoder architecture. Extensive experiments show superior performance of HGAED over state-of-the-art baselines in fusing heterogeneous structures and contents of nodes hierarchically.