Abstract:
Complex network models are helpful to explain the evolution rules of network structures, and also are the foundations of understanding and controlling complex networks. The existing studies (e.g., scale-free model, small-world model) are insufficient to uncover the internal mechanisms of the emergence and evolution of communities in networks. To overcome the above limitation, in consideration of the fact that a network can be regarded as a pattern composed of communities, we introduce Turing pattern dynamic as theory support to construct the network evolution model. Specifically, we develop a Reaction-Diffusion model according to Q-Learning technology (RDQL), in which each node regarded as an intelligent agent makes a behavior choice to update its relationships, based on the utility and behavioral strategy at every time step. Extensive experiments indicate that our model not only reveals how communities form and evolve, but also can generate networks with the properties of scale-free, small-world and assortativity. The effectiveness of the RDQL model has also been verified by its application in real networks. Furthermore, the depth analysis of the RDQL model provides a conclusion that the proportion of exploration and exploitation behaviors of nodes is the only factor affecting the formation of communities. The proposed RDQL model has potential to be the basic theoretical tool for studying network stability and dynamics.