A Joint Learning and Game Theoretic Approach to Multi Dimensional Resource Management in Fog Radio A

Fog radio access networks (F-RANs) have been regarded as a promising paradigm to support latency-sensitive and computation-intensive services by leveraging computing and caching capabilities of fog access points (F-APs). To execute offloaded computation tasks, it is essential to pre-store necessary programs and databases at F-APs, referred as service caching. However, due to system dynamics and the coupling of decisions, cache, radio, and computation resource management at F-RANs is a challenging problem. In this paper, a joint multi-dimensional resource optimization problem is formulated, aiming at minimizing the weighted sum of expected latency cost and caching cost, which is featured by a two-timescale structure. For radio and computation resource allocation on a small timescale, a coalitional game based approach is proposed under given caching decisions. On a larger timescale, services are cached at each F-AP using a multi-agent reinforcement learning algorithm. The advantage of the proposed algorithms is that they can implicitly take the impact of small timescale resource allocation into account while adapting to the long-term statistics of channel coefficients and user service requests. We analyze the proposed algorithms with respect to their convergence, optimality, and complexity, and validate their performance with extensive simulations, where superior performance is observed over several baseline schemes.