Hypergraph convolution mix DDPG for multi-aerial base station deployment

【类型】期刊

【作者】He Haoran  Zhou Fanqin  Zhao Yikun  Li Wenjing  Feng Lei 

【刊名】Journal of Cloud Computing

【关键词】 Hypergraph,Agent,deep,efficiency,(AeBS),learning,decomposition,aerial,(HGCN),multi,(MADRL),optimization,station,Value,convolution,reinforcement,base,energy

【摘要】Aerial base stations (AeBS), as crucial components of air-ground integrated networks, can serve as the edge nodes to provide flexible services to ground users. Optimizing the deployment of multiple AeBSs to maximize system energy efficiency is currently a prominent and actively researched topic in the AeBS-assisted edge-cloud computing network. In this paper, we deploy AeBSs using multi-agent deep reinforcement learning (MADRL). We describe the multi-AeBS deployment challenge as a decentralized partially observable Markov decision process (Dec-POMDP), taking into consideration the constrained observation range of AeBSs. The hypergraph convolution mix deep deterministic policy gradient (HCMIX-DDPG) algorithm is designed to maximize the system energy efficiency. The proposed algorithm uses the value decomposition framework to solve the lazy agent problem, and hypergraph convolutional (HGCN) network is introduced to strengthen the cooperative relationship between agents. Simulation results show that the suggested HCMIX-DDPG algorithm outperforms alternative baseline algorithms in the multi-AeBS deployment scenario.

【年份】2023

【作者单位】https://ror.org/04w9fbh59,grid.31880.32,0000 0000 8780 1230,State Key Laboratory of Networking and Switching Technology,Beijing University of Posts and Telecommunications,100876,Beijing,China

【期号】1