Deep Reinforcement Learning Based 3D-Trajectory Design and Task Offloading in UAV-enabled MEC System

In unmanned aerial vehicle (UAV) enabled mobile edge computing (MEC) system, rotary-wing UAV can be dispatched to fly close to ground terminals (GTs) to execute their offloaded tasks. This can extend GTs’ computing capability and save their energy cost. However, to enhance the energy efficiency of UAV propulsion, ensure successful completion of each GT's mission, and maintain a stable UAV-GT uplinks, it is crucial to design a rational UAV 3D trajectory and mission offloading strategy. To address this joint problem, We further build a deep reinforcement learning (DRL)-based framework in the UAV-enabled MEC system, which applies Double Deep Q-learning (D-DQN) and convex optimization techniques to jointly work out the near-optimal UAV 3D-trajectory and task offloading strategy among GTs in an online manner. With the proposed framework, the UAV-enabled MEC system can finish each GT task quickly and save the UAV mission time and propulsion energy effectively. Numerical results show that the DLR-based framework outperforms the benchmark solutions, e.g., In scenario 1, the throughput, the average data transferring rate through UAV-GT links, and the average energy efficiency of UAV compared to DQN are improved from 64.24Kb to 72.99Kb, 4.72Kbps to 20.75Kbps, 0.32bits/J to 0.36bits/J, respectively, and almost the same as the existing Travelling Salesman Problem (TSP) solution, making the energy efficient edge computing truly viable in UAV-enabled MEC system.