Computational Offloading for MEC Networks with Energy Harvesting: A Hierarchical Multi-Agent Reinforcement Learning Approach
نویسندگان
چکیده
Multi-access edge computing (MEC) is a novel paradigm that leverages nearby MEC servers to augment the computational capabilities of users with limited resources. In this paper, we investigate offloading problem in multi-user multi-server systems energy harvesting, aiming minimize both system latency and consumption by optimizing task offload location selection ratio.We propose hierarchical strategy based on multi-agent reinforcement learning (MARL). The proposed decomposes into two sub-problems: high-level low-level ratio problem. complexity reduced decoupling. To address these sub-problems, framework proximal policy optimization (MAPPO), where each agent generates actions its observed private state avoid action space explosion due increasing number user devices. Simulation results show HDMAPPO outperforms other baseline algorithms terms average latency, consumption, discard rate.
منابع مشابه
A Deep Reinforcement Learning Based Approach for Cost- and Energy-Aware Multi-Flow Mobile Data Offloading
With the rapid increase in demand for mobile data, mobile network operators are trying to expand wireless network capacity by deploying wireless local area network (LAN) hotspots on to which they can offload their mobile traffic. However, these network-centric methods usually do not fulfill the interests of mobile users (MUs). Taking into consideration many issues such as different applications...
متن کاملMulti-Agent Reinforcement Learning for Energy Harvesting Two-Hop Communications with Full Cooperation
We focus on energy harvesting (EH) two-hop communications since they are the essential building blocks of more complicated multi-hop networks. The scenario consists of three nodes, where an EH transmitter wants to send data to a receiver through an EH relay. The harvested energy is used exclusively for data transmission and we address the problem of how to efficiently use it. As in practical sc...
متن کاملLearning-Based Computation Offloading for IoT Devices with Energy Harvesting
Internet of Things (IoT) devices can apply mobileedge computing (MEC) and energy harvesting (EH) to provide the satisfactory quality of experiences for computation intensive applications and prolong the battery lifetime. In this article, we investigate the computation offloading for IoT devices with energy harvesting in wireless networks with multiple MEC devices such as base stations and acces...
متن کاملFederated Control with Hierarchical Multi-Agent Deep Reinforcement Learning
We present a framework combining hierarchical and multi-agent deep reinforcement learning approaches to solve coordination problems among a multitude of agents using a semi-decentralized model. The framework extends the multi-agent learning setup by introducing a meta-controller that guides the communication between agent pairs, enabling agents to focus on communicating with only one other agen...
متن کاملSolving Homogeneous Reinforcement Learning Problems with a Multi-Agent Approach
In this paper we examine reinforcement learning problems which consist of a set of homogeneous entities. These problems tend to have extremely large state spaces making standard approaches unattractive. We study lane change selection in a car traffic control problem as an example of such a problem. We show how a single agent problem can be translated into an approximating multi-agent problem. W...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Electronics
سال: 2023
ISSN: ['2079-9292']
DOI: https://doi.org/10.3390/electronics12061304