Mobility-Aware Cooperative Caching in Vehicular Edge Computing Based on Asynchronous Federated and Deep Reinforcement Learning

نویسندگان

چکیده

Vehicular edge computing (VEC) can learn and cache most popular contents for vehicular users (VUs) in the roadside units (RSUs) to support real-time applications. Federated learning (FL) protect VUs' privacy by sharing vehicles' local models instead of data. In traditional FL, global model is periodically updated aggregating all models. However, vehicles may frequently drive out coverage area VEC before they finish training thus FL cannot upload as expected, which would degrade accuracy model. The asynchronous be performed without models, more uploaded improve vehicle mobility significantly impacts FL. There no published work considering design cooperative caching based on addition, capacity RSU limited size predicted usually exceeds RSU. Hence, should different RSUs while content transmission delay. this paper, we consider propose a scheme federated deep reinforcement (CAFR) predict further obtain optimal location contents. Extensive experimental results have demonstrated that CAFR outperforms other baseline schemes.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Performance Optimization in Mobile-Edge Computing via Deep Reinforcement Learning

To improve the quality of computation experience for mobile devices, mobile-edge computing (MEC) is emerging as a promising paradigm by providing computing capabilities within radio access networks in close proximity. Nevertheless, the design of computation offloading policies for a MEC system remains challenging. Specifically, whether to execute an arriving computation task at local mobile dev...

متن کامل

Operation Scheduling of MGs Based on Deep Reinforcement Learning Algorithm

: In this paper, the operation scheduling of Microgrids (MGs), including Distributed Energy Resources (DERs) and Energy Storage Systems (ESSs), is proposed using a Deep Reinforcement Learning (DRL) based approach. Due to the dynamic characteristic of the problem, it firstly is formulated as a Markov Decision Process (MDP). Next, Deep Deterministic Policy Gradient (DDPG) algorithm is presented t...

متن کامل

A Cooperative Caching Scheme Based on Mobility Prediction in Vehicular Content Centric Networks

Vehicular Content Centric Networks (VCCNs) emerge as a strong candidate to be deployed in informationrich applications of vehicular communications. Due to vehicles’ mobility, it becomes rather inefficient to establish end-to-end connections in VCCNs. Consequently, content packets are usually sent back to the requesting node via different paths in VCCNs. To improve network performance of VCCNs, ...

متن کامل

A Deep Reinforcement Learning-Based Framework for Content Caching

Content caching at the edge nodes is a promising technique to reduce the data traffic in next-generation wireless networks. Inspired by the success of Deep Reinforcement Learning (DRL) in solving complicated control problems, this work presents a DRL-based framework with Wolpertinger architecture for content caching at the base station. The proposed framework is aimed at maximizing the long-ter...

متن کامل

Asynchronous Methods for Deep Reinforcement Learning

We propose a conceptually simple and lightweight framework for deep reinforcement learning that uses asynchronous gradient descent for optimization of deep neural network controllers. We present asynchronous variants of four standard reinforcement learning algorithms and show that parallel actor-learners have a stabilizing effect on training allowing all four methods to successfully train neura...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Journal of Selected Topics in Signal Processing

سال: 2023

ISSN: ['1941-0484', '1932-4553']

DOI: https://doi.org/10.1109/jstsp.2022.3221271