Deep Reinforcement Learning for Scheduling Uplink IoT Traffic with Strict Deadlines - Archive ouverte HAL Access content directly
Conference Papers Year : 2021

Deep Reinforcement Learning for Scheduling Uplink IoT Traffic with Strict Deadlines

(1, 2, 3, 4) , (1) , (2, 5, 3, 4) , (1)
1
2
3
4
5

Abstract

This paper considers the Multiple Access problem where N Internet of Things (IoT) devices share a common wireless medium towards a central Base Station (BS). We propose a Reinforcement Learning (RL) method where the BS is the agent and the devices are part of the environment. A device is allowed to transmit only when the BS decides to schedule it. Besides the information packets, devices send additional messages like the delay or the number of discarded packets since their last transmission. This information is used to design the RL reward function and constitutes the next observation that the agent can use to schedule the next device. Leveraging RL allows us to learn the sporadic and heterogeneous traffic patterns of the IoT devices and an optimal scheduling policy that maximizes the channel throughput. We adapt the Proximal Policy Optimization (PPO) algorithm with a Recurrent Neural Network (RNN) to handle the partial observability of our problem and exploit the temporal correlations of the users' traffic. We demonstrate the performance of our model through simulations on different number of heterogeneous devices with periodic traffic and individual latency constraints. We show that our RL algorithm outperforms traditional scheduling schemes and distributed medium access algorithms.
Fichier principal
Vignette du fichier
globecom21.pdf (1.92 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03566861 , version 1 (11-02-2022)

Identifiers

Cite

Benoît-Marie Robaglia, Apostolos Destounis, Marceau Coupechoux, Dimitrios Tsilimantos. Deep Reinforcement Learning for Scheduling Uplink IoT Traffic with Strict Deadlines. GLOBECOM 2021 - 2021 IEEE Global Communications Conference, Dec 2021, Madrid, France. pp.1-6, ⟨10.1109/GLOBECOM46510.2021.9685561⟩. ⟨hal-03566861⟩
63 View
56 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More