Deep Reinforcement Learning for Optimal Energy Management of Multi-energy Smart Grids - Mines Paris Accéder directement au contenu
Article Dans Une Revue Lecture Notes in Computer Science Année : 2022

Deep Reinforcement Learning for Optimal Energy Management of Multi-energy Smart Grids

Résumé

This paper proposes a Deep Reinforcement Learning approach for optimally managing multi-energy systems in smart grids. The optimal control problem of the production and storage units within the smart grid is formulated as a Partially Observable Markov Decision Process (POMDP), and is solved using an actor-critic Deep Reinforcement Learning algorithm. The framework is tested on a novel multi-energy residential microgrid model that encompasses electrical, heating and cooling storage as well as thermal production systems and renewable energy generation. One of the main challenges faced when dealing with real-time optimal control of such multi-energy systems is the need to take multiple continuous actions simultaneously. The proposed Deep Deterministic Policy Gradient (DDPG) agent has shown to handle well the continuous state and action spaces and learned to simultaneously take multiple actions on the production and storage systems that allow to jointly optimize the electrical, heating and cooling usages within the smart grid. This allows the approach to be applied for the real-time optimal energy management of larger scale multi-energy Smart Grids like eco-distrits and smart cities where multiple continuous actions need to be taken simultaneously.
Fichier principal
Vignette du fichier
LOD_2021_Camera-Ready_89.pdf (722.54 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03587262 , version 1 (24-02-2022)

Identifiants

Citer

Dhekra Bousnina, Gilles Guerassimoff. Deep Reinforcement Learning for Optimal Energy Management of Multi-energy Smart Grids. Lecture Notes in Computer Science, 2022, pp.15 - 30. ⟨10.1007/978-3-030-95470-3_2⟩. ⟨hal-03587262⟩
174 Consultations
137 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More