Samende, C, Cao, J ORCID: https://orcid.org/0000-0001-5099-9914 and Fan, Z ORCID: https://orcid.org/0000-0002-5575-1536 (2022) Multi-Agent Deep Deterministic Policy Gradient Algorithm for Peer-to-Peer Energy Trading Considering Distribution Network Constraints. Applied Energy, 317 (119123).

This is the latest version of this item.

[img]
Preview
Text
2108.09053v1.pdf - Accepted Version

Download (10MB) | Preview
[img]
Preview
Text
1-s2.0-S0306261922005025-main.pdf - Published Version

Download (2MB) | Preview

Abstract

In this paper, we investigate an energy cost minimization problem for prosumers participating in peer-to-peer energy trading. Due to (i) uncertainties caused by renewable energy generation and consumption, (ii) difficulties in developing an accurate and efficient energy trading model, and (iii) the need to satisfy distribution network constraints, it is challenging for prosumers to obtain optimal energy trading decisions that minimize their individual energy costs. To address the challenge, we first formulate the above problem as a Markov decision process and propose a multi-agent deep deterministic policy gradient algorithm to learn optimal energy trading decisions. To satisfy the distribution network constraints, we propose distribution network tariffs which we incorporate in the algorithm as incentives to incentivize energy trading decisions that help to satisfy the constraints and penalize the decisions that violate them. The proposed algorithm is model-free and allows the agents to learn the optimal energy trading decisions without having prior information about other agents in the network. Simulation results based on real-world datasets show the effectiveness and robustness of the proposed algorithm.

Item Type: Article
Additional Information: © 2022 The Author(s). Published by Elsevier Ltd. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
Subjects: Q Science > QA Mathematics
T Technology > T Technology (General)
Divisions: Faculty of Natural Sciences > School of Computing and Mathematics
Related URLs:
Depositing User: Symplectic
Date Deposited: 31 May 2022 15:07
Last Modified: 31 May 2022 15:07
URI: https://eprints.keele.ac.uk/id/eprint/10980

Available Versions of this Item

Actions (login required)

View Item View Item