This works presents a Reinforcement Learning (RL) agent to implement a Cooperative Adaptive Cruise Control (CACC) system that simultaneously enhances energy efficiency and comfort, while also ensuring string stability. CACC systems are a new generation of ACC which systems rely on the communication of the so-called egovehicle with other vehicles and infrastructure using V2V and/ or V2X connectivity. This enables the availability of robust information about the environment thanks to the exchange of information, rather than their estimation or enabling some redundancy of data. CACC systems have the potential to overcome one typical issue that arises with regular ACC, that is the lack of string stability. String stability is the ability of the ACC of a vehicle to avoid unnecessary fluctuations in speed that can cause traffic jams, dampening these oscillations along the vehicle string rather than amplifying them. In this work, a real-time ACC for a Battery Electric Vehicle, based on a Deep Reinforcement Learning algorithm called Deep Deterministic Policy Gradient (DDPG), has been developed, aiming at maximizing energy savings, and improving comfort, thanks to the exchange of information on distance, speed and acceleration through the exploitation of vehicle-to-vehicle technology (V2V). The aforementioned DDPG algorithm is also designed in order to achieve the string stability. It relies on a multi-objective reward function that is adaptive to different driving cycles. The simulation results show how the agent can obtain energy savings up to 11% comparing the first following vehicle and the Lead on standard cycles and good adaptability to driving cycles different from the training one.
Battery Electric Vehicle Control Strategy for String Stability based on Deep Reinforcement Learning in V2V Driving / Borneo, Angelo; Miretti, Federico; Acquarone, Matteo; Misul, Daniela. - In: SAE TECHNICAL PAPER. - ISSN 0148-7191. - ELETTRONICO. - (2023), pp. 1-7. (Intervento presentato al convegno 16th International Conference on Engines & Vehicles tenutosi a Capri, Italy nel September 10th - 14th, 2023) [10.4271/2023-24-0173].
Battery Electric Vehicle Control Strategy for String Stability based on Deep Reinforcement Learning in V2V Driving
Borneo, Angelo;Miretti, Federico;Acquarone, Matteo;Misul, Daniela
2023
Abstract
This works presents a Reinforcement Learning (RL) agent to implement a Cooperative Adaptive Cruise Control (CACC) system that simultaneously enhances energy efficiency and comfort, while also ensuring string stability. CACC systems are a new generation of ACC which systems rely on the communication of the so-called egovehicle with other vehicles and infrastructure using V2V and/ or V2X connectivity. This enables the availability of robust information about the environment thanks to the exchange of information, rather than their estimation or enabling some redundancy of data. CACC systems have the potential to overcome one typical issue that arises with regular ACC, that is the lack of string stability. String stability is the ability of the ACC of a vehicle to avoid unnecessary fluctuations in speed that can cause traffic jams, dampening these oscillations along the vehicle string rather than amplifying them. In this work, a real-time ACC for a Battery Electric Vehicle, based on a Deep Reinforcement Learning algorithm called Deep Deterministic Policy Gradient (DDPG), has been developed, aiming at maximizing energy savings, and improving comfort, thanks to the exchange of information on distance, speed and acceleration through the exploitation of vehicle-to-vehicle technology (V2V). The aforementioned DDPG algorithm is also designed in order to achieve the string stability. It relies on a multi-objective reward function that is adaptive to different driving cycles. The simulation results show how the agent can obtain energy savings up to 11% comparing the first following vehicle and the Lead on standard cycles and good adaptability to driving cycles different from the training one.File | Dimensione | Formato | |
---|---|---|---|
BEV_CACC_RL.pdf
Open Access dal 02/03/2024
Descrizione: Accepted manuscript
Tipologia:
2. Post-print / Author's Accepted Manuscript
Licenza:
Pubblico - Tutti i diritti riservati
Dimensione
823.42 kB
Formato
Adobe PDF
|
823.42 kB | Adobe PDF | Visualizza/Apri |
Borneo et al_2023_Battery Electric Vehicle Control Strategy for String Stability based on Deep.pdf
accesso riservato
Descrizione: Published manuscript
Tipologia:
2a Post-print versione editoriale / Version of Record
Licenza:
Non Pubblico - Accesso privato/ristretto
Dimensione
1.05 MB
Formato
Adobe PDF
|
1.05 MB | Adobe PDF | Visualizza/Apri Richiedi una copia |
Pubblicazioni consigliate
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
https://hdl.handle.net/11583/2981313