Imperial College London
Alternate

Dr Simon Hu

Faculty of Engineering, Department of Civil and Environmental Engineering

Honorary Research Fellow
 
 
 
//

Contact

 

+44 (0)20 7594 6024j.s.hu05

 
 
//

Location

 

422Skempton BuildingSouth Kensington Campus

//

Summary

 

Publications

Citation

BibTex format

@article{Zhou:2024:10.1109/TITS.2024.3352730,
author = {Zhou, B and Zhou, Q and Hu, S and Ma, D and Jin, S and Lee, DH},
doi = {10.1109/TITS.2024.3352730},
journal = {IEEE Transactions on Intelligent Transportation Systems},
title = {Cooperative Traffic Signal Control Using a Distributed Agent-Based Deep Reinforcement Learning With Incentive Communication},
url = {http://dx.doi.org/10.1109/TITS.2024.3352730},
year = {2024}
}
Download

RIS format (EndNote, RefMan)

TY  - JOUR
AB  - Deep Reinforcement Learning has shown some promise in dynamic traffic signal control by adapting to real-time traffic conditions. However, multi-intersection control presents challenges, primarily due to the need for efficient information exchange across increasing intersections, and the importance of spatiotemporal dynamics in traffic flows. Traditional methods often focus solely on spatial or temporal aspects, leading to suboptimal control strategies. This paper introduces a novel Multi-Agent Incentive Communication Deep Reinforcement Learning (MICDRL) method, designed for collaborative control across multiple intersections. MICDRL features an incentive communication mechanism, allowing agents to generate customized messages that influence other agents’ policies, thereby enhancing coordination and achieving globally optimal decisions. A key feature of MICDRL is its reliance on local information for message generation, effectively reducing communication overhead while ensuring collaboration. Additionally, MICDRL integrates a teammate module that leverages temporal data for predicting other agents’ actions, crucial for understanding collective dynamics and spatial environment characteristics. Empirical results show that MICDRL outperforms several state-of-the-art methods in metrics like queue length and throughput. Furthermore, we introduce a tailored three-layer Internet-of-Things architecture to enhance data collection and transmission.
AU  - Zhou,B
AU  - Zhou,Q
AU  - Hu,S
AU  - Ma,D
AU  - Jin,S
AU  - Lee,DH
DO  - 10.1109/TITS.2024.3352730
PY  - 2024///
SN  - 1524-9050
TI  - Cooperative Traffic Signal Control Using a Distributed Agent-Based Deep Reinforcement Learning With Incentive Communication
T2  - IEEE Transactions on Intelligent Transportation Systems
UR  - http://dx.doi.org/10.1109/TITS.2024.3352730
ER  -
Download