A DQN-based intelligent control method for heavy haul trains on long steep downhill section

摘要

The cyclic air braking strategy on the long and steep downhill section is one of the biggest challenges for heavy haul railway lines in China. To deal with this problem, this paper presents an intelligent control method based on the Deep-Q-Network (DQN) algorithm for the heavy haul train running on the long and steep downhill section. The aim of the optimal train control problem in the paper is to enhance the train operation performance in regard to the operational safety, maintenance costs and running efficiency. In the train control model, the characteristics of the heavy haul train, the speed limits and constraints on the air-refilling time of the train pipe are taken into consideration. Then the train control process on the long and steep downhill section is described as a Markov decision process for the application of the reinforcement learning (RL) technique. Further, the critical elements of RL are designed and an intelligent control method on the basis of the DQN algorithm is developed to address the optimal train control problem in this paper. Finally, experimental simulations are carried out with the actual data of the ShuozhouHuanghua Line such that the effectiveness and robustness of the proposed DQN-based control method are verified.