Simulation and Optimization of Collaborative Scheduling of AGV and Yard Crane in U-Shaped Automated Terminal Based on Deep Reinforcement Learning

Abstract

In U-shaped automated container terminals (U-shaped ACTs), automated guided vehicles (AGVs) need to frequently interact with yard cranes (YCs), and separate scheduling of the two devices will affect terminal efficiency. Therefore, this study explores the coordinated scheduling problem between the two devices. To solve this problem, a high-precision simulation model of the U-shaped ACTs is established, which incorporates real operational logic. Second, an Improved Non-dominated Sorting Genetic Algorithm II based on Proximal Policy Optimization (INSGAII-PPO) is proposed. The algorithm uses PPO to realize dynamic genetic operator selection and makes related improvements, which improve the multi-objective optimization ability of NSGAII, and solve the collaborative scheduling problem by combining simulation. Finally, a hybrid weighted Technique for Order Preference by Similarity to Ideal Solution with preferences is proposed to select the final solution. The experimental results show that the scheme obtained by INSGAII-PPO exhibits better convergence and diversity, and offers significant advantages compared with the comparison algorithms. Moreover, the energy consumption and waiting time of the final solution selected by the proposed method are reduced by 3.42% and 4.87% on average. The proposed method has the capability of providing a theoretical reference for the AGVs and YCs collaborative scheduling of U-shaped ACTs.

Bibliographic Information