This paper compares five multi-train path planning algorithms, MT-CBS, MT-ICBS, MT-CBSH, MT-CBSH-RM [
24] and MT-SIPP, on three benchmark map environments [
6] (blank-empty-48-48, random-random-32-32-20, and room-room-32-32-4) for a performance evaluation.MT-CBS, MT-ICBS, MT-CBSH, and MT-CBSH-RM are based on the basic CBS (Conflict-Based Search) algorithm, the modified CBS algorithm, the CBS algorithm with heuristics, and the CBS algorithm combining the heuristics and MDD (Manhattan Distance on a Grid ) for rectangular conflict reasoning is implemented in the CBS algorithm. In the experiments, the number of trains
was systematically increased, with 25 instances tested for each train count. In the result tables, algorithms showing shorter average running times under identical conditions were highlighted in bold to emphasize their comparative performance across diverse scenarios.
The experimental setup utilized a 2.3 GHz processor, 8GB of RAM, and the Windows 10 operating system. MT-CBS, MT-ICBS, MT-CBSH, and MT-CBSH-RM algorithms were implemented in C++, whereas the MT-SIPP algorithm was implemented in Python. Each algorithm was restricted to a maximum solving time of 2 minutes per instance; instances failing to produce a valid solution within this timeframe were deemed unsuccessful.
7.1. Testing in a Blank Map Environment
The blank map environment is distinguished by its prominent feature: the entire map space consists of obstacle-free open areas. This environment provides optimal conditions for the unrestricted movement and efficient interaction of multiple robots. As depicted in
Figure 12, this study selected this typical blank map environment, sized at 48*48, for evaluating algorithm performance.
Figure 13 visually illustrates the comparative results of MT-CBS, MT-ICBS, MT-CBSH, MT-CBSH-RM and MT-SIPP algorithms in terms of their success rates in solving problems within the blank map environment. This comparison offers a clear insight into the performance disparities among the algorithms under these specific environmental conditions.
Based on the success rate comparison depicted in
Figure 13, it is evident that among the five multi-train path planning algorithms—MT-CBS, MT-ICBS, MT-CBSH, MT-CBSH-RM and the proposed MT-SIPP algorithm consistently exhibit the highest success rates in the empty map environment. Of particular note is that although the MT-CBSH-RM algorithm, a prominent CBS-type algorithm, shows comparable success rates to the MT-SIPP algorithm when the value of
(train body length) is small, the superiority of the MT-SIPP algorithm becomes more pronounced as
increases. Detailed statistical analysis reveals that at
, the MT-SIPP algorithm exhibited average success rate improvements of 44.7%, 44%, 42.6%, and 5.6% compared to the other four algorithms. At
, these enhancements were 40%, 38%, 39%, and 17%. At
, the improvements were consistently 42%, 42%, 42%, and 33%. Notably, at
, the algorithm achieved substantial improvements of 49.1%, 48.4%, 48.4%, and 43.6%, while at
, the figures were 48%, 47.6%, 46.9%, and 44%. These findings underscore a significant performance advantage of the MT-SIPP algorithm over CBS-like multi-agent pathfinding algorithms in achieving higher success rates, with an average improvement nearing 40% in blank map environments. Furthermore, regarding the scalability in handling multiple train instances, particularly at larger
values (e.g.,
), MT-SIPP demonstrated superior capability, effectively managing nearly twice the maximum train instances compared to alternative algorithms.
Figure 13.
Comparison of success rates of several algorithms in blank map environment. (a) ; (b) ; (c) ; (d) ; (e) .
Figure 13.
Comparison of success rates of several algorithms in blank map environment. (a) ; (b) ; (c) ; (d) ; (e) .
In our statistical analysis of algorithm runtime (as shown in
Table 1), we compared the MT-CBSH-RM algorithm, known for its superior efficiency in CBS-like multi-train planning algorithms, with the MT-SIPP algorithm. In a blank map environment, MT-CBSH-RM demonstrates better algorithmic runtime efficiency than MT-SIPP when
(train length) is small or when solving a small number of trains. However, as the number of trains or
increases, CBS-like multi-train planning algorithms experience rapid expansion of their solution space, resulting in a gradual decline in efficiency. This efficiency gap becomes more pronounced with increasing problem complexity.
The aforementioned results indicate that in a blank map environment, CBS-like multi-train planning algorithms, particularly the MT-CBSH-RM algorithm, excel in both success rate and runtime efficiency when values are small and the number of trains is limited. This is largely attributed to the expansive layout of the map, which allows ample maneuvering space for trains. However, as the number of trains increases or values grow larger, the available maneuvering space for trains gradually diminishes, leading to a significant decrease in the solving efficiency of CBS-like algorithms. In contrast, under these circumstances, the MT-SIPP algorithm consistently maintains higher solving efficiency, demonstrating its superior performance in handling complex multi-train pathfinding problems.
Table 1.
Running time statistics of the two algorithms in blank map environment.
Table 1.
Running time statistics of the two algorithms in blank map environment.
|
value |
/seconds |
|
MT-SIPP |
MT-CBSH-RM |
|
MT-SIPP |
MT-CBSH-RM |
|
=1 |
5 |
0.416 |
0.003 |
45 |
11.073 |
17.743 |
| 10 |
0.563 |
0.007 |
50 |
21.69 |
26.874 |
| 15 |
0.725 |
0.019 |
55 |
35.186 |
46.069 |
| 20 |
1.051 |
0.035 |
60 |
48.575 |
46.335 |
| 25 |
1.548 |
0.053 |
65 |
54.116 |
62.783 |
| 30 |
1.851 |
0.109 |
70 |
68.208 |
78.754 |
| 35 |
7.377 |
5.155 |
75 |
79.471 |
92.465 |
| 40 |
8.529 |
7.244 |
80 |
93.359 |
101.921 |
|
=2 |
5 |
0.432 |
0.016 |
35 |
7.996 |
44.751 |
| 10 |
0.615 |
0.022 |
40 |
9.569 |
64.221 |
| 15 |
1.103 |
9.75 |
45 |
34.138 |
85.798 |
| 20 |
1.573 |
9.946 |
50 |
66.568 |
101.118 |
| 25 |
6.874 |
20.533 |
55 |
72.455 |
105.727 |
| 30 |
7.495 |
29.742 |
|
|
|
|
=3 |
5 |
0.483 |
5.153 |
30 |
22.032 |
81.689 |
| 10 |
0.729 |
16.249 |
35 |
36.948 |
87.988 |
| 15 |
1.058 |
39.504 |
40 |
42.265 |
110.499 |
| 20 |
1.474 |
57.664 |
45 |
66.665 |
115.241 |
| 25 |
6.918 |
62.574 |
|
|
|
|
=4 |
5 |
0.443 |
14.934 |
25 |
9.1 |
86.532 |
| 10 |
6.111 |
29.459 |
30 |
14.32 |
115.222 |
| 15 |
6.541 |
44.933 |
35 |
33.654 |
106.918 |
| 20 |
7.456 |
62.731 |
|
|
|
|
=5 |
5 |
0.663 |
15.201 |
20 |
8.188 |
82.982 |
| 10 |
6.363 |
30.023 |
25 |
14.849 |
106.183 |
| 15 |
6.664 |
64.845 |
|
|
|
7.2. Random Map Environment Testing
In a random map environment, the distribution of obstacles is stochastic, leading to dispersed and variably-sized passable areas for trains. This variability undoubtedly presents considerable challenges for multi-train planning on such maps. As depicted in
Figure 14, this study utilized a representative random map measuring 32*32 for testing purposes. To thoroughly evaluate the performance of diverse algorithms in this setting, comprehensive testing was conducted, and the findings are consolidated in
Figure 15 and
Table 2.
Figure 14.
Random map random-32-32-20.
Figure 14.
Random map random-32-32-20.
Based on the comparative results of success rates depicted in
Figure 15, it is evident that in random map environments, the high coverage of obstacles leads to an increasing number of conflicts among trains as the number of trains to be solved increases. This diminishes the available maneuvering space and gradually lowers the success rates of all algorithms. Furthermore, as the value of
(train car length) increases, the number of empty grid occupied by trains and their occupation duration also increase, thereby reducing the maximum feasible number of trains that can be effectively managed by several multi-train planning algorithms. Nevertheless, it is worth noting that across various
values, the MT-SIPP algorithm consistently achieves higher success rates than several other algorithms. This superiority is particularly evident at
. In contrast, CBS-like multi-train path planning algorithms show minimal differences in success rates, with their performance nearly converging as
increases. This trend primarily stems from the constrained passable areas in random maps. At lower
values, the enhancement strategies integrated into the MT-CBS algorithm contribute to improved success rates. However, as
increases, the further reduction in passable space and the rapid growth in conflict search state space diminish the effectiveness of these strategies in enhancing success rates. Overall, the MT-SIPP algorithm exhibits an average increase in success rates of approximately 30% compared to CBS-like multi-train planning algorithms. Particularly noteworthy is its ability to handle more than twice the maximum number of solvable trains compared to CBS-like algorithms when
. This robust performance underscores the superiority of MT-SIPP in addressing multi-train path planning challenges in random map environments.
Figure 15.
Comparison of solving success rates of several algorithms in a random map environment. (a) ; (b) ; (c) ; (d) ; (e) .
Figure 15.
Comparison of solving success rates of several algorithms in a random map environment. (a) ; (b) ; (c) ; (d) ; (e) .
According to the data analysis from
Table 2, the prevalence of numerous random obstacles in random map environments significantly complicates the task of multi-train planning. In scenarios with smaller
values and fewer trains to solve, the MT-CBSH-RM algorithm indeed exhibits shorter runtimes compared to the MT-SIPP algorithm. However, once the number of trains to be solved exceeds 10, regardless of the
value, the runtime of the MT-CBSH-RM algorithm experiences exponential growth, making it difficult to provide solutions within a reasonable time frame.
In contrast, while the MT-SIPP algorithm does experience increased runtime as the number of trains to solve increases, the magnitude of this increase is significantly smaller compared to the MT-CBSH-RM algorithm. Consequently, when solving for more than 10 trains (i.e.,), the MT-SIPP algorithm consistently demonstrates shorter runtimes than MT-CBSH-RM, sometimes averaging as little as one-tenth of the latter's runtime. This finding strongly validates the superior performance of the MT-SIPP algorithm in addressing large-scale multi-train planning problems.
Table 2.
Running time statistics of the two algorithms in random map environment.
Table 2.
Running time statistics of the two algorithms in random map environment.
|
value |
/seconds |
|
MT-SIPP |
MT-CBSH-RM |
|
MT-SIPP |
MT-CBSH-RM |
|
=1 |
5 |
0.525 |
0.007 |
25 |
20.361 |
35.737 |
| 10 |
0.589 |
0.051 |
30 |
35.097 |
88.66 |
| 15 |
0.712 |
4.976 |
35 |
44.867 |
109.902 |
| 20 |
10.062 |
10.319 |
40 |
68.949 |
118.032 |
|
=2 |
5 |
0.586 |
0.011 |
20 |
20.281 |
91.697 |
| 10 |
0.919 |
2.651 |
25 |
30.889 |
107.895 |
| 15 |
6.104 |
35.48 |
30 |
59.613 |
117.054 |
|
=3 |
5 |
0.597 |
0.043 |
15 |
15.924 |
77.715 |
| 10 |
10.545 |
31.168 |
20 |
31.347 |
108.167 |
|
=4 |
5 |
0.592 |
4.914 |
15 |
31.447 |
115.636 |
| 10 |
10.406 |
56.327 |
20 |
|
|
|
=5 |
5 |
0.594
|
10.639 |
10 |
6.234 |
82.654 |
7.3. Indoor Map Environment Testing
The indoor map environment replicates the layout of partially enclosed rooms typically found in real-world scenarios, interconnected by narrow passages allowing only one train to pass at a time. In this unique map environment, characterized by spatial constraints and restricted passages, congestion between trains can readily occur, thereby greatly augmenting the complexity and challenges associated with multi-train planning. The indoor room map we tested is illustrated in
Figure 16, with comprehensive test results detailed in
Figure 17 and
Table 3.
In
Figure 17, we have contrasted the success rates of several algorithms in solving room-based maps. The findings reveal that MT-CBS exhibits the lowest success rate, whereas the MT-SIPP algorithm displays the highest success rate. It is worth noting that the performance of the multi-train path planning algorithms that incorporate improvements over MT-CBS shows varying degrees of success and consistency. In specific terms, at
, both the MT-CBSH and MT-CBSH-RM algorithms achieve identical success rates, slightly edging out MT-ICBS. However, as
increases, the scenario evolves. At
and
, MT-ICBS shows slightly superior performance compared to MT-CBSH and MT-CBSH-RM. Conversely, at
, MT-CBSH-RM outperforms MT-ICBS and MT-CBSH. By
, MT-CBSH exhibits marginally better performance than MT-CBSH-RM and MT-ICBS. This inconsistency in results may be attributed to the unique characteristics of room-based maps and the high complexity inherent in multi-train path planning. In certain cases, the addition of more improvement strategies might inadvertently reduce success rates due to increased algorithmic complexity. Overall, in room-based maps, the MT-SIPP algorithm exhibits a notable average increase of approximately 27% in success rates compared to CBS-like multi-train path planning algorithms. This improvement is quite significant.
Figure 17.
Comparison of the success rates of several algorithms in the room map environment. (a) ; (b) ; (c) ; (d) ; (e) .
Figure 17.
Comparison of the success rates of several algorithms in the room map environment. (a) ; (b) ; (c) ; (d) ; (e) .
Based on the data from
Table 3, in the context of room-based map environments, it is observed that when
and the number of trains
is less than 10, the MT-CBSH-RM algorithm indeed shows shorter runtime compared to the MT-SIPP algorithm. However, across all other test conditions, the MT-SIPP algorithm consistently demonstrates shorter runtime.
It is noteworthy that many of the connecting passages between rooms in the room-based maps are single-channel, significantly restricting the throughput of trains. This structural limitation predisposes CBS-like multi-train planning algorithms to conflict generation when applied in such environments. To find conflict-free solutions, algorithms must continually search and replan numerous potential conflict nodes, which inevitably consumes substantial computational resources. Particularly in densely populated train scenarios, achieving a conflict-free solution becomes increasingly challenging. Therefore, the MT-SIPP algorithm demonstrates superior efficiency and adaptability in tackling these intricate indoor multi-train planning problems.
Table 3.
Running time statistics of the two algorithms in room map environment.
Table 3.
Running time statistics of the two algorithms in room map environment.
|
value |
/seconds |
|
MT-SIPP |
MT-CBSH-RM |
|
MT-SIPP |
MT-CBSH-RM |
|
=1 |
5 |
0.141 |
0.003 |
20 |
10.313 |
45.438 |
| 10 |
5.043 |
0.048 |
25 |
20.793 |
118.389 |
| 15 |
9.918 |
11.623 |
|
|
|
|
=2 |
5 |
0.182 |
1.978 |
15 |
5.499 |
45.446 |
| 10 |
4.282 |
5.012 |
20 |
20.964 |
102.241 |
|
=3 |
5 |
0.206 |
4.825 |
15 |
21.503 |
103.262 |
| 10 |
15.235 |
11.454 |
20 |
50.649 |
115.955 |
|
=4 |
5 |
0.201 |
4.835 |
15 |
31.383 |
115.334 |
| 10 |
15.659 |
46.146 |
|
|
|
|
=5 |
5 |
0.197 |
5.028 |
15 |
45.167 |
117.688 |
| 10 |
20.641 |
75.108 |
|
|
|
7.4. Analysis and Discussion of Experimental Results
The experimental results across various map environments indicate that while strategies such as integrating heuristic function -value guidance in search and employing MDD for rectangle conflict resolution can enhance the solving capabilities of the MT-CBS algorithm to some extent, its effectiveness is hindered by the CBS algorithm's reliance on unit discretization nodes for path expansion and conflict detection mechanisms. This limitation results in an exponential increase in solution space as the number of trains and train lengths grow. Despite the incorporation of additional improvement strategies, the overall enhancement in algorithmic efficiency remains rather limited. In contrast, the MT-SIPP algorithm proposed in this study primarily expands path nodes and avoids conflicts based on global safe intervals, demonstrating a linear relationship between search space and both and . Consequently, as and increase beyond certain thresholds, the superior efficiency of the MT-SIPP algorithm in solution space becomes increasingly apparent.
All test results unequivocally demonstrate that our algorithm surpasses existing multi-train path planning algorithms in several key metrics: success rate, maximum number of solvable trains, and algorithm runtime. Particularly notable is the MT-SIPP algorithm's ability to achieve shorter runtimes and higher solving efficiency when confronted with larger numbers of trains and longer train lengths . Furthermore, our algorithm guarantees that the total cost of generated path solutions deviates from the optimal path's total cost by no more than 10%. In scenarios involving blank maps or random and room-based maps with fewer trains, this deviation is further minimized to within 5%. This thoroughly validates the feasibility and efficacy of our algorithm. Despite making compromises in total path cost, its significant advancements in success rate, maximum solvable capacity, and solving efficiency underscore its broad applicability in the realm of multi-train path planning.