7.1. Testing in a Blank Map Environment
The blank map environment is distinguished by its prominent feature: the entire map space consists of obstacle-free open areas. This environment provides optimal conditions for the unrestricted movement and efficient interaction of multiple robots. As depicted in
Figure 12, this study selected this typical blank map environment, sized at 48*48, for evaluating algorithm performance.
Figure 13 visually illustrates the comparative results of MT-CBS, MT-ICBS, MT-CBSH, MT-CBSH-RM and MT-SIPP algorithms in terms of their success rates in solving problems within the blank map environment. This comparison offers a clear insight into the performance disparities among the algorithms under these specific environmental conditions.
Based on the success rate comparison depicted in
Figure 13, it is evident that among the five multi-train path planning algorithms—MT-CBS, MT-ICBS, MT-CBSH, MT-CBSH-RM and the proposed MT-SIPP algorithm consistently exhibit the highest success rates in the empty map environment. Of particular note is that although the MT-CBSH-RM algorithm, a prominent CBS-type algorithm, shows comparable success rates to the MT-SIPP algorithm when the value of
(train body length) is small, the superiority of the MT-SIPP algorithm becomes more pronounced as
increases. Detailed statistical analysis reveals that at
, the MT-SIPP algorithm exhibited average success rate improvements of 44.7%, 44%, 42.6%, and 5.6% compared to the other four algorithms. At
, these enhancements were 40%, 38%, 39%, and 17%. At
, the improvements were consistently 42%, 42%, 42%, and 33%. Notably, at
, the algorithm achieved substantial improvements of 49.1%, 48.4%, 48.4%, and 43.6%, while at
, the figures were 48%, 47.6%, 46.9%, and 44%. These findings underscore a significant performance advantage of the MT-SIPP algorithm over CBS-like multi-agent pathfinding algorithms in achieving higher success rates, with an average improvement nearing 40% in blank map environments. Furthermore, regarding the scalability in handling multiple train instances, particularly at larger
values (e.g.,
), MT-SIPP demonstrated superior capability, effectively managing nearly twice the maximum train instances compared to alternative algorithms.
Figure 13.
Comparison of success rates of several algorithms in blank map environment. (a) ; (b) ; (c) ; (d) ; (e) .
Figure 13.
Comparison of success rates of several algorithms in blank map environment. (a) ; (b) ; (c) ; (d) ; (e) .
In our statistical analysis of algorithm runtime (as shown in
Table 1), we compared the MT-CBSH-RM algorithm, known for its superior efficiency in CBS-like multi-train planning algorithms, with the MT-SIPP algorithm. In a blank map environment, MT-CBSH-RM demonstrates better algorithmic runtime efficiency than MT-SIPP when
(train length) is small or when solving a small number of trains. However, as the number of trains or
increases, CBS-like multi-train planning algorithms experience rapid expansion of their solution space, resulting in a gradual decline in efficiency. This efficiency gap becomes more pronounced with increasing problem complexity.
The aforementioned results indicate that in a blank map environment, CBS-like multi-train planning algorithms, particularly the MT-CBSH-RM algorithm, excel in both success rate and runtime efficiency when values are small and the number of trains is limited. This is largely attributed to the expansive layout of the map, which allows ample maneuvering space for trains. However, as the number of trains increases or values grow larger, the available maneuvering space for trains gradually diminishes, leading to a significant decrease in the solving efficiency of CBS-like algorithms. In contrast, under these circumstances, the MT-SIPP algorithm consistently maintains higher solving efficiency, demonstrating its superior performance in handling complex multi-train pathfinding problems.
Table 1.
Running time statistics of the two algorithms in blank map environment.
Table 1.
Running time statistics of the two algorithms in blank map environment.
|
value |
/seconds |
|
MT-SIPP |
MT-CBSH-RM |
|
MT-SIPP |
MT-CBSH-RM |
|
=1 |
5 |
0.416 |
0.003 |
45 |
11.073 |
17.743 |
| 10 |
0.563 |
0.007 |
50 |
21.69 |
26.874 |
| 15 |
0.725 |
0.019 |
55 |
35.186 |
46.069 |
| 20 |
1.051 |
0.035 |
60 |
48.575 |
46.335 |
| 25 |
1.548 |
0.053 |
65 |
54.116 |
62.783 |
| 30 |
1.851 |
0.109 |
70 |
68.208 |
78.754 |
| 35 |
7.377 |
5.155 |
75 |
79.471 |
92.465 |
| 40 |
8.529 |
7.244 |
80 |
93.359 |
101.921 |
|
=2 |
5 |
0.432 |
0.016 |
35 |
7.996 |
44.751 |
| 10 |
0.615 |
0.022 |
40 |
9.569 |
64.221 |
| 15 |
1.103 |
9.75 |
45 |
34.138 |
85.798 |
| 20 |
1.573 |
9.946 |
50 |
66.568 |
101.118 |
| 25 |
6.874 |
20.533 |
55 |
72.455 |
105.727 |
| 30 |
7.495 |
29.742 |
|
|
|
|
=3 |
5 |
0.483 |
5.153 |
30 |
22.032 |
81.689 |
| 10 |
0.729 |
16.249 |
35 |
36.948 |
87.988 |
| 15 |
1.058 |
39.504 |
40 |
42.265 |
110.499 |
| 20 |
1.474 |
57.664 |
45 |
66.665 |
115.241 |
| 25 |
6.918 |
62.574 |
|
|
|
|
=4 |
5 |
0.443 |
14.934 |
25 |
9.1 |
86.532 |
| 10 |
6.111 |
29.459 |
30 |
14.32 |
115.222 |
| 15 |
6.541 |
44.933 |
35 |
33.654 |
106.918 |
| 20 |
7.456 |
62.731 |
|
|
|
|
=5 |
5 |
0.663 |
15.201 |
20 |
8.188 |
82.982 |
| 10 |
6.363 |
30.023 |
25 |
14.849 |
106.183 |
| 15 |
6.664 |
64.845 |
|
|
|