To address the insufficient mechanical properties of calcined phosphogypsum, this research aims to investigate the utilization of basalt fiber and calcium carbonate whiskers as reinforcing agents. The study examines their impact on the flexural and compressive strength, toughness, water resistance, and tensile strength of calcined phosphogypsum. In the individual tests, basalt fibers with different lengths (3 mm, 6 mm, 9 mm, and 18 mm) were added at dosages of 0%, 0.5%, 1.0%, and 1.5% respectively. The findings demonstrate that basalt fiber effectively enhances the flexural and compressive strength, toughness, and tensile strength of calcined phosphogypsum, albeit potentially compromising water resistance. Among the various fiber lengths, the 6 mm fibers exhibit the most advantageous influence on the performance of calcined phosphogypsum. A subsequent test was conducted to investigate the impact of cross-scale fibers on the properties of calcined phosphogypsum by mixing 6 mm basalt fibers and calcium carbonate whiskers. The results illustrate that calcium carbonate whisker refines the pores, thereby improving the flexural strength and toughness of calcined phosphogypsum. Furthermore, it compensates for the water resistance limitations associated with the sole utilization of basalt fiber while further augmenting the tensile strength and strain capacity. However, it should be noted that increasing the dosage of both calcium carbonate whiskers and basalt fibers concurrently leads to increased porosity of phosphogypsum and reduced compressive strength.