Submitted:
24 August 2025
Posted:
25 August 2025
You are already at the latest version
Abstract
Keywords:
1. Introduction
2. Methodology
Physical Aware Informer Framework
2.1.1. Overview of the Physical Aware-Informer Model

2.1.2. Informer Model for Long-Sequence Forecasting
2.1.3. Derivation of the Unified IRI Residual PDE
2.1.4. Integration of Informer with Physical Constraints
3. Experiments
3.1. Data Collecting
- Meteorological Observations: Precipitation levels and solar radiation intensity are recorded by weather stations (Figure 2).
- Internal Temperature and Humidity Fields: Temperature and humidity distribution within the pavement structure is monitored using temperature and humidity fiber-optic sensors (Figure 3).


3.2. Experiments Details
4. Results and Discussion
4.1. Hyperparameters Tuning Process
4.2. Prediction Accuracy Evaluation
4.3. Sensitivity Analysis


5. Conclusions
References
- T. Zhang, A. Smith, H. Zhai, Y. Lu. LSTM+MA: A Time-Series Model for Predicting Pavement IRI. Infrastructures 2025, 10, 10. [Google Scholar] [CrossRef]
- Dalla Rosa, F. , Liu L., & Gharaibeh, N. G. IRI prediction model for use in network-level pavement management systems. Journal of Transportation Engineering, Part B: Pavements, 2017, 143, 04017001. [Google Scholar] [CrossRef]
- Hochreiter, S. & Schmidhuber, J. Long short-term memory. Neural Computation, 1997, 9, 1735–1780. [Google Scholar]
- Zhou, H. , Zhang S., Peng J., et al. Informer: Beyond efficient transformer for long sequence time-series forecasting. Proceedings of the AAAI Conference on Artificial Intelligence, 2021, 35, 106–115. [Google Scholar] [CrossRef]
- Vaswani A., Shazeer N., Parmar N., et al. Attention is all you need. Advances in Neural Information Processing Systems, 2017, 30.
- Marcelino, P. , de Lurdes Antunes M., & Gomes M. C. Machine learning approach for pavement performance prediction. International Journal of Pavement Engineering, 2021, 22, 341–354. [Google Scholar]
- Qin Y., Song D., Chen H., et al. A dual-stage attention-based recurrent neural network for time series prediction. Proceedings of the 26th International Joint Conference on Artificial Intelligence, 2017, 2627-2633.
- Deng, F. , Tang X., & Wu T. Particle swarm optimization-augmented feedforward networks for pavement rutting prediction. Journal of Computing in Civil Engineering, 2015, 29, 04014097. [Google Scholar]
- Wang, K. , Huang Y., & Zhang Z. Hybrid gray relation analysis and support vector regression for pavement performance prediction. International Journal of Pavement Research and Technology, 2018, 11, 287–294. [Google Scholar]
- Gong, W. , Chen H., & Zhang J. Random forest regression for flexible pavement IRI modeling. Transportation Research Record: Journal of the Transportation Research Board, 2019, 2673, 299–309. [Google Scholar]
- Damirchilo, B. , Yazdani R., & Khavarian M. XGBoost-based pavement performance prediction and handling missing values. International Journal of Pavement Engineering, 2020, 21, 456–466. [Google Scholar]
- Song, Y. , Wang L., & Yin J. ThunderGBM-based ensemble learning for asphalt pavement IRI prediction. Construction and Building Materials, 2021, 313, 125421. [Google Scholar]
- Zhou, X. , Li, J., & Fang, S. RNN-based models for asphalt pavement performance prediction using LTPP data. International Journal of Pavement Research and Technology, 2018, 11, 559–567. [Google Scholar]
- Han, Z. , Liu, F., & Zhang, X. Modified RNN for falling weight deflectometer back-calculation. Journal of Computing in Civil Engineering, 2020, 34, 04020023. [Google Scholar]
- Raissi, M. , Perdikaris, P., & Karniadakis, G. E. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving PDEs. Journal of Computational Physics, 2019, 378, 686–707. [Google Scholar]
- Karniadakis G., E. , Kevrekidis I. G., Lu L., et al. Physics-informed machine learning. Nature Reviews Physics, 2021, 3, 422–440. [Google Scholar] [CrossRef]
- Sun, L. , Wang Z., & Zhang H. Physics-informed deep learning for time-series forecasting in engineering applications. Mechanical Systems and Signal Processing, 2021, 152, 107377. [Google Scholar]
- Tartakovsky A., M. , Marrero C. O., Perdikaris P., et al. Physics-informed deep neural networks for learning parameters and constitutive relationships in subsurface flow problems. Water Resources Research, 2020, 56, e2019WR026731. [Google Scholar] [CrossRef]
- Lu, L. , Meng, X., Mao, Z., & Karniadakis, G. E. DeepXDE: A deep learning library for solving differential equations. SIAM Review, 2021, 63, 208–228. [Google Scholar]
- H. Dai, Z. Liu, J. Dai, Y. Liu, An adaptive spatio-temporal attention mechanism for traffic prediction. IEEE Internet of Things Journal, 2021, 8, 11915–11924. [Google Scholar]
- Z. Xu, C. Feng, L. Zhang, Physics-enhanced neural networks for multiscale spatiotemporal traffic prediction. Transportation Research Part C: Emerging Technologies, 2022, 137, 103597. [Google Scholar]
- Sun, L. , Wang Z., & Zhang H. Physics-informed deep learning for time-series forecasting in engineering applications. Mechanical Systems and Signal Processing, 2021, 152, 107377. [Google Scholar]
- Raissi, M. , Perdikaris P., & Karniadakis G. E. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving PDEs. Journal of Computational Physics, 2019, 378, 686–707. [Google Scholar]
- Child, R. , Gray S., Radford A., & Sutskever I. Generating long sequences with sparse transformers. arXiv preprint, arXiv:1904.10509.
- Beltagy, I. , Peters M. E., & Cohan A. Longformer: The long-document transformer. arXiv preprint, arXiv:2004.05150.
- Vaswani A., Shazeer N., Parmar N., Uszkoreit J., Jones L., Gomez A. N., Kaiser Ł., & Polosukhin I. Transformer-XL: Attentive language models beyond a fixed-length context. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 2019, 2978–2988.
- Sayers M. W., Gillespie T. D., & Paterson W. D. O. Guidelines for conducting and calibrating road roughness measurements. World Bank Technical Paper, 1986, 46.
- Sayers M. W., & Karamihas S. M. The Little Book of Profiling: Basic Information about Measuring and Interpreting Road Profiles. University of Michigan, Transportation Research Institute, 1998.
- Chen Z., Badrinarayanan V., Lee C. Y., & Rabinovich A. GradNorm: Gradient normalization for adaptive loss balancing in deep multitask networks. Proceedings of the 35th International Conference on Machine Learning (ICML), 2018, 807-815.
- Sener, O. , & Koltun V. Multi-task learning as multi-objective optimization. Advances in Neural Information Processing Systems (NeurIPS), 2019, 32, 527–538. [Google Scholar]
- Wang S., Teng Y., Perdikaris P., & Karniadakis G. E. Learning physics-informed neural networks without stacked back-propagation. arXiv preprint, 2021.
- Chatterjee, S. , & Singh B. Durability of concrete in an arid environment: Challenges and remedies. Construction and Building Materials, 2019, 223, 72–80. [Google Scholar]
- Mehta P. K., & Monteiro P. J. M. Concrete: Microstructure, Properties, and Materials. McGraw-Hill Education, 2014.
- Vaitkus, A. , Čygas D., Laurinavičius A., & Perveneckas Z. Analysis and evaluation of asphalt pavement structure damages caused by frost. The Baltic Journal of Road and Bridge Engineering, 2009, 4, 196–202. [Google Scholar]
- Willmott C., J. , & Matsuura K. Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance. Climate Research, 2005, 30, 79–82. [Google Scholar]
- Steel R. G. D., Torrie J. H., & Dickey D. A. Principles and Procedures of Statistics: A Biometrical Approach. McGraw-Hill Education, 1997.
- Saltelli A., Ratto M., Andres T., Campolongo F., Cariboni J., Gatelli D., Saisana M., & Tarantola S. Global Sensitivity Analysis: The Primer. John Wiley & Sons, 2008.
- Goodfellow, I., Bengio, Y., & Courville, A. Deep Learning. MIT Press, 2016.
- Prechelt, L. Early stopping — But when? In Neural Networks: Tricks of the Trade (pp. 55–69). Springer, 1998.
- Li N., Zhang J., & Peng Z. Influence of environmental factors on the deterioration of concrete pavements in cold regions. Cold Regions Science and Technology, 2012, 83-84, 59-66.






| Symbol | Physical Meaning |
| x, y, z | Coordinate |
| t | Time stamp |
| σ | Internal stress |
| u | Horizonal displacement at joints |
| Height difference at the joint | |
| L | Length of the road (In this study, L is fixed at 100 m) |
| Fourth-order elastic stiffness tensor, defined by E and v | |
| I | Cubic tensor |
| T | Atmospheric temperature |
| Tc | Internal temperature of cement concrete |
| Hc | Internal humidity of cement concrete |
| α | Thermal Expansion Coefficient |
| β | Hygroscopic Expansion Coefficient |
| SR | Solar Radiation |
| P | Precipitation |
| κT | Thermal conductivity |
| DH | Moisture diffusion coefficient |
| Dataset Types | Typical Environments | Characteristics of Natural Conditions of the Pavements | Provinces |
| Training set | Arid desert | In the arid desert region, cement concrete pavements face challenges from thermal expansion and contraction due to extreme temperature fluctuations, leading to frequent cracking and joint damage. Sand erosion can abrade the pavement surface, while dust accumulation may reduce skid resistance [32]. | Xinjiang |
| Hot and humid | In humid and rainy regions, excessive moisture infiltrates concrete pavements, causing joint spalling, surface scaling, and subgrade erosion. Persistent water exposure can also lead to damage at joints and cracks, accelerating structural deterioration [33]. | Guangxi | |
| Lightly frozen | Concrete pavements in light ice regions are affected by freeze-thaw cycles, which cause frost heave, cracking, and surface scaling. De-icing chemicals exacerbate surface deterioration and may lead to joint damage, weakening the cement concrete pavement over time [34]. | Beijing | |
| Test set | High-Altitude Cold Region | In Qinghai-Tibet Plateau, the extreme cold and presence of permafrost cause significant frost heave and thaw settlement, leading to uneven surfaces and cracking in concrete pavements. The harsh environment accelerates damage to joints and surface layers, reducing durability [32]. | Tibet |
| Indicators | Formulas |
| MSE | |
| R2 | |
| Sp |
| Hyperparameters | Initial Value | Final Value |
| Encoder layers | 3 | 3 |
| Decoder layers | 2 | 2 |
| Token embedding dimension | 5 | 5 |
| Dimension of the hidden layer of Feed-Forward Neutral Network | 20 | 20 |
| Learning rate | 0.0001 | 0.001 |
| Learning rate decay | 0.5 | 0.8 |
| Epoch | 100 | 20 |
| Batch size | 32 | 32 |
| λPhysics & λdata | 0.1 & 0.9 | 0.46 & 0.54 |
| 0. 39 & 0.61 | ||
| 0.33 & 0.67 | ||
| 0.21 & 0.79 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).