Submitted:
14 April 2025
Posted:
15 April 2025
You are already at the latest version
Abstract
Keywords:
1. Introduction
2. Study Areas and Dataset Description
2.1. Study Areas
2.2. Multi-Modal Benchmark Dataset
2.3. Satellite and Airborne Remote Sensing Datasets for the Test-Sites
3. Proposed Method and Experimental Setup
3.1. Parallel Patch-Wise Sparse Residual Learning (P2SR) Method
3.2. Experimental Setup and Evaluation Strategies
4. Results
4.1. Metrics Based Assessment of Enhanced Hyperspectral Products
4.2. Qualitative Spatial Assessment of Enhanced Hyperspectral Products
4.3. Application-Oriented Assessment of Enhanced HSI Products
5. Discussion
6. Conclusion
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Shah, V. P.; Younan, N. H.; King, R. L. An Efficient Pan-Sharpening Method via a Combined Adaptive PCA Approach and Contourlets. IEEE Transactions on Geoscience and Remote Sensing, 2008, 46, 1323–1335. [Google Scholar] [CrossRef]
- Jelének, J.; Kopačková, V.; Koucká, L.; Mišurec, J. Testing a Modified PCA-Based Sharpening Approach for Image Fusion. Remote Sensing, 2016, 8, 794. [Google Scholar] [CrossRef]
- Dalla Mura, M.; Vivone, G.; Restaino, R.; Addesso, P.; Chanussot, J. Global and Local Gram-Schmidt Methods for Hyperspectral Pansharpening. 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), 2015. [CrossRef]
- Qu, J.; Li, Y.; Dong, W. A New Hyperspectral Pansharpening Method Based on Guided Filter. 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), 2017, 5125–5128. [CrossRef]
- Dong, W.; Xiao, S.; Li, Y. Hyperspectral Pansharpening Based on Guided Filter and Gaussian Filter. Journal of Visual Communication and Image Representation, 2018, 53, 171–179. [Google Scholar] [CrossRef]
- Yokoya, N.; Yairi, T.; Iwasaki, A. Coupled Nonnegative Matrix Factorization Unmixing for Hyperspectral and Multispectral Data Fusion. IEEE Transactions on Geoscience and Remote Sensing, 2012, 50, 528–537. [Google Scholar] [CrossRef]
- Simoes, M.; Bioucas-Dias, J.; Almeida, L. B.; Chanussot, J. A Convex Formulation for Hyperspectral Image Superresolution via Subspace-Based Regularization. IEEE Transactions on Geoscience and Remote Sensing, 2015, 53, 3373–3388. [Google Scholar] [CrossRef]
- Irmak, H.; Akar, G. B.; Yuksel, S. E. A MAP-Based Approach for Hyperspectral Imagery Super-Resolution. IEEE Transactions on Image Processing, 2018, 27, 2942–2951. [Google Scholar] [CrossRef]
- Irmak, H.; Akar, G. B.; Yuksel, S. E.; Aytaylan, H. Super-Resolution Reconstruction of Hyperspectral Images via an Improved MAP-Based Approach. 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), 2016, 7244–7247. [CrossRef]
- Akgun, T.; Altunbasak, Y.; Mersereau, R. M. Super-Resolution Reconstruction of Hyperspectral Images. IEEE Transactions on Image Processing, 2005, 14, 1860–1875. [Google Scholar] [CrossRef]
- Zhang, H.; Zhang, L.; Shen, H. A Super-Resolution Reconstruction Algorithm for Hyperspectral Images. Signal Processing, 2012, 92, 2082–2096. [Google Scholar] [CrossRef]
- Wang, L.; Bi, T.; Shi, Y. A Frequency-Separated 3D-CNN for Hyperspectral Image Super-Resolution. IEEE Access, 2020, 8, 86367–86379. [Google Scholar] [CrossRef]
- Ma, X.; Hong, Y.; Song, Y.; Chen, Y. A Super-Resolution Convolutional-Neural-Network-Based Approach for Subpixel Mapping of Hyperspectral Images. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2019, 12, 4930–4939. [Google Scholar] [CrossRef]
- Liu, W.; Lee, J. An Efficient Residual Learning Neural Network for Hyperspectral Image Superresolution. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2019, 12, 1240–1253. [Google Scholar] [CrossRef]
- Wang, C.; Liu, Y.; Bai, X.; Tang, W.; Lei, P.; Zhou, J. Deep Residual Convolutional Neural Network for Hyperspectral Image Super-Resolution. Lecture Notes in Computer Science, 2017, 370–380. [CrossRef]
- Zhu, Z.; Hou, J.; Chen, J.; Zeng, H.; Zhou, J. Hyperspectral Image Super-Resolution via Deep Progressive Zero-Centric Residual Learning. IEEE Transactions on Image Processing, 2021, 30, 1423–1438. [Google Scholar] [CrossRef]
- Wang, B.; Zhang, S.; Feng, Y.; Mei, S.; Jia, S.; Du, Q. Hyperspectral Imagery Spatial Super-Resolution Using Generative Adversarial Network. IEEE Transactions on Computational Imaging, 2021, 7, 948–960. [Google Scholar] [CrossRef]
- Wang, J.; Zhu, X.; Jing, L.; Tang, Y.; Li, H.; Xiao, Z.; Ding, H. HyperGAN: A Hyperspectral Image Fusion Approach Based on Generative Adversarial Networks. Remote Sensing, 2024, 16, 4389. [Google Scholar] [CrossRef]
- Hu, J.; Liu, Y.; Kang, X.; Fan, S. Multilevel Progressive Network With Nonlocal Channel Attention for Hyperspectral Image Super-Resolution. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60, 1–14. [Google Scholar] [CrossRef]
- Hu, J.-F.; Huang, T.-Z.; Deng, L.-J.; Jiang, T.-X.; Vivone, G.; Chanussot, J. Hyperspectral Image Super-Resolution via Deep Spatiospectral Attention Convolutional Neural Networks. IEEE Transactions on Neural Networks and Learning Systems, 2022, 33, 7251–7265. [Google Scholar] [CrossRef] [PubMed]
- Zhang, M.; Zhang, C.; Zhang, Q.; Guo, J.; Gao, X.; Zhang, J. ESSAformer: Efficient Transformer for Hyperspectral Image Super-Resolution. 2023 IEEE/CVF International Conference on Computer Vision (ICCV), 2023, 23016–23027. [CrossRef]
- Liu, Y.; Hu, J.; Kang, X.; Luo, J.; Fan, S. Interactformer: Interactive Transformer and CNN for Hyperspectral Image Super-Resolution. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60, 1–15. [Google Scholar] [CrossRef]
- Bieniarz, J.; Cerra, D.; Avbelj, J.; Reinartz, P.; Müller, R. Hyperspectral Image Resolution Enhancement Based On Spectral Unmixing and Information Fusion. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2012, XXXVIII-4/W19, 33–37. [CrossRef]
- Li, L.; He, H.; Chen, N.; Kang, X.; Wang, B. SLRCNN: Integrating Sparse and Low-Rank with a CNN Denoiser for Hyperspectral and Multispectral Image Fusion. International Journal of Applied Earth Observation and Geoinformation, 2024, 134, 104227. [Google Scholar] [CrossRef]
- Liu, X.; Liu, Q.; Wang, Y. Remote Sensing Image Fusion Based on Two-Stream Fusion Network. Information Fusion, 2020, 55, 1–15. [Google Scholar] [CrossRef]
- Xiao, J.; Li, J.; Yuan, Q.; Jiang, M.; Zhang, L. Physics-Based GAN With Iterative Refinement Unit for Hyperspectral and Multispectral Image Fusion. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2021, 14, 6827–6841. [Google Scholar] [CrossRef]
- Booysen, R., Jackisch, R., Lorenz, S., Zimmermann, R., Kirsch, M., Nex, P. A., & Gloaguen, R. Detection of REEs with lightweight UAV-based hyperspectral imaging, Scientific Reports, 2020, 10(1). [CrossRef]
- Thiele, Samuel T., Sandra Lorenz, Moritz Kirsch, I. Cecilia Contreras Acosta, Laura Tusa, Erik Herrmann, Robert Möckel, and Richard Gloaguen. Multi-scale, multi-sensor data integration for automated 3-D geological mapping, Ore Geology Reviews, 2021, 136 (2021): 104252. [CrossRef]
- Smithies, R. H., & Marsh, J. S. The Marinkas Quellen Carbonatite Complex, southern Namibia; carbonatite magmatism with an uncontaminated depleted mantle signature in a continental setting, Chemical Geology, 1998, 148(3-4), 201-212. [CrossRef]
- Salkield, L. U. A Technical History of the Rio Tinto Mines: Some Notes on Exploitation from Pre-Phoenician Times to the 1950s; Cahalan, M. J., Ed.; Springer Netherlands, 1987. [CrossRef]
- Hu, J.; Liu, R.; Hong, D.; Camero, A.; Yao, J.; Schneider, M.; Kurz, F.; Segl, K.; Zhu, X. X. MDAS: A New Multimodal Benchmark Dataset for Remote Sensing. Earth System Science Data, 2023, 15, 113–131. [Google Scholar] [CrossRef]
- Mairal, J., Ponce, J., Sapiro, G., Zisserman, A., & Bach, F.. Supervised Dictionary Learning. In D. Koller, D. Schuurmans, Y. Bengio, & L. Bottou (Eds.), Advances in Neural Information Processing Systems, 2008 (Vol. 21). Available online: https://proceedings.neurips.cc/paper_files/paper/2008/file/c0f168ce8900fa56e57789e2a2f2c9d0-Paper.pdf.
- Beck, A.; Teboulle, M. A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems. SIAM Journal on Imaging Sciences, 2009, 2, 183–202. [Google Scholar] [CrossRef]
- Zhang, X.; Huang, W.; Wang, Q.; Li, X. SSR-NET: Spatial–Spectral Reconstruction Network for Hyperspectral and Multispectral Image Fusion. IEEE Transactions on Geoscience and Remote Sensing, 2021, 59, 5953–5965. [Google Scholar] [CrossRef]
- Fotiadou, K.; Tsagkatakis, G.; Tsakalides, P. Spectral Super Resolution of Hyperspectral Images via Coupled Dictionary Learning. IEEE Transactions on Geoscience and Remote Sensing, 2019, 57, 2777–2797. [Google Scholar] [CrossRef]
- Li, J.; Yuan, Q.; Shen, H.; Meng, X.; Zhang, L. Hyperspectral Image Super-Resolution by Spectral Mixture Analysis and Spatial–Spectral Group Sparsity. IEEE Geoscience and Remote Sensing Letters, 2016, 13, 1250–1254. [Google Scholar] [CrossRef]
- P.V., A.; B., K. M.; A., P. Spatial-Spectral Feature Based Approach towards Convolutional Sparse Coding of Hyperspectral Images. Computer Vision and Image Understanding, 2019, 188, 102797. [CrossRef]
- Liu, Z.; Wang, W.; Ma, Q.; Liu, X.; Jiang, J. Rethinking 3D-CNN in Hyperspectral Image Super-Resolution. Remote Sensing, 2023, 15, 2574. [Google Scholar] [CrossRef]
- Fu, Y.; Liang, Z.; You, S. Bidirectional 3D Quasi-Recurrent Neural Network for Hyperspectral Image Super-Resolution. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2021, 14, 2674–2688. [Google Scholar] [CrossRef]
- Wu, H.; Wang, C.; Lu, C.; Zhan, T. HCT: A Hybrid CNN and Transformer Network for Hyperspectral Image Super-Resolution. Multimedia Systems, 2024, 30. [CrossRef]
- “Planet Team (2025). Planet Application Program Interface: In Space for Life on Earth. San Francisco, CA”. Available online: https://api.planet.com.








| Datasets | Area of Acquisition | Spatial Resolution (m) | Spectral Range (nm) | No. of spectral bands |
|---|---|---|---|---|
| HySpex (airborne HSI) | Benchmark, Rio-Tinto | 2 | 416 - 2498 | 416 |
| HyMap (airborne HSI) | Marinkas | 5 | 450 - 2480 | 125 |
| EnMAP (satellite HSI) | All sites* | 30 | 418 - 2445 | 224 |
| Sentinel-2 (satellite MSI) | All sites | 10 | 442 - 2202 | 10 |
| PlanetScope (satellite MSI) | Marinkas, Rio-Tinto | 3 | 431 - 885 | 8 |
| Methods | Dataset | PSNR↑ | SAM↓ | ERGAS↓ | Q2n↑ |
|---|---|---|---|---|---|
| Bicubic | Benchmark | 27.5781 | 7.8388 | 8.0238 | 0.5161 |
| Marinkas | 18.6866 | 16.2178 | 9.0665 | 0.4973 | |
| Rio-Tinto | 27.6162 | 19.7070 | 12.0446 | 0.4168 | |
| Average | 24.6269 | 14.5878 | 9.7116 | 0.4767 | |
| c-Hysure | Benchmark | 16.5403 | 61.1513 | 28.3078 | 0.3218 |
| Marinkas | 9.9804 | 16.1053 | 18.5097 | 0.4786 | |
| Rio-Tinto | 19.3073 | 74.2513 | 27.3184 | 0.2615 | |
| Average | 15.2760 | 50.5026 | 24.7119 | 0.3539 | |
| CNMF | Benchmark | 28.4535 | 7.3729 | 7.3467 | 0.6561 |
| Marinkas | 17.4397 | 27.8083 | 27.8083 | 0.2932 | |
| Rio-Tinto | 26.8105 | 23.1117 | 21.7775 | 0.1504 | |
| Average | 24.2345 | 19.4309 | 18.9775 | 0.3665 | |
| ResTFNet | Benchmark | 16.3690 | 18.9499 | 27.8768 | 0.5499 |
| Marinkas | 8.9582 | 12.3331 | 25.5877 | 0.3832 | |
| Rio-Tinto | 23.9273 | 18.3529 | 15.6876 | 0.3935 | |
| Average | 16.4181 | 16.5453 | 23.0507 | 0.4422 | |
| SSR-NET | Benchmark | 16.3689 | 21.8292 | 27.8770 | 0.3946 |
| Marinkas | 8.9345 | 13.5766 | 25.4453 | 0.3681 | |
| Rio-Tinto | 25.2540 | 22.1869 | 14.8889 | 0.4647 | |
| Average | 16.8524 | 19.1974 | 22.7370 | 0.4091 | |
| P2SR (proposed) | Benchmark | 28.7581 | 7.1787 | 6.9932 | 0.6670 |
| Marinkas | 19.3302 | 12.1016 | 8.0017 | 0.5151 | |
| Rio-Tinto | 27.5418 | 18.0825 | 11.7936 | 0.3649 | |
| Average | 25.2100 | 12.4542 | 8.9295 | 0.5156 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).