Preprint Article Version 1 Preserved in Portico This version is not peer-reviewed

Semantic Information Theory: Recent Advances and Future Challenges

Version 1 : Received: 17 October 2023 / Approved: 18 October 2023 / Online: 19 October 2023 (11:49:20 CEST)
Version 2 : Received: 29 January 2024 / Approved: 29 January 2024 / Online: 30 January 2024 (03:49:44 CET)

A peer-reviewed article of this Preprint also exists.

Xin, G.; Fan, P.; Letaief, K.B. Semantic Communication: A Survey of Its Theoretical Development. Entropy 2024, 26, 102, doi:10.3390/e26020102. Xin, G.; Fan, P.; Letaief, K.B. Semantic Communication: A Survey of Its Theoretical Development. Entropy 2024, 26, 102, doi:10.3390/e26020102.

Abstract

In recent years, semantic communication has received significant attention from both academia and industry, driven by the growing demands for ultra-low latency and high-throughput capabilities in emerging intelligent services. Nonetheless, a comprehensive and effective theoretical framework for semantic communication has yet to be established. In particular, finding the fundamental limits of semantic communication, exploring the capabilities of semantic-aware networks, or utilizing theoretical guidance for deep learning in semantic communication are very important but yet still unresolved issues. In this paper, we delve into the pertinent advancements in semantic information theory. Grounded in the foundational work of Claude Shannon, we present the latest developments in semantic entropy, semantic rate distortion, and semantic channel capacity. Additionally, we will analyze some open problems in semantic information measurement and semantic coding, providing a theoretical basis for the design of a semantic communication system. Furthermore, we carefully review several mathematical theories and tools and evaluate their applicability in the context of semantic communication. Finally, we shed light on the challenges encountered in both semantic communication and semantic information theory.

Keywords

Semantic information theory; semantic communication; semantic distortion; 6G; goal-oriented communications; joint source-channel coding; deep learning; information bottleneck

Subject

Computer Science and Mathematics, Computer Networks and Communications

Comments (0)

We encourage comments and feedback from a broad range of readers. See criteria for comments and our Diversity statement.

Leave a public comment
Send a private comment to the author(s)
* All users must log in before leaving a comment
Views 0
Downloads 0
Comments 0
Metrics 0


×
Alerts
Notify me about updates to this article or when a peer-reviewed version is published.
We use cookies on our website to ensure you get the best experience.
Read more about our cookies here.