Abstract
With significant increase in data and demand for large bandwidth, the wireless research community has identified the need to focus on ‘what’ to transmit rather than focusing on only ‘how’ to transmit. Inspired by this, in the current article a view of wireless systems based on semantic communications is put-forth. Specifically, a semantic wireless system enabled by deep learning is proposed which aims to maximize the system capacity. As opposed to evaluating only the bit/symbol errors, proposed technique is able to recover the meaning of sentences and is hence able to minimize the semantic errors. Further, transfer learning is implemented for accelerating the process of re-training. Extensive simulations to validate performance of the proposed technique demonstrate that it is able to (i) maintain enhanced robustness to variations in the channel, and (ii) achieve higher performance. Overall, the current study makes it evident that the proposed technique is a good candidate for implementation in the semantic wireless systems.
Similar content being viewed by others
Data Availability
Data sharing not applicable to this article as no datasets were generated or analysed during the current study.
Code Availability
Not applicable.
References
Patil, A., Iyer, S., López, O. L. A., Pandya, R. J., Pai, K., Kalla, A., & Kallimani, R. (2024). A comprehensive survey on spectrum sharing techniques for 5G/B5G intelligent wireless networks: opportunities, challenges and future research directions. Accepted for Publication Comput. Netw. Elsevier. Available: https://arxiv.org/abs/2211.08956
Rajatheva, N., Atzeni, I., Bicais, S., Bjornson, E., Bourdoux, A., Buzzi, S., & Xu, W. (2020). Scoring the terabit/s goal: Broadband connectivity in 6G. Available: https://arxiv.org/abs/2008.07220
Iyer, S., Patil, A., Bhairanatti, S., Halagatti, S., & Pandya, R. J. (2022). A survey on technological trends to enhance spectrum-efficiency in 6G communications. Transactions of the Indian National Academy of Engineering, 7(4), 1093–1120.
Uwaechia, A. N., & Mahyuddin, N. M. (2020). A comprehensive survey on millimeter wave communications for fifth-generation wireless networks: feasibility and challenges. IEEE Access, 8, 62367–62414.
Tekbıyık, K., Ekti, A. R., Kurt, G. K., & Görçin, A. (2019). Terahertz band communication systems: Challenges, novelties and standardization efforts. Physical Communication, 35, 100700.
Shannon, C. E. (1948). A mathematical theory of communication. Bell System Technical Journal, 27, 379–423.
Shannon, C. E., & Weaver, W. (1949). The mathematical theory of communication. Champaign: The University of Illinois Press.
Carnap, R. et al (1952). An outline of a theory of semantic information. Research Laboratory Electronics Massachusetts Institution Technology. RLE Technique Report 247. Cambridge MA.
Bao, J. et al. (2011). Towards a theory of semantic communication. In Proceedings IEEE network science workshop (pp. 110–117). NY.
Juang, B. H. (2011). Quantification and transmission of information and intelligence-history and outlook [DSP history]. IEEE Signal Processing Magazine, 28(4), 90–101.
Park, S., Simeone, O. & Kang, J (2020). End-to-End fast training of communication links without a channel model via online meta-learning. In Proceedings IEEE 21st International workshop on signal processing advances in wireless communications (SPAWC), (pp. 1–5). Atlanta, USA.
Ye, H., Liang, L., Li, G. Y., & Juang, B. (2020). Deep learning based end-to end wireless communication systems with conditional GAN as unknown channel. IEEE Transactions on Wireless Communications, 19(5), 3133–3143.
Bourtsoulatze, E., Kurka, D. B., & Gündüz, D. (2019). Deep joint source-channel coding for wireless image transmission. IEEE Transactions Cognitive Communication. Network, 5(3), 567–579.
Xu, J., Tung, T. Y., Ai, B., Chen, W., Sun, Y., & Gündüz, D. D. (2023). Deep joint source-channel coding for semantic communications. Available: https://arxiv.org/pdf/2211.08747.pdf
Dai, J., Zhang, P., Niu, K., Wang, S., Si, Z., & Qin, X. (2022). Communication beyond transmitting bits: Semantics-guided source and channel coding. Available: https://arxiv.org/pdf/2112.03093.pdf
Erdemir, E., Tung, T. Y., Dragotti, P. L., & Gündüz, D. (2023). Generative joint source-channel coding for semantic image transmission. Available: https://arxiv.org/pdf/2211.13772.pdf
Zhang, P., Xu, W., Gao, H., Niu, K., Xu, X., Qin, X., Yuan, C., Qin, Z., Zhao, H., Wei, J., & Zhang, F. (2021). Toward wisdom-evolutionary and primitive-concise 6G: A new paradigm of semantic communication networks. Engineering, 8, 60.
Dai, J., et al. (2022). Nonlinear transform source-channel coding for semantic communications. IEEE Journal on Selected Areas in Communications, 40(8), 2300–2316.
Dommel, J., Utkovski, Z., Simeone, O., & Stanczak, S. (2021). Joint source-channel coding for semantics-aware grant-free radio access in IoT fog networks. IEEE Signal Processing Letters, 28, 728–732.
Zhou, Q., Li, R., Zhao, Z., Xiao, Y., & Zhang, H. (2022). Adaptive bit rate control in semantic communication with incremental knowledge-based HARQ. IEEE Open Journal of the Communications Society, 3, 1076–1089.
Shi, G., Xiao, Y., Li, Y., Gao, D., & Xie, X. (2021). Semantic communication networking for the intelligence of everything. Chinese Journal on Internet of Things, 5(2), 26–36.
Shi, G., Xiao, Y., Li, Y., & Xie, X. (2021). From semantic communication to semantic-aware networking: model, architecture, and open problems. IEEE Communications Magazine, 59, 44–50.
Lan, Q., Wen, D., Zhang, Z., Zeng, Q., Chen, X., Popovski, P., & Huang, K. (2021). What is semantic communication? A view on conveying meaning in the era of machine intelligence. Journal of Communications and Information Networks, 6(4), 336–371.
Popovski, P., Simeone, O., Boccardi, F., Gunduz, D., & Sahin, O. (2020). Semantic effectiveness filtering and control for post-5G wireless connectivity. Journal of the Indian Institute of Science, 100, 435–443.
Iyer, S., et al. (2022). A survey on semantic communications for intelligent wireless networks. Wireless Personal Communications, 129, 569.
Farsad, N., Rao, M., & Goldsmith, A. (2018). Deep learning for joint source-channel coding of text. In 2018 IEEE International conference on acoustics, speech and signal processing (ICASSP) (pp. 2326–2330). Canada
Xie, H., Qin, Z., Li, G. Y., & Juang, B.-H. (2021). Deep learning enabled semantic communication systems. IEEE Transactions on Signal Processing, 69, 2663–2675.
Russell, S. J., & Norvig, P. (2020). Artificial intelligence-a modern approach (4th ed.). UK: Pearson.
Bao, J., Basu, P., Dean, M., Partridge, C., Swami, A., Leland, W., & Hendler, J. A. (2011). Towards a theory of semantic communication. In Proceedings IEEE Network Science Workshop, (pp. 110–1170).
Basu, P., Bao, J., Dean, M., & Hendler, J. (2014). Preserving quality of information by using semantic relationships. Pervasive and Mobile Computing, 11, 188–202.
Cheng, P., Hao, W., Dai, S., Liu, J., Gan, Z., & Carin, L. (2020). Club: A contrastive log-ratio upper bound of mutual information. Available: http://proceedings.mlr.press/v119/cheng20b/cheng20b.pdf
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., ... & Polosukhin, I. (2017). In Proceedings Advances in Neural Information Processing System. (pp. 5998–6008). CA, USA.
Belmega, E. V., Mertikopoulos, P., & Negrel, R. (2022). Online convex optimization in wireless networks and beyond: The feedback-performance trade-off. In: Proceedings RAWNET 2022-International workshop on resource allocation and cooperation in wireless networks (pp.1–8). Turin, Italy.
Krishna Rohit, S. V., & Singh, N. (2018). Analysis of speeches in Indian parliamentary debates. Available: https://arxiv.org/pdf/1808.06834.pdf
Heegard, C., & Wicker, S. B. (2013). Turbo coding. Germany: Springer Science & Business Media.
Reed, I. S., & Solomon, G. (1960). Polynomial codes over certain finite fields. Journal of the Society for Industrial and Applied Math, 8(2), 300–304.
Funding
The author declares that no funds, grants, or other support were received during the preparation of this manuscript.
Author information
Authors and Affiliations
Contributions
Author contributed to the study conception and design, and has read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The author has no conflict of interests to disclose.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Iyer, S. Transfer Learning Model for Joint Semantic and Channel Coding/Decoding in Wireless Systems. Wireless Pers Commun 138, 475–495 (2024). https://doi.org/10.1007/s11277-024-11517-1
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11277-024-11517-1