Journal of Soft Computing and Information Technology

Journal of Soft Computing and Information Technology

AoI-based Performance Optimization in RIS-Assisted mmWave Communications

Document Type : Persian Original Article

Authors
Marzieh Sheikhi 1
Somayeh Asadi 1
Vesal Hakami 2
1 School of Computer Engineering, Iran University of Science and Technology, Tehran, Iran.
2 Center of Excellence in Future Networks, School of Computer Engineering, Iran University of Science and Technology, Tehran, Iran.
Abstract
With the advent of the next generation of wireless communication networks, the requirements for high-rate and timely information delivery, especially in real-time applications, have increased dramatically. In particular, Millimeter wave (mmWave) communications can provide a high data rate, and reconfigurable intelligent surfaces (RISs) can reduce the blockage sensitivity of mmWave links. Also, to quantify the data freshness, the age of information (AoI) metric is introduced in the recent literature, defined as the time elapsed since the last successfully received status update was generated. This paper aims to optimize the average AoI in a multi-user RIS-assisted millimeter wave network. For this purpose, the proposed problem was formulated as a Markov decision process (MDP) that aims to obtain the optimal control policy that minimizes the sum of the average AoI of all users. Under the unknown system statistics assumption, we propose a model-free deep reinforcement learning algorithm to schedule the users’ transmission, adjust the transmit power, and configure the RIS to reflect the signals.  The performance of the proposed method is evaluated in terms of convergence characteristics and the impact of changes in network parameters.
Keywords
Age of Information
Reconfigurable Intelligent Surface
Millimeter Wave
Model-free Deep Reinforcement Learning
[1] R. D. Yates, Y. Sun, D. R. Brown, S. K. Kaul, E. Modiano, and S. Ulukus, “Age of information: An introduction and survey,” IEEE Journal on Selected Areas in Communications, vol.39, no.5, pp.1183–1210, 2021.
[2] S. Kaul, R. Yates, and M. Gruteser, “Real-time status: How often should one update?” in 2012 Proceedings IEEE INFOCOM, pp.2731–2735, IEEE, 2012.
[3] A. Kosta, N. Pappas, V. Angelakis, et al., “Age of information: A new concept, metric, and tool,” Foundations and Trends® in Networking, vol.12, no.3, pp.162–259, 2017.
[4] M. N. Soorki, W. Saad, M. Bennis, and C. S. Hong, “Ultra-reliable indoor millimeter wave communications using multiple artificial intelligence-powered intelligent surfaces,” IEEE Transactions on Communications, vol.69, no.11, pp.7444–7457, 2021.
[5] A. Muhammad, M. Elhattab, M. A. Arfaoui, A. Al-Hilo, and C. Assi, “Age of information optimization in a ris-assisted wireless network,” arXiv preprint arXiv:2103.06405, 2021.
[6] S. Gong, X. Lu, D. T. Hoang, D. Niyato, L. Shu, D. I. Kim, and Y.-C. Liang, “Toward smart wireless communications via intelligent reflecting surfaces: A contemporary survey,” IEEE Communications Surveys Tutorials, vol.22, no.4, pp.2283–2314, 2020.
[7] M. Di Renzo, A. Zappone, M. Debbah, M.-S. Alouini, C. Yuen, J. de Rosny, and S. Tretyakov, “Smart radio environments empowered by reconfigurable intelligent surfaces: How it works, state of research, and the road ahead,” IEEE Journal on Selected Areas in Communications, vol.38, no.11, pp.2450–2525, 2020.
[8] A. Mandal, R. Bhattacharjee, and A. Sinha, “Optimizing age-of-information in adversarial environments with channel state information,” in 2022 14th International Conference on COMmunication Systems & NETworkS (COMSNETS), pp.522530, IEEE, 2022.
[9] A. Muhammad, M. Elhattab, M. Shokry, and C. Assi, “Leveraging reconfigurable intelligent surface to minimize age of information in wireless networks,” in ICC 2022-IEEE International Conference on Communications, pp.2525–2530, IEEE, 2022.
[10] D. Sinha and R. Roy, “Optimal scheduling for maximizing information freshness and system performance in industrial cyber–physical systems,” Computer communications, vol.169, pp.33–47, 2021.
[11] M. P. Abdollahi, H. Azarhava, A. Haghrah, and J. M. Niya, “On the rate and age of information for non-preemptive systems with prioritized arrivals and deterministic packet deadlines in iot networks,” Ad Hoc Networks, vol.124, p.102717, 2022.
[12] Q. Zhang, X. Wang, Z. Li, and Z. Wei, “Design and performance evaluation of joint sensing and communication integrated system for 5g mmwave enabled cavs,” IEEE Journal of Selected Topics in Signal Processing, vol.15, no.6, pp.1500–1514, 2021.
[13] S. Gong, L. Cui, B. Gu, B. Lyu, D. T. Hoang, and D. Niyato, “Hierarchical deep reinforcement learning for age-of-information minimization in irs-aided and wireless-powered wireless networks,” IEEE Transactions on Wireless Communications, 2023.
[14] M. Sherman, S. Shao, X. Sun, and J. Zheng, “Optimizing aoi in uav-ris assisted iot networks: Off policy vs. on policy,” IEEE Internet of Things Journal, 2023.
[15] Q. Wu and R. Zhang, “Intelligent reflecting surface enhanced wireless network via joint active and passive beamforming,” IEEE transactions on wireless communications, vol.18, no.11, pp.53945409, 2019.
[16] C. Huang, A. Zappone, G. C. Alexandropoulos, M. Debbah, and C. Yuen, “Reconfigurable intelligent surfaces for energy efficiency in wireless communication,” IEEE transactions on wireless communications, vol.18, no.8, pp.4157–4170, 2019.
[17] T. Bai, C. Pan, Y. Deng, M. Elkashlan, A. Nallanathan, and L. Hanzo, “Latency minimization for intelligent reflecting surface aided mobile edge computing,” IEEE Journal on Selected Areas in Communications, vol.38, no.11, pp.2666–2682, 2020.
[18] M. Cui, G. Zhang, and R. Zhang, “Secure wireless communication via intelligent reflecting surface,” IEEE Wireless Communications Letters, vol.8, no.5, pp.1410–1414, 2019.
[19] M. R. Akdeniz, Y. Liu, M. K. Samimi, S. Sun, S. Rangan, T. S. Rappaport, and E. Erkip, “Millimeter wave channel modeling and cellular capacity evaluation,” IEEE journal on selected areas in communications, vol.32, no.6, pp.1164–1179, 2014.
[20] Z. Lin, T. Lv, and P. T. Mathiopoulos, “3-d indoor positioning for millimeter-wave massive mimo systems,” IEEE Transactions on Communications, vol.66, no.6, pp.2472–2486, 2018.
[21] T. P. Lillicrap, J. J. Hunt, A. Pritzel, N. Heess, T. Erez, Y. Tassa, D. Silver, and D. Wierstra, “Continuous control with deep reinforcement learning,” arXiv preprint arXiv:1509.02971, 2015.
[22] S. Ioffe and C. Szegedy, “Batch normalization: Accelerating deep network training by reducing internal covariate shift,” in International conference on machine learning, pp.448–456, pmlr, 2015.
[23] Y. Cao, T. Lv, Z. Lin, and W. Ni, “Delay-constrained joint power control, user detection and passive beamforming in intelligent reflecting surface-assisted uplink mmwave system,” IEEE Transactions on Cognitive Communications and Networking, vol.7, no.2, pp.482–495, 2021.
[24] ETSI. TR 121 915 - V15.0.0 - digital cellular telecommunications - ETSI. 3GPP, 2019.
[25] X. Yu, G. Wang, X. Huang, K. Wang, W. Xu, and Y. Rui, “Energy efficient resource allocation for uplink ris-aided millimeter-wave networks with noma,” IEEE Transactions on Mobile Computing, 2022.
[26] H. Guo, Y.-C. Liang, J. Chen, and E. G. Larsson, “Weighted sum-rate maximization for intelligent reflecting surface enhanced wireless networks,” in 2019 IEEE Global Communications Conference (GLOBECOM), pp.1–6, IEEE, 2019.
[27] I. A. Hemadeh, K. Satyanarayana, M. El-Hajjar, and L. Hanzo, “Millimeter-wave communications: Physical channel models, design considerations, antenna constructions, and link-budget,” IEEE Communications Surveys & Tutorials, vol.20, no.2, pp.870–913, 2017.
[28] P. Wang, J. Fang, X. Yuan, Z. Chen, and H. Li, “Intelligent reflecting surface-assisted millimeter wave communications: Joint active and passive precoding design,” IEEE Transactions on Vehicular Technology, vol.69, no.12, pp.14960–14973, 2020.
[29] G. Zhou, C. Pan, H. Ren, K. Wang, M. Di Renzo, and A. Nallanathan, “Robust beamforming design for intelligent reflecting surface aided miso communication systems,” IEEE Wireless Communications Letters, vol.9, no.10, pp.1658–1662, 2020.
[30] C. Jia, J. Cheng, H. Gao, and W. Xu, “High-resolution channel estimation for intelligent reflecting surface-assisted mmwave communications,” in 2020 IEEE 31st Annual International Symposium on Personal, Indoor and Mobile Radio Communications, pp.1–6, IEEE, 2020.
[31] F. O. Catak, U. Cali, M. Kuzlu, and S. Sarp, “Uncertainty aware deep learning model for secure and trustworthy channel estimation in 5g networks,” in 2023 12th Mediterranean Conference on Embedded Computing (MECO), pp.1–4, IEEE, 2023.
Journal of Soft Computing and Information Technology
Volume 13, Issue 1
Spring - May
Spring 2024
Pages 25-38