INFORMATION ABOUT PROJECT,
SUPPORTED BY RUSSIAN SCIENCE FOUNDATION

The information is prepared on the basis of data from the information-analytical system RSF, informative part is represented in the author's edition. All rights belong to the authors, the use or reprinting of materials is permitted only with the prior consent of the authors.

 

COMMON PART


Project Number21-79-10431

Project titleCross-layer networking methods to improve the quality of service for augmented and virtual reality traffic

Project LeadBankov Dmitry

AffiliationInstitute for Information Transmission Problems of the Russian Academy of Sciences (Kharkevich Institute),

Implementation period 07.2021 - 06.2024 

Research area 09 - ENGINEERING SCIENCES, 09-706 - Radio- and television systems, radiolocation and communications

KeywordsWireless networks, 5G systems, Quality of Service (QoS), Augmented Reality (AR), Virtual Reality (VR), cross-layer, traffic classification, analytical modeling, simulations


 

PROJECT CONTENT


Annotation
Communication networks are currently the infrastructure basis for the development of the digital economy. They have obtained high importance during the pandemic by enabling remote work, education, medical care, and many other services. Wireless technologies are the key part of the telecommunications infrastructure, thanks to which we can cheaply and quickly connect many users and autonomous devices. Thanks to wireless networks, we can access the Internet anywhere and anytime; we have smartphones and can use social networks, online navigators, mobile banking, and many other applications. The development of novel wireless technologies is driven by the necessity of providing service for new traffic types that impose very strict requirements for data rate, transmission delay and reliability. For example, we expect significant development of virtual and augmented reality (AR/VR) applications and digital twins soon. They will be widely used in industry automation, education, medicine (including telemedicine), entertainment and marketing. It is expected that AR/VR applications and virtual twins will allow working remotely for almost all kinds of specialists. Interactive VR applications impose unprecedentedly strict requirements to networks. To provide high quality of experience for AR/VR users, networks shall provide transmission of large amounts of data with very low delays and packet losses. Moreover, to provide full immersion, the AR/VR devices shall transmit data via wireless technologies. The widespread deployment of AR/VR technologies will change the traffic structure, channel resource distribution,information in communication networks, and network access requirements. Research and development of the efficient methods for AR/VR quality of service provisioning require precise AR/VR traffic generation models as well as models of AR/VR users quality of experience and the influence of the traffic service policy on it. However, currently there are no appropriate models for that. Hence, there is a need to study AR/VR traffic properties and develop novel algorithms that consider these properties ensuring high quality of service for AR/VR traffic in future wireless networks. In current and future networks, the AR/VR traffic will share resources with other types of traffic that can have either higher (i.e., industry automation and telemedicine) or lower service priority (i.e., web or video-on-demand traffic). Since the AR/VR traffic impose strict data rate, delay and reliability requirements, we cannot use channel resource management methods developed for the types of traffic that are common currently. Hence, future networks require the development of flexible cross-layer radio resource management methods that consider the peculiarities of the heterogeneous traffic. So, the novelty of the problems considered in this project is justified by the novelty of the considered object itself as well as the need to develop efficient algorithms that can be executed in real time on various network devices to solve the stated problems of AR/VR quality of service improvement, which are multiobjective optimization problems and usually are NP-complete.

Expected results
In this project, we will develop novel solutions that will allow increasing the AR/VR traffic quality of service via cross-layer methods for wireless local networks and next generation cellular networks. The developed solutions will be analyzed with simulations in various scenarios, including scenarios with other types of traffic with fundamentally different quality of service requirements. In particular, we will develop: - a model of traffic generated by AR/VR applications; - an adaptation logic algorithm that adaptively changes quality of video generated by AR/VR applications; - radio resource management algorithms that allow improving AR/VR applications quality of service by multiplexing of data flows generated by different users with MU-MIMO technology; - a classification algorithm for ciphered traffic to provide differentiated service of heterogeneous traffic; - radio resource management and traffic generation parameters selection algorithms for AR/VR at the application that allow improving AR/VR applications quality of service in scenarios with other types of traffic by using cross-layer methods; - a method for estimating the amount of channel resources required to satisfy the AR/VR quality of service requirements in scenarios with other types of traffic by using the information provided by the classification algorithm and cross-layer methods. The results of the project will be of great practical value since they will allow significantly improving the efficiency of existing and future wireless networks, and to extend their application area to novel scenarios. We expect that enabling effective support of AR/VR applications in future networks will contribute to digital economics development, including various areas, such as industry automation, logistics, telemedicine, remote work, education and public services provisioning. The significance of the obtained results for the global science will be confirmed by publications in proceedings of prestigious international conferences and leading journals in the field of telecommunications. In this project, we plan to prepare at least 20 publications, out of which 14 will be published in high-ranking journals indexed by Web of Science/Scopus (mainly in Q1 journals). In addition to publishing the project results in journals and preparing patents, we are going to present a part of the project results in international committees for the standardization of modern wireless technologies. Thus, the project results will have an impact not only on world science in the field of wireless communications but also in the development of future wireless communication technologies.


 

REPORTS


Annotation of the results obtained in 2021
The goal of this project is to develop new cross-layer algorithms and methods for improving the quality of service for augmented and virtual reality (AR/VR) application traffic. In the first year of the project, AR/VR application models and algorithms were developed to identify AR/VR application network traffic flows and improve their quality of service. In particular, the following results were obtained. The traffic of virtual reality applications has been studied and a simulation model of a VR application has been developed, which allows generating traffic for the transmission of streams with specified properties (stream duration, video resolution, parameters of the video encoding algorithm used) in the NS-3 simulation environment. Using the developed model, it was demonstrated that by changing the parameters of the video encoding algorithm, it is possible to significantly reduce quality of service requirements of VR streams and increase the capacity of the wireless network up to two times compared to the parameters used in actual VR applications. The team has developed an algorithm for the automatic collection and labeling of traces of network traffic flows. We used the developed algorithm to collect and label a database of encrypted traffic of various types of data. We have shown that traffic encrypted using modern versions of the Transport Layer Security (TLS) protocol can be accurately classified by the public SNI (Server Name Indication) field of the first TLS message containing the domain name of the server generating the flow. It is expected that SNI field will be encrypted in future versions of the TLS protocol because it reveals sensitive information about the connection. The team has developed an algorithm for encrypted traffic classification in the scenario with hidden SNI field. The algorithm predicts traffic class based on metadata that will not be protected in future versions of the TLS protocol, e.g., cipher suites and key length. It is shown that the proposed algorithm has a 5 times lower error rate and is 3 times faster than state-of-the-art solutions. To meet the high quality of service requirements for AR/VR traffic it is planned to use 5G cellular networks with base stations operating in significantly different frequency bands using the Multi-Connectivity feature. The team analyzed existing traffic balancing algorithms for cellular networks and, using simulation, shown that considered algorithms cannot satisfy the strict requirements for the quality of service of AR/VR traffic without excessive consumption of channel resources. The team developed a new algorithm that explicitly takes into account the quality of service requirements of AR/VR traffic and minimizes the share of consumed channel resources. Developed algorithm provides a 2-fold increase in the network capacity and reduces the use of low-frequency channel resources 10 times compared to existing traffic balancing algorithms. Deployment of the developed solutions will improve the quality of service for AR/VR applications and reduce the consumption of channel resources by this type of traffic. Thus, it is possible both to improve the quality of experience of AR/VR users, and the network capacity. In the first year of the project 7 publications were published, out of which three papers are indexed by the WoS/Scopus databases.

 

Publications

1. Korneev E.S., Liubogoschev M.V., Khorov E.M. Исследование трафика облачных приложений виртуальной реальности Информационные процессы/Journal of Communications Technology and Electronics, Том 22, № 2, стр. 100-109 (year - 2022) https://doi.org/10.53921/18195822_2022_22_2_42

2. Kurapov A.A., Shamsimukhametov D.R., Liubogoschev M.V. Разработка алгоритма классификации шифрованного трафика в сценарии расширенной безопасности Сборник трудов 45-й междисциплинарной школы-конференции ИППИ РАН, Информационные технологии и системы. Москва 2021, с.1-12 (year - 2021) https://doi.org/10.53921/itas2021_100

3. Shamsimukhametov D.R., Liubogoschev M.V., Khorov E.M., Akyldiz I.F. Are Neural Networks the Best Way for Encrypted Traffic Classification 2021 International Conference Engineering and Telecommunication (En&T), с. 1-5 (year - 2021) https://doi.org/10.1109/EnT50460.2021.9681767

4. Susloparov M.V., Krasilov A.N., Khorov E.M. Providing High Capacity for AR/VR Traffic in 5G Systems With Multi-Connectivity In Proc. of IEEE Blackseacom 2022, 6-9 June 2022, C. 385-390 (year - 2022) https://doi.org/10.1109/BlackSeaCom54372.2022.9858230

5. Liubogoschev M.V. Cross-layer Cooperation for Better Network Service Measuring Network Quality for End-Users, An Internet Architecture Board virtual workshop, с. 1-2 (year - 2021)

6. Shamsimukhametov D.R., Kurapov A.A., Liubogoschev M.V. Разработка алгоритма классификации трафика по данным, содержащимся в обмене ключами шифрования для будущих версий TLS Труды 64-й Всероссийской научной конференции МФТИ. Радиотехника и компьютерные технологии / МФТИ - Москва, 2021, с. 1-1 (year - 2021)

7. Zudin D.E, Liubogoschev M.V. Распределение радиоресурсов в беспроводных сетях с поддержкой технологии виртуализации ресурсов при обслуживании гетерогенного трафика Труды 64-й Всероссийской научной конференции МФТИ, Москва 2021, с. 1-2 (year - 2021)


Annotation of the results obtained in 2022
An important feature of wireless data transmission technologies is that the user’s movements cause changes in the state of the wireless channel and, as a consequence, in the network bandwidth. Thus to provide the highest quality virtual reality experience for users, cloud-based AR/VR applications must adapt the bitrate of video streams to varying network bandwidth. In the Project, we extended the cloud VR application simulation model developed in the previous phase of the project. We added new features, such as feedback latency, encoding, and playback pipelines, and asynchronous adaptive bitrate selection. The new VR QoS model takes into account the VR update delays between the user motion capture to the VR frame display, as well as the encoding and decoding delays affecting the VR frame generation time. Using the developed model, we investigated the influence of the playback buffer depth on the effective capacity of the WLANs for VR traffic. Furthermore, we developed a method for selecting the optimal buffer depth to satisfy the VR update delay requirements and maximize the capacity network. Numerical results showed that the optimal depth buffer allows up to two times higher effective network capacity compared to a system without a buffer. In addition, we used the developed model to study the performance of the known from the literature VR video bitrate selection algorithms in wireless local area networks. It was shown that the existing algorithms have significant potential to improve the quality of service and the effective capacity of wireless networks for virtual reality traffic. As part of the work on the Project, we developed an architecture for DeSlice virtualization of wireless channel resources of 5G networks (RAN slicing). The developed architecture decomposes the wireless channel resource allocation problem into long-term and short-term problems within and between subnets. This approach provides high quality of service (QoS) for different types of traffic, increases resource utilization efficiency and spectral efficiency, reduces computing load on network devices, and guarantees isolation between operators of virtual subnets. Further, the DeSlice wireless resource virtualization architecture was adapted for use in the 5G networks with MU-MIMO technology. We have developed a method for estimating the amount of resources sufficient to meet the QoS requirements for VR traffic and algorithms to ensure the allocation of a given share of resources to VR streams. The results of simulations have shown that the proposed solution based on the DeSlice architecture can increase the capacity of 5G MU-MIMO systems for VR cloud applications traffic by up to 50% and simultaneously provide at least a 25% increase in the download speed of web pages over the entire considered range of network load. Different traffic categories (video traffic, audio traffic, telephony) require different packet delays, packet loss, and jitter. The provisioning of characteristics needed for a specific traffic category is called Quality of Service (QoS) provisioning. QoS provisioning requires classifying traffic categories first. However, the traffic classification problem became more complicated with the release of the new cryptographic protocol TLS Encrypted ClientHello (ECH). The protocol significantly increases confidentiality and does not transmit in plaintext any parameters that allow accurately classifying traffic categories. As part of the work on the Project, we developed two classification algorithms working in ECH scenarios. The first one is a hybrid algorithm based on the analysis of unencrypted payload and statistical flow data (packet lengths and packet time intervals). It decreases the classification error rate by 11 times compared to algorithms based on payload analysis. The second one considers the correlation between the flows. This algorithm is 1.5 times more effective than the hybrid algorithm in terms of classification error rate. All the results were achieved on the dataset remotely collected in five countries (Germany, Russia, the USA, Spain, and Turkey). The dataset consists of 600 000 download traces of 5 traffic categories: uplink video streaming traffic, buffered video traffic, buffered audio traffic, short buffered traffic, and web traffic. We also developed a cloud traffic classification platform for QoS provisioning. The platform is based on the classifier trained on the collected dataset. With a set of experiments, we showed that the platform increases the mean YouTube bitrate by two times through accurate classification and the use of the proper traffic policy. To improve the quality of service (QoS) of augmented and virtual reality (AR/VR) traffic in the fifth-generation cellular systems (5G), network operators may enable the Multi-Connectivity feature which allows to simultaneously connect a user equipment (UE) to several base stations operating in low-frequency and millimeter-wave frequency bands. In addition to Dual Connectivity where a UE connects to a single millimeter-wave base station, the scenario of connecting a UE to two millimeter-wave base stations simultaneously was considered. The team studied various algorithms for traffic balancing and link management in terms of achieved network capacity and channel resource consumption. As shown in numerical results, the Multi-Connectivity feature allows us to meet the strict QoS requirements of AR/VR traffic and reduce the usage of channel resources. However, the increase in network capacity in the case of Multi-Connectivity is marginal. Therefore, taking into account the increase in cost and power consumption of the mobile device due to support for additional connection, it is preferable to use the Dual Connectivity feature with correctly selected traffic balancing and link management algorithms.

 

Publications

1. Borisov I.S., Kurapov A.A., Shamsimukhametov D.R. Классификация зашифрованного с помощью протокола QUIC трафика с модификацией ESNI Сборник трудов 46-й междисциплинарной школы-конференции ИППИ РАН "Информационные технологии и системы" (ИТиС), Сборник трудов 46-й междисциплинарной школы-конференции ИППИ РАН "Информационные технологии и системы" (ИТиС), 2022, С. 465-480 (year - 2022) https://doi.org/10.53921/itas2022_466

2. Kurapov A.A., Shamsimukhametov D.R., Liubogoshchev M.V. Прототип облачного классификатора трафика для повышения качества обслуживания Сборник трудов школы-конференции "Информационные технологии и системы" (ИТиС 2022), Сборник трудов 46-й междисциплинарной школы-конференции ИППИ РАН "Информационные технологии и системы" (ИТиС), 2022, С. 444-454 (year - 2022) https://doi.org/10.53921/itas2022_444

3. Liubogoshchev M.V., Zudin D.E., Krasilov A.N., Krotov A.V., Khorov E.M. DeSlice: An Architecture for QoE-Aware and Isolated RAN Slicing Sensors, Liubogoshchev M., Zudin D., Krasilov A., Krotov A., Khorov E. DeSlice: An Architecture for QoE-Aware and Isolated RAN Slicing. Sensors. 2023; 23(9):4351 (year - 2023) https://doi.org/10.3390/s23094351

4. Shamsimukhametov D.R., Kurapov A.A., Liubogoshchev M.V., Khorov E.M. Неразличимость трафика по открытым параметрам TLS при использовании Encrypted ClientHello Информационные процессы/Journal of Communications Technology and Electronics, Том 23, № 2, 2023, стр. 231–240 (year - 2023) https://doi.org/10.53921/18195822_2023_23_2_231

5. Shamsimukhametov D.R., Kurapov A.A., Liubogoshchev M.V., Khorov E.M. Is Encrypted ClientHello a challenge for Traffic Classification? IEEE Access, D. Shamsimukhametov, A. Kurapov, M. Liubogoshchev and E. Khorov, "Is Encrypted ClientHello a Challenge for Traffic Classification?," in IEEE Access, vol. 10, pp. 77883-77897, 2022 (year - 2022) https://doi.org/10.1109/ACCESS.2022.3191431

6. Susloparov M.V., Krasilov A.N., Khorov E.M. Исследование алгоритмов балансировки AR/VR-трафика в сетях 5G с функцией множественного подключения Сборник трудов 46-й междисциплинарной школы-конференции ИППИ РАН "Информационные технологии и системы" (ИТиС) (2022 г.), Сборник трудов 46-й междисциплинарной школы-конференции ИППИ РАН "Информационные технологии и системы" (ИТиС), 2022, С. 628-645 (year - 2022) https://doi.org/10.53921/itas2022_629

7. Zudin D.E., Liubogoshchev M.V., Khorov E.M. Эффективная виртуализация сетевых ресурсов в системах MU-MIMO Информационные процессы/Journal of Communications Technology and Electronics, Том 23, № 2, 2023, стр. 241–249 (year - 2023) https://doi.org/10.53921/18195822_2023_23_2_241