1. Introduction

As the demand for comprehensive digitization and intelligence continues to grow, multi-modal services that integrate audio, visual, and haptic elements have emerged [1, 2]. The International Telecommunication Union (ITU) Network 2030 Focus Group has identified these services as killer applications for the B5G and 6G era due to their ability to enhance immersive experiences in scenarios such as industrial manufacturing, rehabilitation medicine, and intelligent education. Cisco’s white paper on future network trends projects a 100-fold increase in global mobile data traffic by 2030, with 81% attributed to multi-modal services [3]. The rapid growth of multi-modal services has led to a massive increase in multi-modal data, including audio, visual, and haptic signals, posing significant challenges to current multimedia communication systems. In the IMT-2030 (6G) white paper published by the China Academy of Information and Communications Technology, it is highlighted that for fully immersive real-time interaction, transmission delay must be under 1ms, data rate should be over 10Gbps, and reliability should reach 99.99999% [4]. However, existing 5G-based systems have 20ms end-to-end delay and a packet loss rate of around \(10^{-5}\) with high deployment costs. Therefore, communication technology should be re-designed to fulfill the increase in multi-modal data volume and the requirements of humans’ immersive experiences.