FIDAL

This use case is an XR application aiming to enhance the Public Protection and Disaster Relief capabilities at the disaster site, enabling their collaboration with indoor medical experts using AR and VR technologies. Outdoor emergency medical surgery teams will use AR Head Mounted Devices (HMDs) to register a patient 3D model on the injured person’s body and overlay deformable medical models directly on top of it. Furthermore, the first responder will perform surgical actions following step-by-step visual instructions and directly communicate with in-office medical experts who will provide real-time medical assistance virtually. Indoor medical experts will participate in a multi-user virtual scene together with the first responders, using VR HMDs to visualise the registered 3D model of the injured patient and the upper body avatar of the first responder. The computationally intensive processes of the XR pipeline are off-loaded to powerful edge resources, and the produced frames are streamed back to the HMDs, exploiting B5G networks. The XR HMD application is a thin client responsible for receiving, decoding, and displaying the streamed frames from the edge application, allowing improved mobility by prolonging the HMD’s battery life. As this use case is a real-time interactive XR application, utilising B5G networks is essential for realising such a distributed XR pipeline, as minimal latency and high bandwidth are integral to maintaining user immersion and optimal Quality of Experience.