Creating and sharing knowledge for telecommunications

Cooperative Augmented Reality: Displaying Occluded Vehicles using V2X Communications

Clérigo, A. C. ; Silva, G. ; Schrapel, M. ; Rito, P. ; Sargento, S. ; Vinel, A. V.

Cooperative Augmented Reality: Displaying Occluded Vehicles using V2X Communications, Proc IEEE Vehicular Networking Conference VNC, Porto, Portugal, Vol. , pp. - , June, 2025.

Digital Object Identifier:

Download Full text PDF ( 6 MBs)

 

Abstract
As urban mobility increasingly integrates micromobility solutions such as bicycles, innovative road safety solutions have become a priority for these Vulnerable Road Users (VRUs). This work explores the use of Augmented Reality (AR) and Vehicle-to-Everything (V2X) communications to enhance cyclist safety at intersections with obstructed visibility. We propose an AR-based system that enables cyclists to visualize occluded vehicles using an ‘X-ray’ vision effect, leveraging real-time V2X messages and edge computing for low-latency interaction. The system architecture integrates multiple communication technologies, including 5G and ITS-G5, ensuring reliable transmission of road user data. To evaluate the system’s feasibility, we conducted a real-world demonstration in the Aveiro Tech City Living Lab (ATCLL) platform using a Microsoft HoloLens 2 AR headset and an NVIDIA Jetson-based object detection pipeline. The system was tested in a real environment and results show that: (1) response time for rendering virtual vehicles in the AR headset falls within the 300 ms safety threshold defined by ETSI; (2) object detection by the headset’s video camera (which verifies that the user is in line of sight with the object and no longer requires assistance) operates on 3.34 FPS; and (3) increasing the video cameras’s frame rate does not significantly affect resource and power consumption.