Immersive Communications
Virtual Reality (VR) systems are expected to become widespread in the near future, with applications not limited to entertainment but extending to e-healthcare, e-education, and many others. VR communications involve omnidirectional (i.e., 360° or spherical) videos, which acquire a 360° scene instantaneously and are a new multimedia format that provides immersive sensation. The viewer, virtually placed at the centre of the sphere, can navigate the scene with 3-Degrees of Freedom (3-DoF) by rotating the head and changing viewing direction. In order to allow the user to navigate the immersive content with comfort, this application requires extremely low latency and research effort is required to make this a commercial reality. The novel geometry of content, the high spatio-temporal resolution and low latency required, as well as the novel interactive way of consuming this media have raised new challenges over the entire end-to-end multimedia chain, including the signal acquisition, representation, processing, compression, delivery and rendering steps.
Among these challenges, our research is focused on optimising the media delivery aspect of VR content over band-limited networks and developing personalised adaptive streaming strategies for spherical content. The key novelty is to develop user-, content- and application-dependent streaming strategies.
Relevant
Publications
-
S. Rossi “Understanding user interactivity for the next-generation immersive communication: design, optimisation, and behavioural analysis” Doctoral thesis (PhD), UCL (University College London), 2022.
-
S. Rossi, A. Guedes, and L. Toni. "Streaming and user behaviour in omnidirectional videos." In Immersive Video Technologies (pp. 49-83). Academic Press. 2023
-
S. Rossi, C. Ozcinar, A. Smolic, and L. Toni “Do Users Behave Similarly in VR? Investigation of the User Influence on the System Design” ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), 2020.
-
S. Rossi and L. Toni, "Navigation-aware adaptive streaming strategies for omnidirectional video" in IEEE International Workshop on Multimedia Signal Processing (MMSP), Luton (UK), Oc- tober, 2017