Towards a format-agnostic approach for production, delivery and rendering of immersive media

Niamut, OA, Kaiser, R, Kienast, G, Kochdale, A, Spille, J, Schreer, O, Ruiz Hidalgo, J, Macq, JF and Shirley, BG ORCID: 2013, Towards a format-agnostic approach for production, delivery and rendering of immersive media , in: 4th ACM Multimedia Systems Conference.

[img] PDF
Restricted to Repository staff only

Download (2MB) | Request a copy


The media industry is currently being pulled in the often-opposing directions of increased realism (high resolution, stereoscopic, large screen) and personalization (selection and control of content, availability on many devices). We investigate the feasibility of an end-to-end format-agnostic approach to support both these trends. In this paper, different aspects of a format- agnostic capture, production, delivery and rendering system are discussed. At the capture stage, the concept of layered scene representation is introduced, including panoramic video and 3D audio capture. At the analysis stage, a virtual director component is discussed that allows for automatic execution of cinematographic principles, using feature tracking and saliency detection. At the delivery stage, resolution-independent audiovisual transport mechanisms for both managed and unmanaged networks are treated. In the rendering stage, a rendering process that includes the manipulation of audiovisual content to match the connected display and loudspeaker properties is introduced. Different parts of the complete system are revisited demonstrating the requirements and the potential of this advanced concept.

Item Type: Conference or Workshop Item (Paper)
Themes: Media, Digital Technology and the Creative Economy
Schools: Schools > School of Computing, Science and Engineering > Salford Innovation Research Centre
Journal or Publication Title: MMSys '13 Proceedings of the 4th ACM Multimedia Systems Conference
Publisher: ACM Digital Library
Refereed: Yes
Related URLs:
Funders: European Union’s Seventh Framework Programme (FP7/2007-2013)
Depositing User: Dr Ben Shirley
Date Deposited: 08 Aug 2014 17:35
Last Modified: 15 Feb 2022 18:36

Actions (login required)

Edit record (repository staff only) Edit record (repository staff only)


Downloads per month over past year