Oldfield, RG, Walley, MSS, Shirley, BG ORCID: https://orcid.org/0000-0001-9634-4489 and Williams, DL
2022,
'Cloud-based AI for automatic audio production for personalized immersive XR experiences'
, SMPTE Motion Imaging Journal, 131 (7)
, pp. 6-16.
![]() |
PDF
- Submitted Version
Restricted to Repository staff only Download (3MB) | Request a copy |
![]() |
PDF
- Accepted Version
Restricted to Repository staff only Download (3MB) | Request a copy |
Abstract
In this article, we focus on the machine-learning approach developed for automatic audio source recognition and mixing for the U.K. Government Department of Culture Media and Sport (DCMS) funded collaborative project called 5G Edge-XR. Leveraging graphics processing unit (GPU) acceleration, we deployed innovative algorithms in the cloud so that content can be automatically mixed on-the-fly for a personalized, immersive, and interactive experience for audiences. We describe the algorithms involved, the system architecture, how it has been implemented for immersive live boxing, and also how we are using it to enhance a live in-stadium experience.
Item Type: | Article |
---|---|
Schools: | Schools > School of Computing, Science and Engineering > Salford Innovation Research Centre |
Journal or Publication Title: | SMPTE Motion Imaging Journal |
Publisher: | IEEE |
ISSN: | 1545-0279 |
Funders: | Department of Culture Media and Sport |
Depositing User: | Dr Ben Shirley |
Date Deposited: | 28 Sep 2022 09:35 |
Last Modified: | 28 Sep 2022 09:35 |
URI: | https://usir.salford.ac.uk/id/eprint/64546 |
Actions (login required)
![]() |
Edit record (repository staff only) |