A mixed reality telepresence system for collaborative space operation

Fairchild, AJ, Campion, SP, Garcia Jimenez, AS, Wolf, R, Fernando, TP ORCID: https://orcid.org/0000-0001-5321-9071 and Roberts, DJ ORCID: https://orcid.org/0000-0002-9257-433X 2017, 'A mixed reality telepresence system for collaborative space operation' , Transactions on Circuits and Systems for Video Technology, 27 (4) , pp. 814-827.

Preview

PDF - Published Version Available under License Creative Commons Attribution. Download (3MB) | Preview

Abstract

This paper presents a Mixed Reality system that results from the integration of a telepresence system and an application to improve collaborative space exploration. The system combines free viewpoint video with immersive projection technology to support non-verbal communication, including eye gaze, inter-personal distance and facial expression. Importantly, these can be interpreted together as people move around the simulation, maintaining natural social distance. The application is a simulation of Mars, within which the collaborators must come to agreement over, for example, where the Rover should land and go. The first contribution is the creation of a Mixed Reality system supporting contextualization of non-verbal communication. Tw technological contributions are prototyping a technique to subtract a person from a background that may contain physical objects and/or moving images, and a light weight texturing method for multi-view rendering which provides balance in terms of visual and temporal quality. A practical contribution is the demonstration of pragmatic approaches to sharing space between display systems of distinct levels of immersion. A research tool contribution is a system that allows comparison of conventional authored and video based reconstructed avatars, within an environment that encourages exploration and social interaction. Aspects of system quality, including the communication of facial expression and end-to-end latency are reported.

Item Type:	Article
Contributors:	O'Hare, JJ (Contributor)
Schools:	Schools > School of Health and Society > Centre for Health Sciences Research
Journal or Publication Title:	Transactions on Circuits and Systems for Video Technology
Publisher:	IEEE
ISSN:	1051-8215
Related URLs:	Publication
Funders:	EU fp7, Engineering and Physical Sciences Research Council (EPSRC)
Depositing User:	Prof David J Roberts
Date Deposited:	17 Jun 2016 13:46
Last Modified:	17 Nov 2020 09:15
URI:	http://usir.salford.ac.uk/id/eprint/39189

Actions (login required)

Edit record (repository staff only)