With you – an experimental end-to-end telepresence system using video-based reconstruction

Roberts, DJ ORCID: https://orcid.org/0000-0002-9257-433X, O'Hare, JJ ORCID: https://orcid.org/0000-0001-5209-7754, Fairchild, AJ, Campion, SP, Moore, C, Aspin, R ORCID: https://orcid.org/0000-0002-2202-1326, Duckworth, TW, Gasparello, P and Tecchia, F 2015, 'With you – an experimental end-to-end telepresence system using video-based reconstruction' , Selected Topics in Signal Processing, 9 (3) , pp. 562-574.

[img]
Preview
PDF - Published Version
Available under License Creative Commons Attribution.

Download (1MB) | Preview

Abstract

We introduce withyou, our telepresence research platform. A systematic explanation of the theory brings together the linked nature of non-verbal communication and how it is influenced by technology. This leads to functional requirements for telepresence, in terms of the balance of visual, spatial and temporal qualities. The first end-to-end description of withyou describes all major processes and the display and capture environment. This includes two approaches to reconstructing the human form in 3D, from live video. An unprecedented characterization of our approach is given in terms of the above qualities, and influences of approach. This leads to non-functional requirements in terms of number and place of cameras and the avoidance of a resultant bottlekneck. Proposals are given for improved distribution of processes across networks, computers, and multi-core CPU and GPU. Simple conservative estimation shows that both approaches should meet our requirements. One is implemented and shown to meet minimum and come close to desirable requirements.

Item Type: Article
Themes: Media, Digital Technology and the Creative Economy
Schools: Schools > School of Computing, Science and Engineering > Salford Innovation Research Centre
Schools > School of Health and Society > Centre for Health Sciences Research
Journal or Publication Title: Selected Topics in Signal Processing
Publisher: IEEE
Refereed: Yes
ISSN: 1932-4553
Related URLs:
Funders: Engineering and Physical Sciences Research Council (EPSRC)
Depositing User: Prof David J Roberts
Date Deposited: 17 Feb 2015 13:27
Last Modified: 15 Feb 2022 18:56
URI: https://usir.salford.ac.uk/id/eprint/33457

Actions (login required)

Edit record (repository staff only) Edit record (repository staff only)