Estimating the gaze of a virtuality human

Roberts, DJ ORCID: https://orcid.org/0000-0002-9257-433X, Rae, J, Duckworth, TW and Moore, C 2013, 'Estimating the gaze of a virtuality human' , IEEE Transactions on Visualization and Computer Graphics, 19 (4) , pp. 681-690.

PDF - Published Version Download (17MB) Download (17MB) | Request a copy

Abstract

The aim of our experiment is to determine if eye-gaze can be estimated from a virtuality human: to within the accuracies that underpin social interaction; and reliably across gaze poses and camera arrangements likely in every day settings. The scene is set by explaining why Immersive Virtuality Telepresence has the potential to meet the grand challenge of faithfully communicating both the appearance and the focus of attention of a remote human participant within a shared 3D computer-supported context. Within the experiment n=22 participants rotated static 3D virtuality humans, reconstructed from surround images, until they felt most looked at. The dependent variable was absolute angular error, which was compared to that underpinning social gaze behaviour in the natural world. Independent variables were 1) relative orientations of eye, head and body of captured subject; and 2) subset of cameras used to texture the form. Analysis looked for statistical and practical significance and qualitative corroborating evidence. The analysed results tell us much about the importance and detail of the relationship between gaze pose, method of video based reconstruction, and camera arrangement. They tell us that virtuality can reproduce gaze to an accuracy useful in social interaction, but with the adopted method of Video Based Reconstruction, this is highly dependent on combination of gaze pose and camera arrangement. This suggests changes in the VBR approach in order to allow more flexible camera arrangements. The work is of interest to those wanting to support expressive meetings that are both socially and spatially situated, and particular those using or building Immersive Virtuality Telepresence to accomplish this. It is also of relevance to the use of virtuality humans in applications ranging from the study of human interactions to gaming and the crossing of the stage line in films and TV.

Item Type:	Article
Themes:	Media, Digital Technology and the Creative Economy
Schools:	Schools > School of Computing, Science and Engineering > Salford Innovation Research Centre
Journal or Publication Title:	IEEE Transactions on Visualization and Computer Graphics
Publisher:	Institute of Electrical and Electronics Engineers
Refereed:	Yes
ISSN:	1077-2626
Related URLs:	Publication
Funders:	Engineering and Physical Sciences Research Council (EPSRC)
Depositing User:	Prof David J Roberts
Date Deposited:	02 May 2013 12:27
Last Modified:	15 Feb 2022 18:19
URI:	https://usir.salford.ac.uk/id/eprint/29142

Actions (login required)

Edit record (repository staff only)