VR 360º subtitles: designing a test suite with eye-tracking technology

Brescia-Zapata, M, Krejtz, K, Duchowski, A and Hughes, C ORCID: https://orcid.org/0000-0002-4468-6660 2022, 'VR 360º subtitles: designing a test suite with eye-tracking technology' , Journal of Audiovisual Translation, 6 (2) , pp. 233-258.

PDF - Accepted Version
Download (1MB) | Preview
PDF - Published Version
Available under License Creative Commons Attribution 4.0.

Download (1MB) | Preview


Subtitle production is an increasingly creative accessibility service. New technologies allow for placing subtitles at any location of the screen in a variety of formats, shapes, typography, font size, and colour. The screen now affords accessible creativity, with subtitles able to provide novel experiences beyond those offered by traditional language translation. Immersive environments multiply 2D subtitles features to new creative viewing modalities. Testing subtitles in eXtended Reality (XR) has pushed existing methods to address user need and enjoyment of audiovisual content in 360º viewing displays. After an overview of existing subtitle features in XR, the article describes the challenges of generating subtitle stimuli to test meaningful user viewing behaviours, based on eye-tracking technology. The approach for the first experimental setup for implementing creative subtitles in XR using eye-tracking is given, in line with novel research questions. The choices made regarding sound, duration and storyboard are described. Conclusions show that testing subtitles in immersive media environments is both a linguistic and an artistic endeavour, which requires an agile framework fostering contrast and comparison of different functionalities. Results of the present, preliminary study shed light on future experimental setups with eye-tracking.

Item Type: Article
Additional Information: "This is the peer-reviewed version of the following article: Brescia-Zapata, M., Krejtz, K., Orero, P., Duchowski, A., & Hughes, C. (2022). VR 360º subtitles: Designing a Test Suite with Eye-Tracking Technology. Journal of Audiovisual Translation, 5(2), 233–258. Retrieved from https://jatjournal.org/index.php/jat/article/view/184, which has been published in final form at https://jatjournal.org/index.php/jat/article/view/184. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Use of Self-Archived Versions."
Schools: Schools > School of Computing, Science and Engineering
Journal or Publication Title: Journal of Audiovisual Translation
Publisher: European Association for Studies in Screen Translation
ISSN: 2617-9148
Depositing User: Dr Chris Hughes
Date Deposited: 14 Oct 2022 06:46
Last Modified: 30 Jan 2023 15:36
URI: https://usir.salford.ac.uk/id/eprint/64867

Actions (login required)

Edit record (repository staff only) Edit record (repository staff only)