VR 360º subtitles: designing a test suite with eye-tracking technology

Brescia-Zapata, M; Krejtz, K; Duchowski, A; Hughes, C

Abstract

Subtitle production is an increasingly creative accessibility service. New technologies allow for placing subtitles at any location of the screen in a variety of formats, shapes, typography, font size, and colour. The screen now affords accessible creativity, with subtitles able to provide novel experiences beyond those offered by traditional language translation. Immersive environments multiply 2D subtitles features to new creative viewing modalities. Testing subtitles in eXtended Reality (XR) has pushed existing methods to address user need and enjoyment of audiovisual content in 360º viewing displays. After an overview of existing subtitle features in XR, the article describes the challenges of generating subtitle stimuli to test meaningful user viewing behaviours, based on eye-tracking technology. The approach for the first experimental setup for implementing creative subtitles in XR using eye-tracking is given, in line with novel research questions. The choices made regarding sound, duration and storyboard are described. Conclusions show that testing subtitles in immersive media environments is both a linguistic and an artistic endeavour, which requires an agile framework fostering contrast and comparison of different functionalities. Results of the present, preliminary study shed light on future experimental setups with eye-tracking.

Citation

Brescia-Zapata, M., Krejtz, K., Duchowski, A., & Hughes, C. (2022). VR 360º subtitles: designing a test suite with eye-tracking technology. Journal of audiovisual translation, 6(2), 233-258

• Journal Article Type: Article
• Acceptance Date: Jul 6, 2022
• Online Publication Date: Dec 21, 2022
• Publication Date: Dec 21, 2022
• Deposit Date: Oct 14, 2022
• Publicly Available Date: Dec 21, 2022
• Journal: Journal of Audiovisual Translation
• Volume: 6
• Issue: 2
• Pages: 233-258
• Publisher URL: https://jatjournal.org/index.php/jat/article/view/184
• Additional Information: Additional Information : "This is the peer-reviewed version of the following article: Brescia-Zapata, M., Krejtz, K., Orero, P., Duchowski, A., & Hughes, C. (2022). VR 360º subtitles: Designing a Test Suite with Eye-Tracking Technology. Journal of Audiovisual Translation, 5(2), 233–258. Retrieved from https://jatjournal.org/index.php/jat/article/view/184, which has been published in final form at https://jatjournal.org/index.php/jat/article/view/184. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Use of Self-Archived Versions."