Скачать или смотреть SHIFT framework for accessibility by design development in XR environments

This work presents an accessibility framework and software tools for creating inclusive Extended Reality (XR) applications using the 'Accessible by Design' approach, addressing the needs of individuals with disabilities, particularly those who are blind or partially sighted, by incorporating XR accessibility guidelines and best practices. This framework is being developed as part of the European project SHIFT, which aims to revitalize the Cultural Heritage experience by blending innovation with tradition and creating multi-sensory heritage encounters that are inclusive and welcoming to all. Key features include customizable text settings, alternative text on visual elements, multiple user interaction controls, edge enhancement for visual elements, audio description of the visual elements, hierarchical navigation, foreground positioning of active objects, and adaptable scene configurations. Most importantly, it enables the enhancement of XR elements with haptics, by utilizing haptic gloves to provide force and temperature feedback, aiming to augment users’ perception with additional information. This functionality enables developers to accurately perceive virtual elements by conveying information about their real-world physical attributes. In addition, combining haptics with audio description and 3D sound enhances user experience with a multi-sensory experience and improved localization of artifacts. The proposed framework is made available as a Unity 3D asset so as to be incorporated in XR applications development, enabling this way a plug & play inherent accessibility support.

The framework was developed using a human-centered design approach, actively engaging individuals with vision impairments and relevant stakeholders in defining its requirements and evaluating its functionality. To facilitate testing and evaluation, a Unity 3D sample scene was developed, using the accessibility features of the framework, featuring a Virtual Reality (VR) museum with different 3D cultural heritage artifacts. A user-based evaluation involving 20 participants with vision impairments assessed the system's effectiveness, usability, mental workload, VR-induced sickness symptoms, and haptic experience. The results showed that the framework improved the exploration of VR environments, allowing users with vision impairments to navigate efficiently, perceive museum exhibits effectively, and enjoy a positive user experience without cognitive workload.