Screen readers have revolutionized the way disabled individuals interact with computers. These software programs convert digital text into audio, making it possible for blind, low vision, and dyslexic users to access information and navigate through various applications. However, when it comes to slideshow software like Microsoft PowerPoint and Google Slides, accessibility becomes a major challenge. These programs heavily rely on the Z-order, which determines the layering of objects on a slide, to guide screen readers. Unfortunately, this method fails to convey the spatial layout of the slide accurately, ultimately rendering the software inaccessible to people with disabilities. Recognizing the need for inclusive design, a team of researchers at the University of Washington has developed A11yBoard for Google Slides – a groundbreaking browser extension and phone app that empowers blind users to navigate complex slide layouts and create rich content.
A11yBoard for Google Slides merges the functionality of a desktop computer with a mobile device, allowing blind users to interact with audio, touch, gesture, speech recognition, and search features. By leveraging these capabilities, individuals can understand the location of different objects on a slide and manipulate them to create dynamic layouts. For example, a user can simply touch a textbox on the screen, and the screen reader will describe its color and position. With a voice command, the user can then modify the size and alignment of the textbox. This innovative solution enables blind users to move beyond being passive consumers of content and empowers them to become content creators.
A11yBoard for Google Slides builds upon previous research conducted in the lab of Jacob O. Wobbrock, a senior author of the study and professor at the University of Washington’s Information School. The research explores how blind users interact with “artboards,” which are digital canvases where objects like textboxes, shapes, images, and diagrams are manipulated. Slideshow software, such as Google Slides, relies on these artboards to construct presentations. By tackling the accessibility flaws present in creativity tools, Wobbrock’s lab aimed to develop a solution that would enable blind users to fully engage with and harness the potential of these powerful software applications.
To ensure the effectiveness of A11yBoard, the researchers collaborated with blind users in the testing and improvement phases. Undergraduate student Gene S-H Kim, who is blind and attends Stanford University, joined the team to enhance the interface. The researchers also worked with two other blind users who recreated slides using A11yBoard. The feedback received was promising, with testers reporting significant improvements in their ability to understand visual content and create slides independently. The need for constant back-and-forth collaboration with sighted assistants was greatly reduced. However, the testers pointed out areas for improvement, such as the challenge of maintaining awareness of objects’ positions while editing and the inability to perform batch actions like aligning multiple visual groups.
While A11yBoard for Google Slides shows immense promise in enhancing accessibility and inclusivity, the researchers acknowledge the need for further development. They plan to integrate a large language model, such as GPT, into the program. By doing so, blind users will be able to author slides more efficiently using natural language commands. For instance, they could request the alignment of multiple boxes using their left edge. The researchers are also determined to address limitations in Google Slides itself, such as the inability to undo or redo edits across different devices. Ultimately, the goal is to release A11yBoard to the public, offering blind users an invaluable tool for creating engaging and impactful presentations.
The development of A11yBoard for Google Slides represents a significant breakthrough in making slideshow software more accessible to blind users. By combining the power of digital technology, touch interfaces, voice commands, and screen readers, A11yBoard empowers individuals to navigate complex slide layouts, understand visual content, and create their own rich presentations. The researchers behind this innovation not only prioritize accessibility but also aim to enable blind users to take control of their own content creation. With continued advancements and integrations, A11yBoard has the potential to revolutionize the way disabled individuals interact with various software applications, furthering the goal of a more inclusive digital world.
Leave a Reply