Saturday 01 March 2025
Scientists have made a significant breakthrough in developing a low-cost, real-time augmented reality (AR) captioning system designed specifically for deaf and hard-of-hearing students. This innovative technology has the potential to revolutionize the way these students learn and interact with their peers.
The system uses a combination of automatic speech recognition (ASR) and machine learning algorithms to provide real-time captions of spoken language, allowing deaf and hard-of-hearing students to better understand and engage with classroom materials. The AR interface is designed to be user-friendly and accessible, using a simple and intuitive layout that makes it easy for students to navigate and focus on the content.
Researchers conducted extensive user studies to test the effectiveness of the system, involving 24 deaf and hard-of-hearing students in a controlled classroom environment. Participants were asked to complete various tasks, including reading comprehension exercises, vocabulary building activities, and group discussions. The results showed that the AR captioning system significantly improved student engagement, reading efficiency, and overall understanding of the material.
One of the key findings was that the system helped students to focus more on the content and less on trying to decipher spoken language. This allowed them to participate more fully in class discussions and activities, which is essential for building social skills and developing a sense of belonging.
Another significant benefit of the system was its ability to reduce cognitive load and minimize distractions. By providing clear and concise captions, students were able to quickly grasp complex concepts and ideas, without becoming overwhelmed by the sheer amount of information presented.
The researchers also experimented with different caption placement strategies, finding that using a karaoke-like format was most effective in improving comprehension and engagement. This format allowed students to focus on individual words or phrases, rather than trying to read long blocks of text.
The system has significant implications for deaf and hard-of-hearing education, offering a new level of accessibility and inclusivity. By providing real-time captions of spoken language, it can help bridge the gap between deaf and hearing students, promoting greater understanding and communication between the two groups.
The researchers are now working to refine and expand the system, exploring its potential applications in a range of educational settings. They hope that their work will contribute to a more inclusive and equitable learning environment for all students, regardless of their abilities or disabilities.
Cite this article: “Breaking Down Barriers: A Low-Cost AR Captioning System for Deaf and Hard-of-Hearing Students”, The Science Archive, 2025.
Augmented Reality, Captioning System, Deaf, Hard-Of-Hearing, Students, Learning, Education, Accessibility, Inclusivity, Automatic Speech Recognition, Machine Learning Algorithms
