A Novel Multimodal Assistive Framework for Arabic-Speaking Deaf and Blind Communities

Document Type

Conference Proceeding

Source of Publication

2026 17th Student Research Conference on Applied Computing Src 2026

Publication Date

4-22-2026

Abstract

The rapid advancement of augmented reality (AR) and artificial intelligence (AI) has catalyzed a growing market for assistive smart glasses designed to bridge the communication gap for individuals with hearing and visual impairments. This paper provides a comprehensive analysis of the current technological landscape, examining the strengths and limitations of prominent commercial products and academic prototypes for Arabic language support. Building on this landscape analysis, the paper proposes a novel system pipeline that utilizes smartphone-dependent architecture to serve both deaf and blind users. The proposed system leverages an optimized software stack validated through testing. Financial analysis indicates this architecture is highly cost-effective. The findings demonstrate that by offloading processing to smartphones and utilizing state-of-The-Art AI models, it is possible to create a scalable, multi-modal assistive technology tailored for Arabic-speaking communities

ISBN

[9798319510167]

Publisher

IEEE

Disciplines

Computer Sciences

Keywords

accessibility, Arabic ASR, assistive technology, augmented reality, hearing impairment, real-Time captioning, smart glasses, speech-To-Text, wearable devices

Scopus ID

105043200905

Indexed in Scopus

yes

Open Access

no

Share

COinS