E-S.H.A.R.A. (Electronic Sign-Language Hand Augmented Recognition Assistant) is an innovative smart glove system designed to bridge the communication gap between deaf and hearing individuals. The project implements a wearable technology solution that enables two-way communication through realtime sign language interpretation and speech-to-text conversion. The smart glove utilizes a sophisticated array of sensors—including five flex sensors to detect finger bending, three force-sensitive resistors to measure pressure, and an IMU (MPU6050) to capture hand orientation and movement—all connected to a Raspberry Pi 4 processing unit.

What distinguishes E-S.H.A.R.A. from existing solutions is its dual-mode communication capability, supporting both American Sign Language (ASL) and Arabic Sign Language (ArSL), making it particularly valuable in the MENA region. The system employs LSTM (Long Short-Term Memory) networks for gesture recognition, trained on a comprehensive customized dataset specifically developed for this glove configuration. This custom dataset collection process ensures optimal recognition accuracy by accounting for the unique sensor placement and characteristics of the designed hardware. The glove operates independently of internet connectivity and requires no additional applications, making it accessible for everyday use. With an integrated OLED display and speaker system, E-S.H.A.R.A. provides real-time visual feedback for deaf users and audio output for hearing individuals, creating a complete communication solution that promotes inclusivity.