SignSense : Sign language at the tip of your fingers

As stated by the United Nations, Sign language is a vital means of communication for millions of people worldwide who are deaf or hard-of-hearing. However, sign language recognition is still a major challenge, as it requires the ability to accurately detect and interpret complex and subtle hand gestures and facial expressions. The objective of this project is to develop a novel system for sign language recognition that combines a glove with attached flex sensors and a computer vision system that function simultaneously in order to recognize and classify ASL letters. The glove contains flex sensors on each finger, which will detect the movements of the user’s hand and fingers as they sign. The glove is also coupled with a computer vision system to aid in detection and recognition of similar gestures.

Project Details