A Natural User Interface Translation Tool

Communication is often difficult for hearing-impaired people because their sign language is only understood by a few ordinary people. On the contrary, the spoken language is difficult to understand due to their hearing impairment. The traditional method of converting speech into written form, similar to the online chat method, was developed to overcome this situation, but is not effective and efficient. Some researchers have long worked with experts to bridge the gap in sign language communication. However, the results are usually very expensive, ineffective and tend to communicate in one direction. The aim of this project was to help hearing impaired people communicate effectively with ordinary people simply by using their sign language. Using Microsoft Kinect technology, hearing impaired people only have to stand in front of the Kinect camera and start communicating their message in sign language. The Kinect Sign Language should translate sign language into written and spoken languages. Conversely, ordinary people can respond directly with their common spoken language, which is easily translated into a written language, along with their animated 3D sign language gestures.