Interpretation of sign language into English using NLP techniques. Issue 6 (18th August 2017)

• Record Type: Journal Article
• Authors: Wazalwar, Sampada S.; Shrawankar, Urmila
• Is Part Of: Journal of information & optimization sciences. Volume 38:Issue 6(2017)
• Page Start: 895
• Page End: 910
• Publication Date: 2017-08-18
• Subjects: Sign language -- hearing disable -- visual interaction -- image processing -- POS -- parse; 68M12; Electronic data processing -- Periodicals; Information science -- Periodicals; Mathematical optimization -- Periodicals; 519.6
• DOI: 10.1080/02522667.2017.1372136
• Languages: English
• ISSNs: 0252-2667

Abstract

Abstract: Sign language is a way of communication for deaf & dumb. Different sign recognition techniques are there which are giving output in the form of word for recognized sign. The proposed method is focusing on interpretation of sign language in proper English sentence. Different NLP techniques are used in addition to sign recognition. Input is given as video of sign language followed by framing & segmentation on video. CamShift algorithm is used for tracking & P2DHMM for hand tracking. Haar Cascade classifier is used for sign identification. After sign recognition, the continuous words for respective sign are given as input to POS tagging module. Word net POS tagger is used which is having its own WordNet dictionary. At last LALR parser is used to frame the sentence. In this way proposed sign language interpreter model gives the output in meaningful English sentence & with a goodaccuracy.