DCA‐based unimodal feature‐level fusion of orthogonal moments for Indian sign language dataset. Issue 5 (28th February 2018)

• Record Type: Journal Article
• Authors: Joshi, Garima; Vig, Renu; Singh, Sukhwinder
• Is Part Of: IET computer vision. Volume 12:Issue 5(2018)
• Page Start: 570
• Page End: 577
• Publication Date: 2018-02-28
• Subjects: sign language recognition -- computational complexity -- correlation theory -- image fusion; DCA-based unimodal feature-level fusion -- orthogonal moments -- Indian sign language dataset -- sign language recognition system -- hand gestures -- shape variations -- shape information -- unimodal feature fusion -- large feature vector size -- classification computational complexity -- discriminant correlation analysis -- unimodal feature-level fusion -- feature-level fusion technique -- intraclass separability -- single feature vector -- discriminative power -- canonical correlation analysis -- feature fusion technique -- CCA-based feature fusion technique; Computer vision -- Periodicals; Pattern recognition systems -- Periodicals; 006.37
• DOI: 10.1049/iet-cvi.2017.0394
• Languages: English
• ISSNs: 1751-9632

Abstract

Abstract : Sign language recognition system classifies signs made by hand gestures. An adequate number of features are required to represent the shape variations of sign language. As compared to individual feature set, a combination of features can be effective due to the fact that a particular feature set represents different shape information. A simple concatenation results in large feature vector size and increases the classification computational complexity. Discriminant correlation analysis (DCA)‐based unimodal feature‐level fusion has been applied on uniform as well as complex background Indian sign language datasets. DCA is a feature‐level fusion technique that takes into account the class associations while combining the feature sets. It maximises the inter‐class separability of two feature sets and also minimises the intra‐class separability while performing the feature fusion. The objective of DCA‐based unimodal feature fusion technique is to combine different feature sets into a single feature vector with more discriminative power. The performance of proposed framework is compared with individual orthogonal moment‐based feature sets and canonical correlation analysis (CCA)‐based feature fusion technique. Results show that in comparison to individual features and CCA‐based fused features, DCA is an effective technique in terms of improved accuracy, reduced feature vector size and smaller classification time.