Robust South African sign language gesture recognition using hand motion and shape

dc.contributor.advisorGhaziasgar, Mehrdad
dc.contributor.advisorConnan, James
dc.contributor.authorFrieslaar, Ibraheem
dc.date.accessioned2014-07-28T13:35:29Z
dc.date.accessioned2024-10-30T14:00:52Z
dc.date.available2014-07-28T13:35:29Z
dc.date.available2024-10-30T14:00:52Z
dc.date.issued2014
dc.descriptionMagister Scientiae - MScen_US
dc.description.abstractResearch has shown that five fundamental parameters are required to recognize any sign language gesture: hand shape, hand motion, hand location, hand orientation and facial expressions. The South African Sign Language (SASL) research group at the University of the Western Cape (UWC) has created several systems to recognize sign language gestures using single parameters. These systems are, however, limited to a vocabulary size of 20 – 23 signs, beyond which the recognition accuracy is expected to decrease. The first aim of this research is to investigate the use of two parameters – hand motion and hand shape – to recognise a larger vocabulary of SASL gestures at a high accuracy. Also, the majority of related work in the field of sign language gesture recognition using these two parameters makes use of Hidden Markov Models (HMMs) to classify gestures. Hidden Markov Support Vector Machines (HM-SVMs) are a relatively new technique that make use of Support Vector Machines (SVMs) to simulate the functions of HMMs. Research indicates that HM-SVMs may perform better than HMMs in some applications. To our knowledge, they have not been applied to the field of sign language gesture recognition. This research compares the use of these two techniques in the context of SASL gesture recognition. The results indicate that, using two parameters results in a 15% increase in accuracy over the use of a single parameter. Also, it is shown that HM-SVMs are a more accurate technique than HMMs, generally performing better or at least as good as HMMs.en_US
dc.identifier.urihttps://hdl.handle.net/10566/16971
dc.language.isoenen_US
dc.rights.holderuwcen_US
dc.subjectHidden Markov modelsen_US
dc.subjectSupport vector Machinesen_US
dc.subjectHidden Markov support vector machineen_US
dc.subjectFace detectionen_US
dc.subjectSkin detectionen_US
dc.subjectBackground subtractionen_US
dc.subjectHand shape recognitionen_US
dc.subjectHand motionen_US
dc.titleRobust South African sign language gesture recognition using hand motion and shapeen_US

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Frieslaar_MSC_2013.pdf
Size:
11.97 MB
Format:
Adobe Portable Document Format
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.62 KB
Format:
Plain Text
Description: