Improved Hand-Tracking Framework with a Recovery Mechanism

Loading...
Thumbnail Image

Date

2013

Journal Title

Journal ISSN

Volume Title

Publisher

Telkom

Abstract

Abstract−Hand-tracking is fundamental to translating sign language to a spoken language. Accurate and reliable sign language translation depends on effective and accurate hand-tracking. This paper proposes an improved hand-tracking framework that includes a tracking recovery algorithm optimising a previous framework to better handle occlusion. It integrates the tracking recovery algorithm to improve the discrimination between hands and the tracking of hands. The framework was evaluated on 30 South African Sign Language phrases that use: a single hand; both hands without occlusion; and both hands with occlusion. Ten individuals in constrained and unconstrained environments performed the gestures. Overall, the proposed framework achieved an average success rate of 91.8% compared to an average success rate of 81.1% using the previous framework. The results show an improved tracking accuracy across all signs in constrained and unconstrained environments.

Description

Keywords

Hand-tracking, Occlusion handling, Scale Invariant Features Transform (SIFT), Sign language recognition

Citation

Achmed, I., Venter, I.M. & Eisert, P. (2013). Improved Hand-Tracking Framework with a Recovery Mechanism. In. Proc. Southern African Telecommunication Networks and Applications Conference, pp. 185-190, Stellenbosch, South Africa