About using serious games to teach (Portuguese) sign language João Manuel Ferreira Gameiro - 2014


Support : Références scientifiques
Author(s) : João Manuel Ferreira Gameiro
Editor : The Faculty of Science and Technology and the New University of Lisbon
Date : 2014
Lang : Lang




Sign language is the form of communication used by Deaf people, which, in most cases have been learned since childhood. The problem arises when a non-Deaf tries to contact with a Deaf. For example, when nonDeaf parents try to communicate with their Deaf child. In most cases, this situation tends to happen when the parents did not have time to properly learn sign language. This dissertation proposes the teaching of sign language through the usage of serious games. Currently, similar solutions to this proposal do exist, however, those solutions are scarce and limited. For this reason, the proposed solution is composed of a natural user interface that is intended to create a new concept on this field. The validation of this work, consisted on the implementation of a serious game prototype, which can be used as a source for learning (Portuguese) sign language. On this validation, it was first implemented a module responsible for recognizing sign language. This first stage, allowed the increase of interaction and the construction of an algorithm capable of accurately recognizing sign language. On a second stage of the validation, the proposal was studied so that the pros and cons can be determined and considered on future works.


References (1):


DJAOUTI, D.; ALVAREZ, J.; JESSEL, J.P.; RAMPNOUX, O. Origins of Serious Games. In Serious Games and Edutainment Applications. Springer, 2011, pp.25-43. 



Keywords : Natural User Interface, Sign Language, Serious Game, Kinect Sensor, Image Processing