Online Multilingual Dictionary Using Hamburg Notation for Avatar-Based Indian Sign Language Generation System

Authors: Sugandhi, Parteek Kumar, Sanmeet Kaur

Abstract:

Sign Language (SL) is used by deaf and other people who cannot speak but can hear or have a problem with spoken languages due to some disability. It is a visual gesture language that makes use of either one hand or both hands, arms, face, body to convey meanings and thoughts. SL automation system is an effective way which provides an interface to communicate with normal people using a computer. In this paper, an avatar based dictionary has been proposed for text to Indian Sign Language (ISL) generation system. This research work will also depict a literature review on SL corpus available for various SL s over the years. For ISL generation system, a written form of SL is required and there are certain techniques available for writing the SL. The system uses Hamburg sign language Notation System (HamNoSys) and Signing Gesture Mark-up Language (SiGML) for ISL generation. It is developed in PHP using Web Graphics Library (WebGL) technology for 3D avatar animation. A multilingual ISL dictionary is developed using HamNoSys for both English and Hindi Language. This dictionary will be used as a database to associate signs with words or phrases of a spoken language. It provides an interface for admin panel to manage the dictionary, i.e., modification, addition, or deletion of a word. Through this interface, HamNoSys can be developed and stored in a database and these notations can be converted into its corresponding SiGML file manually. The system takes natural language input sentence in English and Hindi language and generate 3D sign animation using an avatar. SL generation systems have potential applications in many domains such as healthcare sector, media, educational institutes, commercial sectors, transportation services etc. This research work will help the researchers to understand various techniques used for writing SL and generation of Sign Language systems.

Keywords: Avatar, dictionary, HamNoSys, hearing-impaired, Indian Sign Language, sign language.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1474397

References:

[1] S. Chalk, “Do we know how many sign languages there are in the world?,” 2014. (Online). Available: http://www.clarion-uk.com/know-many-sign-languages-world.
[2] D. C. I (Deaf Community of India), “The indian sign language community,” 2012. (Online). Available: https://joshuaproject.net/assets/media/profiles/text/t19007_in.pdf.
[3] U. Zeshan, M. N. Vasishta, and M. Sethna, “Implementation of indian sign language in educational settings,” Asia Pacific Disability Rehabilitation Journal, vol. 16, no. 1, pp. 16–40, 2005.
[4] S. Sinha, Indian Sign Language: An Analysis of Its Grammar. Gallaudet University Press, 2017.
[5] J. L. Fuertes, A. L. Gonzalez,´ G. Mariscal, and C. Ruiz, “Bilingual sign language dictionary,” in International Conference on Computers for Handicapped Persons. Springer, 2006, pp. 599–606.
[6] E. Suzuki, T. Suzuki, and K. Kakihana, “On the web trilingual sign language dictionary to learn the foreign sign language without learning a target spoken language,” in Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC’06), 2006.
[7] J. H. Kristoffersen and T. Troelsgard, “The danish sign language dic-tionary,” in Proceedings of the XIV EURALEX International Congress. Leeuwarden: Fryske Akademy, 2010, pp. 1549–1554.
[8] J. H. Kristoffersen and T. TroelsgArd, The electronic lexicographical treatment of sign languages: The Danish Sign Language Dictionary. Oxford University Press, 2012.
[9] K. Cormier et. al, “British Sign Language (BSL) corpus project,” 2011. (Online). Available: http://bslcorpusproject.org.
[10] J. Fenlon, K. Cormier, and A. Schembri, “Building bsl signbank: The lemma dilemma revisited,” International Journal of Lexicography, vol. 28, no. 2, pp. 169–206, 2015.
[11] P. M. Martin, S. Belhe, S. Mudliar, M. Kulkarni, and S. Sahasrabudhe, “An indian sign language (isl) corpus of the domain disaster message using avatar,” in Proceedings of the Third International Symposium in Sign Language Translations and Technology (SLTAT-2013), 2013, pp. 1–4.
[12] T. Hanke, “Dgs corpus project-development of a corpus based electronic dictionary German sign language/German,” in Proceedings of the Corpus Linguistics Conference 2009 (CL2009), 2009, p. 355.
[13] W. C. Stokoe, D. C. Casterline, and C. G. Croneberg, A dictionary of American Sign Language on linguistic principles. Linstok Press, 1976.
[14] S. Parkhurst and D. Parkhurst, SignWriting: A Complete System for Writing and Reading Signed Languages. SignWriting Press, 2007.
[15] T. Hanke, “Hamnosys-representing sign language data in language resources and language processing contexts,” in LREC, vol. 4, 2004, pp. 1–6.
[16] D. Singh et. al, “Sanket - Text to Indian Sign Language Translator,” 2018. (Online). Available: http://play.google.com/store/apps/details?id=in.dsingh.sanket.