Intelligibility of Cued Speech in Video

Authors: P. Heribanová, J. Polec, S. Ondrušová, M. Hosťovecký

Abstract:

This paper discusses the cued speech recognition methods in videoconference. Cued speech is a specific gesture language that is used for communication between deaf people. We define the criteria for sentence intelligibility according to answers of testing subjects (deaf people). In our tests we use 30 sample videos coded by H.264 codec with various bit-rates and various speed of cued speech. Additionally, we define the criteria for consonant sign recognizability in single-handed finger alphabet (dactyl) analogically to acoustics. We use another 12 sample videos coded by H.264 codec with various bit-rates in four different video formats. To interpret the results we apply the standard scale for subjective video quality evaluation and the percentual evaluation of intelligibility as in acoustics. From the results we construct the minimum coded bit-rate recommendations for every spatial resolution.

Keywords: cued speech, inteligibility, logatom, video

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1070297

References:

[1] M. Granat, Objective methods for evaluation of audio signal quality (in Slovak), Brno University of Technology. Brno, 2009.
[2] D. Tarcsiová, Pedagogics of hearing-impaired (in Slovak), MABAG spol. s r. o., Bratislava, 2008.
[3] M. Hefty, Finger alphabet (in Slovak), Organization Myslím - development of thinking not only for hearing-impaired (in Slovak), 2009, www.zzz.sk
[4] F. Mak├íň, Elektroacoustics (in Slovak), Vydavate─¥stvo STU Bratislava, 1995.
[5] J. Polec, S. Ondru┼íov├í, A. Mordelov├í, J. Filanov├í, "New Objective Method of Evaluation Cued Speech Recognition in Videoconferences," Proceedings Redž├║r 2010: 4th International Workshop on Speech and Signal Processing, Bratislava, Slovak Republic, May, 14, 2010 - Bratislava, STU v Bratislave FEI, 2010, 4 p., CD-Rom.