Loughborough University
Leicestershire, UK
LE11 3TU
+44 (0)1509 263171
Loughborough University

Loughborough University Institutional Repository

Please use this identifier to cite or link to this item: https://dspace.lboro.ac.uk/2134/18426

Title: Geometrical-based lip-reading using template probabilistic multi-dimension dynamic time warping
Authors: Ibrahim, M.Z.
Mulvaney, David J.
Keywords: Lip reading
Lip geometry
Mouth detection
Skin segmentation
Convex hull
Multi dimension dynamic time warping
Template probabilistic
Issue Date: 2015
Publisher: © Elsevier
Citation: IBRAHIM, M. and MULVANEY, D.J., 2015. Geometrical-based lip-reading using template probabilistic multi-dimension dynamic time warping. Journal of Visual Communication and Image Representation, 30, pp.219-233
Abstract: By identifying lip movements and characterizing their associations with speech sounds, the performance of speech recognition systems can be improved, particularly when operating in noisy environments. In this paper, we present a geometrical-based automatic lip reading system that extracts the lip region from images using conventional techniques, but the contour itself is extracted using a novel application of a combination of border following and convex hull approaches. Classification is carried out using an enhanced dynamic time warping technique that has the ability to operate in multiple dimensions and a template probability technique that is able to compensate for differences in the way words are uttered in the training set. The performance of the new system has been assessed in recognition of the English digits 0 to 9 as available in the CUAVE database. The experimental results obtained from the new approach compared favorably with those of existing lip reading approaches, achieving a word recognition accuracy of up to 71% with the visual information being obtained from estimates of lip height, width and their ratio.
Version: Accepted for publication
DOI: 10.1016/j.jvcir.2015.04.013
URI: https://dspace.lboro.ac.uk/2134/18426
Publisher Link: http://dx.doi.org/10.1016/j.jvcir.2015.04.013
ISSN: 1047-3203
Appears in Collections:Published Articles (Mechanical, Electrical and Manufacturing Engineering)

Files associated with this item:

File Description SizeFormat
zamri_mulvaney_jvci.pdfAccepted version3.94 MBAdobe PDFView/Open


SFX Query

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.