+44 (0)1509 263171
Please use this identifier to cite or link to this item:
|Title: ||Feature-fusion based audio-visual speech recognition using lip geometry features in noisy enviroment|
|Authors: ||Ibrahim, M.Z.|
Mulvaney, David J.
|Keywords: ||Lip geometry|
Audio-visual speech recognition
|Issue Date: ||2015|
|Publisher: ||© Asian Research Publishing Network (ARPN)|
|Citation: ||IBRAHIM, M.Z., MULVANEY, D.J. and ABAS, M.F., 2015. Feature-fusion based audio-visual speech recognition using lip geometry features in noisy enviroment. ARPN Journal of Engineering and Applied Sciences, 10(23), pp. 17521-17527.|
|Abstract: ||Humans are often able to compensate for noise degradation and uncertainty in speech information by augmenting the received audio with visual information. Such bimodal perception generates a rich combination of information that can be used in the recognition of speech. However, due to wide variability in the lip movement involved in articulation, not all speech can be substantially improved by audio-visual integration. This paper describes a feature-fusion audio-visual speech recognition (AVSR) system that extracts lip geometry from the mouth region using a combination of skin color filter, border following and convex hull, and classification using a Hidden Markov Model. The comparison of the new approach with conventional audio-only system is made when operating under simulated ambient noise conditions that affect the spoken phrases. The experimental results demonstrate that, in the presence of audio noise, the audio-visual approach significantly improves speech recognition accuracy compared with audio-only approach.|
|Description: ||This paper is in closed access.|
|Publisher Link: ||http://www.arpnjournals.com/jeas/index.htm|
|Appears in Collections:||Closed Access (Mechanical, Electrical and Manufacturing Engineering)|
Files associated with this item:
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.