Loughborough University
Leicestershire, UK
LE11 3TU
+44 (0)1509 263171
Loughborough University

Loughborough University Institutional Repository

Please use this identifier to cite or link to this item: https://dspace.lboro.ac.uk/2134/7251

Title: A multimodal approach to blind source separation of moving sources
Authors: Naqvi, Syed M.R.
Yu, Miao
Chambers, Jonathon
Keywords: 3-D tracking
Markov Chain Monte Carlo (MCMC) particle filtering
Blind source separation (BSS)
Multimodal signal processing
Issue Date: 2010
Publisher: © IEEE
Citation: NAQVI, S.M., YU, M. and CHAMBERS, J.A., 2010. A multimodal approach to blind source separation of moving sources. IEEE Journal of selected topics in signal processing, 4(5), pp 895- 910
Abstract: A novel multimodal approach is proposed to solve the problem of blind source separation (BSS) of moving sources. The challenge of BSS for moving sources is that the mixing filters are time varying; thus, the unmixing filters should also be time varying, which are difficult to calculate in real time. In the proposed approach, the visual modality is utilized to facilitate the separation for both stationary and moving sources. The movement of the sources is detected by a 3-D tracker based on video cameras. Positions and velocities of the sources are obtained from the 3-D tracker based on a Markov Chain Monte Carlo particle filter (MCMC-PF), which results in high sampling efficiency. The full BSS solution is formed by integrating a frequency domain blind source separation algorithm and beamforming: if the sources are identified as stationary for a certain minimum period, a frequency domain BSS algorithm is implemented with an initialization derived from the positions of the source signals. Once the sources are moving, a beamforming algorithm which requires no prior statistical knowledge is used to perform real time speech enhancement and provide separation of the sources. Experimental results confirm that by utilizing the visual modality, the proposed algorithm not only improves the performance of the BSS algorithm and mitigates the permutation problem for stationary sources, but also provides a good BSS performance for moving sources in a low reverberant environment.
Description: This is a journal article[© IEEE]. It is also available at: http://ieeexplore.ieee.org/ Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Version: Published
DOI: 10.1109/JSTSP.2010.2057198
URI: https://dspace.lboro.ac.uk/2134/7251
Publisher Link: http://dx.doi.org/10.1109/JSTSP.2010.2057198
ISSN: 1932-4553
Appears in Collections:Published Articles (Mechanical, Electrical and Manufacturing Engineering)

Files associated with this item:

File Description SizeFormat
naqvi.pdf2.32 MBAdobe PDFView/Open


SFX Query

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.