Loughborough University
Leicestershire, UK
LE11 3TU
+44 (0)1509 263171
Loughborough University

Loughborough University Institutional Repository

Please use this identifier to cite or link to this item: https://dspace.lboro.ac.uk/2134/5615

Title: Virtual friend: tracking and generating natural interactive behaviours in real video
Authors: Zheng, Yue
Hicks, Yulia
Marshall, Dave
Mostaza, Juan C.
Chambers, Jonathon
Issue Date: 2006
Publisher: © IEEE
Citation: ZHENG, Y. ... et al., 2006. Virtual friend: tracking and generating natural interactive behaviours in real video. IN: 2006 8th International Conference on Signal Processing (ICSP 2006), Guilin, China, Vol.2., 16-20 November.
Abstract: The aim of our research is to create a “virtual friend” i.e., a virtual character capable of responding to actions obtained from observing a real person in video in a realistic and sensible manner. In this paper, we present a novel approach for generating a variety of complex behavioural responses for a fully articulated “virtual friend” in three dimensional (3D) space. Our approach is model-based. First of all, we train a collection of dual Hidden Markov Models (HMMs) on 3D motion capture (MoCap) data representing a number of interactions between two people. Secondly, we track 3D articulated motion of a single person in ordinary 2D video. Finally, using the dual HMM, we generate a moving “virtual friend” reacting to the motion of the tracked person and place it in the original video footage. In this paper, we describe our approach in depth as well as present the results of experiments, which show that the produced behaviours are very close to those of real people.
Description: This is a conference paper [© IEEE]. It is also available at: http://ieeexplore.ieee.org/ Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Version: Published
DOI: 10.1109/ICOSP.2006.345649
URI: https://dspace.lboro.ac.uk/2134/5615
Appears in Collections:Conference Papers and Presentations (Mechanical, Electrical and Manufacturing Engineering)

Files associated with this item:

File Description SizeFormat
Virtual Friend Tracking and Generating Natural Interactive Behaviours in Real Video.pdf281.04 kBAdobe PDFView/Open


SFX Query

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.