Loughborough University
Browse

File(s) under permanent embargo

Reason: This item is currently closed access.

Natural human-robot musical interaction: understanding the music conductor gestures by using the WB-4 inertial measurement system

journal contribution
posted on 2014-08-22, 11:56 authored by Sarah Cosentino, Klaus Petersen, Zhuohua Lin, Luca Bartolomeo, Salvatore Sessa, Massimiliano ZeccaMassimiliano Zecca, Atsuo Takanishi
This paper presents an IMU (Inertial Measurement Unit) based human gesture recognition system for a robot instrument player to understand the instructions dictated by an orchestra conductor and accordingly adapt its musical performance. It is an extension of our previous publications on natural human-robot musical interaction [28]. With this system, the robot can understand the real- time variations in musical parameters dictated by the conductor's movements, adding expression to its performance while being synchronized with all the other human partner musicians. The enhanced interaction ability would obviously lead to an improvement of the overall live performance, but also allow the partner musicians, as well as the conductor, to better appreciate a joint musical performance, thanks to the complete naturalness of the interaction.

Funding

This research was partially supported by a grant by STMicroelectronics, which also provided the core sensors and the microcontroller. This work was also supported in part by: the Global COE Program "Global Robot Academia", MEXT, Japan; and the Consolidated Research Insti- tute for Advanced Science and Medical Care, Waseda University (ASMeW). The authors would like to express their thanks to the Italian Ministry of Foreign A airs, General Directorate for Cultural Promotion and Cooperation, for its support to RoboCasa. The authors would also like to express their gratitude to Life Performance Research, Okino Industries LTD, Japan ROBOTECH LTD, SolidWorks Corp, Dyden, for their support to the research, and Professor Suzuki of the University of Tsukuba for the meaningful discussions.

History

School

  • Mechanical, Electrical and Manufacturing Engineering

Published in

Advanced Robotics

Volume

28

Issue

11

Pages

781 - 792

Citation

COSENTINO, S. ... (et al.), 2014. Natural human-robot musical interaction: understanding the music conductor gestures by using the WB-4 inertial measurement system. Advanced Robotics, 28 (11), pp. 781-792.

Publisher

© Taylor & Francis and The Robotics Society of Japan

Version

  • AM (Accepted Manuscript)

Publisher statement

This work is made available according to the conditions of the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0) licence. Full details of this licence are available at: https://creativecommons.org/licenses/by-nc-nd/4.0/.

Publication date

2014

Notes

This item is embargoed until 26-02-2015.

ISSN

0169-1864

eISSN

1568-5535

Language

  • en