Month: September 2014

This paper describes an exploratory study of different gestures and body movements of a viola player resulting from the variation of bow strokes length and quantity. Within the theoretical framework of embodied music cognition and the study of musical gestures, we aim to observe how the variation of a musical feature within the piece affects the body movements of the performer. Two brief pieces were performed in four different versions, each one with different directions regarding the bow strokes. The performances were recorded using a multimodal recording platform that included audio, video and motion capture data obtained from high-speed tracking of reflective markers placed on the body of the performer and on the instrument. We extracted measurements of quantity of motion and velocity of different parts of the body, the bow and the viola. Results indicate that an increased activity in sound-producing and instrumental gestures does not always resonate proportionally in the rest of the body and the outcome in terms of ancillary gestures may vary across upper body and lower body.

Unfolding | Clusters is a music and visual media installation modeled from published scientific data related to the pathophysiology of amyotrophic lateral sclerosis (ALS). The work aims to create an engaging multimodal experience useful for raising awareness in the greater public about the disease and its scientific process. This paper describes the motivation behind the adoption of a musification approach and the musical criteria applied to the data mapping process. Details regarding the mapping structure are illustrated in relation to the different phases of the progress of the disease. The results are then discussed, noting that adopting a musification approach not only helped in obtaining a more engaging audience experience but also in providing expressive solutions that would be useful for modeling other complex biomedical data and processes.