
Project Type
University Coursework, Master's
Module
Final Year Project, Dissertation
AWARDS and result
Awarded the John Lansdown prize for outstanding contribution to the final project.
Final mark: 82%
Abstract
Past studies have individually applied audio reactive live-visual and musical-haptic feedback in
musical experiences. However, a more immersive and engaging musical experience could be
achieved from further research into a synergistic integration of both of these stimuli. It is this gap in
the research that acts as the rationale for this project. The aim of this project was to analyse the user's reaction and interaction to a musical experience when presented with vibro-tactile and visual feedback driven by the musical output. Two user studies were conducted and quantitative, qualitative and behavioural data was collected. User feedback was used to ascertain if these added stimuli impacted the audience’s immersion within an experience. The aim has been met by the creation of audio-haptic and live audio-visual technical artefacts that were implemented and studied together in the form of an experience. It was found that there was a confident reason to include live visual and haptic stimuli based on the musical output as it enhances the experience of listening to music.
musical experiences. However, a more immersive and engaging musical experience could be
achieved from further research into a synergistic integration of both of these stimuli. It is this gap in
the research that acts as the rationale for this project. The aim of this project was to analyse the user's reaction and interaction to a musical experience when presented with vibro-tactile and visual feedback driven by the musical output. Two user studies were conducted and quantitative, qualitative and behavioural data was collected. User feedback was used to ascertain if these added stimuli impacted the audience’s immersion within an experience. The aim has been met by the creation of audio-haptic and live audio-visual technical artefacts that were implemented and studied together in the form of an experience. It was found that there was a confident reason to include live visual and haptic stimuli based on the musical output as it enhances the experience of listening to music.
User study and images from the final result!
The hypotheses for this project were:
1) The user's immersion is increased by the addition of visuals and further increased by the additional integration of haptics.
2) This specific case of added visual and haptic feedback will have an impact on the musical experience in general.
1) The user's immersion is increased by the addition of visuals and further increased by the additional integration of haptics.
2) This specific case of added visual and haptic feedback will have an impact on the musical experience in general.
The results conclude that both hypotheses can be accepted. For (1) there is a clear increase in the qualitative and quantitative results pertaining to the feeling of immersion.
For (2) there is data that suggests the addition of haptic and visual stimuli in the musical experience positively impacts their emotions, with users stating they felt as if they were “a part of the experience”.








