The body as instrument: tissue conducted multimodal audio-tactile spatial music.

Conference item


Lennox, Peter, McKenzie, I. and Brown, Michael 2017. The body as instrument: tissue conducted multimodal audio-tactile spatial music.
AuthorsLennox, Peter, McKenzie, I. and Brown, Michael
Abstract

We describe early progress in exploring the compositional potential for multimodal music of a multi-transducer audio-plus-vibrotactile apparatus, utilising ambisonics encoding; the tactile component is an incidental by-product, carried by the same transducers. An elicitation exercise with one hundred uninstructed listeners who gave responses in their own words was conducted and responses were transcribed and aggregated to identify emergent descriptive themes. The tactile components of the stimuli assume greater importance in the perceptual experience than originally considered, suggesting compositional opportunities in utilizing additive effects of audio-plus-tactile signals. This could engender assistive technologies for those with some degree of conductive hearing loss, ameliorating music-deprivation and addressing quality-of-life (QoL) issues.

KeywordsMultimodal perception; Quality of life; Spatial music; Bone conduction; Tissue conduction; Hearing impairment; Assistive technology; Audio-tactile
Year2017
Web address (URL)http://hdl.handle.net/10545/621929
http://creativecommons.org/licenses/by-nc-sa/4.0/
hdl:10545/621929
File
File Access Level
Open
File
File Access Level
Open
File
File Access Level
Open
Publication dates25 Aug 2017
Publication process dates
Deposited30 Oct 2017, 12:54
ContributorsUniversity of Derby
Permalink -

https://repository.derby.ac.uk/item/941q3/the-body-as-instrument-tissue-conducted-multimodal-audio-tactile-spatial-music

Download files


File
isaar_2017_Body as Instrument.pdf
File access level: Open

license_url
File access level: Open

license.txt
File access level: Open

  • 64
    total views
  • 28
    total downloads
  • 4
    views this month
  • 1
    downloads this month

Export as

Related outputs

Time tides: An exploration of dynamic loop-based performance diffused in a multi-channel environment.
Vandemast-Bell, Paul and Brown, Michael 2017. Time tides: An exploration of dynamic loop-based performance diffused in a multi-channel environment.
Immersive deconstruction: An exploration of dynamic loop-based performance diffused in a multi-channel environment.
Vandemast-Bell, Paul and Brown, Michael 2017. Immersive deconstruction: An exploration of dynamic loop-based performance diffused in a multi-channel environment.
Auralising the sublime: An investigation into creativity and process in the pursuit of sonic perfection.
Brown, Michael, Paterson, David M. and Wilson, Chris 2017. Auralising the sublime: An investigation into creativity and process in the pursuit of sonic perfection. KIE Conference Publications.
The philosophy of perception and stupidity
Lennox, Peter 2015. The philosophy of perception and stupidity.
A perceptual approach to the composition of meaning in artificial spatial audio
Lennox, Peter and Myatt, Tony 2007. A perceptual approach to the composition of meaning in artificial spatial audio. Audio Engineering Society.
Discussing the applicability of soundfield techniques for larger audience entertainment
Dickins, Glenn and Lennox, Peter 2016. Discussing the applicability of soundfield techniques for larger audience entertainment. Audio Engineering Society. https://doi.org/10.17743/aesconf.2016.978-1-942220-12-1
Destroying creativity
Lennox, Peter, Wilson, Chris and Brown, Michael 2016. Destroying creativity.
Music as artificial environment: Spatial, embodied multimodal experience
Lennox, Peter 2017. Music as artificial environment: Spatial, embodied multimodal experience. in: Routledge.
Dynamic loops and processing
Vandemast-Bell, Paul and Brown, Michael 2016. Dynamic loops and processing.
How to develop creative capacity for the fourth industrial revolution: Creativity and employability in higher education
Wilson, Chris, Lennox, Peter, Brown, Michael and Hughes, G. 2017. How to develop creative capacity for the fourth industrial revolution: Creativity and employability in higher education. Knowledge, Innovation & Enterprise.
Feel it in my bones: Composing multimodal experience through tissue conduction
Lennox, Peter, McKenzie, I. and Brown, Michael 2017. Feel it in my bones: Composing multimodal experience through tissue conduction. Les éditions de PRISM.
Sensory augmentation through tissue conduction
Lennox, Peter and McKenzie, I. 2017. Sensory augmentation through tissue conduction. InTech. https://doi.org/10.5772/intechopen.71126
Investigating spatial music qualia through tissue conduction
Lennox, Peter and McKenzie, I. 2017. Investigating spatial music qualia through tissue conduction. Aalto University.
Audio-tactile multimodal perception of tissue-conducted sound fields
Lennox, Peter and McKenzie, I. 2017. Audio-tactile multimodal perception of tissue-conducted sound fields.
Thirteen
Shore, Tim and Brown, Michael 2016. Thirteen.
The shape of my thoughts
Baggaley, Phil, Brown, Michael, Bosward, Marc, Poynton, Stuart and Thorpe, Hayley 2016. The shape of my thoughts.
Creative inhibition: how and why
Lennox, Peter, Brown, Michael and Wilson, Chris 2016. Creative inhibition: how and why. in: KIE Conference Publications.
Staying creative: creative technique, habit and experience
Wilson, Chris and Brown, Michael 2016. Staying creative: creative technique, habit and experience. in: KIE Conference Publications.
A cage for the muse and the limits of invention
Brown, Michael and Wilson, Chris 2016. A cage for the muse and the limits of invention. in: KIE Conference Publications.
Making projects sing: a musical perspective of project management
Wilson, Chris, Sivaraman, R, Brown, Michael and McCormack, Danny 2016. Making projects sing: a musical perspective of project management. Business Expert Press.
Conformity, deformity and reformity
Brown, Michael and Wilson, Chris 2015. Conformity, deformity and reformity. West East Institute.
Creative dynamics: artistic production as a model of creative interaction
Brown, Michael and Wilson, Chris 2014. Creative dynamics: artistic production as a model of creative interaction. in: Knowledge, Innovation & Enterprise.
Ambiguity, uncertainty and new realities: perspectives of creative value, utility and authenticity
Wilson, Chris and Brown, Michael 2015. Ambiguity, uncertainty and new realities: perspectives of creative value, utility and authenticity. in: KIE, Knowledge, Innovation & Enterprise.
Creativity and authenticity: perspectives of creative value, utility and quality
Wilson, Chris and Brown, Michael 2015. Creativity and authenticity: perspectives of creative value, utility and quality. DAKAM - Eastern Mediterranean Academic Research Center.
Conformity, deformity and reformity
Brown, Michael and Wilson, Chris 2015. Conformity, deformity and reformity. in: Knowledge, Innovation & Enterprise.
The business of invention: considering project management in the arts and industry
Wilson, Chris and Brown, Michael 2013. The business of invention: considering project management in the arts and industry. in: Knowledge, Innovation & Enterprise.
Conformity, deformity, and reformity: considering the domain-idiolect creativity dynamic
Brown, Michael and Wilson, Chris 2015. Conformity, deformity, and reformity: considering the domain-idiolect creativity dynamic. in: KIE Conference Publications.
Ambiguity, uncertainty and new realities: perspectives of creative value, utility and authenticity
Wilson, Chris and Brown, Michael 2015. Ambiguity, uncertainty and new realities: perspectives of creative value, utility and authenticity. in: KIE Conference Publications.
Cognitive maps and spatial sound
Lennox, Peter 2013. Cognitive maps and spatial sound.
Spatialization and computer music
Lennox, Peter 2011. Spatialization and computer music. The Oxford Handbook of Computer Music. https://doi.org/10.1093/oxfordhb/9780199792030.013.0013
Higher Education Academy Fellowship
Lennox, Peter 2014. Higher Education Academy Fellowship.
Causal contexts, cognitive cartoons and spatial sound
Lennox, Peter and Myatt, Tony 2006. Causal contexts, cognitive cartoons and spatial sound. Qu e e n M a r y , U n i v e r s i t y o f L o n d o n.
The emotional contents of the ‘space’ in spatial music
Lennox, Peter 2009. The emotional contents of the ‘space’ in spatial music. International Conference on Music and Emotion, Durham, UK.
Bonfire of the inanities
Lennox, Peter 2010. Bonfire of the inanities. Times Higher Education.
Pecking Order
Lennox, Peter 2010. Pecking Order. Times Higher Education.
From surround to true 3-D
Lennox, Peter, Myatt, Tony and Vaughan, John 1999. From surround to true 3-D. The Proceedings of the AES 16th International conference.
Composing and capturing 3-D soundscapes
Lennox, Peter 2007. Composing and capturing 3-D soundscapes. University of Derby.
Are my cognitive maps the same as yours? …or even, the same as mine?
Lennox, Peter 2013. Are my cognitive maps the same as yours? …or even, the same as mine?
Plato's Ambisonic Garden
Lennox, Peter 2007. Plato's Ambisonic Garden.
Composing space: the ecology of artificial auditory environments
Lennox, Peter 2012. Composing space: the ecology of artificial auditory environments.
Perceptual cartoonification in multi-spatial sound systems
Lennox, Peter and Myatt, Tony 2011. Perceptual cartoonification in multi-spatial sound systems.
Report on a medium-scale three dimensional artificial soundscape rendition: research and development system
Lennox, Peter 2002. Report on a medium-scale three dimensional artificial soundscape rendition: research and development system. Earshot.
3D audio as an information-environment: manipulating perceptual significance for differntiation and pre-selection
Lennox, Peter, Vaughan, John and Myatt, Tony 2001. 3D audio as an information-environment: manipulating perceptual significance for differntiation and pre-selection. Laboratory of Acoustics and audio signal processing and the Telecommunications Software and Multimedia Laboratory, Helsinki University of Technology.
3-D Sound: Massive and minute
Lennox, Peter 2006. 3-D Sound: Massive and minute.
Composing and Capturing 3-D Soundscapes
Lennox, Peter 2007. Composing and Capturing 3-D Soundscapes.
Concepts of perceptual significance for composition and reproduction of explorable sound fields
Lennox, Peter and Myatt, Tony 2007. Concepts of perceptual significance for composition and reproduction of explorable sound fields. Schulich School of Music, McGill University.
Inside-outside: 3-D music through tissue conduction
McKenzie, I., Lennox, Peter and Wiggins, Bruce 2015. Inside-outside: 3-D music through tissue conduction.
Tissue-conducted spatial sound fields
McKenzie, I., Lennox, Peter and Wiggins, Bruce 2014. Tissue-conducted spatial sound fields. Institute of Acoustics.
Hearing Without Ears
McKenzie, I., Lennox, Peter and Wiggins, Bruce 2014. Hearing Without Ears. International Community for Auditory Display.
Between possibilities and places: cognitive metaphor, creativity, art and education
Brown, Michael and Wilson, Chris 2013. Between possibilities and places: cognitive metaphor, creativity, art and education. in: KIE.
Extending realities: creativity, artistry and technology
Wilson, Chris and Brown, Michael 2013. Extending realities: creativity, artistry and technology. in: KIE.
Education for innovation: exploring the place of creativity, innovation and entrepreneurship in Higher Education
Wilson, Chris and Lennox, Peter 2012. Education for innovation: exploring the place of creativity, innovation and entrepreneurship in Higher Education. IETSD.
Sound, space, image and music: hybridity in creative process through technology, interactivity and collaboration
Wilson, Chris and Brown, Michael 2012. Sound, space, image and music: hybridity in creative process through technology, interactivity and collaboration. Journal of Music, Technology and Education. https://doi.org/10.1386/jmte.5.1.89_1