Feel it in my bones: Composing multimodal experience through tissue conduction

Conference item


Lennox, Peter, McKenzie, I. and Brown, Michael 2017. Feel it in my bones: Composing multimodal experience through tissue conduction. Les éditions de PRISM.
AuthorsLennox, Peter, McKenzie, I. and Brown, Michael
Abstract

We outline here the feasibility of coherently utilising tissue conduction for spatial audio and tactile input. Tissue conduction display-specific compositional concerns are discussed; it is hypothesised that the qualia available through this medium substantively differ from those for conventional artificial means of appealing to auditory spatial perception. The implications include that spatial music experienced in this manner constitutes a new kind of experience, and that the ground rules of composition are yet to be established. We refer to results from listening experiences with one hundred listeners in an unstructured attribute elicitation exercise, where prominent themes such as “strange”, “weird”, “positive”, “spatial” and “vibrations” emerged. We speculate on future directions aimed at taking maximal advantage of the principle of multimodal perception to broaden the informational bandwidth of the display system. Some implications for composition for hearing-impaired are elucidated.

KeywordsBone conduction; Tissue conduction; Multimodal perception; Multimodal composition; Pallesthesia; Audio-tactile
Year2017
JournalProceedings of The 13th International Symposium on Computer Music Multidisciplinary Research (CMMR)
PublisherLes éditions de PRISM
Web address (URL)http://hdl.handle.net/10545/621931
http://creativecommons.org/licenses/by-nc-sa/4.0/
hdl:10545/621931
ISBN9791097498
File
File Access Level
Open
File
File Access Level
Open
File
File Access Level
Open
Publication dates28 Sep 2017
Publication process dates
Deposited30 Oct 2017, 16:46
ContributorsUniversity of Derby
Permalink -

https://repository.derby.ac.uk/item/94vz3/feel-it-in-my-bones-composing-multimodal-experience-through-tissue-conduction

Download files


File
CMMR_2017_paper_32.pdf
File access level: Open

license_url
File access level: Open

license.txt
File access level: Open

  • 23
    total views
  • 18
    total downloads
  • 1
    views this month
  • 1
    downloads this month

Export as

Related outputs

Time tides: An exploration of dynamic loop-based performance diffused in a multi-channel environment.
Vandemast-Bell, Paul and Brown, Michael 2017. Time tides: An exploration of dynamic loop-based performance diffused in a multi-channel environment.
Immersive deconstruction: An exploration of dynamic loop-based performance diffused in a multi-channel environment.
Vandemast-Bell, Paul and Brown, Michael 2017. Immersive deconstruction: An exploration of dynamic loop-based performance diffused in a multi-channel environment.
Auralising the sublime: An investigation into creativity and process in the pursuit of sonic perfection.
Brown, Michael, Paterson, David M. and Wilson, Chris 2017. Auralising the sublime: An investigation into creativity and process in the pursuit of sonic perfection. KIE Conference Publications.
The philosophy of perception and stupidity
Lennox, Peter 2015. The philosophy of perception and stupidity.
A perceptual approach to the composition of meaning in artificial spatial audio
Lennox, Peter and Myatt, Tony 2007. A perceptual approach to the composition of meaning in artificial spatial audio. Audio Engineering Society.
Discussing the applicability of soundfield techniques for larger audience entertainment
Dickins, Glenn and Lennox, Peter 2016. Discussing the applicability of soundfield techniques for larger audience entertainment. Audio Engineering Society. https://doi.org/10.17743/aesconf.2016.978-1-942220-12-1
Destroying creativity
Lennox, Peter, Wilson, Chris and Brown, Michael 2016. Destroying creativity.
Music as artificial environment: Spatial, embodied multimodal experience
Lennox, Peter 2017. Music as artificial environment: Spatial, embodied multimodal experience. in: Routledge.
Dynamic loops and processing
Vandemast-Bell, Paul and Brown, Michael 2016. Dynamic loops and processing.
How to develop creative capacity for the fourth industrial revolution: Creativity and employability in higher education
Wilson, Chris, Lennox, Peter, Brown, Michael and Hughes, G. 2017. How to develop creative capacity for the fourth industrial revolution: Creativity and employability in higher education. Knowledge, Innovation & Enterprise.
Sensory augmentation through tissue conduction
Lennox, Peter and McKenzie, I. 2017. Sensory augmentation through tissue conduction. InTech. https://doi.org/10.5772/intechopen.71126
The body as instrument: tissue conducted multimodal audio-tactile spatial music.
Lennox, Peter, McKenzie, I. and Brown, Michael 2017. The body as instrument: tissue conducted multimodal audio-tactile spatial music.
Investigating spatial music qualia through tissue conduction
Lennox, Peter and McKenzie, I. 2017. Investigating spatial music qualia through tissue conduction. Aalto University.
Audio-tactile multimodal perception of tissue-conducted sound fields
Lennox, Peter and McKenzie, I. 2017. Audio-tactile multimodal perception of tissue-conducted sound fields.
Thirteen
Shore, Tim and Brown, Michael 2016. Thirteen.
The shape of my thoughts
Baggaley, Phil, Brown, Michael, Bosward, Marc, Poynton, Stuart and Thorpe, Hayley 2016. The shape of my thoughts.
Creative inhibition: how and why
Lennox, Peter, Brown, Michael and Wilson, Chris 2016. Creative inhibition: how and why. in: KIE Conference Publications.
Staying creative: creative technique, habit and experience
Wilson, Chris and Brown, Michael 2016. Staying creative: creative technique, habit and experience. in: KIE Conference Publications.
A cage for the muse and the limits of invention
Brown, Michael and Wilson, Chris 2016. A cage for the muse and the limits of invention. in: KIE Conference Publications.
Making projects sing: a musical perspective of project management
Wilson, Chris, Sivaraman, R, Brown, Michael and McCormack, Danny 2016. Making projects sing: a musical perspective of project management. Business Expert Press.
Conformity, deformity and reformity
Brown, Michael and Wilson, Chris 2015. Conformity, deformity and reformity. West East Institute.
Creative dynamics: artistic production as a model of creative interaction
Brown, Michael and Wilson, Chris 2014. Creative dynamics: artistic production as a model of creative interaction. in: Knowledge, Innovation & Enterprise.
Ambiguity, uncertainty and new realities: perspectives of creative value, utility and authenticity
Wilson, Chris and Brown, Michael 2015. Ambiguity, uncertainty and new realities: perspectives of creative value, utility and authenticity. in: KIE, Knowledge, Innovation & Enterprise.
Creativity and authenticity: perspectives of creative value, utility and quality
Wilson, Chris and Brown, Michael 2015. Creativity and authenticity: perspectives of creative value, utility and quality. DAKAM - Eastern Mediterranean Academic Research Center.
Conformity, deformity and reformity
Brown, Michael and Wilson, Chris 2015. Conformity, deformity and reformity. in: Knowledge, Innovation & Enterprise.
The business of invention: considering project management in the arts and industry
Wilson, Chris and Brown, Michael 2013. The business of invention: considering project management in the arts and industry. in: Knowledge, Innovation & Enterprise.
Conformity, deformity, and reformity: considering the domain-idiolect creativity dynamic
Brown, Michael and Wilson, Chris 2015. Conformity, deformity, and reformity: considering the domain-idiolect creativity dynamic. in: KIE Conference Publications.
Ambiguity, uncertainty and new realities: perspectives of creative value, utility and authenticity
Wilson, Chris and Brown, Michael 2015. Ambiguity, uncertainty and new realities: perspectives of creative value, utility and authenticity. in: KIE Conference Publications.
Cognitive maps and spatial sound
Lennox, Peter 2013. Cognitive maps and spatial sound.
Spatialization and computer music
Lennox, Peter 2011. Spatialization and computer music. The Oxford Handbook of Computer Music. https://doi.org/10.1093/oxfordhb/9780199792030.013.0013
Higher Education Academy Fellowship
Lennox, Peter 2014. Higher Education Academy Fellowship.
Causal contexts, cognitive cartoons and spatial sound
Lennox, Peter and Myatt, Tony 2006. Causal contexts, cognitive cartoons and spatial sound. Qu e e n M a r y , U n i v e r s i t y o f L o n d o n.
The emotional contents of the ‘space’ in spatial music
Lennox, Peter 2009. The emotional contents of the ‘space’ in spatial music. International Conference on Music and Emotion, Durham, UK.
Bonfire of the inanities
Lennox, Peter 2010. Bonfire of the inanities. Times Higher Education.
Pecking Order
Lennox, Peter 2010. Pecking Order. Times Higher Education.
From surround to true 3-D
Lennox, Peter, Myatt, Tony and Vaughan, John 1999. From surround to true 3-D. The Proceedings of the AES 16th International conference.
Composing and capturing 3-D soundscapes
Lennox, Peter 2007. Composing and capturing 3-D soundscapes. University of Derby.
Are my cognitive maps the same as yours? …or even, the same as mine?
Lennox, Peter 2013. Are my cognitive maps the same as yours? …or even, the same as mine?
Plato's Ambisonic Garden
Lennox, Peter 2007. Plato's Ambisonic Garden.
Composing space: the ecology of artificial auditory environments
Lennox, Peter 2012. Composing space: the ecology of artificial auditory environments.
Perceptual cartoonification in multi-spatial sound systems
Lennox, Peter and Myatt, Tony 2011. Perceptual cartoonification in multi-spatial sound systems.
Report on a medium-scale three dimensional artificial soundscape rendition: research and development system
Lennox, Peter 2002. Report on a medium-scale three dimensional artificial soundscape rendition: research and development system. Earshot.
3D audio as an information-environment: manipulating perceptual significance for differntiation and pre-selection
Lennox, Peter, Vaughan, John and Myatt, Tony 2001. 3D audio as an information-environment: manipulating perceptual significance for differntiation and pre-selection. Laboratory of Acoustics and audio signal processing and the Telecommunications Software and Multimedia Laboratory, Helsinki University of Technology.
3-D Sound: Massive and minute
Lennox, Peter 2006. 3-D Sound: Massive and minute.
Composing and Capturing 3-D Soundscapes
Lennox, Peter 2007. Composing and Capturing 3-D Soundscapes.
Concepts of perceptual significance for composition and reproduction of explorable sound fields
Lennox, Peter and Myatt, Tony 2007. Concepts of perceptual significance for composition and reproduction of explorable sound fields. Schulich School of Music, McGill University.
Inside-outside: 3-D music through tissue conduction
McKenzie, I., Lennox, Peter and Wiggins, Bruce 2015. Inside-outside: 3-D music through tissue conduction.
Tissue-conducted spatial sound fields
McKenzie, I., Lennox, Peter and Wiggins, Bruce 2014. Tissue-conducted spatial sound fields. Institute of Acoustics.
Hearing Without Ears
McKenzie, I., Lennox, Peter and Wiggins, Bruce 2014. Hearing Without Ears. International Community for Auditory Display.
Between possibilities and places: cognitive metaphor, creativity, art and education
Brown, Michael and Wilson, Chris 2013. Between possibilities and places: cognitive metaphor, creativity, art and education. in: KIE.
Extending realities: creativity, artistry and technology
Wilson, Chris and Brown, Michael 2013. Extending realities: creativity, artistry and technology. in: KIE.
Education for innovation: exploring the place of creativity, innovation and entrepreneurship in Higher Education
Wilson, Chris and Lennox, Peter 2012. Education for innovation: exploring the place of creativity, innovation and entrepreneurship in Higher Education. IETSD.
Sound, space, image and music: hybridity in creative process through technology, interactivity and collaboration
Wilson, Chris and Brown, Michael 2012. Sound, space, image and music: hybridity in creative process through technology, interactivity and collaboration. Journal of Music, Technology and Education. https://doi.org/10.1386/jmte.5.1.89_1