Feel it in my bones: Composing multimodal experience through tissue conduction

Conference item


Lennox, P., McKenzie, I. and Brown, M. 2017. Feel it in my bones: Composing multimodal experience through tissue conduction. Les éditions de PRISM.
AuthorsLennox, P., McKenzie, I. and Brown, M.
Abstract

We outline here the feasibility of coherently utilising tissue conduction for spatial audio and tactile input. Tissue conduction display-specific compositional concerns are discussed; it is hypothesised that the qualia available through this medium substantively differ from those for conventional artificial means of appealing to auditory spatial perception. The implications include that spatial music experienced in this manner constitutes a new kind of experience, and that the ground rules of composition are yet to be established. We refer to results from listening experiences with one hundred listeners in an unstructured attribute elicitation exercise, where prominent themes such as “strange”, “weird”, “positive”, “spatial” and “vibrations” emerged. We speculate on future directions aimed at taking maximal advantage of the principle of multimodal perception to broaden the informational bandwidth of the display system. Some implications for composition for hearing-impaired are elucidated.

KeywordsBone conduction; Tissue conduction; Multimodal perception; Multimodal composition; Pallesthesia; Audio-tactile
Year2017
JournalProceedings of The 13th International Symposium on Computer Music Multidisciplinary Research (CMMR)
PublisherLes éditions de PRISM
Web address (URL)http://hdl.handle.net/10545/621931
http://creativecommons.org/licenses/by-nc-sa/4.0/
hdl:10545/621931
ISBN9791097498
File
File Access Level
Open
File
File Access Level
Open
File
File Access Level
Open
Publication dates28 Sep 2017
Publication process dates
Deposited30 Oct 2017, 16:46
ContributorsUniversity of Derby
Permalink -

https://repository.derby.ac.uk/item/94vz3/feel-it-in-my-bones-composing-multimodal-experience-through-tissue-conduction

Download files


File
CMMR_2017_paper_32.pdf
File access level: Open

license_url
File access level: Open

license.txt
File access level: Open

  • 161
    total views
  • 72
    total downloads
  • 1
    views this month
  • 0
    downloads this month

Export as

Related outputs

What Music they Make
Brown, M. and Randell, M. 2025. What Music they Make. Dracula Returns to Derby.
We robot: artificial intelligence and the future of creativity
Brown, M. and Wilson, C. 2024. We robot: artificial intelligence and the future of creativity. in: Reisman, F. (ed.) Creativity, Motivation, Neuroscience, AI and their Future London: KIE Publications KIE, Knowledge, Innovation & Enterprise. pp. 100-119
Audio artists assemble!: designing a creative pedagogic methodology that promotes collaboration and artistic cross- pollination
McMahon, D., Ribchester, C., Brown, M. and Randell, M. 2023. Audio artists assemble!: designing a creative pedagogic methodology that promotes collaboration and artistic cross- pollination. Makings - A Journal Researching the Creative Industries. 4 (1), pp. 1-17.
“When the boys come home”: an authentic and interdisciplinary audio drama production
Brown, M., McMahon, D., Ribchester, C., Randell, M. and Baggaley, P. 2022. “When the boys come home”: an authentic and interdisciplinary audio drama production. in: Sengupta, E. and Blessinger, P. (ed.) Changing the Conventional University Classroom London, UK. Emerald Group Publishing Limited. pp. 99-115
The philosophy of perception and stupidity
Lennox, Peter 2015. The philosophy of perception and stupidity.
A perceptual approach to the composition of meaning in artificial spatial audio
Lennox, Peter and Myatt, Tony 2007. A perceptual approach to the composition of meaning in artificial spatial audio. Audio Engineering Society.
Discussing the applicability of soundfield techniques for larger audience entertainment
Dickins, Glenn and Lennox, Peter 2016. Discussing the applicability of soundfield techniques for larger audience entertainment. Audio Engineering Society. https://doi.org/10.17743/aesconf.2016.978-1-942220-12-1
Music as artificial environment: Spatial, embodied multimodal experience
Lennox, Peter 2017. Music as artificial environment: Spatial, embodied multimodal experience. in: Routledge.
How to develop creative capacity for the fourth industrial revolution: Creativity and employability in higher education
Wilson, C., Lennox, P., Brown, M. and Hughes, G. 2017. How to develop creative capacity for the fourth industrial revolution: Creativity and employability in higher education. Knowledge, Innovation & Enterprise.
Sensory augmentation through tissue conduction
Lennox, Peter and McKenzie, I. 2017. Sensory augmentation through tissue conduction. InTech. https://doi.org/10.5772/intechopen.71126
The body as instrument: tissue conducted multimodal audio-tactile spatial music.
Lennox, P., McKenzie, I. and Brown, M. 2017. The body as instrument: tissue conducted multimodal audio-tactile spatial music.
Investigating spatial music qualia through tissue conduction
Lennox, Peter and McKenzie, I. 2017. Investigating spatial music qualia through tissue conduction. Aalto University.
Auralising the sublime: An investigation into creativity and process in the pursuit of sonic perfection.
Brown, M., Paterson, D. M. and Wilson, C. 2017. Auralising the sublime: An investigation into creativity and process in the pursuit of sonic perfection. KIE Conference Publications.
Immersive deconstruction: An exploration of dynamic loop-based performance diffused in a multi-channel environment.
Vandemast-Bell, P. and Brown, M. 2017. Immersive deconstruction: An exploration of dynamic loop-based performance diffused in a multi-channel environment.
Time tides: An exploration of dynamic loop-based performance diffused in a multi-channel environment.
Vandemast-Bell, P. and Brown, M. 2017. Time tides: An exploration of dynamic loop-based performance diffused in a multi-channel environment.
Audio-tactile multimodal perception of tissue-conducted sound fields
Lennox, Peter and McKenzie, I. 2017. Audio-tactile multimodal perception of tissue-conducted sound fields.
Creative inhibition: how and why
Lennox, P., Brown, M. and Wilson, C. 2016. Creative inhibition: how and why. in: KIE Conference Publications.
Dynamic loops and processing
Vandemast-Bell, P. and Brown, M. 2016. Dynamic loops and processing.
Thirteen
Shore, T. and Brown, M. 2016. Thirteen.
Making projects sing: a musical perspective of project management
Wilson, C., Sivaraman, R, Brown, M. and McCormack, D. 2016. Making projects sing: a musical perspective of project management. Business Expert Press.
Staying creative: creative technique, habit and experience
Wilson, C. and Brown, M. 2016. Staying creative: creative technique, habit and experience. in: KIE Conference Publications.
A cage for the muse and the limits of invention
Brown, M. and Wilson, C. 2016. A cage for the muse and the limits of invention. in: KIE Conference Publications.
The shape of my thoughts
Baggaley, P., Brown, M., Bosward, M., Poynton, S. and Thorpe, H. 2016. The shape of my thoughts.
Destroying creativity
Lennox, P., Wilson, C. and Brown, M. 2016. Destroying creativity.
Cognitive maps and spatial sound
Lennox, Peter 2013. Cognitive maps and spatial sound.
Spatialization and computer music
Lennox, Peter 2011. Spatialization and computer music. The Oxford Handbook of Computer Music. https://doi.org/10.1093/oxfordhb/9780199792030.013.0013
Higher Education Academy Fellowship
Lennox, Peter 2014. Higher Education Academy Fellowship.
Causal contexts, cognitive cartoons and spatial sound
Lennox, Peter and Myatt, Tony 2006. Causal contexts, cognitive cartoons and spatial sound. Qu e e n M a r y , U n i v e r s i t y o f L o n d o n.
The emotional contents of the ‘space’ in spatial music
Lennox, Peter 2009. The emotional contents of the ‘space’ in spatial music. International Conference on Music and Emotion, Durham, UK.
Bonfire of the inanities
Lennox, Peter 2010. Bonfire of the inanities. Times Higher Education.
Pecking Order
Lennox, Peter 2010. Pecking Order. Times Higher Education.
From surround to true 3-D
Lennox, Peter, Myatt, Tony and Vaughan, John 1999. From surround to true 3-D. The Proceedings of the AES 16th International conference.
Composing and capturing 3-D soundscapes
Lennox, Peter 2007. Composing and capturing 3-D soundscapes. University of Derby.
Are my cognitive maps the same as yours? …or even, the same as mine?
Lennox, Peter 2013. Are my cognitive maps the same as yours? …or even, the same as mine?
Plato's Ambisonic Garden
Lennox, Peter 2007. Plato's Ambisonic Garden.
Composing space: the ecology of artificial auditory environments
Lennox, Peter 2012. Composing space: the ecology of artificial auditory environments.
Perceptual cartoonification in multi-spatial sound systems
Lennox, Peter and Myatt, Tony 2011. Perceptual cartoonification in multi-spatial sound systems.
Report on a medium-scale three dimensional artificial soundscape rendition: research and development system
Lennox, Peter 2002. Report on a medium-scale three dimensional artificial soundscape rendition: research and development system. Earshot.
3D audio as an information-environment: manipulating perceptual significance for differntiation and pre-selection
Lennox, Peter, Vaughan, John and Myatt, Tony 2001. 3D audio as an information-environment: manipulating perceptual significance for differntiation and pre-selection. Laboratory of Acoustics and audio signal processing and the Telecommunications Software and Multimedia Laboratory, Helsinki University of Technology.
3-D Sound: Massive and minute
Lennox, Peter 2006. 3-D Sound: Massive and minute.
Composing and Capturing 3-D Soundscapes
Lennox, Peter 2007. Composing and Capturing 3-D Soundscapes.
Concepts of perceptual significance for composition and reproduction of explorable sound fields
Lennox, Peter and Myatt, Tony 2007. Concepts of perceptual significance for composition and reproduction of explorable sound fields. Schulich School of Music, McGill University.
Inside-outside: 3-D music through tissue conduction
McKenzie, I., Lennox, Peter and Wiggins, Bruce 2015. Inside-outside: 3-D music through tissue conduction.
Ambiguity, uncertainty and new realities: perspectives of creative value, utility and authenticity
Wilson, C. and Brown, M. 2015. Ambiguity, uncertainty and new realities: perspectives of creative value, utility and authenticity. in: KIE Conference Publications.
Conformity, deformity and reformity
Brown, M. and Wilson, C. 2015. Conformity, deformity and reformity. in: Knowledge, Innovation & Enterprise.
Conformity, deformity, and reformity: considering the domain-idiolect creativity dynamic
Brown, M. and Wilson, C. 2015. Conformity, deformity, and reformity: considering the domain-idiolect creativity dynamic. in: KIE Conference Publications.
Conformity, deformity and reformity
Brown, M. and Wilson, C. 2015. Conformity, deformity and reformity. West East Institute.
Creativity and authenticity: perspectives of creative value, utility and quality
Wilson, C. and Brown, M. 2015. Creativity and authenticity: perspectives of creative value, utility and quality. DAKAM - Eastern Mediterranean Academic Research Center.
Ambiguity, uncertainty and new realities: perspectives of creative value, utility and authenticity
Wilson, C. and Brown, M. 2015. Ambiguity, uncertainty and new realities: perspectives of creative value, utility and authenticity. in: KIE, Knowledge, Innovation & Enterprise.
Creative dynamics: artistic production as a model of creative interaction
Brown, M. and Wilson, C. 2014. Creative dynamics: artistic production as a model of creative interaction. in: Knowledge, Innovation & Enterprise.
Tissue-conducted spatial sound fields
McKenzie, I., Lennox, Peter and Wiggins, Bruce 2014. Tissue-conducted spatial sound fields. Institute of Acoustics.
Hearing Without Ears
McKenzie, I., Lennox, Peter and Wiggins, Bruce 2014. Hearing Without Ears. International Community for Auditory Display.
Education for innovation: exploring the place of creativity, innovation and entrepreneurship in Higher Education
Wilson, Chris and Lennox, Peter 2012. Education for innovation: exploring the place of creativity, innovation and entrepreneurship in Higher Education. IETSD.
Extending realities: creativity, artistry and technology
Wilson, C. and Brown, M. 2013. Extending realities: creativity, artistry and technology. in: KIE.
Between possibilities and places: cognitive metaphor, creativity, art and education
Brown, M. and Wilson, C. 2013. Between possibilities and places: cognitive metaphor, creativity, art and education. in: KIE.
The business of invention: considering project management in the arts and industry
Wilson, C. and Brown, M. 2013. The business of invention: considering project management in the arts and industry. in: Knowledge, Innovation & Enterprise.
Sound, space, image and music: hybridity in creative process through technology, interactivity and collaboration
Wilson, C. and Brown, M. 2012. Sound, space, image and music: hybridity in creative process through technology, interactivity and collaboration. Journal of Music, Technology and Education. https://doi.org/10.1386/jmte.5.1.89_1