Room acoustics and virtual reality: An implementation of auralisation and 360 degree image techniques to create virtual representations of spaces

Conference paper


Vilkaitis, A., Dring, M., Middlicott, C., Wiggins, B. and Hill, A.J. 2016. Room acoustics and virtual reality: An implementation of auralisation and 360 degree image techniques to create virtual representations of spaces. Institute of Acoustics.
AuthorsVilkaitis, A., Dring, M., Middlicott, C., Wiggins, B. and Hill, A.J.
TypeConference paper
Abstract

There has been a huge increase in enthusiasm for virtual reality in recent years. Spatial audio is of significant importance when creating virtual reality content if the experience is to be perceptually congruent. This project aims to intersect the worlds of virtual acoustic auralisation and virtual reality, creating a novel method of demonstrating room acoustic environments with maximal audio visual impact in a user friendly fashion. An open source library of 3D impulse responses together with 360° image/video capture using a variety of techniques will be created in different spaces (and positions within). Various spaces will be measured and analysed including classrooms, music venues, buildings of historical interest and theatres. As well as impulse response (IR) measurements, 360° images will be recorded using photospheres, captured on android smart phones [1] and the Ricoh theta S [2]. Future applications for these impulse responses will be the development of a virtual mixing tool, where the user will be able to experience mixing live performances within an auralised virtual environment, a method of allowing audiences to view and hear auralisations of different seating positions within a space for ticketing and marketing purposes, and the possibility of a real time auralised virtual concert.

There has been a huge increase in enthusiasm for virtual reality in recent years. Spatial audio is of significant importance when creating virtual reality content if the experience is to be perceptually congruent. This project aims to intersect the worlds of virtual acoustic auralisation and virtual reality, creating a novel method of demonstrating room acoustic environments with maximal audio visual impact in a user friendly fashion. An open source library of 3D impulse responses together with 360° image/video capture using a variety of techniques will be created in different spaces (and positions within). Various spaces will be measured and analysed including classrooms, music venues, buildings of historical interest and theatres. As well as impulse response (IR) measurements, 360° images will be recorded using photospheres, captured on android smart phones [1] and the Ricoh theta S [2]. Future applications for these impulse responses will be the development of a virtual mixing tool, where the
user will be able to experience mixing live performances within an auralised virtual environment, a method of allowing audiences to view and hear auralisations of different seating positions within a space for ticketing and marketing purposes, and the possibility of a real time auralised virtual concert.

KeywordsVirtual reality; Ambisonics; Binaural; Surround sound
Year2016
JournalProceedings of the Institute of Acoustics
PublisherInstitute of Acoustics
Web address (URL)http://www.scopus.com/inward/record.url?eid=2-s2.0-85015376606&partnerID=MN8TOARS
File
File Access Level
Open
File
File Access Level
Open
Publication dates2016
Publication process dates
Deposited18 Sep 2017, 09:07
ContributorsUniversity of Derby
Permalink -

https://repository.derby.ac.uk/item/92540/room-acoustics-and-virtual-reality-an-implementation-of-auralisation-and-360-degree-image-techniques-to-create-virtual-representations-of-spaces

Download files


File
license.txt
File access level: Open

  • 118
    total views
  • 85
    total downloads
  • 1
    views this month
  • 2
    downloads this month

Export as

Related outputs

Dynamic characterisation of a linearised transfer function of non-ideal buck converters
Wilson, D., Bousbaine, A. and Wiggins, B. 2024. Dynamic characterisation of a linearised transfer function of non-ideal buck converters. 13th International Conference on Power Electronics, Machines and Drives (PEMD 2024). IEEE. https://doi.org/10.1049/icp.2024.2197
Browser-Based Webcam Head-Tracked Ambisonics (WHAM)
Dring, M. and Wiggins, B. 2023. Browser-Based Webcam Head-Tracked Ambisonics (WHAM). 2023 Immersive and 3D Audio: from Architecture to Automotive (I3DA). IEEE. https://doi.org/10.1109/I3DA57090.2023.10289143
Guitars with Ambisonic Spatial Performance (GASP) An immersive guitar system
Werner, D., Wiggins, B., Fitzmaurice, E. and Hart, M. 2022. Guitars with Ambisonic Spatial Performance (GASP) An immersive guitar system. 21st Century Guitar Conference .
Capsule Calibration Approaches for Low-Cost Higher Order Ambisonic Microphone Arrays
Middlicott, C. and Wiggins, B. 2022. Capsule Calibration Approaches for Low-Cost Higher Order Ambisonic Microphone Arrays. 153rd Audio Engineering Society Convention. Audio Engineering Society.
Development of an Ambisonic Guitar System
Wiggins, B., Werner, D. and Emma Fitzmaurice 2021. Development of an Ambisonic Guitar System. in: Innovation in Music London Taylor & Francis. pp. 21
WHAM: To Asymmetry and Beyond!
Dring, M. and Wiggins, Bruce 2021. WHAM: To Asymmetry and Beyond! Institute of Acoustics.
The design and optimisation of surround sound decoders using heuristic methods
Wiggins, Bruce, Berry, Stuart, Lowndes, Val and Paterson-Stephens, Iain 2003. The design and optimisation of surround sound decoders using heuristic methods.
Development of an ambisonic guitar system GASP: Guitars with ambisonic spatial performance
Werner, Duncan, Wiggins, Bruce and Fitzmaurice, Emma 2021. Development of an ambisonic guitar system GASP: Guitars with ambisonic spatial performance. in: CRC Press/ Routledge.
WHAM: Webcam head-tracked ambisonics
Dring, M. and Wiggins, B. 2020. WHAM: Webcam head-tracked ambisonics. Institute of Acoustics. https://doi.org/10.25144/13379
Calibration approaches for higher order ambisonic microphones
Middlicott, C.J., Wiggins, B.J. and Wiggins, B. 2019. Calibration approaches for higher order ambisonic microphones. Audio Engineering Society.
The transparency of binaural auralisation using very high order circular harmonics
Dring, M. and Wiggins, Bruce 2019. The transparency of binaural auralisation using very high order circular harmonics. Institute of Acoustics.
Development of ambisonic microphone design tools – Part 1.
Middlicott, Charlie and Wiggins, Bruce 2018. Development of ambisonic microphone design tools – Part 1. Audio Engineering Society.
Development of ambisonic microphone design tools - Part 1
Middlicott, C.J., Wiggins, B.J. and Wiggins, B. 2018. Development of ambisonic microphone design tools - Part 1. Audio Engineering Society.
Analysis of binaural cue matching using ambisonics to binaural decoding techniques
Wiggins, Bruce 2017. Analysis of binaural cue matching using ambisonics to binaural decoding techniques.
Head tracked audio for all - the 3D audio VR revolution
Wiggins, Bruce 2016. Head tracked audio for all - the 3D audio VR revolution. Institute of Acoustics.
Modelling the performance of speaker arrays in domestic listening environments.
Dring, M., Middlicott, Charlie, Wiggins, Bruce and Vilkaitis, Alex 2017. Modelling the performance of speaker arrays in domestic listening environments. Institute of Acoustics.
GASP v2: Guitars with Ambisonic Spatial Performance
Werner, Duncan, Wiggins, Bruce, Box, Charlie, Dallali, Dominic, Hooley, Jack and Middlicott, Charlie 2016. GASP v2: Guitars with Ambisonic Spatial Performance.
AmbiFreeverb 2 - Development of a 3D ambisonic reverb with spatial warping and variable scattering
Wiggins, B. and Dring, M. 2016. AmbiFreeverb 2 - Development of a 3D ambisonic reverb with spatial warping and variable scattering. Audio Engineering Society.
GASP: Guitars with ambisonic spatial performance
Werner, Duncan, Wiggins, Bruce, Lawson, Tom, Weightman, Tom and Callister, Joe 2015. GASP: Guitars with ambisonic spatial performance.
Inside-outside: 3-D music through tissue conduction
McKenzie, I., Lennox, Peter and Wiggins, Bruce 2015. Inside-outside: 3-D music through tissue conduction.
Tissue-conducted spatial sound fields
McKenzie, I., Lennox, Peter and Wiggins, Bruce 2014. Tissue-conducted spatial sound fields. Institute of Acoustics.
Hearing Without Ears
McKenzie, I., Lennox, Peter and Wiggins, Bruce 2014. Hearing Without Ears. International Community for Auditory Display.
Validation of a quad-rotor helicopter matlab/simulink and solidworks models
Poyi, Gwangtim Timothy, Wu, Mian Hong, Bousbaine, Amar and Wiggins, Bruce 2013. Validation of a quad-rotor helicopter matlab/simulink and solidworks models.
The generation of panning laws for irregular speaker arrays using heuristic methods
Wiggins, Bruce 2007. The generation of panning laws for irregular speaker arrays using heuristic methods. Audio Engineering Society.
Distance coding and performance of the mark 5 and st350 SoundField microphones and their suitability for Ambisonic reproduction.
Wiggins, Bruce and Spenceley, Thomas 2009. Distance coding and performance of the mark 5 and st350 SoundField microphones and their suitability for Ambisonic reproduction. Proceeding of the Institute of Acoustics, Vol 31, Pt 4..
Has Ambisonics come of age?
Wiggins, Bruce 2008. Has Ambisonics come of age? Reproduced Sound 24 Conference Proceedings Vol 30. Pt 6.
An investigation into the real-time manipulation and control of three-dimensional sound fields
Wiggins, Bruce 2004. An investigation into the real-time manipulation and control of three-dimensional sound fields. PhD Thesis https://doi.org/10.48773/93q0q