Room acoustics and virtual reality: An implementation of auralisation and 360 degree image techniques to create virtual representations of spaces

Conference item


Vilkaitis, Alex, Dring, M., Middlicott, Charlie, Hill, Adam J. and Wiggins, Bruce 2016. Room acoustics and virtual reality: An implementation of auralisation and 360 degree image techniques to create virtual representations of spaces. Institute of Acoustics.
AuthorsVilkaitis, Alex, Dring, M., Middlicott, Charlie, Hill, Adam J. and Wiggins, Bruce
Abstract

There has been a huge increase in enthusiasm for virtual reality in recent years. Spatial audio is of significant importance when creating virtual reality content if the experience is to be perceptually congruent. This project aims to intersect the worlds of virtual acoustic auralisation and virtual reality, creating a novel method of demonstrating room acoustic environments with maximal audio visual impact in a user friendly fashion. An open source library of 3D impulse responses together with 360° image/video capture using a variety of techniques will be created in different spaces (and positions within). Various spaces will be measured and analysed including classrooms, music venues, buildings of historical interest and theatres. As well as impulse response (IR) measurements, 360° images will be recorded using photospheres, captured on android smart phones [1] and the Ricoh theta S [2]. Future applications for these impulse responses will be the development of a virtual mixing tool, where the user will be able to experience mixing live performances within an auralised virtual environment, a method of allowing audiences to view and hear auralisations of different seating positions within a space for ticketing and marketing purposes, and the possibility of a real time auralised virtual concert.

There has been a huge increase in enthusiasm for virtual reality in recent years. Spatial audio is of significant importance when creating virtual reality content if the experience is to be perceptually congruent. This project aims to intersect the worlds of virtual acoustic auralisation and virtual reality, creating a novel method of demonstrating room acoustic environments with maximal audio visual impact in a user friendly fashion. An open source library of 3D impulse responses together with 360° image/video capture using a variety of techniques will be created in different spaces (and positions within). Various spaces will be measured and analysed including classrooms, music venues, buildings of historical interest and theatres. As well as impulse response (IR) measurements, 360° images will be recorded using photospheres, captured on android smart phones [1] and the Ricoh theta S [2]. Future applications for these impulse responses will be the development of a virtual mixing tool, where the
user will be able to experience mixing live performances within an auralised virtual environment, a method of allowing audiences to view and hear auralisations of different seating positions within a space for ticketing and marketing purposes, and the possibility of a real time auralised virtual concert.

KeywordsVirtual reality; Ambisonics; Binaural; Surround sound
Year2016
JournalReproduced Sound 2016 - Proceedings of the Institute of Acoustics
PublisherInstitute of Acoustics
Web address (URL)http://hdl.handle.net/10545/621850
hdl:10545/621850
File
File Access Level
Open
File
File Access Level
Open
Publication datesNov 2016
Publication process dates
Deposited18 Sep 2017, 09:07
ContributorsUniversity of Derby
Permalink -

https://repository.derby.ac.uk/item/92540/room-acoustics-and-virtual-reality-an-implementation-of-auralisation-and-360-degree-image-techniques-to-create-virtual-representations-of-spaces

Download files


File
license.txt
File access level: Open

  • 15
    total views
  • 0
    total downloads
  • 0
    views this month
  • 0
    downloads this month

Export as

Related outputs

Capsule Calibration Approaches for Low-Cost Higher Order Ambisonic Microphone Arrays
Middlicott, C. and Wiggins, B. 2022. Capsule Calibration Approaches for Low-Cost Higher Order Ambisonic Microphone Arrays. 153rd Audio Engineering Society Convention. Audio Engineering Society.
The influence of audience participatory noise on sound levels at live events
Hill, A., Kok, M., Burton, J., Mulder, J. and Lawrence, M. 2022. The influence of audience participatory noise on sound levels at live events. Inter-noise. Inter-noise.
Towards the Global Standard for Safe Listening Venues and Events
Hill, A., Mulder, J, Burton, J., Kok,M. and Lawrence, M. 2022. Towards the Global Standard for Safe Listening Venues and Events. 152nd Convention of the Audio Engineering Society. Online May - Jun 2022 Audio Engineering Society.
AN INVESTIGATION INTO THE CALIBRATION OF LOW-COST MICROPHONES FOR HIGHER-ORDER MICROPHONE ARRAYS
Middlicott, C. 2022. AN INVESTIGATION INTO THE CALIBRATION OF LOW-COST MICROPHONES FOR HIGHER-ORDER MICROPHONE ARRAYS. PhD Thesis
Sound Level Monitoring at Live Events, Part 3 - Improved Tools and Procedures
Hill, Adam J., Mulder, Johannes, Burton, J., Kok, Marcel and Lawrence, Michael 2022. Sound Level Monitoring at Live Events, Part 3 - Improved Tools and Procedures. Journal of the Audio Engineering Society. https://doi.org/10.17743/jaes.2021.0049
Sound Level Monitoring at Live Events, Part 2 - Regulations, Practices, and Preferences
Hill, Adam J., Mulder, Johannes, Burton, J., Kok, Marcel and Lawrence, Michael 2022. Sound Level Monitoring at Live Events, Part 2 - Regulations, Practices, and Preferences. Journal of the Audio Engineering Society. https://doi.org/10.17743/jaes.2021.0042
WHAM: To Asymmetry and Beyond!
Dring, M. and Wiggins, Bruce 2021. WHAM: To Asymmetry and Beyond! Institute of Acoustics.
Sound Level Monitoring at Live Events, Part 1–Live Dynamic Range
Hill, Adam J., Mulder, Johannes, Burton, J., Kok, Marcel and Lawrence, Michael 2021. Sound Level Monitoring at Live Events, Part 1–Live Dynamic Range. Audio Engineering Society. https://doi.org/10.17743/jaes.2021.0050
Education and Certification in Sound Pressure Level Measurement, Monitoring and Management at Entertainment Events
Mulder, Johannes, Hill, Adam, Burton, J., Kok, Marcel, Lawrence, Michael and Shabalina, Elena 2021. Education and Certification in Sound Pressure Level Measurement, Monitoring and Management at Entertainment Events. Audio Engineering Society.
The design and optimisation of surround sound decoders using heuristic methods
Wiggins, Bruce, Berry, Stuart, Lowndes, Val and Paterson-Stephens, Iain 2003. The design and optimisation of surround sound decoders using heuristic methods.
Development of an ambisonic guitar system GASP: Guitars with ambisonic spatial performance
Werner, Duncan, Wiggins, Bruce and Fitzmaurice, Emma 2021. Development of an ambisonic guitar system GASP: Guitars with ambisonic spatial performance. in: CRC Press/ Routledge.
Understanding and managing sound exposure and noise pollution at outdoor events
Hill, Adam J. 2020. Understanding and managing sound exposure and noise pollution at outdoor events. Audio Engineering Society.
WHAM - Webcam Head-tracked AMbisonics
Dring, M. and Wiggins, Bruce 2020. WHAM - Webcam Head-tracked AMbisonics. Institute of Acoustics.
A case study on the impact list event sound level regulations have on sound engineering practice
Hill, Adam J. and Burton, J. 2020. A case study on the impact list event sound level regulations have on sound engineering practice. Institute of Acoustics. https://doi.org/10.25144/13382
Calibration approaches for higher order ambisonic microphones
Middlicott, Charlie and Wiggins, Bruce 2019. Calibration approaches for higher order ambisonic microphones.
Optimizing wide-area sound reproduction using a single subwoofer with dynamic signal decorrelation
Hill, Adam J. and Moore, J.B. 2019. Optimizing wide-area sound reproduction using a single subwoofer with dynamic signal decorrelation. Audio Engineering Society.
The transparency of binaural auralisation using very high order circular harmonics
Dring, M. and Wiggins, Bruce 2019. The transparency of binaural auralisation using very high order circular harmonics. Institute of Acoustics.
A case study on sound level monitoring and management at large-scale music festivals
Hill, Adam J., Kok, Marcel, Mulder, Johannes, Burton, J., Kociper, Alex and Berrios, Anthony 2019. A case study on sound level monitoring and management at large-scale music festivals. Institute of Acoustics.
Development of ambisonic microphone design tools – Part 1.
Middlicott, Charlie and Wiggins, Bruce 2018. Development of ambisonic microphone design tools – Part 1. Audio Engineering Society.
Development of ambisonic microphone design tools – Part 1.
Middlicott, Charlie and Wiggins, Bruce 2018. Development of ambisonic microphone design tools – Part 1. Proceedings of the 145th Convention of the Audio Engineering Society.
Investigation into the relationship between standing audience density and absorption.
Hammond, Ross, Hill, Adam J. and Mapp, Peter 2018. Investigation into the relationship between standing audience density and absorption.
Live sound loudspeaker array optimization for consistent directional coverage with diffuse radiation characteristics.
Hill, Adam J. and Hawksford, Malcolm O. J. 2018. Live sound loudspeaker array optimization for consistent directional coverage with diffuse radiation characteristics.
Dynamic diffuse signal processing for sound reinforcement and reproduction.
Moore, Jonathan B. and Hill, Adam J. 2018. Dynamic diffuse signal processing for sound reinforcement and reproduction. Journal of the Audio Engineering Society. https://doi.org/10.17743/jaes.2018.0054
Live sound subwoofer system performance quantification.
Hill, Adam J. 2018. Live sound subwoofer system performance quantification. Audio Engineering Society.
WFS and HOA: Simulations and evaluations of planar higher order ambisonic, wave field synthesis and surround hybrid algorithms for lateral spatial reproduction in theatre.
Vilkaitis, Alexander 2017. WFS and HOA: Simulations and evaluations of planar higher order ambisonic, wave field synthesis and surround hybrid algorithms for lateral spatial reproduction in theatre. Verband Deutscher Tonmeister.
Applications of dynamic diffuse signal processing in sound reinforcement and reproduction.
Moore, Jonathan B. and Hill, Adam J. 2017. Applications of dynamic diffuse signal processing in sound reinforcement and reproduction. Institute of Acoustics.
Efficient acoustic modelling of large acoustic spaces using finite difference methods.
Durbridge, Simon E. and Hill, Adam J. 2017. Efficient acoustic modelling of large acoustic spaces using finite difference methods. Institute of Acoustics.
Practical considerations for subwoofer arrays and clusters in live sound reinforcement.
Hill, Adam J. 2017. Practical considerations for subwoofer arrays and clusters in live sound reinforcement. Audio Engineering Society.
Dynamic diffuse signal processing for low-frequency spatial variance minimization across wide audience areas.
Moore, Jonathan B. and Hill, Adam J. 2017. Dynamic diffuse signal processing for low-frequency spatial variance minimization across wide audience areas. Audio Engineering Society.
Analysis of binaural cue matching using ambisonics to binaural decoding techniques
Wiggins, Bruce 2017. Analysis of binaural cue matching using ambisonics to binaural decoding techniques.
Disagreement between STI and STIPA measurements due to high level, discrete reflections
Hammond, Ross, Mapp, Peter and Hill, Adam J. 2017. Disagreement between STI and STIPA measurements due to high level, discrete reflections. Audio Engineering Society.
Optimization of temporally diffuse impulses for decorrelation of multiple discrete loudspeakers
Moore, Jonathan B. and Hill, Adam J. 2017. Optimization of temporally diffuse impulses for decorrelation of multiple discrete loudspeakers. Journal of the Audio Engineering Society.
Head tracked audio for all - the 3D audio VR revolution
Wiggins, Bruce 2016. Head tracked audio for all - the 3D audio VR revolution. Institute of Acoustics.
Modelling the performance of speaker arrays in domestic listening environments.
Dring, M., Middlicott, Charlie, Wiggins, Bruce and Vilkaitis, Alex 2017. Modelling the performance of speaker arrays in domestic listening environments. Institute of Acoustics.
The effect of performance stages on subwoofer polar and frequency responses
Hill, Adam J. and Paul, Joe 2016. The effect of performance stages on subwoofer polar and frequency responses. Institute of Acoustics.
Getting the most from your subs
Hill, Adam J. 2015. Getting the most from your subs. New Bay.
Defining true propagation patterns of underwater noise produced by stationary vessels
Lusted-Kosolwski, Claire, Piercy, Julius J. B. and Hill, Adam J. 2016. Defining true propagation patterns of underwater noise produced by stationary vessels. Acoustical Society of America.
The influence of discrete arriving reflections on perceived intelligibility and speech transmission index measurements
Hammond, Ross, Mapp, Peter and Hill, Adam J. 2016. The influence of discrete arriving reflections on perceived intelligibility and speech transmission index measurements. Audio Engineering Society.
The influence of discrete arriving reflections on perceived intelligibility and STI measurements
Hammond, Ross, Mapp, Peter and Hill, Adam J. 2016. The influence of discrete arriving reflections on perceived intelligibility and STI measurements. Audio Engineering Society.
GASP v2: Guitars with Ambisonic Spatial Performance
Werner, Duncan, Wiggins, Bruce, Box, Charlie, Dallali, Dominic, Hooley, Jack and Middlicott, Charlie 2016. GASP v2: Guitars with Ambisonic Spatial Performance.
Enhanced wide-area low-frequency sound reproduction in cinemas: effective and practical alternatives to current calibration strategies
Hill, Adam J., Hawksford, Malcolm O. J. and Newell, Philip 2016. Enhanced wide-area low-frequency sound reproduction in cinemas: effective and practical alternatives to current calibration strategies. Journal of the Audio Engineering Society. https://doi.org/10.17743/jaes.2016.0012
The good, the bad, and the distant: soundscape cues for larval fish
Piercy, Julius J. B., Smith, David J., Codling, Edward A., Hill, Adam J. and Simpson, Stephen D. 2015. The good, the bad, and the distant: soundscape cues for larval fish. in:
AmbiFreeVerb 2—Development of a 3D ambisonic reverb with spatial warping and variable scattering
Wiggins, Bruce and Dring, M. 2016. AmbiFreeVerb 2—Development of a 3D ambisonic reverb with spatial warping and variable scattering. Audio Engineering Society.
The effects of distortion on the perception of loudness in live sound
Durbridge, Simon E., Hill, Adam J. and Taylor, John 2015. The effects of distortion on the perception of loudness in live sound.
Habitat quality affects sound production and likely distance of detection on coral reefs
Piercy, Julius J. B., Codling, Edward A., Hill, Adam J., Smith, David J. and Simpson, Stephen D. 2014. Habitat quality affects sound production and likely distance of detection on coral reefs. Marine Ecology Progress Series. https://doi.org/10.3354/meps10986
Enhanced wide-area low-frequency sound reproduction in cinemas: Effective and practical alternatives to current sub-optimal calibration strategies
Hill, Adam J., Hawksford, Malcolm O. J. and Newell, Philip 2015. Enhanced wide-area low-frequency sound reproduction in cinemas: Effective and practical alternatives to current sub-optimal calibration strategies.
GASP: Guitars with ambisonic spatial performance
Werner, Duncan, Wiggins, Bruce, Lawson, Tom, Weightman, Tom and Callister, Joe 2015. GASP: Guitars with ambisonic spatial performance.
Inside-outside: 3-D music through tissue conduction
McKenzie, I., Lennox, Peter and Wiggins, Bruce 2015. Inside-outside: 3-D music through tissue conduction.
Subjective evaluation of an emerging theory of low-frequency sound source localization in closed acoustic spaces
Hill, Adam J. and Hawksford, Malcolm O. J. 2014. Subjective evaluation of an emerging theory of low-frequency sound source localization in closed acoustic spaces.
Has Ambisonics come of age?
Wiggins, Bruce 2008. Has Ambisonics come of age? Reproduced Sound 24 Conference Proceedings Vol 30. Pt 6.
Tissue-conducted spatial sound fields
McKenzie, I., Lennox, Peter and Wiggins, Bruce 2014. Tissue-conducted spatial sound fields. Institute of Acoustics.
Hearing Without Ears
McKenzie, I., Lennox, Peter and Wiggins, Bruce 2014. Hearing Without Ears. International Community for Auditory Display.
A scientific approach to microphone placement for cymbals in live sound
Harrison, Joshua J. and Hill, Adam J. 2013. A scientific approach to microphone placement for cymbals in live sound. Institute of Acoustics.
Low-frequency sound source localization as a function of closed acoustic spaces
Hill, Adam J. and Hawksford, Malcolm O. J. 2013. Low-frequency sound source localization as a function of closed acoustic spaces. Institute of Acoustics.
On the perceptual advantage of stereo subwoofer systems in live sound reinforcement
Hill, Adam J. and Hawksford, Malcolm O. J. 2013. On the perceptual advantage of stereo subwoofer systems in live sound reinforcement. Audio Engineering Society.
Live event performer tracking for digital console automation using industry-standard wireless microphone systems
Hill, Adam J., Lane, Kit, Rosenthal, Adam P. and Gand, Gary 2013. Live event performer tracking for digital console automation using industry-standard wireless microphone systems. Audio Engineering Society.
Music to our ears: the effect of background music in higher education learning environments
Hill, Adam J. 2013. Music to our ears: the effect of background music in higher education learning environments. Audio Engineering Society.
Validation of a quad-rotor helicopter matlab/simulink and solidworks models
Poyi, Gwangtim Timothy, Wu, Mian Hong, Bousbaine, Amar and Wiggins, Bruce 2013. Validation of a quad-rotor helicopter matlab/simulink and solidworks models.
The generation of panning laws for irregular speaker arrays using heuristic methods
Wiggins, Bruce 2007. The generation of panning laws for irregular speaker arrays using heuristic methods. Audio Engineering Society.
Towards a generalized theory of low-frequency sound source localization
Hill, Adam J., Lewis, Simon P. and Hawksford, Malcolm O. J. 2012. Towards a generalized theory of low-frequency sound source localization.
Low-frequency temporal accuracy of small-room sound reproduction
Hill, Adam J. and Hawksford, Malcolm O. J. 2012. Low-frequency temporal accuracy of small-room sound reproduction.
Analysis, modeling and wide-area spatiotemporal control of low-frequency sound reproduction
Hill, Adam J. 2012. Analysis, modeling and wide-area spatiotemporal control of low-frequency sound reproduction. Thesis
Chameleon subwoofer arrays in live sound
Hill, Adam J. and Hawksford, Malcolm O. J. 2011. Chameleon subwoofer arrays in live sound. Acoustics Bulletin.
Visualization and analysis tools for low-frequency propagation in a generalized 3D acoustic space
Hill, Adam J. and Hawksford, Malcolm O. J. 2011. Visualization and analysis tools for low-frequency propagation in a generalized 3D acoustic space. Journal of the Audio Engineering Society.
A hybrid virtual bass system for optimized steady-state and transient performance
Hill, Adam J. and Hawksford, Malcolm O. J. 2010. A hybrid virtual bass system for optimized steady-state and transient performance.
Kick-Drum signal acquisition, isolation and reinforcement optimization in live sound
Hill, Adam J., Hawksford, Malcolm O. J., Rosenthal, Adam P. and Gand, Gary 2011. Kick-Drum signal acquisition, isolation and reinforcement optimization in live sound.
Individualized low-frequency response manipulation for multiple listeners using chameleon subwoofer arrays
Hill, Adam J. and Hawksford, Malcolm O. J. 2011. Individualized low-frequency response manipulation for multiple listeners using chameleon subwoofer arrays. in: IEEE.
Practical applications of chameleon subwoofer arrays
Hill, Adam J. and Hawksford, Malcolm O. J. 2012. Practical applications of chameleon subwoofer arrays.
Wide-area psychoacoustic correction for problematic room-modes using nonlinear bass synthesis
Hill, Adam J. and Hawksford, Malcolm O. J. 2011. Wide-area psychoacoustic correction for problematic room-modes using nonlinear bass synthesis. Journal of the Audio Engineering Society.
Distance coding and performance of the mark 5 and st350 SoundField microphones and their suitability for Ambisonic reproduction.
Wiggins, Bruce and Spenceley, Thomas 2009. Distance coding and performance of the mark 5 and st350 SoundField microphones and their suitability for Ambisonic reproduction. Proceeding of the Institute of Acoustics, Vol 31, Pt 4..
An investigation into the real-time manipulation and control of three-dimensional sound fields
Wiggins, Bruce 2004. An investigation into the real-time manipulation and control of three-dimensional sound fields. Thesis