Browser-Based Webcam Head-Tracked Ambisonics (WHAM)

Conference paper


Dring, M. and Wiggins, B. 2023. Browser-Based Webcam Head-Tracked Ambisonics (WHAM). 2023 Immersive and 3D Audio: from Architecture to Automotive (I3DA). IEEE. https://doi.org/10.1109/I3DA57090.2023.10289143
AuthorsDring, M. and Wiggins, B.
TypeConference paper
Abstract

This paper documents the development of a Higher Order Ambisonic (HOA) real-time head-tracked auralisation platform. Headphone-based audio is decoded binaurally without needing specialist head-tracking hardware using open-source libraries augmented for this project. The room scanning and head-tracked presentation technique discussed can provide accurate auralisation of real (captured/measured) and/or modelled spaces using up to 15th-order Ambisonics, much higher than current Ambisonic microphone technology allows. The differences between measuring the acoustic response of a space using Ambisonic microphones and rotated Head and Torso Simulators (HATS) are discussed, along with the importance of removing the left/right symmetry assumption used in current Ambisonic to Binaural implementations. A Dynamic Binaural Reverberation Acquisition Technique (D-BRAT) is introduced, allowing for a full 3D binaural capture and reproduction of an acoustic space while allowing dynamic head rotation by transformation into the Ambisonic, Spherical Harmonic domain. Open-source Software has been created (based on JSAmbisonics) to allow this Binaural Room Impulse Response (BRIR) Data to be auditioned using up to 15th-order Ambisonics with dynamic head rotations considered in real-time with accompanying 360-degree graphics display. A working example can be found at: https://brucewiggins.co.uk/WHAM/.

© 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

KeywordsAmbisonics; Auralisation; Binaural; Head-tracking; WebAudio API
Year2023
Conference2023 Immersive and 3D Audio: from Architecture to Automotive (I3DA)
PublisherIEEE
Digital Object Identifier (DOI)https://doi.org/10.1109/I3DA57090.2023.10289143
Web address (URL)https://ieeexplore.ieee.org/document/10289143
https://www.i3da2023.org/
Accepted author manuscript
License
All rights reserved
File Access Level
Controlled
ISBN9798350311044
97983503411051
Web address (URL) of conference proceedingshttps://ieeexplore.ieee.org/xpl/conhome/10288631/proceeding
Output statusPublished
Publication dates
Online23 Oct 2023
Publication process dates
Accepted2023
Deposited23 Oct 2023
Permalink -

https://repository.derby.ac.uk/item/q0608/browser-based-webcam-head-tracked-ambisonics-wham

Restricted files

Accepted author manuscript

  • 4
    total views
  • 1
    total downloads
  • 1
    views this month
  • 0
    downloads this month

Export as

Related outputs

The effect of purported acoustically transparent materials on sound propagation
Hill, A., Szoke, Z, Burton, J. and Dring, M. 2023. The effect of purported acoustically transparent materials on sound propagation. Institute of Acoustics Reproduced Sound. Institute of Acoustics.
Guitars with Ambisonic Spatial Performance (GASP) An immersive guitar system
Werner, D., Wiggins, B., Fitzmaurice, E. and Hart, M. 2022. Guitars with Ambisonic Spatial Performance (GASP) An immersive guitar system. 21st Century Guitar Conference .
Capsule Calibration Approaches for Low-Cost Higher Order Ambisonic Microphone Arrays
Middlicott, C. and Wiggins, B. 2022. Capsule Calibration Approaches for Low-Cost Higher Order Ambisonic Microphone Arrays. 153rd Audio Engineering Society Convention. Audio Engineering Society.
Development of an Ambisonic Guitar System
Wiggins, B., Werner, D. and Emma Fitzmaurice 2021. Development of an Ambisonic Guitar System. in: Innovation in Music London Taylor & Francis. pp. 21
WHAM: To Asymmetry and Beyond!
Dring, M. and Wiggins, Bruce 2021. WHAM: To Asymmetry and Beyond! Institute of Acoustics.
The design and optimisation of surround sound decoders using heuristic methods
Wiggins, Bruce, Berry, Stuart, Lowndes, Val and Paterson-Stephens, Iain 2003. The design and optimisation of surround sound decoders using heuristic methods.
Development of an ambisonic guitar system GASP: Guitars with ambisonic spatial performance
Werner, Duncan, Wiggins, Bruce and Fitzmaurice, Emma 2021. Development of an ambisonic guitar system GASP: Guitars with ambisonic spatial performance. in: CRC Press/ Routledge.
WHAM: Webcam head-tracked ambisonics
Dring, M. and Wiggins, B. 2020. WHAM: Webcam head-tracked ambisonics. Institute of Acoustics. https://doi.org/10.25144/13379
Calibration approaches for higher order ambisonic microphones
Middlicott, C.J., Wiggins, B.J. and Wiggins, B. 2019. Calibration approaches for higher order ambisonic microphones. Audio Engineering Society.
The transparency of binaural auralisation using very high order circular harmonics
Dring, M. and Wiggins, Bruce 2019. The transparency of binaural auralisation using very high order circular harmonics. Institute of Acoustics.
Development of ambisonic microphone design tools – Part 1.
Middlicott, Charlie and Wiggins, Bruce 2018. Development of ambisonic microphone design tools – Part 1. Audio Engineering Society.
Development of ambisonic microphone design tools - Part 1
Middlicott, C.J., Wiggins, B.J. and Wiggins, B. 2018. Development of ambisonic microphone design tools - Part 1. Audio Engineering Society.
Analysis of binaural cue matching using ambisonics to binaural decoding techniques
Wiggins, Bruce 2017. Analysis of binaural cue matching using ambisonics to binaural decoding techniques.
Head tracked audio for all - the 3D audio VR revolution
Wiggins, Bruce 2016. Head tracked audio for all - the 3D audio VR revolution. Institute of Acoustics.
Modelling the performance of speaker arrays in domestic listening environments.
Dring, M., Middlicott, Charlie, Wiggins, Bruce and Vilkaitis, Alex 2017. Modelling the performance of speaker arrays in domestic listening environments. Institute of Acoustics.
GASP v2: Guitars with Ambisonic Spatial Performance
Werner, Duncan, Wiggins, Bruce, Box, Charlie, Dallali, Dominic, Hooley, Jack and Middlicott, Charlie 2016. GASP v2: Guitars with Ambisonic Spatial Performance.
AmbiFreeverb 2 - Development of a 3D ambisonic reverb with spatial warping and variable scattering
Wiggins, B. and Dring, M. 2016. AmbiFreeverb 2 - Development of a 3D ambisonic reverb with spatial warping and variable scattering. Audio Engineering Society.
Room acoustics and virtual reality: An implementation of auralisation and 360 degree image techniques to create virtual representations of spaces
Vilkaitis, A., Dring, M., Middlicott, C., Wiggins, B. and Hill, A.J. 2016. Room acoustics and virtual reality: An implementation of auralisation and 360 degree image techniques to create virtual representations of spaces. Institute of Acoustics.
GASP: Guitars with ambisonic spatial performance
Werner, Duncan, Wiggins, Bruce, Lawson, Tom, Weightman, Tom and Callister, Joe 2015. GASP: Guitars with ambisonic spatial performance.
Inside-outside: 3-D music through tissue conduction
McKenzie, I., Lennox, Peter and Wiggins, Bruce 2015. Inside-outside: 3-D music through tissue conduction.
Tissue-conducted spatial sound fields
McKenzie, I., Lennox, Peter and Wiggins, Bruce 2014. Tissue-conducted spatial sound fields. Institute of Acoustics.
Hearing Without Ears
McKenzie, I., Lennox, Peter and Wiggins, Bruce 2014. Hearing Without Ears. International Community for Auditory Display.
Validation of a quad-rotor helicopter matlab/simulink and solidworks models
Poyi, Gwangtim Timothy, Wu, Mian Hong, Bousbaine, Amar and Wiggins, Bruce 2013. Validation of a quad-rotor helicopter matlab/simulink and solidworks models.
The generation of panning laws for irregular speaker arrays using heuristic methods
Wiggins, Bruce 2007. The generation of panning laws for irregular speaker arrays using heuristic methods. Audio Engineering Society.
Distance coding and performance of the mark 5 and st350 SoundField microphones and their suitability for Ambisonic reproduction.
Wiggins, Bruce and Spenceley, Thomas 2009. Distance coding and performance of the mark 5 and st350 SoundField microphones and their suitability for Ambisonic reproduction. Proceeding of the Institute of Acoustics, Vol 31, Pt 4..
Has Ambisonics come of age?
Wiggins, Bruce 2008. Has Ambisonics come of age? Reproduced Sound 24 Conference Proceedings Vol 30. Pt 6.
An investigation into the real-time manipulation and control of three-dimensional sound fields
Wiggins, Bruce 2004. An investigation into the real-time manipulation and control of three-dimensional sound fields. PhD Thesis https://doi.org/10.48773/93q0q