Browser-Based Webcam Head-Tracked Ambisonics (WHAM)
Conference paper
Authors | Dring, M. and Wiggins, B. |
---|---|
Type | Conference paper |
Abstract | This paper documents the development of a Higher Order Ambisonic (HOA) real-time head-tracked auralisation platform. Headphone-based audio is decoded binaurally without needing specialist head-tracking hardware using open-source libraries augmented for this project. The room scanning and head-tracked presentation technique discussed can provide accurate auralisation of real (captured/measured) and/or modelled spaces using up to 15th-order Ambisonics, much higher than current Ambisonic microphone technology allows. The differences between measuring the acoustic response of a space using Ambisonic microphones and rotated Head and Torso Simulators (HATS) are discussed, along with the importance of removing the left/right symmetry assumption used in current Ambisonic to Binaural implementations. A Dynamic Binaural Reverberation Acquisition Technique (D-BRAT) is introduced, allowing for a full 3D binaural capture and reproduction of an acoustic space while allowing dynamic head rotation by transformation into the Ambisonic, Spherical Harmonic domain. Open-source Software has been created (based on JSAmbisonics) to allow this Binaural Room Impulse Response (BRIR) Data to be auditioned using up to 15th-order Ambisonics with dynamic head rotations considered in real-time with accompanying 360-degree graphics display. A working example can be found at: https://brucewiggins.co.uk/WHAM/. © 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. |
Keywords | Ambisonics; Auralisation; Binaural; Head-tracking; WebAudio API |
Year | 2023 |
Conference | 2023 Immersive and 3D Audio: from Architecture to Automotive (I3DA) |
Publisher | IEEE |
Digital Object Identifier (DOI) | https://doi.org/10.1109/I3DA57090.2023.10289143 |
Web address (URL) | https://ieeexplore.ieee.org/document/10289143 |
https://www.i3da2023.org/ | |
Accepted author manuscript | License All rights reserved File Access Level Controlled |
ISBN | 9798350311044 |
97983503411051 | |
Web address (URL) of conference proceedings | https://ieeexplore.ieee.org/xpl/conhome/10288631/proceeding |
Output status | Published |
Publication dates | |
Online | 23 Oct 2023 |
Publication process dates | |
Accepted | 2023 |
Deposited | 23 Oct 2023 |
https://repository.derby.ac.uk/item/q0608/browser-based-webcam-head-tracked-ambisonics-wham
Restricted files
Accepted author manuscript
40
total views1
total downloads0
views this month0
downloads this month