3D audio and ambisonics
Getting started working with spatial audio
What is it?
3D audio, or spatial audio, uses sound objects to place sounds around you in the environment. The effect is similar to gaming, where sounds from characters appear to come from the direction they appear from.
ECHOES enables spatial audio by using its existing system to place sound triggers (or Echoes) which then play sounds (Elements) which have fixed GPS coordinates. These sounds are then spatialised around the listener, creating a 'real' environment in which you can approach and walk around sound objects.
How do I create 3D sounds (sound objects)?
For 3D sounds, you can either:
- Select 'Add a 3D sound element' when adding an Element. It'll have the '3D' switch turned on already, or
- use your existing Elements: just enable the 3D button on the Element.
Each sound has its own 'marker' which indicates its virtual placement in real space. You can move these. Bear in mind that if the sound is physically far from you when you trigger the Echo, you likely won't be able to hear it.
Each sound will appear to come from its location. You can add multiple sounds per Echo, and have them at different positions, and these sounds will be spatialised around you, giving you the appearance of a 'sound' environment that changes as you move.
How do I create ambisonic (360°) sounds?
For ambisonic sounds, select 'ambisonic' when creating an element.
Don't switch the type to ambisonic after creating a 'sound' otherwise it will fail when you try to play it in the app.
Once you've created an ambisonic Element, then you can upload a first order, ambix channel order (wxyz) file (wav or aiff) and it will convert it.
Currently HOA (2nd/3rd order) is not working (although we're working on it).
How do I experience it?
Currently 3D audio/ambisonic support is only available on
- iOS in the production app (although support is still in beta)
- and android via the beta version of the app.
To access the beta version of ECHOES on android, visit the Google Play store listing and sign up for testing.
When you do the walk, it will only work when downloaded (it should prompt to do so).
It will prompt you to use headtracking. Currently there are three options (two on android):
- Using the onboard compass (phone sensors). This will spatialise using the phone’s compass, so point the device where your head is pointing.
- Using the Thingy:52 IoT bluetooth prototyping device. Attach it to a hat or the headband of a pair of headphones
- Using the Apple Airpods Pro headphones, which support spatial audio (iOS only).
Love what we do? ➔ become our Open Collective backer
© ECHOES. All rights reserved / ECHOES.XYZ Limited is a company registered in England and Wales, Registered office at Merston Common Cottage, Merston, Chichester, West Sussex, PO20 1BE