18
IBC2022 ACCELERATOR: 6DOF AUDIO-LED NARRATIVE AND MUSIC EXPERIENCES IN THE METAVERSE
4D cinemas and XR (extended reality) have introduced the concept of immersive experiences to electronic media with 3D effects, VR headsets, motion, scent and water jets. However, the most immersive of all media, sound, is still somewhat overlooked. The IBC Accelerator Project ‘6DOF Audio- Led Narrative and Music Experiences in the Metaverse’ aims to use six degrees of freedom (6DOF) audio content in the creation of fi rst-person perspective music and narrative experiences that audiences are free to move around and interact with.
THE POWER OF AUDIO Gareth Llewellyn, Co-Founder and CEO at MagicBeans, one of the Challenge Participants, is a strong believer in the power of audio to tell stories. “I think there’s a really big blind spot around what makes audiovisual experiences compelling,” he says. “And I think we know from cinema that visuals are paramount, but the real emotional heart of cinema is the soundtrack – without it, it’s sort of lost, it’s not cinema.”
Fellow MagicBeans Co-Founder and CTO Jon Olive concurs. “The received wisdom is that the visual sense is our dominant sense. I completely disagree with that,” he says. “With music you don’t think ‘oh, yeah, I’m listening to a piece of music. Oh, it’s in a minor key and I suppose that’ll make me feel sad’. It just doesn’t work in that way. It gets in, in a direct way that, dare I say, visuals on the whole don’t.” Describing the Accelerator project, Llewellyn says: “We’re very interested in what can be done with audio and pushing the boundaries of what’s possible with technology to provide a new palette of experiences. We’re creating a location-based experience, with projection, lighting and sound – recreating an artist’s performance from the Isle of MTV Malta Festival. We’re going to recreate the experience of being on stage. The audience is going to literally be in amongst the band, and it’s going to be, hopefully, very viscerally realistic.” “We’re going to make a digital twin of these experiences that you can access on your computer,” he adds. “You can go into the environment we’ve created and use a keypad to move around it.” live clarifi es that the focus of the proect
isn’t about proving that it’s possible to take recorded audio and make it sound like it’s
Gareth Llewellyn, Co-Founder and CEO, MagicBeans
actually coming from the real world. “We’ve already proved that it’s possible,” he says. “This whole project is more about knowing that once it’s possible, how do you best use that ability to engage your audience?”
“We’re very interested in what can be done with audio and pushing the boundaries of what’s possible with technology to provide a new palette of experiences,”
Gareth Llewellyn, MagicBeans
BENEFITS OF PARTNERSHIP The team at MagicBeans have seen the advantage of working in partnership on this project. “An interesting aspect of working with [Project Champion] the BBC was the ADM, which is the Audio efi nition odel, says Llewellyn. “There’s a set of standards that are being created for next generation audio. It allows lots of interesting things, like being able to balance elements differently, having different language versions, and being able to go from large multichannel mixes to small versions. “We’re looking at what needs to be thought about in the next round of open standards to accommodate 6DOF audio content. The explorations that the BBC is getting involved with is around what is missing from the standards now – what are we doing in 6DOF
Jon Olive, Co-Founder and CTO, MagicBeans
that the standards don’t cover?” “As CPUs get faster, as improvements get made to all sorts of aspects of acoustic synthesis, the actual approach to rendering will always be changing,” he adds. “Standards will have to support some sort of interchange model: this is what the core content looks like, it needs these basic parameters, and then you throw it into whatever the model. I think there’s some interesting discussions to be had around what things like ADM will look like in the future.” Of the IBC Accelerator session taking place today at 15:45-16:30 on the Innovation Stage in Hall 2, he says: “We are not going to be able to reproduce the large multiplayer experience here at IBC. But we will be showing the digital twin immersive experiences that can play on your laptop or your mobile phone.”
6DOF Audio-Led Narrative and Music Experiences in the Metaverse Champions: BBC, Paramount, King’s College London Participants: MagicBeans, TuneURL, White Light
For more information on the 2022 Accelerator Media Innovation Programme, supported by AMD and Microsoft, visit
show.ibc.org/2022-accelerator-media- innovation-programme
Page 1 |
Page 2 |
Page 3 |
Page 4 |
Page 5 |
Page 6 |
Page 7 |
Page 8 |
Page 9 |
Page 10 |
Page 11 |
Page 12 |
Page 13 |
Page 14 |
Page 15 |
Page 16 |
Page 17 |
Page 18 |
Page 19 |
Page 20 |
Page 21 |
Page 22 |
Page 23 |
Page 24 |
Page 25 |
Page 26 |
Page 27 |
Page 28 |
Page 29 |
Page 30 |
Page 31 |
Page 32 |
Page 33 |
Page 34 |
Page 35 |
Page 36 |
Page 37 |
Page 38 |
Page 39 |
Page 40 |
Page 41 |
Page 42 |
Page 43 |
Page 44 |
Page 45 |
Page 46 |
Page 47 |
Page 48 |
Page 49 |
Page 50 |
Page 51 |
Page 52 |
Page 53 |
Page 54 |
Page 55 |
Page 56 |
Page 57 |
Page 58 |
Page 59 |
Page 60 |
Page 61 |
Page 62 |
Page 63 |
Page 64 |
Page 65 |
Page 66 |
Page 67 |
Page 68 |
Page 69 |
Page 70 |
Page 71 |
Page 72 |
Page 73 |
Page 74 |
Page 75 |
Page 76 |
Page 77 |
Page 78 |
Page 79 |
Page 80 |
Page 81 |
Page 82 |
Page 83 |
Page 84 |
Page 85 |
Page 86 |
Page 87 |
Page 88 |
Page 89 |
Page 90 |
Page 91 |
Page 92 |
Page 93 |
Page 94 |
Page 95 |
Page 96
