22
IBC2024 ACCELERATORS: CONNECTING LIVE PERFORMANCES OF THE
FUTURE WITH ULL-AVLM AND SCALABLE ULTRA-LOW LATENCY STREAMING FOR PREMIUM SPORTS
Proposed by d&b solutions and University of Strathclyde, ‘Connecting Live Performances of the Future with ULL-AVLM (ultra-low latency audio, video, light and media data)’ is the fi rst Accelerator Project to be presented on the Innovation Stage today. The ultimate aim of the project is to recreate the experience of a live performance in multiple locations and/or bring together remote performers into a seamless and immersive live experience. While that might sound a prohibitively aspirational challenge, many in the Project team have considerable form in this area, having successfully collaborated on the 2023 IBC Accelerator project ‘5G Motion Capture for Live Performance and Animation’. Sam Yoffe, Research Associate at University of Strathclyde and Senior Systems Engineer, Neutral Wireless, said at the IBC Accelerator Kickstart Day: “The intention is to build on the very successful Accelerator project we ran last year, which saw us produce a live performance in a virtual space with performers distributed across the UK. We want to connect multiple locations with as low latency as we can get and really focusing on a shared and equal experience for different locations with audience and performers across the world.” Indeed, the broader aims of the 2023
project and the 2024 edition have considerable crossover, as Andy Hook, Director of Technology Strategy, d&b, explains: “Last year’s project was hugely successful and facilitated a live performance between two dancers about 500 miles apart. However, the need to synchronise the video, audio and motion capture data stood out as an important thread in the challenge of sharing performances across multiple venues, which formed a signifi cant element of this project. Here, in addition to motion capture data to drive rendered graphics, we also include full lighting control data as well as telemetry required to generate spatial audio, adding to the immersive experience.” Specifi c objectives of the project include exploring the role of private 5G networks to harness the power of live object-based audio and acoustic emulation in multiple, live music performances; defi ning new methods for the acquisition and distribution of data in live events; minimising latency at every step of the chain; developing ways to synchronise the full
Giladi: ‘We’re trying to take what we used to have as a premium sports experience and make it feel better’
spectrum of AVLM control data; and exploring the role of real-time engines and cloud infrastructure to connect experiences. “We’ve made great progress and demonstrated all of the desired technical components in action. The application of the techniques developed here are actually very fl exible. The workfl ow could fi nd use in many different multiple-venue scenarios, whether that is a one-to-many recreation of an event or two- way interactive live performances,” states Yoffe. Champions EBU, Kings College London, TV2, University of Kent, Music Venue Trust, Royal Central School of Speech and Drama, and Participants Spectral Compute, Salsa Sound and Neutral Wireless have all contributed to the project.
The focus switches to live sports this
afternoon, with ‘Scalable Ultra-Low Latency Streaming for Premium Sports’ at 13:30-14:30. Champions Comcast, BT Media & Broadcast, AP and Globo, along with Participants Videoclarity, Castlabs, Ateme, AMD and HP, will be showcasing their work, which seeks to achieve Twitter-equivalent latency and near-instant playback start using standard HTTP streaming technical stack and infrastructure. The areas being explored include the use of low-latency encoding and segment-based ingest, the latest
low-delay extensions to MPEG DASH, and possible uses of MV-HEVC video codec and the QUIC protocol.
The goal of the POC is to explore an end-to- end system comprising an encoder, a latency- optimised origin, and a mix of open source and proprietary DASH players. In addition, the innovation would be the achievement of sub-2s glass-to-glass delay with standard adaptive streaming, which will allow premium sports experiences.
Alex Giladi, Fellow, Comcast, says: “We’re trying to take what we used to have as a premium sports experience and make it feel better. Ideally we want to be at a second end- to-end latency and this second needs to be achieved in a way that is interoperable with the current DASH and HLS deployments, otherwise it becomes too expensive. We also want to have a high-quality 4K feed and we want to have a WiFi network that is at 70dBm and things still work. “The whole point of this project is to take newer technologies that are coming to the mainstream and see how we can improve something that we’re already providing.” This evening also sees the IBC Accelerator Drinks, sponsored by ConsoleConnect, taking place in the Accelerator Zone in Hall 3 from 17:00-18:00. They are open to all.
Page 1 |
Page 2 |
Page 3 |
Page 4 |
Page 5 |
Page 6 |
Page 7 |
Page 8 |
Page 9 |
Page 10 |
Page 11 |
Page 12 |
Page 13 |
Page 14 |
Page 15 |
Page 16 |
Page 17 |
Page 18 |
Page 19 |
Page 20 |
Page 21 |
Page 22 |
Page 23 |
Page 24 |
Page 25 |
Page 26 |
Page 27 |
Page 28 |
Page 29 |
Page 30 |
Page 31 |
Page 32 |
Page 33 |
Page 34 |
Page 35 |
Page 36 |
Page 37 |
Page 38 |
Page 39 |
Page 40 |
Page 41 |
Page 42 |
Page 43 |
Page 44 |
Page 45 |
Page 46 |
Page 47 |
Page 48 |
Page 49 |
Page 50 |
Page 51 |
Page 52 |
Page 53 |
Page 54 |
Page 55 |
Page 56 |
Page 57 |
Page 58 |
Page 59 |
Page 60 |
Page 61 |
Page 62 |
Page 63 |
Page 64 |
Page 65 |
Page 66 |
Page 67 |
Page 68 |
Page 69 |
Page 70 |
Page 71 |
Page 72 |
Page 73 |
Page 74 |
Page 75 |
Page 76 |
Page 77 |
Page 78 |
Page 79 |
Page 80 |
Page 81 |
Page 82 |
Page 83 |
Page 84 |
Page 85 |
Page 86 |
Page 87 |
Page 88 |
Page 89 |
Page 90 |
Page 91 |
Page 92 |
Page 93 |
Page 94 |
Page 95 |
Page 96
