Champions: RTÉ, FOX Sports, Connected Ideas Limited, Unity Technologies, Unreal/Epic Games, DAZN
Volumetric Video for Broadcasting, Metaverse Production and RT3D Assets
The goal of this IBC Challenge is to unify the groundbreaking learnings from previous IBC Accelerators in XR spatial design and real-time 3D interactive animated content creation and develop future-proof traditional broadcast studio production methods and cutting-edge, digital human delivery processes.
This will be achieved by incorporating volumetric video, motion capture, live-action and 3D render game engine tech into a unified pipeline with real-time, 2D live streaming of digital humans and reusable assets into multi-platform broadcasting, ecommerce and into the Metaverse.
This will be achieved by incorporating volumetric video, motion capture, live-action and 3D render game engine tech into a unified pipeline with real-time, 2D live streaming of digital humans and reusable assets into multi-platform broadcasting, ecommerce and into the Metaverse.
The Challenge Objective:
While broadcasters want to embrace new technologies and innovative solutions to increase production quality, the challenge faced is that often, these solutions don't easily fit the timeframe, budget and resources of a traditional broadcast pipeline.
These Challenge objectives will focus on the creation, delivery and application of Digital Humans, exploring ways to add both photo-realistic and stylized 3D avatars to our broadcast and digital platforms.
Another key objective will include efficient generation of reusable 3D assets, suitable for live broadcast as well as VR, AR extended and mixed reality experiences.
These Challenge objectives will focus on the creation, delivery and application of Digital Humans, exploring ways to add both photo-realistic and stylized 3D avatars to our broadcast and digital platforms.
Another key objective will include efficient generation of reusable 3D assets, suitable for live broadcast as well as VR, AR extended and mixed reality experiences.
The Aim of the POC:
POC Solutions being explored:
* Swapping 2D images and video elements with 3D volumetric assets in live broadcast. Exploring additional use cases for these 3D volumetric elements (metaverse, mobile devices, apps, etc.)
* Low-cost, fast turnaround solutions for volumetric video assets. Single camera capture using mobile devices (Volu app), versus multi-camera volumetric capture studios.
AI conversion of 2D videos and images to 3D volumetric assets versus bespoke 3D avatars, mocap live puppetry, etc.
* Digitally enhancing volumetric assets through the use of real time shaders. Allowing assets to be reused in different settings by enabling features such as lighting adjustments, hue, saturation and contrast to match indoor and outdoor settings for broadcast, as well as multi-platform use.
* Applying stylized rendering techniques and filters to 3D assets and volumetric content in keeping with the timeframe and budget of a traditional broadcast design department.
* Exploring editing, cleanup and advanced rendering techniques to enhance our digital humans.
* Swapping 2D images and video elements with 3D volumetric assets in live broadcast. Exploring additional use cases for these 3D volumetric elements (metaverse, mobile devices, apps, etc.)
* Low-cost, fast turnaround solutions for volumetric video assets. Single camera capture using mobile devices (Volu app), versus multi-camera volumetric capture studios.
AI conversion of 2D videos and images to 3D volumetric assets versus bespoke 3D avatars, mocap live puppetry, etc.
* Digitally enhancing volumetric assets through the use of real time shaders. Allowing assets to be reused in different settings by enabling features such as lighting adjustments, hue, saturation and contrast to match indoor and outdoor settings for broadcast, as well as multi-platform use.
* Applying stylized rendering techniques and filters to 3D assets and volumetric content in keeping with the timeframe and budget of a traditional broadcast design department.
* Exploring editing, cleanup and advanced rendering techniques to enhance our digital humans.
The Innovation:
Innovation being explored:
* Investigate use of volumetric video in broadcast production
* Especially an affordable solution, via Participants Volu by Volograms
* Implement real-world use case e.g. sports, replacing common 2D elements by volumetric video in Sports
* AI conversion of 2D videos and images to 3D volumetric assets versus bespoke 3D avatars, mocap live puppetry, etc.
* Investigate use of volumetric video in broadcast production
* Especially an affordable solution, via Participants Volu by Volograms
* Implement real-world use case e.g. sports, replacing common 2D elements by volumetric video in Sports
* AI conversion of 2D videos and images to 3D volumetric assets versus bespoke 3D avatars, mocap live puppetry, etc.
Please complete the form below if you are interested in joining an Accelerator project.
For more information, please email the team at accelerators@ibc.org