<Group>

Hero Subpage - Accelerator Pages

No content here.

3 - 6 December 2021

Smart Remote Production for Real-Time Animation

Smart Remote Production for Real-Time Animation

2-featuredimage


The objectives of this Challenge

This novel workflow, led by RTE and EBU, and Co-Championed by RAI, VRT, YLE and ETC, will be accomplished through remote collaboration using a Cloud Based Software Bridge and off-the-shelf hardware. It will also test the feasibility of using vocal performance and body posture to drive 3D avatars from remotely connected locations, all the while using minimal equipment.  

Characters will be integrated into their environments by staging and shooting the content in a real-time render engine (Unreal) using collaborative virtual production techniques and software.  

The goal of this unique POC will be to create the most effective, low cost “Script to 3D Character Pipeline” imaginable. That’s why they call it: Smart Remote Production for Real Time Animation. 

What’s the aim of the POC?

The aim is to explore the following approaches to low cost animated remote production by creating a proof of concept in a cloud-based workflow: 

Pose Estimation Software: 

  • Test how usable this approach is for animating the bodies of characters 

  • Can it successfully track fingers for quality animated performances 

Speech To Facial Animation Software: 

  • Look to achieve compelling facial performances from this software 

  • Do we need to test alternatives? (ex: Live Link Face for Unreal Engine) 

Omniverse: 

  • Can we easily connect our “Pose Estimation” workflow with our “Speech to Facial” animation workflow into a cohesive performance using Omniverse? 

Unreal Engine: 

  • Can these characters be successfully imported from Omniverse and integrated into their environments? How complex is it to implement this workflow for multiple characters performing in the same set? 

Cloud Based Storage / Digital Asset Manager (DAM) 

  • Integration of external cloud-based DAM & storage 

2021 Champions:

2021 Participants:

7-featuredimage

What’s the Innovation?

  • Using markerless pose estimation software 

  • Speech to facial animation software 

  • Real-time render engine to generate animated content in a remote workflow

IBC POC showcase 2021 output: 

  1. GALAXY DANCE: Short Animated 3D Film (30-90 second clip) 
  2. “Making Of” Presentation: How we accomplished this new workflow, including a short teaser to present what we want to do in the future phases. 
  3. Findings: What went well and what needs to be improved. 

Exhibitors include: