HOUSE OF MOVES HELP CREATE NEW DIGITAL DOUBLE PIPELINE

The University of Southern California Institute for Creative Technologies (ICT), Icon Imaging Studio, Lightstage LLC and House of Moves (HOM) collaboratively pioneered a new process to create digital doubles for the recently released Journey 2: The Mysterious Island, from New Line Cinema, Contrafilm Production and Warner Bros. Pictures. The mysterious island is a place few people have ever seen. It’s a place of stunning beauty, strange and threatening life forms, volcanoes, mountains of gold and more than one astonishing secret. To capture the full extent of the fantastical action, digital doubles were created for the film’s main actors: Dwayne Johnson, Michael Caine, Josh Hutcherson, Vanessa Hudgens and Luis Guzman.

Journey 2 visual effects supervisor Boyd Shermis put a coalition of Academy Award®-winning talents on the task and they applied their respective crafts to revolutionize the way digital doubles are created. ICT’s Light Stage 6 captured full body lighting scenarios simultaneous to the scanning of character topology by Icon Imaging; Lightstage LLC recorded the actors’ facial shape and appearance at the level of pore detail and fine creases; and HOM contributed character rigging and conducted mocap sessions. All facial and full body data, lighting and textures were captured in just a few hours resulting in the creation of high quality digital doubles that were VFX vendor-ready with minimal time required of the A-list talent.

“When you have many VFX studios working on a project and they are just getting raw data, you can get vast discrepancies in shots with digital doubles. This is time consuming and expensive to correct,” said Shermis. “For Journey 2, we wanted to create a single data set with high-res geometry, texturing and lighting as well as a skeleton with a fundamental range of motion for all our vendors to use for their characters. Working with ICT, Icon, Lightstage LLC and HOM, we were able to fuse their individual proprietary technologies to create a new process that was convenient for the actors with amazing results.”

This collaboration represents the first commercial use of ICT’s Light Stage 6, a 26-foot diameter sphere outfitted with over 6000 LEDs and multiple cameras that digitize full body texture and reflectance data. By devising a way to insert Icon Imaging’s 3D scanning system into the Light Stage 6 dome, lighting data and full body scanning could be derived simultaneously resulting in immediate photo-quality 3D textures and eliminating a lot of time consuming steps along the way. Taking data from two completely different systems and getting them to align posed a challenge to all teams involved, but they refined a custom process for lining up the geometric lighting information with Icon’s 3D scans using reference points.

“With this process, the VFX vendors on the show were able to start at the 50-yard line so to speak instead of working from scratch and laboring through the tedious R&D process of building digital doubles,” added Paul Debevec, who heads up the Graphics Lab at ICT and developed both the Light Stage 6 and the technology behind the facial scanning Light Stage used by Lightstage LLC. “With the physical proximity of ICT, Icon and House of Moves, talent was in and out having had their body scan, texture, lighting and mocap data all captured in under three hours.”

“Paul and I had designed equipment completely separately but with the same purpose in mind. We took it over to ICT’s LS6 and it was kismet that it all fit perfectly – that was the easy part,” said Domi Piturro, President, Icon Imaging Studio. “We had to do some technology wrangling to make our systems complement each other but conceptually they were meant to join and in the end this new digital double system saves a huge amount of time while providing the highest quality possible. Perfect models literally went straight into productions without even one call for revisions.”

Once scanning was complete, the 3D mo