Assimilate Announces New Live FX and Live FX Studio Software for Live Compositing Virtual Productions – SHOOT Online | Hot Mobile Press

Assimilate® today announced the immediate availability of its new and innovative Live FX® and Live FX Studio® Software packages that enable and simplify real-time live compositing for green screen and LED wall based virtual productions on set. Both products feature the latest technology in keying, camera tracking and more, optimizing on-set virtual production (VP) not only for pre-visualization, but even for the final pixels for in-camera VFX. By recording all incoming dynamic metadata along with the images, Live FX can automatically prepare all content for VFX/post, saving significant time and money.

“We’ve used Live FX on literally every shoot for the year big poppy Short film to accurately align our layered blue screen elements with our virtual sets. Our on-set pre-comps made our post-VFX compositing much faster and easier,” said Sam Nicholson, Founder/CEO of Los Angeles-based Stargate Studios.

Live FX
Live FX provides a basic toolset for indie filmmakers who film mostly with green screen setups, allowing them to create full 3D environments and simple on-camera green screen replacement setups in real-time. It supports the most popular camera trackers like Intel RealSense, HTC Vive, Stereolabs ZED2i and a number of Android and iOS tracking apps. In addition, it supports the generic FreeD protocol and Open Sound Control (OSC) to collect camera tracking information. All tracking data can be refined and synchronized with the incoming live camera signal, keeping all data in sync throughout the pipeline.

With built-in virtual camera calibration, Live FX is able to calculate lens distortion and create final composites live on set. It also comes with all the tools needed to key the green screen and replace it with regular 2D images, 360 VR videos, or a live Unreal Engine feed sent via SDI, NDI, or zero-latency spout texture -Sharing was included. To create the perfect illusion, Live FX supports popular OFX plugins and Matchbox shaders and can record the live composite in ProRes, DNx or h264.

“Virtual production is the new kid on the block, specifically for LED volume. Its roots are in the world of live entertainment, and the tools currently available have focused on those applications, not filmmaking. Assimilate changed that paradigm by developing Live FX for this new way of filmmaking. Building on their legacy in digital image post-production, Assimilate has developed a robust toolset that appeals to the filmmaker and allows complete control over all modern techniques employed in VP. I can’t think of any other system that performs as well as Live FX,” said Alexis Haggar, Effects Director at Lexhag, London. “I’ve used Live FX with our indie LED wall during its beta period and it consistently delivers. The Assimilate team was amazingly responsive, listening to my suggestions and walking me through the functionality of their software.”

Live FX Studio
Live FX Studio builds on Live FX and allows direct use of 3D environments within the application in the form of notch blocks and scenes in Universal Scene Descriptor (USD) format.
It adds support for high-end camera tracking solutions such as NCAM and Mo-Sys, and comes with built-in DMX and ArtNet controls to control stage lighting based on image content.

Live FX Studio also offers multi-cam support, direct remote control of Brompton Tessera LED processors and video router control for AJA and Blackmagic routers. Most importantly, it includes Assimilate’s award-winning finishing software, SCRATCH VR, which can combine the live captured metadata such as camera tracking and lens information with the in-camera recorded RAW files to create high-resolution VFX discs including all frames -based metadata in OpenEXR format.

“Live FX enables the merging of several virtual production solutions in one software. It handles 2D rendering and game engine content for pre-viz and final pixel in-camera VFX in a VFX-friendly environment that natively appeals to post-production professionals,” said Julian Sarmiento, global director, virtual production and Real time at FuseFX.

“The Open Beta for Live FX has been absolutely amazing as we’ve received valuable feedback from people using the software in real life workflows for everything from quick compositions at location scouts to driving full LED screen volumes. Adding these innovative tools to our product line really allows us to better cover the breadth of uses and needs of all filmmakers,” said Jeff Edson, CEO of Assimilate. “And as with all of our products, we offer very flexible licensing options.”

Flexible licensing and pricing
Monthly subscriptions, annual and perpetual licenses are available, as well as a new three-month project license. Both software packages are offered at an introductory price for project, annual and perpetual licenses, starting at $345 (USD) for Live FX and $495 (USD) for Live FX Studio.

Free Personal Learning Edition (PLE) of Live FX and Live FX Studio available
To access the free and fully functional watermarked educational edition, visit and click the Live FX Try button. Enter your email address and you will receive a reply email with the download link and license key. To get started right away, you can access a series of short, hands-on video tutorials from the Assimilate channels on YouTube and Vimeo.

About assimilation
Assimilate develops and provides advanced real-time on-set and post-production workflow tools that provide industry professionals with breakthrough features, speed, power, flexibility and stability. The recently launched Live FX/Live FX Studio is a state-of-the-art live compositor that comes with camera tracking, DMX control and the latest green screen keying technology for virtual production. Live Assist is the multi-cam VTR video support tool that offers support for any number of cameras and any resolution, with easy green screen compensation and local clip server functionality. Live Looks is the go-to tool for live grading and direct look creation with an instant connection to Scratch VR for live streaming and keying capabilities. Used by DITs and post-artists worldwide, Scratch VR is known for its advanced on-set and post-production tools that provide stability, speed, and metadata support for any camera format, including 2D/3D/VR. Play Pro is the ideal solution for a professional player for VFX reviews, ProRes RAW QC and true ProRes transcoding on Windows. Learn more at

Leave a Comment