SynthEyes' Adoration: Insights from VFX Supervisor Matt Merkovich
In the world of visual effects, Boris FX SynthEyes stands out as a powerful tool for integrating CGI with live-action footage. Matthew Merkovich, a specialist in 3D tracking and matchmoving, has been using SynthEyes since its early stages and considers it the best 3D tracking and matchmoving app available.
Merkovich discovered SynthEyes through a conversation with its original author, Russ Andersson. Over the years, he has found the software improving and evolving, revealing new capabilities with each update. One of the latest advancements is its ability to handle anamorphic footage with significantly improved precision, thanks to new lens distortion tools.
Merkovich's workflow with SynthEyes involves bidding, ingesting the shot into the pipeline, denoising proxies, creating a version zero in SynthEyes, supervised 2D tracking, 3D solving, building and aligning 3D geometry, review, QC steps, packaging deliverables, and moving on to the next job. However, he admits that handling handheld cameras with jerky camera motion and a ton of motion blur can be challenging.
One of the most difficult shots he has ever tracked with SynthEyes was a minutes-long shot for the show Mr. Robot. But despite the challenges, SynthEyes proved to be up to the task, demonstrating its versatility and reliability.
Advanced features like anamorphic distance are not yet supported within the 3D animation apps on the market, making SynthEyes a unique and valuable asset for VFX artists. Other challenging shots include those for Into the Badlands that took place at night, in the rain, with lightning, where he was tracking heads for face replacements.
SynthEyes goes beyond just 3D tracking and offers a wide range of capabilities. It can also be used for roto, creating geometry, rendering mattes for comp, and on-set VFX supervision. The software provides both automatic solves and tools for experienced users, offering flexibility depending on the complexity of the project.
One of the key features of SynthEyes is its AI-Powered Motion Tracking. The latest version, SynthEyes 2025.5, introduces new AI tools such as ML Motion Estimation, which uses deep learning models to track optical flow of pixels between frames. This mode excels at handling challenging footage with low texture (e.g., smooth walls or vehicles) and fast or heavy camera movements where traditional tracking methods struggle.
SynthEyes also offers consistent, platform-ready lens data exports that integrate easily into various post-production pipelines, saving time and reducing friction across workflows. Its Mesh-to-Track Parenting feature allows fast and intuitive object attachment by parenting objects to tracked mesh surfaces, simplifying complex compositing tasks.
For artists new to SynthEyes, Merkovich's best pro tip is not to be afraid of the UI, as it is simple once one gets used to it. He also recommends trying out the free trial offered by the Boris FX Hub to learn more about SynthEyes.
Merkovich's favorite project he's ever worked on is Minority Report, due to its beloved status and the talented VFX team he worked with. Despite the many projects he's worked on, SynthEyes continues to be his go-to tool for 3D tracking and matchmoving.
[1] Source: Boris FX SynthEyes official website.
In the vast field of multimedia experiences, SynthEyes' integration into Matthew Merkovich's lifestyle as a VFX artist not only encompasses 3D tracking and matchmoving but also extends to realms such as roto, creating geometry, rendering mattes for compositing, and on-set VFX supervision.
Pioneering technology in SynthEyes, like AI-Powered Motion Tracking and advanced anamorphic distance support, propels it beyond the reach of other 3D animation apps, making it an invaluable asset to entertainers, sports enthusiasts, and technology enthusiasts alike.
