11/18/2025
So, how do we use AI?
We received a batch of raw footage for a VFX-heavy project, and the deadline was tight. The shots were diverse in the kind of visual effects they required. Some called for a straightforward cleanup, others involved creating full scenes from scratch.
One sequence, in particular, took place in a surreal, void-like space with a pitch-black background. The footage had been shot on a black backdrop, but often, stray elements crept into frame: crew members, equipment edges, or lighting artifacts.
That meant shot-by-shot cleanup, masking, and in many cases, rotoscoping actors so they could be placed convincingly into the void. Tools like After Effectsā AI-powered rotobrush were a huge time-saver here. Itās not revolutionary tech, but in a time-sensitive project, every shortcut matters.
Where things did get more complex was with the portal scene.
The brief?
Create an āevil, magical portalā Ć la Marvel that opens behind a character and then swallows them whole. Ambitious. Especially on a tight timeline. A full 3D simulation? Out of the question. Rendering alone would eat the entire schedule.
We used Midjourney to generate concept images for the portal.
Once we had the final still, we refined it manually in Photoshop to match the lighting and perspective of the original shot.
This wasnāt something you could fake with parallax or puppet tools. The portal needed energy. Motion.
So we turned to Luma Labsā Dream Machine. After a few misses (and plenty of prompt refinement) we ended up with an animated sequence of the portal opening and closing that felt dynamic and cinematic.
From there, it was back to traditional VFX work.
We adjusted timing, composited secondary animations, tracked the camera to embed the portal in 3D space, and rotoscoped the characters. We simulated lighting interactions, added particles, lens flares, and finally, color graded everything into a cohesive whole.
The AI tools gave us speed and new creative possibilities. But they didnāt replace the core craft.
Theyāre just ingredients and it still takes a chef to make the meal.
