Скачать или смотреть Digital LEGO® Research: Look Development – 3D Tracking + HDR Image-based Lighting

#HDRI Look Development
#Blender 3.5 Alpha – #Cycles
HDRI: #Insta360 One R
Camera: #iPhone 11
#LEGO® model: #Mecabricks
#Laptop: Schenker Technologies GmbH #XMG #NEO15 #rtx3080
#Renderfarm: 22x RTX 3070Ti
#Soundtrack: Synthwave by FortyTwoStudio

3D tracking of a hand-shot backplate using Adobe After Effects. The resulting camera data is imported into a 3D reference scene. A reference scene is a close digital version of a photo shoot with real elements.

Once the first animation has been tested on the basis of the reference scene with optimized shaders and lights, additional models can be loaded into the scene, which is rendered according to the same principle in OpenEXR MultiLayer format and exchanged in the Blender compositing.

The particular challenge here was the poor quality of the backplate, which has to be simulated for the CGI elements using a scaling trick. The backplate was filmed in 4K, but the footage is so bad that the CGI parts are rendered in HD and scaled to 4K with bilinear filtering. The final step is to apply grain to the composited parts via a difference key and a pulled mask in After Effects. The type of grain is analyzed and transferred from the backplate