Maniphest T56703

The Proxy creation in the clip editor does not take color management into account
Confirmed, NormalKNOWN ISSUE

Assigned To
None
Authored By
Sebastian Koenig (sebastian_k)
Sep 6 2018, 12:44 PM
Tags
  • BF Blender
  • VFX & Video
  • EEVEE & Viewport
Subscribers
Bastien Montagne (mont29)
Sebastian Koenig (sebastian_k)
Sergey Sharybin (sergey)
Troy Sobotka (sobotka)

Description

System Information
elementaryOS 0.4.1, GTX1080

Blender Version
Broken: 2.79.6, 7ff1750

Short description of error
When generating proxies from Blender's Clip Editor while using a different Color Management View profile other than Default, that color profile is not taken into account, making the proxies look different than the actual movie in the Clip Editor.

Exact steps for others to reproduce the error
The whole issue came up when trying to work with footage shot with the Arri Alexa.
The footage is a ProRes file, encode with Arri Wide Gamut in LogC. I am currently working with @Troy Sobotka (sobotka) on making that work inside Blender. The way we do that currently is as follows:
By using Blackmagic Fusion I convert the ProRes to a Linear EXR, but not rec709, instead it's Linear Arri Wide Gamut, in order to keep the data of that colorspace intact.
Loading this in Blender looks wrong of course, since Blender assumes an EXR file to be Linear Rec709.
In order to work around that, @Troy Sobotka (sobotka) thankfully created a new OpenColorIO config file, that uses the AWG colorspace when setting the view to Filmic.
Using that new config.ocio the Footage looks correct in the Clip Editor.
Obviously I need the Background Images in the 3D Viewport to look the same, since I want to integrate 3D elements into the footage.
However, when I generate the Proxies, they seem to use the Default Rec709 View Transform.
See this screenshot:


The colors in MCE at the bottom are correct, but wrong in the 3d View above.
I can understand that the 3D View cannot do realtime color conversions in order to maintain a decent playback. However, that's why I think the proxies need to take CM into account, including gamma and exposure.
For anyone who wants to try it, I have attached a folder with one frame from that footage, the proxy, the blendfile, as well as a the adjusted colormanagement folder with the new config.ocio. (I left out the film responce curves).

Event Timeline

Sebastian Koenig (sebastian_k) assigned this task to Sergey Sharybin (sergey).Sep 6 2018, 12:44 PM
Sebastian Koenig (sebastian_k) created this task.
Sebastian Koenig (sebastian_k) updated the task description.
Bastien Montagne (mont29) lowered the priority of this task from 90 to Normal.Sep 8 2018, 4:11 PM
Bastien Montagne (mont29) added a subscriber: Bastien Montagne (mont29).

@Sergey Sharybin (sergey) guess that one is for you to handle? Though am not sure there is any bug here tbh…

Sebastian Koenig (sebastian_k) added a comment.Jul 13 2019, 6:11 PM

I would like to come back to this issue.
@Sergey Sharybin (sergey) told me a while ago that this is indeed a bug, and for the upcoming VFX course this should be fixed.

The issue does not just arise with fancy custom wide gamut colorspaces, it's already a problem with Filmic / Standard view transform.

When you load some footage into the Clip Editor, the view transform is applied to that clip as well, and that's fine.
Now, when you use that clip as Camera Background Images in the 3d Viewport in order to setup your scene, with lighting and textures, etc., the background images do NOT use Filmic as view transform! So it is not possible to match your scene to the footage in the 3d viewport.
So what to do? First idea is to build proxies.
But when you create Proxies from your clip in the Clip Editor, the resulting proxies do not have the view transform nor the look applied to them. I do think they should though!

Another way to deal with this would be an option to apply color management to background images.
It might make sense to not use colormanagement for background images if you use reference images for modeling or so, but when it comes to Camera Background Images, which are mostly used for VFX, there should at least some option to apply your scene's View Transform to the background images as well. "View as Render" from the image editor comes to mind...

Now, let's say I have proxies with Filmic baked into them, in that case I would want to disable the imaginary "View as Render" button from above, instead the Standard sRGB view transform would be used for them, just as it is the case now, probably for performance reasons.

Troy Sobotka (sobotka) added a comment.EditedJul 13 2019, 6:33 PM

So what to do?

There is only one answer, and it remains the same:

Always honour the intent of the RGB encoding. Always. That means there is never a case where pixel management is turned off or assumed, as it is a fundamental misunderstanding as to how pixel management works and what the intention of the encoded values in an RGB encoding represent.

Sam Van Hulle (sam_vh) mentioned this in T68926: Color Management Improvements.Sep 5 2019, 12:48 PM
Dalai Felinto (dfelinto) removed Sergey Sharybin (sergey) as the assignee of this task.Dec 23 2019, 4:36 PM
Dalai Felinto (dfelinto) added a project: Tracker Curfew.
Dalai Felinto (dfelinto) added a subscriber: Sergey Sharybin (sergey).
Richard Antalik (ISS) changed the subtype of this task from "Report" to "Known Issue".Feb 11 2020, 12:13 AM
Richard Antalik (ISS) edited projects, added VFX & Video, EEVEE & Viewport; removed Tracker Curfew.
Sergey Sharybin (sergey) moved this task from Backlog to Known Issues on the VFX & Video board.Jun 12 2020, 4:02 PM
Clément Foucault (fclem) moved this task from Backlog to Known Issues on the EEVEE & Viewport board.Jun 22 2020, 3:14 PM