Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Why the extracted texture is much brighter than it should be? #17

Open
CCOSerika opened this issue Jan 9, 2023 · 1 comment
Open

Why the extracted texture is much brighter than it should be? #17

CCOSerika opened this issue Jan 9, 2023 · 1 comment

Comments

@CCOSerika
Copy link

Hi, author.
First of all, cheers on such an awesome work.
I've managed to obtain textured mesh from an existing geometry. The results are as follows. The right is from this project and the left is from another.
2023-01-09 11-44-36 的屏幕截图
2023-01-09 11-46-35 的屏幕截图
It's clear that the right texture is much brighter than the left, which caused texture detail missing sometimes.
I wonder why and how to adjust it?

@jmunkberg
Copy link
Collaborator

Thanks @CCOSerika ,

Note that we use a PBR shading model with a diffuse and specular lobe (see paper for details), so directly visualizing only the diffuse texture in MeshLab won't capture the full shading. Does it also look brighter during training in our renderer (check the images dumped during training)?
You can look at the included blender example on how to setup the PBR shading network: https://github.com/NVlabs/nvdiffrecmc/#use-the-extracted-3d-models-in-blender

Another issue is that we optimize the material and lighting jointly, so the optimization process has freedom to either make the lighting darker and materials brighter or vice versa. This is a bit tricky to control. You can constrain the material parameters with the config flags

    "kd_min" : [0.03, 0.03, 0.03], # diffuse texture min values 
    "kd_max" : [0.8, 0.8, 0.8],      # diffuse texture min values 
    "ks_min" : [0, 0.08, 0.0], # specular parameters: x (unused) , roughness, metalness
    "ks_max" : [0, 1.0, 1.0],

Controlling the light intensity is harder, as it is an HDR probe.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants