Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Architecture of Generator Network. #2

Open
kvthr opened this issue Nov 8, 2017 · 3 comments
Open

Architecture of Generator Network. #2

kvthr opened this issue Nov 8, 2017 · 3 comments

Comments

@kvthr
Copy link

kvthr commented Nov 8, 2017

In the code, it says CONV->BIAS->ACTIVATION but it is CONV->BATCH NORMALISATION->ACTIVATION. Correct me if I am wrong!

@blaskowitz100
Copy link

Hey,
I think the batch normalization already includes the bias term. See here:
https://stackoverflow.com/questions/46256747/can-not-use-both-bias-and-batch-normalization-in-convolution-layers

@patrikohlsson
Copy link

patrikohlsson commented Nov 8, 2017

Actually bias is built in to tf.layers.conv2d and tf.layers.conv2d_transpose and is on by default. So technically it's conv->bias->batch normalization->activation

@patrikohlsson
Copy link

patrikohlsson commented Nov 8, 2017

But as @blaskowitz100 mentioned it's common to scale and add a bias after batch normalization as well.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants