Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support for batch normalization #7

Closed
2 of 4 tasks
beniz opened this issue Jun 6, 2015 · 3 comments
Closed
2 of 4 tasks

Support for batch normalization #7

beniz opened this issue Jun 6, 2015 · 3 comments
Assignees
@beniz
Labels
kind:API kind:neural net type:enhancement

Comments

@beniz
Copy link
Collaborator

beniz commented Jun 6, 2015

Batch normalization significantly lowers training time, http://arxiv.org/pdf/1502.03167v3.pdf

This is to be based on Caffe PR BVLC/caffe#1965 unless some other implementation surfaces.

Two steps:

  • support for BN in underlying Caffe custom build
  • support for BN in MLP templates and optional through API
  • add googlenet BN template
  • add cifar BN template
@beniz beniz self-assigned this Jun 6, 2015
@beniz
Copy link
Collaborator Author

beniz commented Jun 7, 2015

This repository has many useful tricks and code snippets:
https://github.com/lim0606/ndsb
And interesting comment: lim0606/ndsb#1

@beniz
Copy link
Collaborator Author

beniz commented Oct 23, 2015

PR BVLC/caffe#3229 got merged into Caffe.

beniz added a commit that referenced this issue Oct 25, 2015
@beniz
added template for googlenet with batch normalization, ref #7
28efa86
beniz pushed a commit that referenced this issue May 1, 2016
@kyrs
Merge pull request #7 from beniz/tf
02be500 
fixed dependency of bazel hash + fixed linking of dede exe with tenso…
@beniz
Copy link
Collaborator Author

beniz commented Oct 19, 2017

Done a while ago through net_templates.

@beniz beniz closed this as completed Oct 19, 2017
@beniz beniz mentioned this issue Sep 25, 2019
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@beniz beniz

Labels
kind:API kind:neural net type:enhancement
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@beniz