Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Snapshot model weights/solver state to HDF5 files #2836

Merged
merged 5 commits into from
Aug 7, 2015
Merged

Snapshot model weights/solver state to HDF5 files #2836

merged 5 commits into from
Aug 7, 2015

Commits on Aug 7, 2015

  1. add double_data, double_diff to BlobProto for weights/snapshots saved 

    when using Dtype == double
    @jeffdonahue @erictzeng
    jeffdonahue authored and erictzeng committed Aug 7, 2015
    Configuration menu
    Copy the full SHA
    f973819 View commit details
    Browse the repository at this point in the history

  2. TestGradientBasedSolver: add TestSnapshot to verify behavior when 

    restoring net/solver from snapshot
    @jeffdonahue @erictzeng
    jeffdonahue authored and erictzeng committed Aug 7, 2015
    Configuration menu
    Copy the full SHA
    1e740e1 View commit details
    Browse the repository at this point in the history

  3. Snapshot model weights/solver state to HDF5 files. 

    Summary of changes:
- HDF5 helper functions were moved into a separate file util/hdf5.cpp
- hdf5_save_nd_dataset now saves n-d blobs, can save diffs instead of
  data
- Minor fix for memory leak in HDF5 functions (delete instead of
  delete[])
- Extra methods have been added to both Net/Solver enabling
  snapshotting and restoring from HDF5 files
- snapshot_format was added to SolverParameters, with possible values
  HDF5 or BINARYPROTO (default HDF5)
- kMaxBlobAxes was reduced to 32 to match the limitations of HDF5
    @erictzeng
    erictzeng committed Aug 7, 2015
    Configuration menu
    Copy the full SHA
    ada055b View commit details
    Browse the repository at this point in the history

  4. TestSnapshot expects .h5 snapshots, explicitly checks history.

    @erictzeng
    erictzeng committed Aug 7, 2015
    Configuration menu
    Copy the full SHA
    5c89c64 View commit details
    Browse the repository at this point in the history

  5. Update example bash scripts to expect .h5, new extensions in .gitignore

    @erictzeng
    erictzeng committed Aug 7, 2015
    Configuration menu
    Copy the full SHA
    c9b333e View commit details
    Browse the repository at this point in the history