Skip to content

Hierarchical Distributed Machine Learning Prefetcher

License

Notifications You must be signed in to change notification settings

OpenCoreCH/hdmlp

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

HDMLP: Hierarchical Distributed Machine Learning Prefetcher

HDMLP

Installation

Using setuptools:

  • Clone this repo using git clone
  • Run python setup.py install

Non-default libconfig location

If libconfig is installed in a non-default location ($libconfig_install_location), you need to export the following environment variables before running the install script:

export CMAKE_PREFIX_PATH=$libconfig_install_location:$CMAKE_PREFIX_PATH
export CXXFLAGS=-isystem\ $libconfig_install_location/include/

Non-default OpenCV location

If OpenCV is installed in a non-default location ($opencv_install_location), the environment variable OpenCV_DIR needs to be set to:

export OpenCV_DIR=$opencv_install_location/lib64/cmake/opencv4/

Requirements

  • Python 3
  • Any MPI implementation (e.g. OpenMPI)
  • cmake
  • libconfig
  • OpenCV

Documentation

The system is documented in OpenCoreCH/Clairvoyant-Prefetching-for-Machine-Learning-IO

License

HDMLP is published under the new BSD license, see LICENSE

About

Hierarchical Distributed Machine Learning Prefetcher

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages