-
Notifications
You must be signed in to change notification settings - Fork 27
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Feature: general purpose data distribution testing to support non-uniform data #129
base: master
Are you sure you want to change the base?
Commits on Aug 20, 2024
-
Start data distribution out as varient of normal distribution
Copy h5bench_write_normal_dist.c as baseline.
Configuration menu - View commit details
-
Copy full SHA for 8ead940 - Browse repository at this point
Copy the full SHA 8ead940View commit details -
Add write_var_data_dist benchmark support to h5bench.py
Created a new benchmark test name and added selection support into h5bench.py test wrapper.
Configuration menu - View commit details
-
Copy full SHA for bddc4c9 - Browse repository at this point
Copy the full SHA bddc4c9View commit details -
Add DATA_DIST_PATH support to params struct and config file
Added parsing of DATA_DIST_PATH into params struct to record the data distrbution based on an input file.
Configuration menu - View commit details
-
Copy full SHA for 776cc51 - Browse repository at this point
Copy the full SHA 776cc51View commit details -
Add data dist file parsing to populate memory allocation pattern
Takes the provided DATA_DIST_PATH file and reads the data sizes per rank from the file feeding into holder array.
Configuration menu - View commit details
-
Copy full SHA for 2088710 - Browse repository at this point
Copy the full SHA 2088710View commit details -
Add build and install targets for new data distribution test
Create make targets and add file to install list.
Configuration menu - View commit details
-
Copy full SHA for d899116 - Browse repository at this point
Copy the full SHA d899116View commit details -
Remove rank 0 output summary limit so all processes report performance rather than just accepting rank 0 results. This is especially important for non-uniform data distribution but should be considered for uniform since no summary stats are computed. Recommend --tag-output to track per-rank stdout. Remove naive total size compute and limit it to a per rank size value.
Configuration menu - View commit details
-
Copy full SHA for e051203 - Browse repository at this point
Copy the full SHA e051203View commit details -
Add scaling factor for data distribution particle counts
Add scaling paramter to tests to scale particle count in order to create memory footprints that more accurately reflect a data distribution. Data distribution inputs are in particle counts. Particles are 32-byte structures so a data distribution measured in bytes needs to be scaled down so the particals instiated match the actual data footprint, in multiples of 32-byte particles.
Configuration menu - View commit details
-
Copy full SHA for 9cf8232 - Browse repository at this point
Copy the full SHA 9cf8232View commit details -
Fix the data dist benchmark binary name to use "var" naming convention
Change the deployed binary to "write_var_data_dist" so it matches the configured test reference in h5bench. The binary name needs to match the test name so that it can be called by the hbench wrapper. This follows convention of "write_var_normal_dist". Update code to log the correct benchmark name.
Configuration menu - View commit details
-
Copy full SHA for de1d787 - Browse repository at this point
Copy the full SHA de1d787View commit details
Commits on Sep 9, 2024
-
Update the github action/artifacts-upload version
Change action/artifacts-upload from v2 to v4 to remove dependence on deprecated v2. The v4 syntax for the artifact-upload remains the same so a simple update of the version number should be sufficient. See blog post for details: https://github.blog/changelog/2024-02-13-deprecation-notice-v1-and-v2-of-the-artifact-actions/
Configuration menu - View commit details
-
Copy full SHA for 241fee7 - Browse repository at this point
Copy the full SHA 241fee7View commit details -
Update clang-format container version to 0.18.2
Update to latest version of container to see if it avoids the missing distutils dependency reported with the @0.11 version.
Configuration menu - View commit details
-
Copy full SHA for 7610377 - Browse repository at this point
Copy the full SHA 7610377View commit details -
Merge branch 'fix-github-upload-artifact-version' of github.com:jpror…
…ama/h5bench into feat-data-dist Grab the github actions fixes to ensure current feature branch validation tests run successfully.
Configuration menu - View commit details
-
Copy full SHA for dff8efc - Browse repository at this point
Copy the full SHA dff8efcView commit details -
Configuration menu - View commit details
-
Copy full SHA for fd64d7a - Browse repository at this point
Copy the full SHA fd64d7aView commit details