Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Parallel Stream File Parsing with ray.io (#260)
* add ray dep for parallelization * add ray as testing dep * fix up docstrings * add proper capitalization, fix dtypes in A / eV * use Union instead of | * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * maybe fix build issue * remove unused imports, attr * add average cell method * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * fix wavelength for empty peak lists * fix numpy v1 support * add numpy v1 to matrix * fix numpy versioning * pass through kwargs to ray.init * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * enable read only stream parsing * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * remove unused imports * fix column spec, add option to disable ray, make num_cpus explicit * test with and without ray * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * add error message * clean up dataset creation * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * remove unused variable * removed unused timing stuff * removed unused DataSeries --------- Co-authored-by: Kevin Dalton <kmdalton@slac.stanford.edu> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Kevin Dalton <kmdalton@pop-os.localdomain>
- Loading branch information