Stabilize dask loading of Ocean Model data#776

Merged

CKehl merged 64 commits intomasterfrom

stabilize_dask_field_loading

Apr 3, 2020

Commits on Mar 19, 2020

#770 - initial fix-commit for the field sets. Continue running tests on paleo-plankton to verify fixes and develop a proper testing procedure
CKehl
committed
Merge branch 'master' into stabilize_lazy_evaluation_NEMOfields
CKehl
authored

Commits on Mar 20, 2020

Commits on Mar 23, 2020

#774 - local update of MEDUSA
CKehl
committed
Merge branch 'stabilize_lazy_evaluation_NEMOfields' of github.com:OceanParcels/parcels into stabilize_lazy_evaluation_NEMOfields
CKehl
committed
#774 - fixed error in field.py line 1741, trying to compare a number and a NetCDF dimension (should be self.dataset.dimensions[name].size)
CKehl
committed
#774 - added chunking tests
CKehl
committed
#774 - resolved the pytest fixture problem. Now getting OutOfBounds errors for Nemo data when using chunking
CKehl
committed
#774 - fixed test function naming in example_nemo_curvilinear.py
CKehl
committed
#774 - tests are breaking cause NetCDF attempts to open and chunk each individual entry in files. That means that many files are opened multiple times simultaneously, leading to memory errors.
CKehl
committed

Commits on Mar 24, 2020

Commits on Mar 25, 2020

#774 - fixed the infinite-loop out-of-bounds bug with specified chunks arising from an error in the NetCDFFileBuffer. Also cleared commented code where required and adapted formatting to the PEP8 l…
CKehl
committed

Commits on Mar 30, 2020

Commits on Mar 31, 2020

Commits on Apr 1, 2020

Commits on Apr 3, 2020

Merge branch 'master' into stabilize_dask_field_loading
erikvansebille
authored