Code

ParallelTable Musings#185

Code

Open

JSKenyon wants to merge 12 commits intomasterratt-ru/dask-ms:masterfrom parallel_tables_casacoreratt-ru/dask-ms:parallel_tables_casacoreCopy head branch name to clipboard

+155-2

Commits

Commits on Feb 21, 2022

• Try figuring out how to integrate symlinks with daskms.

  JSKenyon

  committed
  81d8d08

• Add WIP - seems to work for threaded case. Processes and distributed need some investigation.

  JSKenyon

  committed
  2c6fb4c

Commits on Feb 22, 2022

• Commit changes - still not entirely satisfactory.

  JSKenyon

  committed
  9d5e9dd

• Change approach - this is more promising, non-invasive, more intuitive.

  JSKenyon

  committed
  bca8956

Commits on Feb 23, 2022

• Add finalizer to tidy up when a parallel table is GCed.

  JSKenyon

  committed
  bf40c65

• Basic sort of working (not in all cases) parallel table implementation.

  JSKenyon

  committed
  cdd2d3f

• Add reduce method to allow for pickling of Parallel table objects.

  JSKenyon

  committed
  5cad3da

Commits on Feb 24, 2022

• No need for symlinks with Ben's PR.

  JSKenyon

  committed
  c043dcd

• Remove internal thread pool using a Dummy. PoC.

  JSKenyon

  committed
  e174581

• Minor changes before embarking on rework.

  JSKenyon

  committed
  3a2e60a

• Tidy up.

  JSKenyon

  committed
  c8ff7db

Commits on Mar 7, 2022

• Reintroduce hack for now - just an experiment.

  JSKenyon

  committed
  3ca905c