Code

Tracking file provenance#3712

Code

Open

astro-friedel wants to merge 68 commits intoParsl:masterParsl/parsl:masterfrom astro-friedel:trackingFileProvenanceastro-friedel/parsl:trackingFileProvenanceCopy head branch name to clipboard

+1,070-43

Commits

Commits on May 13, 2024

• initial version of dynamic file list classes

  astro-friedel

  committed
  30f54ca

  Copy full SHA for 30f54ca

Commits on May 21, 2024

• integrated dynamic file into output file handling

  astro-friedel

  committed
  69d8f02

  Copy full SHA for 69d8f02

Commits on Jun 7, 2024

• data flow kernel changes to accommodate dynamic file lists

  astro-friedel

  committed
  882e3ba

  Copy full SHA for 882e3ba

• Merge remote-tracking branch 'upstream/master' into fixing_dynamic_file_inputs_and_outputs

  astro-friedel

  committed
  ce369aa

  Copy full SHA for ce369aa

• Auto stash before checking out "HEAD"

  astro-friedel

  committed
  7138adc

  Copy full SHA for 7138adc

• creation of file tale in the monitoring

  Show description for 5bff70f
  astro-friedel

  committed
  5bff70f

  Copy full SHA for 5bff70f

Commits on Jun 14, 2024

• added initial file provenance data in database

  astro-friedel

  committed
  6025691

  Copy full SHA for 6025691

Commits on Jun 17, 2024

• fixed error where uuid's were not strings

  astro-friedel

  committed
  efc3b14

  Copy full SHA for efc3b14

• fixed typos in names

  astro-friedel

  committed
  222166a

  Copy full SHA for 222166a

Commits on Jun 18, 2024

• initial working version

  astro-friedel

  committed
  92597f6

  Copy full SHA for 92597f6

Commits on Jun 27, 2024

• Merge branch 'fixing_dynamic_file_inputs_and_outputs' into trackingFileProvenance

  astro-friedel

  committed
  8b922d9

  Copy full SHA for 8b922d9

• added flask-wtf to monitoring requirements for form processing

  astro-friedel

  committed
  632890b

  Copy full SHA for 632890b

• added file size and md5sum tracking for files

  astro-friedel

  committed
  17e5c43

  Copy full SHA for 17e5c43

• fixed issue with clean_copy in dynamic files

  astro-friedel

  committed
  d8df5fe

  Copy full SHA for d8df5fe

• added initial provenance interface to flask pages

  astro-friedel

  committed
  b16cad6

  Copy full SHA for b16cad6

Commits on Jul 1, 2024

• indentation fix

  astro-friedel

  committed
  0275b28

  Copy full SHA for 0275b28

• fixed database code for provenance tracking

  astro-friedel

  committed
  3a1238b

  Copy full SHA for 3a1238b

Commits on Jul 9, 2024

• added environment tracking to monitoring

  astro-friedel

  committed
  bb013fe

  Copy full SHA for bb013fe

Commits on Jul 31, 2024

• Merge remote-tracking branch 'upstream/master' into trackingFileProvenance

  astro-friedel

  committed
  bc8247a

  Copy full SHA for bc8247a

• added file provenance tracking as an option to monitoring framework

  astro-friedel

  committed
  45af5f9

  Copy full SHA for 45af5f9

• better reporting on environment

  astro-friedel

  committed
  cd99828

  Copy full SHA for cd99828

• ensure that files are tagged with the task id that generated them, not the one that used them last

  astro-friedel

  committed
  558d170

  Copy full SHA for 558d170

• get the task reporting the environment correctly

  astro-friedel

  committed
  05caec8

  Copy full SHA for 05caec8

• only provide file link if files were actually used in the workflow

  astro-friedel

  committed
  8f212ba

  Copy full SHA for 8f212ba

• only provide file link if there were files

  astro-friedel

  committed
  3ade95a

  Copy full SHA for 3ade95a

• properly report environment with file details

  astro-friedel

  committed
  7501cc3

  Copy full SHA for 7501cc3

• properly format and report files

  astro-friedel

  committed
  66238e5

  Copy full SHA for 66238e5

• make header responsive to url

  astro-friedel

  committed
  00ffa6f

  Copy full SHA for 00ffa6f

• fix bug in file size reporting

  astro-friedel

  committed
  da73f91

  Copy full SHA for da73f91

• documentation on file provenance

  astro-friedel

  committed
  76b8008

  Copy full SHA for 76b8008

• fix bug in format

  astro-friedel

  committed
  93b17b0

  Copy full SHA for 93b17b0

Commits on Sep 17, 2024

• get the correct timestamp for the file

  astro-friedel

  committed
  1e004a6

  Copy full SHA for 1e004a6

• remove unneeded prints

  astro-friedel

  committed
  8dde82c

  Copy full SHA for 8dde82c

• auto determine file size, md5sum, timestamp if possible

  astro-friedel

  committed
  cb550ee

  Copy full SHA for cb550ee

• refactor variable

  astro-friedel

  committed
  5ebd009

  Copy full SHA for 5ebd009

• make sure dfk is propagated from dynamic file list to children

  astro-friedel

  committed
  baf2332

  Copy full SHA for baf2332

• documentation and annotation cleanup

  astro-friedel

  committed
  79211bc

  Copy full SHA for 79211bc

• cleanup

  astro-friedel

  committed
  825842f

  Copy full SHA for 825842f

• Merge remote-tracking branch 'upstream/master' into trackingFileProvenance

  astro-friedel

  committed
  117e66d

  Copy full SHA for 117e66d

Commits on Nov 12, 2024

• backed out DynamicFile stuff so that this branch is pure file tracking

  astro-friedel

  committed
  8c9a2a0

  Copy full SHA for 8c9a2a0

• Merge branch 'master' into trackingFileProvenance

  astro-friedel

  committed
  eff8ab6

  Copy full SHA for eff8ab6

Commits on Nov 27, 2024

• Merge branch 'master' into trackingFileProvenance

  astro-friedel

  committed
  5ca48cf

  Copy full SHA for 5ca48cf

• reorganized to group similar codes together

  astro-friedel

  committed
  9a05b2c

  Copy full SHA for 9a05b2c

• fixed message format

  astro-friedel

  committed
  14aac2b

  Copy full SHA for 14aac2b

• fixed some typos

  astro-friedel

  committed
  585fd03

  Copy full SHA for 585fd03

• updates to include misc info table

  astro-friedel

  committed
  19f7747

  Copy full SHA for 19f7747

• updated docs

  astro-friedel

  committed
  27f6391

  Copy full SHA for 27f6391

• fixed bug for remote files

  astro-friedel

  committed
  97ade30

  Copy full SHA for 97ade30

• test for provenance framework

  astro-friedel

  committed
  33be080

  Copy full SHA for 33be080

• flake8 fixes

  astro-friedel

  committed
  07c2e45

  Copy full SHA for 07c2e45

• fixed missing line in docs

  astro-friedel

  committed
  97108e1

  Copy full SHA for 97108e1

Commits on Dec 3, 2024

• removed extraneous ignores

  astro-friedel

  committed
  a837f08

  Copy full SHA for a837f08

• reverted removal of trailing white spaces

  astro-friedel

  committed
  6bef04f

  Copy full SHA for 6bef04f

• fixes per review comments

  astro-friedel

  committed
  5057d19

  Copy full SHA for 5057d19

• ensure that md5sum is only calculated when file provenance tracking is on.

  astro-friedel

  committed
  89d5e0a

  Copy full SHA for 89d5e0a

• fixes based on review comments

  astro-friedel

  committed
  c653cbc

  Copy full SHA for c653cbc

• added dfk as a required parameter to DataFuture

  astro-friedel

  committed
  7efebad

  Copy full SHA for 7efebad

• make sure file md5sum is only calculated

  astro-friedel

  committed
  d6e7e5b

  Copy full SHA for d6e7e5b

• added full path and parsing for path for file database entries

  astro-friedel

  committed
  1fcdbc6

  Copy full SHA for 1fcdbc6

• fixed typos and tests

  astro-friedel

  committed
  b443cbb

  Copy full SHA for b443cbb

• put back required SECRET_KEY so that the file search form works

  astro-friedel

  committed
  69cfc7b

  Copy full SHA for 69cfc7b

• isort fixes

  astro-friedel

  committed
  0316cf9

  Copy full SHA for 0316cf9

• Merge branch 'Parsl:master' into trackingFileProvenance

  astro-friedel

  authored
  af51f0e

  Copy full SHA for af51f0e

• removed unneeded import

  astro-friedel

  committed
  9ed699d

  Copy full SHA for 9ed699d

• mypy fixes

  astro-friedel

  committed
  ce609cc

  Copy full SHA for ce609cc

Commits on Dec 10, 2024

• Merge remote-tracking branch 'upstream/master'

  astro-friedel

  committed
  d646aaa

  Copy full SHA for d646aaa

• fixed incorrect variable name

  astro-friedel

  committed
  53f323d

  Copy full SHA for 53f323d

• Merge branch 'master' into trackingFileProvenance

  astro-friedel

  committed
  9444f42

  Copy full SHA for 9444f42