2.3.3

• Internal changes to enable Python 3 support (in progress)
  • 100% of the pilot code is Python 3 compliant [BUILD 7] as measured by the 2to3 command
  • Testing is expected to reveal other issues since 2to3 does not find every incompatibility
  • Three additional changes were resolved during interactive testing. A blocker was discovered on Nov 22 - there is a problem with the cvmfs Python 3 version (enum module is broken) that causes rucio API to fail at import (Asoka is working on a fix)
• Reduction of “Payload metadata does not exist”-errors
  • Added recognition of (trf) “command not found” due to InstallArea error, using error code 1346 (“Transform not found”). Previously this led to secondary error 1187 (“Payload metadata does not exist”)
    • Note: less important fix since trf error “127: Transformation not installed in CE” is also reported in this case
  • Identification of “cannot create directory” due to permission errors, using error code 1199 ("Failed to create local directory") instead of 1187 error
    • Note: these errors are also labelled with trf error 64: General failure in transform substep executor
• Added chi2 from memory leak calculation to job metrics
  • The chi2 calculation can be improved further after study with different job types; the current calculation excludes the first five and last two measurement
• Updates for unified queues, pending tests on unified test queue
  • Pilot uploads output to destination decided by server (unified queues only)
• Problematic time-out mechanism fixed
  • Pilot is now once again protecting rucio stage-in/out
• Support for new HPC workflow; standard/normal jobs on restricted HPCs
  • Tested on Cori
• Fix for prmon restarts during stage-out
  • Reported by R. Walker

Contributions from A. Anisenkov, D. Benjamin, P. Nilsson