Code

Regression testing updates#2459

Code

Merged

rwest merged 15 commits intoReactionMechanismGenerator:mainReactionMechanismGenerator/RMG-Py:mainfrom rwest:regressionrwest/RMG-Py:regressionCopy head branch name to clipboardJun 8, 2023

+84-53

Commits

Commits on Jun 8, 2023

• CI: Streamline logging in regression test results

  rwest

  committed
  c2c1954

  Copy full SHA for c2c1954

• CI: small changes to CI file and call it "Continuous Integration"

  rwest

  committed
  638c947

  Copy full SHA for 638c947

• CI: only upload failed test artifacts if tests failed

  Show description for 9643c6f
  rwest

  committed
  9643c6f

  Copy full SHA for 9643c6f

• CI: report regression tests to the job summary

  rwest

  committed
  bd9e529

  Copy full SHA for bd9e529

• CI: 120 minute timeout on building Julia step.

  Show description for 9a1c717
  rwest

  committed
  9a1c717

  Copy full SHA for 9a1c717

• CI: use an env variable to track if running the reference case job

  Show description for 982ee11
  rwest

  committed
  982ee11

  Copy full SHA for 982ee11

• CI: store artifacts with specific names to avoid over-writing.

  Show description for edc9912
  rwest

  committed
  edc9912

  Copy full SHA for edc9912

• CI: regression test returns exit code 1 if it doesn't pass all tests.

  Show description for 0b9d45c
  rwest

  committed
  0b9d45c

  Copy full SHA for 0b9d45c

• CI: checkModels now has exit code 1 if it detects a discrepancy.

  Show description for 1a424ef
  rwest

  committed
  1a424ef

  Copy full SHA for 1a424ef

• CI: report failure if detect difference in core or edge during regression tests.

  Show description for 1169f9d
  rwest

  committed
  1169f9d

  Copy full SHA for 1169f9d

• CI: run codecov even if regression tests fail.

  Show description for 9e8f5c4
  rwest

  committed
  9e8f5c4

  Copy full SHA for 9e8f5c4

• CI: update changelog

  Show description for a854f81
  rwest

  committed
  a854f81

  Copy full SHA for a854f81

• CI: change logging for regression tests.

  Show description for ae2b67f
  rwest

  committed
  ae2b67f

  Copy full SHA for ae2b67f

• CI: allow macos-latest run to fail

  Show description for 25cc365
  rwest

  committed
  25cc365

  Copy full SHA for 25cc365

• CI: compare regression with latest successful artifact

  Show description for e44a4ee
  rwest

  committed
  e44a4ee

  Copy full SHA for e44a4ee