Skip to content

Write test plan of things that need to be tested for 1.0 release #1373

@JoerivanEngelen

Description

@JoerivanEngelen

@deltamarnix mentioned that it is good to first write up what we want to test additionally to the stuff currently in our CI. We can then work on automating these if possible.

Test cases I'm currently thinking of:

Broad metrics we could test for:

  • Did the test run without error, did the validation succeed? 
  • Are the model input files written by iMOD Python the same (account for differences in sorting of List-based input)?
  • Are iMOD Python's run times in a similar ballpark?
  • Are there large differences in memory usage? Did memory usage explode?
  • How much does model output differ? (Compute some basic statistics, mean, min, max difference)
  • Make some plots of model output differences, these can help identifying differences.

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

Status

✅ Done

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions