run AeroVal experiment from CLI

[avaldebe]

No description provided.

[codecov]

Codecov Report

Attention: Patch coverage is 86.95652% with 3 lines in your changes are missing coverage. Please review.

Project coverage is 78.96%. Comparing base (8d067d3) to head (c2de306).

Files	Patch %	Lines
pyaerocom/scripts/cli.py	86.95%	3 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff            @@
##           main-dev     #998   +/-   ##
=========================================
  Coverage     78.95%   78.96%           
=========================================
  Files           105      105           
  Lines         18478    18500   +22     
=========================================
+ Hits          14590    14609   +19     
- Misses         3888     3891    +3     

Flag	Coverage Δ
unittests	78.96% <86.95%> (+<0.01%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[lewisblake]

We have tests for the CLI. What do you think about adding a test for this?

[avaldebe]

I do not think that running an experiment would work as a test.
Instead I would create a fixture that prevents proc.run() for doing anything.
Would this could work as a test?

[lewisblake]

We do have configs which we currently use in CI https://github.com/metno/pyaerocom/blob/main-dev/tests/fixtures/aeroval/cfg_test_exp1.py. Creating a fixture that prevents proc.run() for doing anything could be a good way to test it without adding too much compute time to CI.

[heikoklein]

The idea of having a proper command-line interface matches very well the with Usability Guidelines for AeroTools. We haven't decided on a proper configuration-format yet, and json is rather a data-transfer format that a configuration language, in particular since readability is not enforced, and comments are not part of the json standard.
Since we have already json-files which can be used for configuration, please call the the cli something like aeroval_json rather than calling it the aeroval config.

[lewisblake]

🦄