Add new fields to the _STATUS.log and add run_STATUS.log

[veaceslavdoina]

Intro

We already finished initial implementation of the _STATUS.log and it works as expected. We can see in Grafana table all information about run tests status and same logs in Kibana

Screenshot

But from the Grafana table above it is not clear if tests run was finished and how long it take.

Also, it will be good to have information about all used components version in the logs to not search that in Dist-Tests source code.

Proposal

• Update existing _STATUS.log and add additional fields about used components

  gethid:       docker image of the Geth used during the tests
  prometheusid: docker image of the Prometheus used during the tests
  codexcontractsethid: docker image of the codex-contracts-eth used during the tests
  

• Add a new status log with information about the whole run - run_STATUS.log(do we need a separate file or we can append that data into existing _STATUS.log file?). It should have format similar to the _STATUS.log with some exceptions

  Category: "Finish - %Category%"                  # A special category name, which identify finish of the whole run
  Fixture: ""                                      # Empty - we don't have that information in that context
  Test Name: ""                                    # Empty - we don't have that information in that context
  Status: "%Failed%/%Skipped%/%Passed%/%Total%"    # Tests count by category
  Duration: "%Total Duration%"                     # Whole run duration
  

  We are using file name pattern and file format similar to the _STATUS.log to handle parsing and shipping by the same logs shipper rules.

  This implementation will help us to accomplish the following

  • By the end of the all tests run we will have a delimiter in the Grafana table to distinguish runs by colors
  • We will be able to see stats about duration and number of tests by runs

  And just an example of the runner output, and we would like to see that data(in a different format) in our log file

  Passed!  - Failed:     0, Passed:    26, Skipped:     2, Total:    28, Duration: 31 m 19 s - Tests.dll (net7.0)
  

[veaceslavdoina]

First part was implemented during #39.