Retrieve feature-based results for Test262 runs #1645
Labels
documentation
update documentation
enhancement
New feature or request
test
Issues and PRs related to the tests.
Milestone
The current implementation of the Tes262 compliance results page shows the compliance test suite by test suite, which is straightforward, since we run the tests suite by suite, test by test, and then we just collect the information about it.
It would be very nice to have the option to also see it feature by feature. Some tests, such as this one have a list of features (only one in this case). This information is already being stored in the
MetaData
information structure here.In order to show these results, we first need to gather them. Currently, when we run a test suite, we get a
SuiteResult
, as you can see here. These results are generated from theTestResult
each test returns, as it can be seen here. The definition of both structures can be seen in themain.rs
file of theboa_tester
project, here.We should change the
SuiteResult
structure to include information on the features each test had. This would allow having feature coverage per test-suite. Since the top-most suite will include feature information for all the suites below it, we can store that information on a JSON file, as we do with the rest of theSuiteResult
.Note that we want to store this information in a separate JSON file, so we will need to ignore part of the
SuiteResult
structure when serializing it, and extract that information to a new structure that will be stored in a new JSON file. Similarly to what we do with theReducedResultInfo
structure. Note that there should be also results for "no features", for base language tests.After this, we should be able to use that file in the results page.
The text was updated successfully, but these errors were encountered: