Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update manual.csv for TD, document pipeline #292

Open
mmccool opened this issue Apr 13, 2022 · 1 comment
Open

Update manual.csv for TD, document pipeline #292

mmccool opened this issue Apr 13, 2022 · 1 comment

Comments

@mmccool
Copy link
Contributor

mmccool commented Apr 13, 2022

  • Changes in assertions in TD1.1 change some of the assertions and/or ids, i.e. IANA -> security
  • Current manual.csv in wot-testing is old
  • Need to update manual.csv to reflect this
  • Some pipelines issues; how and when do we update the AssertionTester, Implementation Report, etc? Need to document process. Can this be automated, e.g. using Toumura-san's script to extract assertions, then AssertionTester subtracts the ones that are testable, generating a new manual.csv, etc...
@egekorkan
Copy link
Contributor

The problem is to make sure that this pipeline works as autonomously and quickly as possible

  1. Change happens in the TD spec that affects an assertion (new, deleted, update)
  2. Assertion tester does not implement this assertion currently, so it is flagged as manual by doing a difference between the whole list of assertions and the automatic ones.
  3. This new manual.csv should be submitted to this repository
  4. Every implementation owner should update their implementation to reflect that

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants