Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extensive testing of (new) functionality #489

Open
14 tasks
sauterl opened this issue Jul 16, 2024 · 0 comments
Open
14 tasks

Extensive testing of (new) functionality #489

sauterl opened this issue Jul 16, 2024 · 0 comments
Assignees

Comments

@sauterl
Copy link
Collaborator

sauterl commented Jul 16, 2024

Extensively test (new) functionality:

Evaluation Template Building

  • VBS-Style template
  • LSC-Style template
  • Templates including perpetual tasks
  • Exotic Templates
  • Try to break the builder

Evaluation Execution

  • VBS-Style evaluation, SYNC
  • VBS-Style evaluation, ASYNC
  • LSC-Style evalution, SYNC
  • LSC-Style evaluation, ASYNC
  • Perpetual tasks, SYNC
  • Perpetual tasks, ASYNC
  • Exotic Templates Evaluation, SYNC
  • Exotic Templates Evaluation, ASYNC
  • Robustness of submission endpoint

While doing the above, we should make sure that

  • The frontend behaves as expected
  • The backend behaves as expected
  • Errors in frontend are understandable for end users
  • Errors in backend are somewhat understandable and reportable
  • The API(s) works as intended
@sauterl sauterl converted this from a draft issue Jul 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Ready
Development

No branches or pull requests

2 participants