Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support custom configuration schema, and fault injection testing #398

Merged
merged 91 commits into from
Dec 15, 2024

Conversation

tylergu
Copy link
Member

@tylergu tylergu commented Dec 15, 2024

This PR adds the following new features to Acto:

Using Custom Schema for Opaque Properties in CRDs

Acto now supports to test opaque schemas with a user-specific schema. This feature is useful for testing the applications' configuration interface, without having to rewrite the CRD.

Support Fault-Injection Testing via Chactos

Acto now supports to test operators in the presence of application faults. Chactos injects different types of application faults before each test and after each test.

Porting new operator versions to Acto

We ported some operators with their newest version. The operators' porting files are under versioned directories under the /data directory.

tylergu and others added 30 commits October 13, 2024 21:51
Signed-off-by: Tyler Gu <jiaweig3@illinois.edu>
Signed-off-by: Tyler Gu <jiaweig3@illinois.edu>
Signed-off-by: Tyler Gu <jiaweig3@illinois.edu>
Signed-off-by: Tyler Gu <jiaweig3@illinois.edu>
Signed-off-by: Tyler Gu <jiaweig3@illinois.edu>
Signed-off-by: Tyler Gu <jiaweig3@illinois.edu>
Signed-off-by: Tyler Gu <jiaweig3@illinois.edu>
Signed-off-by: Tyler Gu <jiaweig3@illinois.edu>
Signed-off-by: Tyler Gu <jiaweig3@illinois.edu>
Signed-off-by: Tyler Gu <jiaweig3@illinois.edu>
Signed-off-by: Tyler Gu <jiaweig3@illinois.edu>
Signed-off-by: Tyler Gu <jiaweig3@illinois.edu>
Signed-off-by: Tyler Gu <jiaweig3@illinois.edu>
Signed-off-by: Tyler Gu <jiaweig3@illinois.edu>
Signed-off-by: Tyler Gu <jiaweig3@illinois.edu>
Signed-off-by: Tyler Gu <jiaweig3@illinois.edu>
Signed-off-by: Tyler Gu <jiaweig3@illinois.edu>
Signed-off-by: Tyler Gu <jiaweig3@illinois.edu>
Signed-off-by: Tyler Gu <jiaweig3@illinois.edu>
Signed-off-by: Tyler Gu <jiaweig3@illinois.edu>
Signed-off-by: Tyler Gu <jiaweig3@illinois.edu>
Signed-off-by: Tyler Gu <jiaweig3@illinois.edu>
Signed-off-by: Tyler Gu <jiaweig3@illinois.edu>
Signed-off-by: Tyler Gu <jiaweig3@illinois.edu>
Signed-off-by: Tyler Gu <jiaweig3@illinois.edu>
Signed-off-by: Tyler Gu <jiaweig3@illinois.edu>
Copy link
Contributor

Coverage report

Click to see where and how coverage changed

FileStatementsMissingCoverageCoverage
(new stmts)
Lines missing
  acto
  deploy.py 23-28
  engine.py 86, 151-159, 297, 416-417, 603-606, 774-776, 895-900
  oracle_handle.py 46-60, 68
  result.py 78, 81
  snapshot.py
  acto/checker
  checker_set.py
  acto/checker/impl
  health.py 20
  state_compare.py 88-98, 162-163, 172-178
  acto/checker/impl/tests
  test_state.py
  acto/input
  input.py 241-272, 581
  testcase.py
  value_with_schema.py
  acto/input/test_generators
  __init__.py
  configuration.py 19-93
  generator.py
  stateful_set.py
  acto/post_process
  collect_test_result.py 11, 21, 39-44
  post_diff_test.py 278-292, 492, 621, 642-650, 819, 879, 884, 1033
  acto/runner
  runner.py 115, 135, 144-145, 177, 186, 205, 344-358, 365-383, 390-395, 490-493
  acto/schema
  string.py 57-61
  under_specified.py 14-16, 34, 39, 42, 49, 52, 55, 58, 63, 68
  acto/system_state
  stateful_set.py 58-63
  acto/utils
  k8s_helper.py 128
  process_with_except.py 12
Project Total  

This report was generated by python-coverage-comment-action

@tylergu tylergu merged commit 572fc01 into main Dec 15, 2024
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants