Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix and rework settings tests #234

Merged
merged 1 commit into from
Mar 7, 2022
Merged

Fix and rework settings tests #234

merged 1 commit into from
Mar 7, 2022

Conversation

EnricoMi
Copy link
Owner

@EnricoMi EnricoMi commented Mar 7, 2022

  • fixes regexp in is_alpha, extends testing
  • fixes the way TEST_CHANGES_LIMIT is parsed
  • harmonize parsing numbers in get_settings
  • remove _default from test names, test all cases for each option
  • compact options raising exceptions, use more loops and sub-tests
  • move unknown value tests into specific option tests

- fixes regexp in is_alpha, extends testing
- harmonize parsing numbers in get_settings
- remove _default from test names, test all cases for each option
- compact options raising exceptions, use more loops and sub-tests
- move unknown value tests into specific option tests
@github-actions
Copy link

github-actions bot commented Mar 7, 2022

Unit Test Results (Linux)

       54 files  ±  0         54 suites  ±0   2m 32s ⏱️ -1s
     265 tests +  1       265 ✔️ +  1      0 💤 ±0  0 ±0 
14 310 runs  +54  13 878 ✔️ +54  432 💤 ±0  0 ±0 

Results for commit c873e40. ± Comparison against base commit a57df58.

This pull request removes 14 and adds 15 tests. Note that renamed tests count towards both.
test_action_script.Test ‑ test_get_settings_check_name_default
test_action_script.Test ‑ test_get_settings_comment_mode_default
test_action_script.Test ‑ test_get_settings_comment_on_pr_default
test_action_script.Test ‑ test_get_settings_comment_title_default
test_action_script.Test ‑ test_get_settings_commit_default
test_action_script.Test ‑ test_get_settings_compare_to_earlier_commit_default
test_action_script.Test ‑ test_get_settings_dedup_classes_by_file_name_default
test_action_script.Test ‑ test_get_settings_fail_on_default
test_action_script.Test ‑ test_get_settings_hide_comment_default
test_action_script.Test ‑ test_get_settings_ignore_runs_default
…
test_action_script.Test ‑ test_get_settings_check_name
test_action_script.Test ‑ test_get_settings_check_run_annotations
test_action_script.Test ‑ test_get_settings_comment_mode
test_action_script.Test ‑ test_get_settings_comment_on_pr
test_action_script.Test ‑ test_get_settings_comment_title
test_action_script.Test ‑ test_get_settings_commit
test_action_script.Test ‑ test_get_settings_compare_to_earlier_commit
test_action_script.Test ‑ test_get_settings_dedup_classes_by_file_name
test_action_script.Test ‑ test_get_settings_fail_on
test_action_script.Test ‑ test_get_settings_hide_comment
…

@github-actions
Copy link

github-actions bot commented Mar 7, 2022

Unit Test Results (setup-python)

       54 files  ±  0         54 suites  ±0   2m 32s ⏱️ -1s
     265 tests +  1       265 ✔️ +  1      0 💤 ±0  0 ±0 
14 310 runs  +54  13 878 ✔️ +54  432 💤 ±0  0 ±0 

Results for commit c873e40. ± Comparison against base commit a57df58.

This pull request removes 14 and adds 15 tests. Note that renamed tests count towards both.
test_action_script.Test ‑ test_get_settings_check_name_default
test_action_script.Test ‑ test_get_settings_comment_mode_default
test_action_script.Test ‑ test_get_settings_comment_on_pr_default
test_action_script.Test ‑ test_get_settings_comment_title_default
test_action_script.Test ‑ test_get_settings_commit_default
test_action_script.Test ‑ test_get_settings_compare_to_earlier_commit_default
test_action_script.Test ‑ test_get_settings_dedup_classes_by_file_name_default
test_action_script.Test ‑ test_get_settings_fail_on_default
test_action_script.Test ‑ test_get_settings_hide_comment_default
test_action_script.Test ‑ test_get_settings_ignore_runs_default
…
test_action_script.Test ‑ test_get_settings_check_name
test_action_script.Test ‑ test_get_settings_check_run_annotations
test_action_script.Test ‑ test_get_settings_comment_mode
test_action_script.Test ‑ test_get_settings_comment_on_pr
test_action_script.Test ‑ test_get_settings_comment_title
test_action_script.Test ‑ test_get_settings_commit
test_action_script.Test ‑ test_get_settings_compare_to_earlier_commit
test_action_script.Test ‑ test_get_settings_dedup_classes_by_file_name
test_action_script.Test ‑ test_get_settings_fail_on
test_action_script.Test ‑ test_get_settings_hide_comment
…

@github-actions
Copy link

github-actions bot commented Mar 7, 2022

Unit Test Results (macOS)

       54 files  ±  0         54 suites  ±0   2m 32s ⏱️ -1s
     265 tests +  1       265 ✔️ +  1      0 💤 ±0  0 ±0 
14 310 runs  +54  13 878 ✔️ +54  432 💤 ±0  0 ±0 

Results for commit c873e40. ± Comparison against base commit a57df58.

This pull request removes 14 and adds 15 tests. Note that renamed tests count towards both.
test_action_script.Test ‑ test_get_settings_check_name_default
test_action_script.Test ‑ test_get_settings_comment_mode_default
test_action_script.Test ‑ test_get_settings_comment_on_pr_default
test_action_script.Test ‑ test_get_settings_comment_title_default
test_action_script.Test ‑ test_get_settings_commit_default
test_action_script.Test ‑ test_get_settings_compare_to_earlier_commit_default
test_action_script.Test ‑ test_get_settings_dedup_classes_by_file_name_default
test_action_script.Test ‑ test_get_settings_fail_on_default
test_action_script.Test ‑ test_get_settings_hide_comment_default
test_action_script.Test ‑ test_get_settings_ignore_runs_default
…
test_action_script.Test ‑ test_get_settings_check_name
test_action_script.Test ‑ test_get_settings_check_run_annotations
test_action_script.Test ‑ test_get_settings_comment_mode
test_action_script.Test ‑ test_get_settings_comment_on_pr
test_action_script.Test ‑ test_get_settings_comment_title
test_action_script.Test ‑ test_get_settings_commit
test_action_script.Test ‑ test_get_settings_compare_to_earlier_commit
test_action_script.Test ‑ test_get_settings_dedup_classes_by_file_name
test_action_script.Test ‑ test_get_settings_fail_on
test_action_script.Test ‑ test_get_settings_hide_comment
…

@github-actions
Copy link

github-actions bot commented Mar 7, 2022

Unit Test Results (Test Files)

  25 files  ±0      4 errors  22 suites  ±0   39m 12s ⏱️ ±0s
272 tests ±0  227 ✔️ ±0  18 💤 ±0  23 ±0  4 🔥 ±0 
443 runs  ±0  357 ✔️ ±0  55 💤 ±0  26 ±0  5 🔥 ±0 

For more details on these parsing errors, failures and errors, see this check.

Results for commit c873e40. ± Comparison against base commit a57df58.

@github-actions
Copy link

github-actions bot commented Mar 7, 2022

Unit Test Results (Dockerfile)

       54 files  ±  0         54 suites  ±0   2m 32s ⏱️ -1s
     265 tests +  1       265 ✔️ +  1      0 💤 ±0  0 ±0 
14 310 runs  +54  13 878 ✔️ +54  432 💤 ±0  0 ±0 

Results for commit c873e40. ± Comparison against base commit a57df58.

This pull request removes 14 and adds 15 tests. Note that renamed tests count towards both.
test_action_script.Test ‑ test_get_settings_check_name_default
test_action_script.Test ‑ test_get_settings_comment_mode_default
test_action_script.Test ‑ test_get_settings_comment_on_pr_default
test_action_script.Test ‑ test_get_settings_comment_title_default
test_action_script.Test ‑ test_get_settings_commit_default
test_action_script.Test ‑ test_get_settings_compare_to_earlier_commit_default
test_action_script.Test ‑ test_get_settings_dedup_classes_by_file_name_default
test_action_script.Test ‑ test_get_settings_fail_on_default
test_action_script.Test ‑ test_get_settings_hide_comment_default
test_action_script.Test ‑ test_get_settings_ignore_runs_default
…
test_action_script.Test ‑ test_get_settings_check_name
test_action_script.Test ‑ test_get_settings_check_run_annotations
test_action_script.Test ‑ test_get_settings_comment_mode
test_action_script.Test ‑ test_get_settings_comment_on_pr
test_action_script.Test ‑ test_get_settings_comment_title
test_action_script.Test ‑ test_get_settings_commit
test_action_script.Test ‑ test_get_settings_compare_to_earlier_commit
test_action_script.Test ‑ test_get_settings_dedup_classes_by_file_name
test_action_script.Test ‑ test_get_settings_fail_on
test_action_script.Test ‑ test_get_settings_hide_comment
…

@github-actions
Copy link

github-actions bot commented Mar 7, 2022

Unit Test Results (Windows)

       54 files  ±  0         54 suites  ±0   2m 32s ⏱️ -1s
     265 tests +  1       265 ✔️ +  1      0 💤 ±0  0 ±0 
14 310 runs  +54  13 878 ✔️ +54  432 💤 ±0  0 ±0 

Results for commit c873e40. ± Comparison against base commit a57df58.

This pull request removes 14 and adds 15 tests. Note that renamed tests count towards both.
test_action_script.Test ‑ test_get_settings_check_name_default
test_action_script.Test ‑ test_get_settings_comment_mode_default
test_action_script.Test ‑ test_get_settings_comment_on_pr_default
test_action_script.Test ‑ test_get_settings_comment_title_default
test_action_script.Test ‑ test_get_settings_commit_default
test_action_script.Test ‑ test_get_settings_compare_to_earlier_commit_default
test_action_script.Test ‑ test_get_settings_dedup_classes_by_file_name_default
test_action_script.Test ‑ test_get_settings_fail_on_default
test_action_script.Test ‑ test_get_settings_hide_comment_default
test_action_script.Test ‑ test_get_settings_ignore_runs_default
…
test_action_script.Test ‑ test_get_settings_check_name
test_action_script.Test ‑ test_get_settings_check_run_annotations
test_action_script.Test ‑ test_get_settings_comment_mode
test_action_script.Test ‑ test_get_settings_comment_on_pr
test_action_script.Test ‑ test_get_settings_comment_title
test_action_script.Test ‑ test_get_settings_commit
test_action_script.Test ‑ test_get_settings_compare_to_earlier_commit
test_action_script.Test ‑ test_get_settings_dedup_classes_by_file_name
test_action_script.Test ‑ test_get_settings_fail_on
test_action_script.Test ‑ test_get_settings_hide_comment
…

@github-actions
Copy link

github-actions bot commented Mar 7, 2022

Unit Test Results (Docker Image)

       54 files  ±  0         54 suites  ±0   2m 32s ⏱️ -1s
     265 tests +  1       265 ✔️ +  1      0 💤 ±0  0 ±0 
14 310 runs  +54  13 878 ✔️ +54  432 💤 ±0  0 ±0 

Results for commit c873e40. ± Comparison against base commit a57df58.

This pull request removes 14 and adds 15 tests. Note that renamed tests count towards both.
test_action_script.Test ‑ test_get_settings_check_name_default
test_action_script.Test ‑ test_get_settings_comment_mode_default
test_action_script.Test ‑ test_get_settings_comment_on_pr_default
test_action_script.Test ‑ test_get_settings_comment_title_default
test_action_script.Test ‑ test_get_settings_commit_default
test_action_script.Test ‑ test_get_settings_compare_to_earlier_commit_default
test_action_script.Test ‑ test_get_settings_dedup_classes_by_file_name_default
test_action_script.Test ‑ test_get_settings_fail_on_default
test_action_script.Test ‑ test_get_settings_hide_comment_default
test_action_script.Test ‑ test_get_settings_ignore_runs_default
…
test_action_script.Test ‑ test_get_settings_check_name
test_action_script.Test ‑ test_get_settings_check_run_annotations
test_action_script.Test ‑ test_get_settings_comment_mode
test_action_script.Test ‑ test_get_settings_comment_on_pr
test_action_script.Test ‑ test_get_settings_comment_title
test_action_script.Test ‑ test_get_settings_commit
test_action_script.Test ‑ test_get_settings_compare_to_earlier_commit
test_action_script.Test ‑ test_get_settings_dedup_classes_by_file_name
test_action_script.Test ‑ test_get_settings_fail_on
test_action_script.Test ‑ test_get_settings_hide_comment
…

@github-actions
Copy link

github-actions bot commented Mar 7, 2022

Unit Test Results (reference)

       54 files  ±  0         54 suites  ±0   2m 32s ⏱️ -1s
     265 tests +  1       265 ✔️ +  1      0 💤 ±0  0 ±0 
14 310 runs  +54  13 878 ✔️ +54  432 💤 ±0  0 ±0 

Results for commit c873e40. ± Comparison against base commit a57df58.

This pull request removes 14 and adds 15 tests. Note that renamed tests count towards both.
test_action_script.Test ‑ test_get_settings_check_name_default
test_action_script.Test ‑ test_get_settings_comment_mode_default
test_action_script.Test ‑ test_get_settings_comment_on_pr_default
test_action_script.Test ‑ test_get_settings_comment_title_default
test_action_script.Test ‑ test_get_settings_commit_default
test_action_script.Test ‑ test_get_settings_compare_to_earlier_commit_default
test_action_script.Test ‑ test_get_settings_dedup_classes_by_file_name_default
test_action_script.Test ‑ test_get_settings_fail_on_default
test_action_script.Test ‑ test_get_settings_hide_comment_default
test_action_script.Test ‑ test_get_settings_ignore_runs_default
…
test_action_script.Test ‑ test_get_settings_check_name
test_action_script.Test ‑ test_get_settings_check_run_annotations
test_action_script.Test ‑ test_get_settings_comment_mode
test_action_script.Test ‑ test_get_settings_comment_on_pr
test_action_script.Test ‑ test_get_settings_comment_title
test_action_script.Test ‑ test_get_settings_commit
test_action_script.Test ‑ test_get_settings_compare_to_earlier_commit
test_action_script.Test ‑ test_get_settings_dedup_classes_by_file_name
test_action_script.Test ‑ test_get_settings_fail_on
test_action_script.Test ‑ test_get_settings_hide_comment
…

@EnricoMi EnricoMi merged commit af300a5 into master Mar 7, 2022
@EnricoMi EnricoMi deleted the branch-fix-tests branch March 7, 2022 12:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant