Release of version 0.20.1

[sesheta]

Hey, @fridex!

Opening this PR to fix the last release.

Related: #1546

Changelog:
### Features
* Add a temporary workaround for #1541
* Provide stack info in security indicators
* Adjust message logged to reduce confusion
* Increase verbosity to see where inspections are triggered
* Adjust description in liveness.py
* Add links to termial random
### Bug Fixes
* Fix issue when signal is sent in one call in livenenss.py
### Improvements
* :sparkles: remove the Zuul config file, as we dont use Zuul anymore
* Adjust tests for stack_info provided by security indicators
### Automatic Updates
* :pushpin: Automatic update of dependency thoth-storages from 0.25.16 to 0.25.17 (#1540)

[sefkhet-abwy]

This is an auto-approve of an auto-PR.

[fridex]

/approve

[sesheta]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: fridex, sefkhet-abwy[bot]

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [fridex]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[sesheta]

Pytest Test failed! Click here

running test
Searching for setuptools>=40.3.0
Reading https://pypi.org/simple/setuptools/
Downloading https://files.pythonhosted.org/packages/6d/38/c21ef5034684ffc0412deefbb07d66678332290c14bb5269c85145fbd55e/setuptools-50.3.2-py3-none-any.whl#sha256=2c242a0856fbad7efbe560df4a7add9324f340cf48df43651e9604924466794a
Best match: setuptools 50.3.2
Processing setuptools-50.3.2-py3-none-any.whl
Installing setuptools-50.3.2-py3-none-any.whl to /workspace/repo/.eggs
writing requirements to /workspace/repo/.eggs/setuptools-50.3.2-py3.6.egg/EGG-INFO/requires.txt

Installed /workspace/repo/.eggs/setuptools-50.3.2-py3.6.egg
running egg_info
creating thoth_adviser.egg-info
writing thoth_adviser.egg-info/PKG-INFO
writing dependency_links to thoth_adviser.egg-info/dependency_links.txt
writing entry points to thoth_adviser.egg-info/entry_points.txt
writing requirements to thoth_adviser.egg-info/requires.txt
writing top-level names to thoth_adviser.egg-info/top_level.txt
writing manifest file 'thoth_adviser.egg-info/SOURCES.txt'
package init file 'thoth/__init__.py' not found (or not a regular file)
reading manifest file 'thoth_adviser.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no previously-included files found matching 'liveness.py'
warning: no previously-included files found matching '*.md'
warning: no previously-included files found matching '*.sh'
warning: no previously-included files found matching 'thoth-adviser'
warning: no previously-included files found matching '*.toml'
warning: no previously-included files found matching '*.yaml'
warning: no previously-included files found matching 'tests/wraps/pytorch/test_mkl_threads.txt'
warning: no previously-included files found matching 'thoth/adviser/wraps/pytorch/mkl_threads.txt'
warning: no files found matching '*.yaml' under directory 'openshift'
warning: no files found matching '*.yaml' under directory 'workflows'
writing manifest file 'thoth_adviser.egg-info/SOURCES.txt'
running build_ext
============================= test session starts ==============================
platform linux -- Python 3.6.8, pytest-6.1.2, py-1.9.0, pluggy-0.13.1 -- /opt/app-root/bin/python3
cachedir: .pytest_cache
hypothesis profile 'default' -> database=DirectoryBasedExampleDatabase('/workspace/repo/.hypothesis/examples')
rootdir: /workspace/repo
plugins: hypothesis-5.41.1, cov-2.10.1, mypy-0.7.0, timeout-1.4.2
timeout: 60.0s
timeout method: signal
timeout func_only: False
collecting ... collected 1175 items

tests/__init__.py::mypy PASSED
tests/base.py::mypy PASSED
tests/conftest.py::mypy PASSED
tests/graph_mock.py::mypy PASSED
tests/helpers.py::mypy PASSED
tests/test_beam.py::mypy PASSED
tests/test_beam.py::TestBeam::test_initialization_positive PASSED
tests/test_beam.py::TestBeam::test_initialization_not_positive_error PASSED
tests/test_beam.py::TestBeam::test_wipe PASSED
tests/test_beam.py::TestBeam::test_add_state PASSED
tests/test_beam.py::TestBeam::test_get_random PASSED
tests/test_beam.py::TestBeam::test_iter_states_sorted PASSED
tests/test_beam.py::TestBeam::test_max PASSED
tests/test_beam.py::TestBeam::test_add_state_order_multi PASSED
tests/test_beam.py::TestBeam::test_add_state_order_single PASSED
tests/test_beam.py::TestBeam::test_remove FAILED
tests/test_context.py::mypy PASSED
tests/test_context.py::TestContext::test_get_package_version PASSED
tests/test_context.py::TestContext::test_get_package_version_graceful PASSED
tests/test_context.py::TestContext::test_get_top_accepted_final_state PASSED
tests/test_context.py::TestContext::test_register_accepted_final_state PASSED
tests/test_context.py::TestContext::test_register_package_version_existing PASSED
tests/test_context.py::TestContext::test_register_package_tuple_new PASSED
tests/test_context.py::TestContext::test_register_package_tuple_existing PASSED
tests/test_context.py::TestContext::test_note_dependencies PASSED
tests/test_context.py::TestContext::test_is_dependency_monkey PASSED
tests/test_context.py::TestContext::test_is_adviser PASSED
tests/test_context.py::TestContext::test_invalid_context_no_type PASSED
tests/test_context.py::TestContext::test_invalid_context_type PASSED
tests/test_dependency_monkey.py::mypy PASSED
tests/test_dependency_monkey.py::TestDependencyMonkey::test_construct PASSED
tests/test_dependency_monkey.py::TestDependencyMonkey::test_amun_output PASSED
tests/test_dependency_monkey.py::TestDependencyMonkey::test_dir_output PASSED
tests/test_dependency_monkey.py::TestDependencyMonkey::test_stdout_output PASSED
tests/test_dm_report.py::mypy PASSED
tests/test_dm_report.py::TestDependencyMonkeyReport::test_to_dict PASSED
tests/test_dm_report.py::TestDependencyMonkeyReport::test_add_responses PASSED
tests/test_exceptions.py::mypy PASSED
tests/test_exceptions.py::TestExceptions::test_exception_hierarchy PASSED
tests/test_pipeline_builder.py::mypy PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_is_included PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_is_adviser_pipeline PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_is_dependency_monkey_pipeline PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_invalid_pipeline_builder_context PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_add_unit[Boot2-boots] PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_add_unit[Pseudonym2-pseudonyms] PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_add_unit[Sieve2-sieves] PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_add_unit[Step2-steps] PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_add_unit[Stride2-strides] PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_add_unit[Wrap2-wraps] PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_get_included_boots PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_get_included_pseudonyms PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_get_included_sieves PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_get_included_steps PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_get_included_strides PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_get_included_wraps PASSED
tests/test_pipeline_builder.py::TestPipelineBuilder::test_build_configuration[get_adviser_pipeline_config-kwargs0] PASSED
tests/test_pipeline_builder.py::TestPipelineBuilder::test_build_configuration[get_dependency_monkey_pipeline_config-kwargs1] PASSED
tests/test_pipeline_builder.py::TestPipelineBuilder::test_blocked_units PASSED
tests/test_pipeline_builder.py::TestPipelineBuilder::test_from_dict PASSED
tests/test_pipeline_builder.py::TestPipelineBuilder::test_load PASSED
tests/test_pipeline_builder.py::TestPipelineBuilder::test_from_dict_unit_configuration_error PASSED
tests/test_pipeline_builder.py::TestPipelineBuilder::test_from_dict_unit_not_exist_error PASSED
tests/test_pipeline_config.py::mypy PASSED
tests/test_pipeline_config.py::TestPipelineConfig::test_to_dict PASSED
tests/test_pipeline_config.py::TestPipelineConfig::test_iter_units PASSED
tests/test_pipeline_config.py::TestPipelineConfig::test_call_pre_run PASSED
tests/test_pipeline_config.py::TestPipelineConfig::test_call_post_run PASSED
tests/test_pipeline_config.py::TestPipelineConfig::test_call_post_run_report PASSED
tests/test_predictor.py::mypy PASSED
tests/test_predictor.py::TestPredictor::test_keep_temperature_history_init PASSED
tests/test_predictor.py::TestPredictor::test_assign_context PASSED
tests/test_product.py::mypy PASSED
tests/test_product.py::TestProduct::test_from_final_state PASSED
tests/test_product.py::TestProduct::test_to_dict PASSED
tests/test_product.py::TestProduct::test_environment_markers PASSED
tests/test_report.py::mypy PASSED
tests/test_report.py::TestReport::test_stack_info PASSED
tests/test_report.py::TestReport::test_add_product PASSED
tests/test_report.py::TestReport::test_to_dict PASSED
tests/test_resolver.py::mypy PASSED
tests/test_resolver.py::TestResolver::test_run_boots PASSED
tests/test_resolver.py::TestResolver::test_run_boots_not_acceptable PASSED
tests/test_resolver.py::TestResolver::test_run_boots_error PASSED
tests/test_resolver.py::TestResolver::test_run_sieves PASSED
tests/test_resolver.py::TestResolver::test_run_sieves_error PASSED
tests/test_resolver.py::TestResolver::test_run_sieves_not_acceptable PASSED
tests/test_resolver.py::TestResolver::test_run_steps_not_acceptable PASSED
tests/test_resolver.py::TestResolver::test_run_steps_step_error PASSED
tests/test_resolver.py::TestResolver::test_run_steps_multi_package_resolution PASSED
tests/test_resolver.py::TestResolver::test_run_steps_error PASSED
tests/test_resolver.py::TestResolver::test_run_steps_inf_nan[inf] PASSED
tests/test_resolver.py::TestResolver::test_run_steps_inf_nan[nan] PASSED
tests/test_resolver.py::TestResolver::test_run_strides PASSED
tests/test_resolver.py::TestResolver::test_run_strides_not_acceptable PASSED
tests/test_resolver.py::TestResolver::test_run_strides_error PASSED
tests/test_resolver.py::TestResolver::test_run_wraps PASSED
tests/test_resolver.py::TestResolver::test_run_wraps_error PASSED
tests/test_resolver.py::TestResolver::test_resolve_direct_dependencies_multiple_error PASSED
tests/test_resolver.py::TestResolver::test_resolve_direct_dependencies_some_error PASSED
tests/test_resolver.py::TestResolver::test_resolve_direct_dependencies PASSED
tests/test_resolver.py::TestResolver::test_prepare_initial_state_limit_latest_versions PASSED
tests/test_resolver.py::TestResolver::test_prepare_initial_state_cannot_produce_stack PASSED
tests/test_resolver.py::TestResolver::test_prepare_initial_state PASSED
tests/test_resolver.py::TestResolver::test_expand_state_not_found_one_unresolved PASSED
tests/test_resolver.py::TestResolver::test_expand_state_not_found_more_unresolved PASSED
tests/test_resolver.py::TestResolver::test_expand_state_no_dependencies_final_simple PASSED
tests/test_resolver.py::TestResolver::test_expand_state_no_dependencies_final PASSED
tests/test_resolver.py::TestResolver::test_expand_state_no_dependencies_final_multiple_different PASSED
tests/test_resolver.py::TestResolver::test_expand_state_no_dependencies_final_multiple_same PASSED
tests/test_resolver.py::TestResolver::test_expand_state_no_intersection PASSED
tests/test_resolver.py::TestResolver::test_expand_state_sieves_discarded PASSED
tests/test_resolver.py::TestResolver::test_expand_state_intersection_adjust PASSED
tests/test_resolver.py::TestResolver::test_expand_state_no_dependencies_not_final PASSED
tests/test_resolver.py::TestResolver::test_expand_state_add_dependencies_call PASSED
tests/test_resolver.py::TestResolver::test_expand_state_add_dependencies_unsolved PASSED
tests/test_resolver.py::TestResolver::test_resolve_boot_error PASSED
tests/test_resolver.py::TestResolver::test_resolve_pre_run_error[boots] PASSED
tests/test_resolver.py::TestResolver::test_resolve_pre_run_error[sieves] PASSED
tests/test_resolver.py::TestResolver::test_resolve_pre_run_error[steps] PASSED
tests/test_resolver.py::TestResolver::test_resolve_pre_run_error[strides] PASSED
tests/test_resolver.py::TestResolver::test_resolve_pre_run_error[wraps] PASSED
tests/test_resolver.py::TestResolver::test_do_resolve_states_limit_reached PASSED
tests/test_resolver.py::TestResolver::test_expand_state_marker_true PASSED
tests/test_resolver.py::TestResolver::test_expand_state_marker_false PASSED
tests/test_resolver.py::TestResolver::test_do_resolve_states_beam_empty PASSED
tests/test_resolver.py::TestResolver::test_resolve_products PASSED
tests/test_resolver.py::TestResolver::test_resolve_products_eager_stop PASSED
tests/test_resolver.py::TestResolver::test_resolve_no_stack PASSED
tests/test_resolver.py::TestResolver::test_resolve PASSED
tests/test_resolver.py::TestResolver::test_get_adviser_instance PASSED
tests/test_resolver.py::TestResolver::test_get_dependency_monkey_instance PASSED
tests/test_resolver.py::TestResolver::test_positive_int_validator[-1-10] PASSED
tests/test_resolver.py::TestResolver::test_positive_int_validator[10--1] PASSED
tests/test_resolver.py::TestResolver::test_positive_int_validator[-1--1] PASSED
tests/test_resolver.py::TestResolver::test_positive_int_validator[0-10] PASSED
tests/test_resolver.py::TestResolver::test_positive_int_validator[10-0] PASSED
tests/test_resolver.py::TestResolver::test_positive_int_validator[0-0] PASSED
tests/test_resolver.py::TestResolver::test_no_direct_dependencies_error PASSED
tests/test_resolver.py::TestResolver::test_finalize_initial_state PASSED
tests/test_resolver.py::TestResolver::test_finalize_state PASSED
tests/test_resolver.py::TestResolver::test_step_boundaries[101.0-1.0] PASSED
tests/test_resolver.py::TestResolver::test_step_boundaries[-101.0--1.0] PASSED
tests/test_resolver.py::TestResolver::test_maybe_score_user_lock_file_no_lock_file PASSED
tests/test_resolver.py::TestResolver::test_maybe_score_user_lock_file_sieves_removal PASSED
tests/test_resolver.py::TestResolver::test_maybe_score_user_lock_file_steps_removal PASSED
tests/test_resolver.py::TestResolver::test_maybe_score_user_lock_file PASSED
tests/test_resolver.py::TestResolver::test_maybe_score_user_lock_file_error PASSED
tests/test_resolver.py::TestResolver::test_prepare_user_lock_file_index_not_enabled PASSED
tests/test_resolver.py::TestResolver::test_prepare_user_lock_file_provenance_unknown PASSED
tests/test_resolver.py::TestResolver::test_prepare_user_lock_file_one_source PASSED
tests/test_resolver.py::TestResolver::test_prepare_user_lock_file_multiple_sources PASSED
tests/test_resolver.py::TestResolver::test_sieve_skip_package_exception PASSED
tests/test_resolver.py::TestResolver::test_sieve_skip_package PASSED
tests/test_resolver.py::TestResolver::test_sieve_skip_package_unresolved PASSED
tests/test_resolver.py::TestResolver::test_sieve_skip_package_direct PASSED
tests/test_resolver.py::TestResolver::test_sieve_skip_package_user_stack PASSED
tests/test_resolver.py::TestResolver::test_sieve_skip_package_user_stack_direct PASSED
tests/test_resolver.py::TestResolver::test_step_skip_package_run_steps PASSED
tests/test_resolver.py::TestResolver::test_run_pseudonyms PASSED
tests/test_resolver.py::TestResolver::test_run_pseudonyms_initial_state PASSED
tests/test_resolver.py::TestResolver::test_run_pseudonym_units PASSED
tests/test_resolver.py::TestResolver::test_run_pseudonym_units_no_return PASSED
tests/test_resolver.py::TestResolver::test_run_pseudonym_units_already_resolved PASSED
tests/test_resolver.py::TestResolver::test_run_pseudonym_units_already_unresolved PASSED
tests/test_resolver.py::TestResolver::test_run_boots_only_none PASSED
tests/test_resolver.py::TestResolver::test_run_boots_with_none PASSED
tests/test_resolver.py::TestResolver::test_run_sieves_with_none PASSED
tests/test_resolver.py::TestResolver::test_run_sieves_only_none PASSED
tests/test_resolver.py::TestResolver::test_run_steps_with_none PASSED
tests/test_resolver.py::TestResolver::test_run_steps_only_none PASSED
tests/test_resolver.py::TestResolver::test_run_strides_only_none PASSED
tests/test_resolver.py::TestResolver::test_run_strides_with_none PASSED
tests/test_resolver.py::TestResolver::test_run_wraps_only_none PASSED
tests/test_resolver.py::TestResolver::test_run_wraps_with_none PASSED
tests/test_resolver.py::TestResolver::test_run_boot_unit_run PASSED
tests/test_resolver.py::TestResolver::test_run_pseudonym_unit_run PASSED
tests/test_resolver.py::TestResolver::test_run_sieves_unit_run PASSED
tests/test_resolver.py::TestResolver::test_run_steps_unit_run PASSED
tests/test_resolver.py::TestResolver::test_run_stride_unit_run PASSED
tests/test_resolver.py::TestResolver::test_run_wraps_unit_run PASSED
tests/test_resolver.py::TestResolver::test_run_steps_skip_package PASSED
tests/test_resolver.py::TestResolver::test_run_steps_skip_package_no_result PASSED
tests/test_resolver.py::TestResolver::test_run_steps_skip_package_unresolved PASSED
tests/test_resolver.py::TestResolver::test_run_steps_skip_package_no_unresolved PASSED
tests/test_resolver.py::TestResolver::test_run_steps_skip_package_beam_remove PASSED
tests/test_solver.py::mypy PASSED
tests/test_solver.py::TestSolver::test_db_0_raises[graph0] PASSED
tests/test_solver.py::TestSolver::test_db_0[graph0] PASSED
tests/test_solver.py::TestSolver::test_db_0_multiple[graph0] PASSED
tests/test_solver.py::TestSolver::test_db_0_package_raises[graph0] PASSED
tests/test_solver.py::TestSolver::test_db_0_all_package_versions[graph0] PASSED
tests/test_solver.py::TestSolver::test_db_0_package_multiple[graph0] PASSED
tests/test_solver.py::TestSolver::test_db_0_multiple_times_error[graph0] PASSED
tests/test_state.py::mypy PASSED
tests/test_state.py::TestState::test_justification PASSED
tests/test_state.py::TestState::test_is_final PASSED
tests/test_state.py::TestState::test_add_unresolved_dependency PASSED
tests/test_state.py::TestState::test_get_random_first_unresolved_dependency PASSED
tests/test_state.py::TestState::test_get_random_first_unresolved_dependency_error PASSED
tests/test_state.py::TestState::test_clone PASSED
tests/test_state.py::TestState::test_parent PASSED
tests/test_state.py::TestState::test_dict_order[0] PASSED
tests/test_state.py::TestState::test_dict_order[1] PASSED
tests/test_state.py::TestState::test_dict_order[2] PASSED
tests/test_state.py::TestState::test_dict_order[3] PASSED
tests/test_state.py::TestState::test_dict_order[4] PASSED
tests/test_step.py::mypy PASSED
tests/test_step.py::TestStep::test_boundaries PASSED
tests/test_unit.py::mypy PASSED
tests/test_unit.py::TestUnit::test_is_aicoe_release[package_version0-True] PASSED
tests/test_unit.py::TestUnit::test_is_aicoe_release[package_version1-True] PASSED
tests/test_unit.py::TestUnit::test_is_aicoe_release[package_version2-False] PASSED
tests/test_unit.py::TestUnit::test_get_aicoe_configuration[package_version0-expected0] PASSED
tests/test_unit.py::TestUnit::test_get_aicoe_configuration[package_version1-expected1] PASSED
tests/test_unit.py::TestUnit::test_get_aicoe_configuration[package_version2-None] PASSED
tests/boots/__init__.py::mypy PASSED
tests/boots/test_fully_specified_environment.py::mypy PASSED
tests/boots/test_fully_specified_environment.py::TestFullySpecifiedEnvironment::test_provided_unit_tested <- tests/base.py PASSED
tests/boots/test_fully_specified_environment.py::TestFullySpecifiedEnvironment::test_provided_package_version <- tests/base.py SKIPPED
tests/boots/test_fully_specified_environment.py::TestFullySpecifiedEnvironment::test_default_configuration <- tests/base.py PASSED
tests/boots/test_fully_specified_environment.py::TestFullySpecifiedEnvironment::test_super_pre_run <- tests/base.py SKIPPED
tests/boots/test_fully_specified_environment.py::TestFullySpecifiedEnvironment::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/boots/test_fully_specified_environment.py::TestFullySpecifiedEnvironment::test_verify_multiple_should_include PASSED
tests/boots/test_fully_specified_environment.py::TestFullySpecifiedEnvironment::test_should_include PASSED
tests/boots/test_fully_specified_environment.py::TestFullySpecifiedEnvironment::test_should_include_no_include PASSED
tests/boots/test_fully_specified_environment.py::TestFullySpecifiedEnvironment::test_run PASSED
tests/boots/test_fully_specified_environment.py::TestFullySpecifiedEnvironment::test_run_error PASSED
tests/boots/test_platform.py::mypy PASSED
tests/boots/test_platform.py::TestPlatformBoot::test_provided_unit_tested <- tests/base.py PASSED
tests/boots/test_platform.py::TestPlatformBoot::test_provided_package_version <- tests/base.py SKIPPED
tests/boots/test_platform.py::TestPlatformBoot::test_default_configuration <- tests/base.py PASSED
tests/boots/test_platform.py::TestPlatformBoot::test_super_pre_run <- tests/base.py SKIPPED
tests/boots/test_platform.py::TestPlatformBoot::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/boots/test_platform.py::TestPlatformBoot::test_verify_multiple_should_include PASSED
tests/boots/test_platform.py::TestPlatformBoot::test_should_include PASSED
tests/boots/test_platform.py::TestPlatformBoot::test_adjust PASSED
tests/boots/test_platform.py::TestPlatformBoot::test_no_platform PASSED
tests/boots/test_platform.py::TestPlatformBoot::test_no_adjust PASSED
tests/boots/test_python_version.py::mypy PASSED
tests/boots/test_python_version.py::TestPythonVersionBoot::test_provided_unit_tested <- tests/base.py PASSED
tests/boots/test_python_version.py::TestPythonVersionBoot::test_provided_package_version <- tests/base.py SKIPPED
tests/boots/test_python_version.py::TestPythonVersionBoot::test_default_configuration <- tests/base.py PASSED
tests/boots/test_python_version.py::TestPythonVersionBoot::test_super_pre_run <- tests/base.py SKIPPED
tests/boots/test_python_version.py::TestPythonVersionBoot::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/boots/test_python_version.py::TestPythonVersionBoot::test_verify_multiple_should_include PASSED
tests/boots/test_python_version.py::TestPythonVersionBoot::test_no_python_config PASSED
tests/boots/test_python_version.py::TestPythonVersionBoot::test_no_python_pipfile PASSED
tests/boots/test_rhel_version.py::mypy PASSED
tests/boots/test_rhel_version.py::TestRHELVersionBoot::test_provided_unit_tested <- tests/base.py PASSED
tests/boots/test_rhel_version.py::TestRHELVersionBoot::test_provided_package_version <- tests/base.py SKIPPED
tests/boots/test_rhel_version.py::TestRHELVersionBoot::test_default_configuration <- tests/base.py PASSED
tests/boots/test_rhel_version.py::TestRHELVersionBoot::test_super_pre_run <- tests/base.py SKIPPED
tests/boots/test_rhel_version.py::TestRHELVersionBoot::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/boots/test_rhel_version.py::TestRHELVersionBoot::test_verify_multiple_should_include PASSED
tests/boots/test_rhel_version.py::TestRHELVersionBoot::test_version_change PASSED
tests/boots/test_rhel_version.py::TestRHELVersionBoot::test_version_no_change_no_os_match PASSED
tests/boots/test_rhel_version.py::TestRHELVersionBoot::test_version_no_change_no_version PASSED
tests/boots/test_solved_software_environment.py::mypy PASSED
tests/boots/test_solved_software_environment.py::TestSolvedSoftwareEnvironmentBoot::test_provided_unit_tested <- tests/base.py PASSED
tests/boots/test_solved_software_environment.py::TestSolvedSoftwareEnvironmentBoot::test_provided_package_version <- tests/base.py SKIPPED
tests/boots/test_solved_software_environment.py::TestSolvedSoftwareEnvironmentBoot::test_default_configuration <- tests/base.py PASSED
tests/boots/test_solved_software_environment.py::TestSolvedSoftwareEnvironmentBoot::test_super_pre_run <- tests/base.py SKIPPED
tests/boots/test_solved_software_environment.py::TestSolvedSoftwareEnvironmentBoot::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/boots/test_solved_software_environment.py::TestSolvedSoftwareEnvironmentBoot::test_verify_multiple_should_include PASSED
tests/boots/test_solved_software_environment.py::TestSolvedSoftwareEnvironmentBoot::test_should_include PASSED
tests/boots/test_solved_software_environment.py::TestSolvedSoftwareEnvironmentBoot::test_should_include_not_fully_specified PASSED
tests/boots/test_solved_software_environment.py::TestSolvedSoftwareEnvironmentBoot::test_run PASSED
tests/boots/test_solved_software_environment.py::TestSolvedSoftwareEnvironmentBoot::test_run_error PASSED
tests/boots/test_ubi.py::mypy PASSED
tests/boots/test_ubi.py::TestUbiBoot::test_provided_unit_tested <- tests/base.py PASSED
tests/boots/test_ubi.py::TestUbiBoot::test_provided_package_version <- tests/base.py SKIPPED
tests/boots/test_ubi.py::TestUbiBoot::test_default_configuration <- tests/base.py PASSED
tests/boots/test_ubi.py::TestUbiBoot::test_super_pre_run <- tests/base.py SKIPPED
tests/boots/test_ubi.py::TestUbiBoot::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/boots/test_ubi.py::TestUbiBoot::test_verify_multiple_should_include PASSED
tests/boots/test_ubi.py::TestUbiBoot::test_rhel_assign PASSED
tests/boots/test_ubi.py::TestUbiBoot::test_no_rhel_assign PASSED
tests/predictors/__init__.py::mypy PASSED
tests/predictors/test_annealing.py::mypy PASSED
tests/predictors/test_annealing.py::TestAdaptiveSimulatedAnnealing::test_temperature_function PASSED
tests/predictors/test_annealing.py::TestAdaptiveSimulatedAnnealing::test_acceptance_probability PASSED
tests/predictors/test_annealing.py::TestAdaptiveSimulatedAnnealing::test_pre_run PASSED
tests/predictors/test_annealing.py::TestAdaptiveSimulatedAnnealing::test_run PASSED
tests/predictors/test_hill_climbing.py::mypy PASSED
tests/predictors/test_hill_climbing.py::TestHillClimbing::test_run PASSED
tests/predictors/test_hill_climbing.py::TestHillClimbing::test_pre_run PASSED
tests/predictors/test_latest.py::mypy PASSED
tests/predictors/test_latest.py::TestApproximatingLatest::test_run PASSED
tests/predictors/test_latest.py::TestApproximatingLatest::test_heat_up PASSED
tests/predictors/test_latest.py::TestApproximatingLatest::test_heat_up_end PASSED
tests/predictors/test_mcts.py::mypy PASSED
tests/predictors/test_mcts.py::TestMCTS::test_init PASSED
tests/predictors/test_mcts.py::TestMCTS::test_pre_run PASSED
tests/predictors/test_mcts.py::TestMCTS::test_set_reward_signal_nan PASSED
tests/predictors/test_mcts.py::TestMCTS::test_set_reward_signal PASSED
tests/predictors/test_mcts.py::TestMCTS::test_set_reward_signal_inf PASSED
tests/predictors/test_mcts.py::TestMCTS::test_run_heat_up[None] PASSED
tests/predictors/test_mcts.py::TestMCTS::test_run_heat_up[next_state1] PASSED
tests/predictors/test_mcts.py::TestMCTS::test_run_next_state PASSED
tests/predictors/test_mcts.py::TestMCTS::test_run_next_state_no_last PASSED
tests/predictors/test_mcts.py::TestMCTS::test_run_no_next_state PASSED
tests/predictors/test_package_combinations.py::mypy PASSED
tests/predictors/test_package_combinations.py::TestPackageCombinations::test_pre_run_error PASSED
tests/predictors/test_package_combinations.py::TestPackageCombinations::test_pre_run PASSED
tests/predictors/test_random_walk.py::mypy PASSED
tests/predictors/test_random_walk.py::TestRandomWalk::test_run PASSED
tests/predictors/test_random_walk.py::TestRandomWalk::test_pre_run PASSED
tests/predictors/test_sampling.py::mypy PASSED
tests/predictors/test_sampling.py::TestSampling::test_run PASSED
tests/predictors/test_sampling.py::TestSampling::test_pre_run PASSED
tests/predictors/test_td.py::mypy PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_acceptance_probability PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_temperature_function PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_init PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_pre_run PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_set_reward_signal_nan_inf[nan] PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_set_reward_signal_nan_inf[inf] PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_set_reward_signal_nan_inf[-inf] PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_set_reward_signal_unseen PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_set_reward_signal_seen PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_do_exploitation PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_do_exploitation_no_records PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_run_exploration PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_run_exploitation PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_validation PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_step_default PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_n_step_td_step_adjust PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_n_step_td_step_no_adjust PASSED
tests/pseudonyms/__init__.py::mypy PASSED
tests/pseudonyms/test_intel_tensorflow.py::mypy PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_provided_unit_tested <- tests/base.py PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_provided_package_version <- tests/base.py PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_default_configuration <- tests/base.py PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_super_pre_run <- tests/base.py PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_verify_multiple_should_include PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_recommendation_types_considered PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_include[RecommendationType.TESTING] PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_include[RecommendationType.STABLE] PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_include[RecommendationType.PERFORMANCE] PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_include[RecommendationType.SECURITY] PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_no_include[RecommendationType.LATEST-None-None] PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_no_include[RecommendationType.TESTING-None-10.1] PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_no_include[None-DecisionType.RANDOM-None] PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_pre_run PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_run_pseudonym PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_run_noop[tf_versions0] PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_run_noop[tf_versions1] PASSED
tests/pseudonyms/test_tensorflow_gpu.py::mypy PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_provided_unit_tested <- tests/base.py PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_provided_package_version <- tests/base.py PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_default_configuration <- tests/base.py PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_super_pre_run <- tests/base.py PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_verify_multiple_should_include PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_recommendation_types_considered PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_include[RecommendationType.TESTING] PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_include[RecommendationType.STABLE] PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_include[RecommendationType.PERFORMANCE] PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_include[RecommendationType.SECURITY] PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_no_include[RecommendationType.LATEST-None-10.1] PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_no_include[RecommendationType.PERFORMANCE-None-None] PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_no_include[None-DecisionType.RANDOM-None] PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_pre_run PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_run_pseudonym PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_run_noop[tf_versions0] PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_run_noop[tf_versions1] PASSED
tests/pseudonyms/_debug/__init__.py::mypy PASSED
tests/pseudonyms/_debug/test_alias.py::mypy PASSED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_provided_unit_tested <- tests/base.py PASSED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_super_pre_run <- tests/base.py PASSED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_verify_multiple_should_include SKIPPED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_default_configuration SKIPPED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_provided_package_version SKIPPED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_no_include PASSED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_run_pseudonym[2.2.0-https://pypi.org/simple] PASSED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_run_pseudonym[None-https://pypi.org/simple] PASSED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_run_pseudonym[2.2.0-None] PASSED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_run_pseudonym[None-None] PASSED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_run_noop[==1.1.1-https://pypi.org/simple-2.2.0-https://pypi.org/simple] PASSED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_run_noop[==1.1.1-https://pypi.org/simple-2.2.0-None] PASSED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_run_noop[==2.2.0-https://thoth-station.ninja/simple-2.2.0-https://pypi.org/simple] PASSED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_run_noop[==2.2.0-https://thoth-station.ninja/simple-None-https://pypi.org/simple] PASSED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_run_noop[==1.1.1-https://thoth-station.ninja/simple-2.2.0-https://pypi.org/simple] PASSED
tests/sieves/__init__.py::mypy PASSED
tests/sieves/test_abi_compat.py::mypy PASSED
tests/sieves/test_abi_compat.py::TestAbiCompatSieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/test_abi_compat.py::TestAbiCompatSieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/test_abi_compat.py::TestAbiCompatSieve::test_default_configuration <- tests/base.py PASSED
tests/sieves/test_abi_compat.py::TestAbiCompatSieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/test_abi_compat.py::TestAbiCompatSieve::test_verify_multiple_should_include PASSED
tests/sieves/test_abi_compat.py::TestAbiCompatSieve::test_abi_compat_symbols_present PASSED
tests/sieves/test_abi_compat.py::TestAbiCompatSieve::test_abi_compat_symbols_not_present PASSED
tests/sieves/test_abi_compat.py::TestAbiCompatSieve::test_super_pre_run PASSED
tests/sieves/test_filter_index.py::mypy PASSED
tests/sieves/test_filter_index.py::TestFilterIndexSieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/test_filter_index.py::TestFilterIndexSieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/test_filter_index.py::TestFilterIndexSieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/test_filter_index.py::TestFilterIndexSieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/test_filter_index.py::TestFilterIndexSieve::test_verify_multiple_should_include SKIPPED
tests/sieves/test_filter_index.py::TestFilterIndexSieve::test_default_configuration PASSED
tests/sieves/test_filter_index.py::TestFilterIndexSieve::test_run_filter PASSED
tests/sieves/test_filter_index.py::TestFilterIndexSieve::test_run_no_filter PASSED
tests/sieves/test_filter_index.py::TestFilterIndexSieve::test_run_no_filter_multiple PASSED
tests/sieves/test_index_enabled.py::mypy PASSED
tests/sieves/test_index_enabled.py::TestPackageIndexSieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/test_index_enabled.py::TestPackageIndexSieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/test_index_enabled.py::TestPackageIndexSieve::test_default_configuration <- tests/base.py PASSED
tests/sieves/test_index_enabled.py::TestPackageIndexSieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/test_index_enabled.py::TestPackageIndexSieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/test_index_enabled.py::TestPackageIndexSieve::test_verify_multiple_should_include PASSED
tests/sieves/test_index_enabled.py::TestPackageIndexSieve::test_sieve_index_enabled PASSED
tests/sieves/test_index_enabled.py::TestPackageIndexSieve::test_sieve_index_disabled PASSED
tests/sieves/test_index_enabled.py::TestPackageIndexSieve::test_sieve_index_not_found PASSED
tests/sieves/test_locked.py::mypy PASSED
tests/sieves/test_locked.py::TestCutPreReleasesSieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/test_locked.py::TestCutPreReleasesSieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/test_locked.py::TestCutPreReleasesSieve::test_default_configuration <- tests/base.py PASSED
tests/sieves/test_locked.py::TestCutPreReleasesSieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/test_locked.py::TestCutPreReleasesSieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/test_locked.py::TestCutPreReleasesSieve::test_verify_multiple_should_include PASSED
tests/sieves/test_locked.py::TestCutPreReleasesSieve::test_cut_locked PASSED
tests/sieves/test_locked.py::TestCutPreReleasesSieve::test_cut_locked_dev PASSED
tests/sieves/test_locked.py::TestCutPreReleasesSieve::test_no_cut PASSED
tests/sieves/test_locked.py::TestCutPreReleasesSieve::test_no_cut_dev PASSED
tests/sieves/test_locked.py::TestCutPreReleasesSieve::test_noop PASSED
tests/sieves/test_locked.py::TestCutPreReleasesSieve::test_noop_dev PASSED
tests/sieves/test_prereleases.py::mypy PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_default_configuration <- tests/base.py PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_include[RecommendationType.STABLE] PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_include[RecommendationType.PERFORMANCE] PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_include[RecommendationType.SECURITY] PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_include[RecommendationType.LATEST] PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_include[RecommendationType.TESTING] PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_not_include[RecommendationType.STABLE] PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_not_include[RecommendationType.PERFORMANCE] PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_not_include[RecommendationType.SECURITY] PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_not_include[RecommendationType.LATEST] PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_not_include[RecommendationType.TESTING] PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_verify_multiple_should_include PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_remove_pre_releases_disallowed_noop PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_pre_releases_disallowed_removal PASSED
tests/sieves/test_solved.py::mypy PASSED
tests/sieves/test_solved.py::TestSolvedSieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/test_solved.py::TestSolvedSieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/test_solved.py::TestSolvedSieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/test_solved.py::TestSolvedSieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/test_solved.py::TestSolvedSieve::test_verify_multiple_should_include PASSED
tests/sieves/test_solved.py::TestSolvedSieve::test_not_found PASSED
tests/sieves/test_solved.py::TestSolvedSieve::test_not_solved_without_error PASSED
tests/sieves/test_solved.py::TestSolvedSieve::test_acceptable_with_error PASSED
tests/sieves/test_solved.py::TestSolvedSieve::test_default_configuration PASSED
tests/sieves/test_version_constraint.py::mypy PASSED
tests/sieves/test_version_constraint.py::TestVersionConstrainSieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/test_version_constraint.py::TestVersionConstrainSieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/test_version_constraint.py::TestVersionConstrainSieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/test_version_constraint.py::TestVersionConstrainSieve::test_verify_multiple_should_include SKIPPED
tests/sieves/test_version_constraint.py::TestVersionConstrainSieve::test_configuration_error PASSED
tests/sieves/test_version_constraint.py::TestVersionConstrainSieve::test_default_configuration PASSED
tests/sieves/test_version_constraint.py::TestVersionConstrainSieve::test_run_filter PASSED
tests/sieves/test_version_constraint.py::TestVersionConstrainSieve::test_run_no_filter PASSED
tests/sieves/test_version_constraint.py::TestVersionConstrainSieve::test_super_pre_run PASSED
tests/sieves/backports/__init__.py::mypy PASSED
tests/sieves/backports/test_enum34.py::mypy PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_default_configuration <- tests/base.py PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_verify_multiple_should_include PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_should_include[3.4-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_should_include[3.5-None-DecisionType.RANDOM-True] PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_should_include[3.6-RecommendationType.STABLE-None-False] PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_should_include[3.7-RecommendationType.TESTING-None-True] PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_should_include[3.8-None-DecisionType.ALL-False] PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_no_include[3.0-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_no_include[None-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_no_include[3.1-None-DecisionType.RANDOM-True] PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_no_include[3.2-RecommendationType.STABLE-None-False] PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_no_include[3.3-RecommendationType.TESTING-None-True] PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_no_include[3.2-None-DecisionType.ALL-False] PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_remove PASSED
tests/sieves/backports/test_functools32.py::mypy PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_default_configuration <- tests/base.py PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_verify_multiple_should_include PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_should_include[3.7-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_should_include[3.8-None-DecisionType.RANDOM-True] PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_should_include[3.9-RecommendationType.STABLE-None-False] PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_should_include[3.5-RecommendationType.TESTING-None-True] PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_should_include[3.2-None-DecisionType.ALL-False] PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_no_include[2.7-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_no_include[None-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_no_include[3.1-None-DecisionType.RANDOM-True] PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_no_include[3.0-RecommendationType.STABLE-None-False] PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_no_include[2.6-RecommendationType.TESTING-None-True] PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_no_include[3.1-None-DecisionType.ALL-False] PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_remove PASSED
tests/sieves/backports/test_importlib_metadata.py::mypy PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_default_configuration <- tests/base.py PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_verify_multiple_should_include PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_should_include[3.8-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_should_include[3.8-None-DecisionType.RANDOM-True] PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_should_include[3.9-RecommendationType.STABLE-None-False] PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_should_include[3.9-RecommendationType.TESTING-None-True] PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_no_include[3.4-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_no_include[None-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_no_include[3.5-None-DecisionType.RANDOM-True] PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_no_include[3.3-RecommendationType.STABLE-None-False] PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_no_include[3.6-RecommendationType.TESTING-None-True] PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_no_include[3.7-None-DecisionType.ALL-False] PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_remove PASSED
tests/sieves/backports/test_importlib_resources.py::mypy PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_default_configuration <- tests/base.py PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_verify_multiple_should_include PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_should_include[3.8-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_should_include[3.8-None-DecisionType.RANDOM-True] PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_should_include[3.9-RecommendationType.STABLE-None-False] PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_should_include[3.9-RecommendationType.TESTING-None-True] PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_no_include[3.4-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_no_include[None-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_no_include[3.5-None-DecisionType.RANDOM-True] PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_no_include[3.3-RecommendationType.STABLE-None-False] PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_no_include[3.6-RecommendationType.TESTING-None-True] PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_no_include[3.7-None-DecisionType.ALL-False] PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_remove PASSED
tests/sieves/backports/test_mock.py::mypy PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_default_configuration <- tests/base.py PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_verify_multiple_should_include PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_should_include[3.8-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_should_include[3.8-None-DecisionType.RANDOM-True] PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_should_include[3.9-RecommendationType.STABLE-None-False] PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_should_include[3.9-RecommendationType.TESTING-None-True] PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_no_include[3.0-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_no_include[None-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_no_include[3.1-None-DecisionType.RANDOM-True] PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_no_include[3.2-RecommendationType.STABLE-None-False] PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_no_include[3.2-RecommendationType.TESTING-None-True] PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_no_include[2.7-None-DecisionType.ALL-False] PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_remove PASSED
tests/sieves/pandas/__init__.py::mypy PASSED
tests/sieves/pandas/test_py36_drop.py::mypy PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_default_configuration <- tests/base.py PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_verify_multiple_should_include PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_include[RecommendationType.STABLE] PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_include[RecommendationType.PERFORMANCE] PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_include[RecommendationType.SECURITY] PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_no_include[RecommendationType.TESTING-None-3.6] PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_no_include[RecommendationType.LATEST-None-3.6] PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_no_include[None-DecisionType.RANDOM-3.6] PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_no_include[RecommendationType.STABLE-None-3.9] PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_no_include[RecommendationType.PERFORMANCE-None-3.8] PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_run[1.2.0] PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_run[2.0.0] PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_no_filter PASSED
tests/sieves/setuptools/__init__.py::mypy PASSED
tests/sieves/setuptools/test_py36.py::mypy PASSED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_default_configuration <- tests/base.py PASSED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_verify_multiple_should_include PASSED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_include[RecommendationType.STABLE-None] PASSED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_include[RecommendationType.TESTING-None] PASSED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_include[None-DecisionType.RANDOM] PASSED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_include[None-DecisionType.ALL] PASSED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_no_include[RecommendationType.STABLE-None-3.8] PASSED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_no_include[RecommendationType.TESTING-None-3.9] PASSED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_no_include[None-DecisionType.RANDOM-3.5] PASSED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_filter PASSED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_no_filter PASSED
tests/sieves/tensorflow/__init__.py::mypy PASSED
tests/sieves/tensorflow/test_tf_cuda.py::mypy PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_default_configuration <- tests/base.py PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_verify_multiple_should_include PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_recommendation_types_considered PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_include[RecommendationType.STABLE-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_include[RecommendationType.STABLE-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_include[RecommendationType.STABLE-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_include[RecommendationType.STABLE-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_include[RecommendationType.PERFORMANCE-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_include[RecommendationType.PERFORMANCE-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_include[RecommendationType.PERFORMANCE-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_include[RecommendationType.PERFORMANCE-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_include[RecommendationType.SECURITY-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_include[RecommendationType.SECURITY-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_include[RecommendationType.SECURITY-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_include[RecommendationType.SECURITY-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_no_include[RecommendationType.LATEST-None-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_no_include[RecommendationType.TESTING-None-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_no_include[None-DecisionType.RANDOM-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_no_include[RecommendationType.STABLE-None-UNKNOWN_CUDA_VERSION] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_no_include[RecommendationType.STABLE-None-None] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_pre_run[8-_TF_1_CUDA_8_SUPPORT-_EMPTY] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_pre_run[9-_TF_1_CUDA_9_SUPPORT-_EMPTY] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_pre_run[10.0-_TF_1_CUDA_10_0_SUPPORT-_TF_2_CUDA_10_0_SUPPORT] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_pre_run[10.1-_EMPTY-_TF_2_CUDA_10_1_SUPPORT] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_pre_run[UNKNOWN_CUDA_VERSION-_EMPTY-_EMPTY] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_unknown_tensorflow[tensorflow] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_unknown_tensorflow[tensorflow-gpu] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow-2.3.0-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow-gpu-2.3.0-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow-2.2.0-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow-gpu-2.2.0-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow-2.1.0-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow-gpu-2.1.0-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow-2.0.0-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow-gpu-2.0.0-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.15.0-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.14.0-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.13.1-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.12.0-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.11.0-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.10.0-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.9.0-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.8.0-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.7.0-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.6.0-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.5.0-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.4.0-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.3.0-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.2.0-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.1.0-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.0.0-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv0-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv1-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv2-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv3-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv4-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv5-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv6-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv7-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv8-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv9-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv10-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv11-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv12-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv13-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv14-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv15-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv16-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv17-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv18-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv19-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv20-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv21-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv22-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv23-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv24-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv25-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv26-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv27-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv28-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv29-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv30-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv31-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv32-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv33-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv34-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv35-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv36-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv37-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv38-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv39-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv40-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv41-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv42-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv43-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv44-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv45-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv46-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv47-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv48-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv49-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv50-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv51-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv52-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv53-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv54-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv55-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv56-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv57-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv58-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv59-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv60-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv61-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv62-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv63-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_sieve_multiple PASSED
tests/sieves/tensorflow/test_tf_py39.py::mypy PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_default_configuration <- tests/base.py PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_verify_multiple_should_include PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_recommendation_types_considered PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_include[RecommendationType.STABLE-3.9] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_include[RecommendationType.PERFORMANCE-3.9] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_include[RecommendationType.SECURITY-3.9] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_no_include[RecommendationType.LATEST-None-3.9] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_no_include[RecommendationType.TESTING-None-3.9] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_no_include[None-DecisionType.RANDOM-3.9] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_no_include[RecommendationType.STABLE-None-3.6] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_no_include[RecommendationType.STABLE-None-None] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_yield[intel-tensorflow-2.5.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_yield[tensorflow-2.5.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_yield[tensorflow-gpu-2.5.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_no_yield[intel-tensorflow-2.4.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_no_yield[tensorflow-2.4.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_no_yield[tensorflow-gpu-2.4.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_no_yield[intel-tensorflow-2.3.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_no_yield[tensorflow-2.3.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_no_yield[tensorflow-gpu-2.3.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_no_yield[intel-tensorflow-2.2.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_no_yield[tensorflow-2.2.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_no_yield[tensorflow-gpu-2.2.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_no_yield[intel-tensorflow-1.12.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_no_yield[tensorflow-1.12.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_no_yield[tensorflow-gpu-1.12.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_sieve_multiple PASSED
tests/steps/__init__.py::mypy PASSED
tests/steps/test_aicoe.py::mypy PASSED
tests/steps/test_aicoe.py::TestAICoEReleasesStep::test_provided_unit_tested <- tests/base.py PASSED
tests/steps/test_aicoe.py::TestAICoEReleasesStep::test_provided_package_version <- tests/base.py PASSED
tests/steps/test_aicoe.py::TestAICoEReleasesStep::test_default_configuration <- tests/base.py PASSED
tests/steps/test_aicoe.py::TestAICoEReleasesStep::test_super_pre_run <- tests/base.py PASSED
tests/steps/test_aicoe.py::TestAICoEReleasesStep::test_default_multi_package_resolution <- tests/base.py PASSED
tests/steps/test_aicoe.py::TestAICoEReleasesStep::test_verify_multiple_should_include PASSED
tests/steps/test_aicoe.py::TestAICoEReleasesStep::test_aicoe_release PASSED
tests/steps/test_aicoe.py::TestAICoEReleasesStep::test_no_aicoe_release PASSED
tests/steps/test_cve.py::mypy PASSED
tests/steps/test_cve.py::TestCvePenalizationStep::test_provided_unit_tested <- tests/base.py PASSED
tests/steps/test_cve.py::TestCvePenalizationStep::test_provided_package_version <- tests/base.py PASSED
tests/steps/test_cve.py::TestCvePenalizationStep::test_default_configuration <- tests/base.py PASSED
tests/steps/test_cve.py::TestCvePenalizationStep::test_super_pre_run <- tests/base.py PASSED
tests/steps/test_cve.py::TestCvePenalizationStep::test_default_multi_package_resolution <- tests/base.py PASSED
tests/steps/test_cve.py::TestCvePenalizationStep::test_verify_multiple_should_include PASSED
tests/steps/test_cve.py::TestCvePenalizationStep::test_cve_penalization PASSED
tests/steps/test_cve.py::TestCvePenalizationStep::test_no_cve_record PASSED
tests/steps/test_cve.py::TestCvePenalizationStep::test_cve_not_acceptable PASSED
tests/steps/test_dropout.py::mypy PASSED
tests/steps/test_dropout.py::TestDropoutStep::test_provided_unit_tested <- tests/base.py PASSED
tests/steps/test_dropout.py::TestDropoutStep::test_provided_package_version <- tests/base.py PASSED
tests/steps/test_dropout.py::TestDropoutStep::test_super_pre_run <- tests/base.py PASSED
tests/steps/test_dropout.py::TestDropoutStep::test_default_multi_package_resolution <- tests/base.py PASSED
tests/steps/test_dropout.py::TestDropoutStep::test_verify_multiple_should_include SKIPPED
tests/steps/test_dropout.py::TestDropoutStep::test_run_accept PASSED
tests/steps/test_dropout.py::TestDropoutStep::test_run_no_accept PASSED
tests/steps/test_dropout.py::TestDropoutStep::test_default_configuration PASSED
tests/steps/test_security_indicators.py::mypy PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_provided_unit_tested <- tests/base.py PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_provided_package_version <- tests/base.py PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_default_configuration <- tests/base.py PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_super_pre_run <- tests/base.py PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_default_multi_package_resolution <- tests/base.py PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_verify_multiple_should_include PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_include[RecommendationType.STABLE] PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_include[RecommendationType.SECURITY] PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_no_include[RecommendationType.LATEST] PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_no_include[RecommendationType.PERFORMANCE] PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_no_include[RecommendationType.TESTING] PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_security_indicator_scoring PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_security_indicator_scoring_missing_secure[RecommendationType.SECURITY] PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_security_indicator_scoring_missing_stable[RecommendationType.STABLE] PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_security_indicator_with_high_confidence PASSED
tests/steps/tensorflow/__init__.py::mypy PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::mypy PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_provided_unit_tested <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_provided_package_version <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_default_configuration <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_super_pre_run <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_default_multi_package_resolution <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_verify_multiple_should_include PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_include[RecommendationType.STABLE0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_include[RecommendationType.TESTING] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_include[RecommendationType.PERFORMANCE] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_include[RecommendationType.STABLE1] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_no_include[RecommendationType.LATEST-None] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_no_include[None-DecisionType.RANDOM] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_not_acceptable[tensorflow-1.13.3] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_not_acceptable[tensorflow-1.14.0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_not_acceptable[tensorflow-1.15.0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_not_acceptable[tensorflow-1.15.5] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_not_acceptable[tensorflow-cpu-1.13.3] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_not_acceptable[tensorflow-cpu-1.14.0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_not_acceptable[tensorflow-cpu-1.15.0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_not_acceptable[tensorflow-cpu-1.15.5] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_not_acceptable[tensorflow-gpu-1.13.3] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_not_acceptable[tensorflow-gpu-1.14.0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_not_acceptable[tensorflow-gpu-1.15.0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_not_acceptable[tensorflow-gpu-1.15.5] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_noop[tensorflow-1.16.0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_noop[tensorflow-1.17.0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_noop[tensorflow-1.19.0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_noop[tensorflow-cpu-1.16.0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_noop[tensorflow-cpu-1.17.0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_noop[tensorflow-cpu-1.19.0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_noop[tensorflow-gpu-1.16.0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_noop[tensorflow-gpu-1.17.0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_noop[tensorflow-gpu-1.19.0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::mypy PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_provided_unit_tested <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_provided_package_version <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_default_configuration <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_super_pre_run <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_default_multi_package_resolution <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_verify_multiple_should_include PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_include[RecommendationType.STABLE0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_include[RecommendationType.TESTING] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_include[RecommendationType.PERFORMANCE] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_include[RecommendationType.STABLE1] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_no_include[RecommendationType.LATEST-None] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_no_include[None-DecisionType.RANDOM] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-1.13.3-0.3.0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-1.13.3-0.3.1] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-1.13.3-0.2.3] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-1.14.0-0.3.0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-1.14.0-0.3.1] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-1.14.0-0.2.3] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-1.14.1-0.3.0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-1.14.1-0.3.1] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-1.14.1-0.2.3] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-1.5.1-0.3.0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-1.5.1-0.3.1] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-1.5.1-0.2.3] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-cpu-1.13.3-0.3.0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-cpu-1.13.3-0.3.1] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-cpu-1.13.3-0.2.3] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-cpu-1.14.0-0.3.0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-cpu-1.14.0-0.3.1] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-cpu-1.14.0-0.2.3] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-cpu-1.14.1-0.3.0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-cpu-1.14.1-0.3.1] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-cpu-1.14.1-0.2.3] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-cpu-1.5.1-0.3.0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-cpu-1.5.1-0.3.1] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-cpu-1.5.1-0.2.3] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-gpu-1.13.3-0.3.0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-gpu-1.13.3-0.3.1] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-gpu-1.13.3-0.2.3] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-gpu-1.14.0-0.3.0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-gpu-1.14.0-0.3.1] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-gpu-1.14.0-0.2.3] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-gpu-1.14.1-0.3.0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-gpu-1.14.1-0.3.1] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-gpu-1.14.1-0.2.3] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-gpu-1.5.1-0.3.0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-gpu-1.5.1-0.3.1] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-gpu-1.5.1-0.2.3] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_noop[tensorflow-1.13.0-0.2.2] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_noop[tensorflow-cpu-2.0.0-0.3.0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_noop[tensorflow-gpu-1.14.0-0.2.0] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::mypy PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_provided_unit_tested <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_provided_package_version <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_default_configuration <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_super_pre_run <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_default_multi_package_resolution <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_verify_multiple_should_include PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_tf_21[2.1.0-3.0.0] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_tf_21[2.1.0-3.0.1] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_tf_21[2.1.0-4.0.0] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_tf_21[2.1.0-3.2.0] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_tf_21[2.1.1-3.0.0] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_tf_21[2.1.1-3.0.1] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_tf_21[2.1.1-4.0.0] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_tf_21[2.1.1-3.2.0] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_tf_21[2.1.2-3.0.0] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_tf_21[2.1.2-3.0.1] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_tf_21[2.1.2-4.0.0] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_tf_21[2.1.2-3.2.0] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_no_tf_21[2.9-2.1.0] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_no_tf_21[3.0-2.3] PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::mypy PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::TestTensorFlow21Urllib32Step::test_provided_unit_tested <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::TestTensorFlow21Urllib32Step::test_provided_package_version <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::TestTensorFlow21Urllib32Step::test_default_configuration <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::TestTensorFlow21Urllib32Step::test_super_pre_run <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::TestTensorFlow21Urllib32Step::test_default_multi_package_resolution <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::TestTensorFlow21Urllib32Step::test_verify_multiple_should_include PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::TestTensorFlow21Urllib32Step::test_tf_21[1.2-2.1] PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::TestTensorFlow21Urllib32Step::test_tf_21[1.2.1-2.1.1] PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::TestTensorFlow21Urllib32Step::test_tf_21[1.2.2-2.1.0] PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::TestTensorFlow21Urllib32Step::test_tf_21[1.3-2.1] PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::TestTensorFlow21Urllib32Step::test_tf_21[1.4-2.1] PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::TestTensorFlow21Urllib32Step::test_tf_21[1.5-2.1.dev] PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::TestTensorFlow21Urllib32Step::test_no_tf_21[1.2-2.2.0] PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::TestTensorFlow21Urllib32Step::test_no_tf_21[1.25.10-2.1] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::mypy PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_provided_unit_tested <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_provided_package_version <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_default_configuration <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_super_pre_run <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_default_multi_package_resolution <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_verify_multiple_should_include PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_include[RecommendationType.STABLE0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_include[RecommendationType.TESTING] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_include[RecommendationType.PERFORMANCE] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_include[RecommendationType.STABLE1] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_no_include[RecommendationType.LATEST-None] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_no_include[None-DecisionType.RANDOM] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-2.0.0-1.19.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-2.0.0-1.20.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-2.1.0-1.19.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-2.1.0-1.20.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-2.2.0-1.19.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-2.2.0-1.20.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-cpu-2.0.0-1.19.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-cpu-2.0.0-1.20.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-cpu-2.1.0-1.19.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-cpu-2.1.0-1.20.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-cpu-2.2.0-1.19.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-cpu-2.2.0-1.20.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-gpu-2.0.0-1.19.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-gpu-2.0.0-1.20.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-gpu-2.1.0-1.19.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-gpu-2.1.0-1.20.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-gpu-2.2.0-1.19.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-gpu-2.2.0-1.20.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[intel-tensorflow-2.0.0-1.19.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[intel-tensorflow-2.0.0-1.20.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[intel-tensorflow-2.1.0-1.19.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[intel-tensorflow-2.1.0-1.20.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[intel-tensorflow-2.2.0-1.19.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[intel-tensorflow-2.2.0-1.20.0] PASSED
tests/steps/tensorflow/test_tf_22_prob.py::mypy PASSED
tests/steps/tensorflow/test_tf_22_prob.py::TestTensorFlow22ProbabilityStep::test_provided_unit_tested <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_22_prob.py::TestTensorFlow22ProbabilityStep::test_provided_package_version <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_22_prob.py::TestTensorFlow22ProbabilityStep::test_default_configuration <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_22_prob.py::TestTensorFlow22ProbabilityStep::test_super_pre_run <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_22_prob.py::TestTensorFlow22ProbabilityStep::test_default_multi_package_resolution <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_22_prob.py::TestTensorFlow22ProbabilityStep::test_verify_multiple_should_include PASSED
tests/steps/tensorflow/test_tf_22_prob.py::TestTensorFlow22ProbabilityStep::test_include[RecommendationType.STABLE] PASSED
tests/steps/tensorflow/test_tf_22_prob.py::TestTensorFlow22ProbabilityStep::test_include[RecommendationType.TESTING] PASSED
tests/steps/tensorflow/test_tf_22_prob.py::TestTensorFlow22ProbabilityStep::test_no_include[RecommendationType.LATEST-None] PASSED
tests/steps/tensorflow/test_tf_22_prob.py::TestTensorFlow22ProbabilityStep::test_no_include[None-DecisionType.RANDOM] PASSED
tests/steps/tensorflow/test_tf_22_prob.py::TestTensorFlow22ProbabilityStep::test_run[tensorflow] PASSED
tests/steps/tensorflow/test_tf_22_prob.py::TestTensorFlow22ProbabilityStep::test_run[tensorflow-cpu] PASSED
tests/steps/tensorflow/test_tf_22_prob.py::TestTensorFlow22ProbabilityStep::test_run[tensorflow-gpu] PASSED
tests/steps/tensorflow/test_tf_22_prob.py::TestTensorFlow22ProbabilityStep::test_run_acceptable_tf PASSED
tests/steps/tensorflow/test_tf_avx2.py::mypy PASSED
tests/steps/tensorflow/test_tf_avx2.py::TestTensorFlowAVX2Step::test_provided_unit_tested <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_avx2.py::TestTensorFlowAVX2Step::test_provided_package_version <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_avx2.py::TestTensorFlowAVX2Step::test_default_configuration <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_avx2.py::TestTensorFlowAVX2Step::test_super_pre_run <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_avx2.py::TestTensorFlowAVX2Step::test_default_multi_package_resolution <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_avx2.py::TestTensorFlowAVX2Step::test_verify_multiple_should_include PASSED
tests/steps/tensorflow/test_tf_avx2.py::TestTensorFlowAVX2Step::test_include[RecommendationType.STABLE] PASSED
tests/steps/tensorflow/test_tf_avx2.py::TestTensorFlowAVX2Step::test_include[RecommendationType.TESTING] PASSED
tests/steps/tensorflow/test_tf_avx2.py::TestTensorFlowAVX2Step::test_no_include[RecommendationType.STABLE-None-None-None] PASSED
tests/steps/tensorflow/test_tf_avx2.py::TestTensorFlowAVX2Step::test_no_include[RecommendationType.TESTING-None--1--1] PASSED
tests/steps/tensorflow/test_tf_avx2.py::TestTensorFlowAVX2Step::test_no_include[None-DecisionType.RANDOM-6-15] PASSED
tests/steps/tensorflow/test_tf_avx2.py::TestTensorFlowAVX2Step::test_tf_avx2 PASSED
tests/steps/tensorflow/test_tf_avx2.py::TestTensorFlowAVX2Step::test_no_tf_avx2 PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::mypy PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_provided_unit_tested <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_provided_package_version <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_default_configuration <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_super_pre_run <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_default_multi_package_resolution <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_verify_multiple_should_include PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_include[RecommendationType.STABLE] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_include[RecommendationType.PERFORMANCE] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_include[RecommendationType.SECURITY] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_no_include[RecommendationType.LATEST-None-False] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_no_include[RecommendationType.TESTING-None-False] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_no_include[RecommendationType.STABLE-None-True] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_no_include[None-DecisionType.RANDOM-False] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[tensorflow-2.1.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[tensorflow-2.1.1] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[tensorflow-2.2.0rc0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[tensorflow-2.2.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[tensorflow-cpu-2.1.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[tensorflow-cpu-2.1.1] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[tensorflow-cpu-2.2.0rc0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[tensorflow-cpu-2.2.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[tensorflow-gpu-2.1.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[tensorflow-gpu-2.1.1] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[tensorflow-gpu-2.2.0rc0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[tensorflow-gpu-2.2.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[intel-tensorflow-2.1.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[intel-tensorflow-2.1.1] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[intel-tensorflow-2.2.0rc0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[intel-tensorflow-2.2.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[tensorflow-2.0.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[tensorflow-1.9.1] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[tensorflow-1.15.3] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[tensorflow-2.3.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[tensorflow-cpu-2.0.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[tensorflow-cpu-1.9.1] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[tensorflow-cpu-1.15.3] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[tensorflow-cpu-2.3.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[tensorflow-gpu-2.0.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[tensorflow-gpu-1.9.1] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[tensorflow-gpu-1.15.3] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[tensorflow-gpu-2.3.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[intel-tensorflow-2.0.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[intel-tensorflow-1.9.1] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[intel-tensorflow-1.15.3] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[intel-tensorflow-2.3.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_deps PASSED
tests/strides/__init__.py::mypy PASSED
tests/strides/test_one_version.py::mypy PASSED
tests/strides/test_one_version.py::TestOneVersionStride::test_provided_unit_tested <- tests/base.py PASSED
tests/strides/test_one_version.py::TestOneVersionStride::test_provided_package_version <- tests/base.py SKIPPED
tests/strides/test_one_version.py::TestOneVersionStride::test_super_pre_run <- tests/base.py SKIPPED
tests/strides/test_one_version.py::TestOneVersionStride::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/strides/test_one_version.py::TestOneVersionStride::test_verify_multiple_should_include SKIPPED
tests/strides/test_one_version.py::TestOneVersionStride::test_default_configuration PASSED
tests/strides/test_one_version.py::TestOneVersionStride::test_should_include PASSED
tests/strides/test_one_version.py::TestOneVersionStride::test_pre_run_error PASSED
tests/strides/test_one_version.py::TestOneVersionStride::test_configuration_default PASSED
tests/strides/test_one_version.py::TestOneVersionStride::test_run_only_once PASSED
tests/strides/test_one_version.py::TestOneVersionStride::test_run_no_only_once PASSED
tests/strides/test_random_decision.py::mypy PASSED
tests/strides/test_random_decision.py::TestRandomDecision::test_provided_unit_tested <- tests/base.py PASSED
tests/strides/test_random_decision.py::TestRandomDecision::test_provided_package_version <- tests/base.py SKIPPED
tests/strides/test_random_decision.py::TestRandomDecision::test_default_configuration <- tests/base.py PASSED
tests/strides/test_random_decision.py::TestRandomDecision::test_super_pre_run <- tests/base.py SKIPPED
tests/strides/test_random_decision.py::TestRandomDecision::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/strides/test_random_decision.py::TestRandomDecision::test_verify_multiple_should_include SKIPPED
tests/strides/test_random_decision.py::TestRandomDecision::test_accept PASSED
tests/strides/test_random_decision.py::TestRandomDecision::test_reject PASSED
tests/strides/test_unique_stack.py::mypy PASSED
tests/strides/test_unique_stack.py::TestUniqueStackStride::test_provided_unit_tested <- tests/base.py PASSED
tests/strides/test_unique_stack.py::TestUniqueStackStride::test_provided_package_version <- tests/base.py SKIPPED
tests/strides/test_unique_stack.py::TestUniqueStackStride::test_default_configuration <- tests/base.py PASSED
tests/strides/test_unique_stack.py::TestUniqueStackStride::test_super_pre_run <- tests/base.py SKIPPED
tests/strides/test_unique_stack.py::TestUniqueStackStride::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/strides/test_unique_stack.py::TestUniqueStackStride::test_verify_multiple_should_include SKIPPED
tests/strides/test_unique_stack.py::TestUniqueStackStride::test_should_include[STABLE-None] PASSED
tests/strides/test_unique_stack.py::TestUniqueStackStride::test_should_include[TESTING-None] PASSED
tests/strides/test_unique_stack.py::TestUniqueStackStride::test_should_include[LATEST-None] PASSED
tests/strides/test_unique_stack.py::TestUniqueStackStride::test_should_include[PERFORMANCE-None] PASSED
tests/strides/test_unique_stack.py::TestUniqueStackStride::test_should_include[SECURITY-None] PASSED
tests/strides/test_unique_stack.py::TestUniqueStackStride::test_should_include[None-ALL] PASSED
tests/strides/test_unique_stack.py::TestUniqueStackStride::test_should_include[None-RANDOM] PASSED
tests/strides/test_unique_stack.py::TestUniqueStackStride::test_run PASSED
tests/units/__init__.py::mypy PASSED
tests/units/boots.py::mypy PASSED
tests/units/pseudonyms.py::mypy PASSED
tests/units/sieves.py::mypy PASSED
tests/units/steps.py::mypy PASSED
tests/units/strides.py::mypy PASSED
tests/units/wraps.py::mypy PASSED
tests/wraps/__init__.py::mypy PASSED
tests/wraps/test_no_observation.py::mypy PASSED
tests/wraps/test_no_observation.py::TestNoObservationWrap::test_provided_unit_tested <- tests/base.py PASSED
tests/wraps/test_no_observation.py::TestNoObservationWrap::test_provided_package_version <- tests/base.py SKIPPED
tests/wraps/test_no_observation.py::TestNoObservationWrap::test_default_configuration <- tests/base.py PASSED
tests/wraps/test_no_observation.py::TestNoObservationWrap::test_super_pre_run <- tests/base.py SKIPPED
tests/wraps/test_no_observation.py::TestNoObservationWrap::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/wraps/test_no_observation.py::TestNoObservationWrap::test_verify_multiple_should_include PASSED
tests/wraps/test_no_observation.py::TestNoObservationWrap::test_run_justification_noop PASSED
tests/wraps/test_no_observation.py::TestNoObservationWrap::test_run_no_justification PASSED
tests/wraps/python/__init__.py::mypy PASSED
tests/wraps/python/test_no_semantic_interposition.py::mypy PASSED
tests/wraps/python/test_no_semantic_interposition.py::TestNoSemanticInterpositionWrap::test_provided_unit_tested <- tests/base.py PASSED
tests/wraps/python/test_no_semantic_interposition.py::TestNoSemanticInterpositionWrap::test_provided_package_version <- tests/base.py SKIPPED
tests/wraps/python/test_no_semantic_interposition.py::TestNoSemanticInterpositionWrap::test_default_configuration <- tests/base.py PASSED
tests/wraps/python/test_no_semantic_interposition.py::TestNoSemanticInterpositionWrap::test_super_pre_run <- tests/base.py SKIPPED
tests/wraps/python/test_no_semantic_interposition.py::TestNoSemanticInterpositionWrap::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/wraps/python/test_no_semantic_interposition.py::TestNoSemanticInterpositionWrap::test_verify_multiple_should_include PASSED
tests/wraps/python/test_no_semantic_interposition.py::TestNoSemanticInterpositionWrap::test_include[rhel-8.2-3.6] PASSED
tests/wraps/python/test_no_semantic_interposition.py::TestNoSemanticInterpositionWrap::test_include[ubi-8.2-3.7] PASSED
tests/wraps/python/test_no_semantic_interposition.py::TestNoSemanticInterpositionWrap::test_no_include[None-RecommendationType.LATEST-rhel-8.0-3.8] PASSED
tests/wraps/python/test_no_semantic_interposition.py::TestNoSemanticInterpositionWrap::test_no_include[None-RecommendationType.STABLE-ubi-8.0-3.8] PASSED
tests/wraps/python/test_no_semantic_interposition.py::TestNoSemanticInterpositionWrap::test_no_include[None-RecommendationType.LATEST-rhel-8.2-3.8] PASSED
tests/wraps/python/test_no_semantic_interposition.py::TestNoSemanticInterpositionWrap::test_no_include[None-RecommendationType.STABLE-fedora-32-3.8] PASSED
tests/wraps/python/test_no_semantic_interposition.py::TestNoSemanticInterpositionWrap::test_no_include[DecisionType.RANDOM-None-rhel-8.2-3.6] PASSED
tests/wraps/python/test_no_semantic_interposition.py::TestNoSemanticInterpositionWrap::test_run PASSED
tests/wraps/pytorch/__init__.py::mypy PASSED
tests/wraps/tensorflow/__init__.py::mypy PASSED
tests/wraps/tensorflow/test_intel.py::mypy PASSED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_provided_unit_tested <- tests/base.py PASSED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_provided_package_version <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_default_configuration <- tests/base.py PASSED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_super_pre_run <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_verify_multiple_should_include PASSED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_include[13-6-RecommendationType.STABLE] PASSED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_include[13-6-RecommendationType.TESTING] PASSED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_include[13-6-RecommendationType.LATEST] PASSED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_include[13-6-RecommendationType.PERFORMANCE] PASSED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_include[13-6-RecommendationType.SECURITY] PASSED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_no_include[None-RecommendationType.LATEST-666-6-linux-x86_64] PASSED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_no_include[None-RecommendationType.STABLE-13-666-linux-x86_64] PASSED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_no_include[None-RecommendationType.LATEST-13-6-win-amd64] PASSED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_no_include[DecisionType.RANDOM-None-13-6-linux-x86_64] PASSED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_run PASSED
tests/wraps/tensorflow/test_mkl_threads.py::mypy PASSED
tests/wraps/tensorflow/test_mkl_threads.py::TestMKLThreadsWrap::test_provided_unit_tested <- tests/base.py PASSED
tests/wraps/tensorflow/test_mkl_threads.py::TestMKLThreadsWrap::test_provided_package_version <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_mkl_threads.py::TestMKLThreadsWrap::test_default_configuration <- tests/base.py PASSED
tests/wraps/tensorflow/test_mkl_threads.py::TestMKLThreadsWrap::test_super_pre_run <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_mkl_threads.py::TestMKLThreadsWrap::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_mkl_threads.py::TestMKLThreadsWrap::test_verify_multiple_should_include PASSED
tests/wraps/tensorflow/test_mkl_threads.py::TestMKLThreadsWrap::test_run_justification_noop PASSED
tests/wraps/tensorflow/test_mkl_threads.py::TestMKLThreadsWrap::test_run_add_justification PASSED
tests/wraps/tensorflow/test_tf_23_accuracy.py::mypy PASSED
tests/wraps/tensorflow/test_tf_23_accuracy.py::TestTensorFlow23Accuracy::test_provided_unit_tested <- tests/base.py PASSED
tests/wraps/tensorflow/test_tf_23_accuracy.py::TestTensorFlow23Accuracy::test_provided_package_version <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_23_accuracy.py::TestTensorFlow23Accuracy::test_default_configuration <- tests/base.py PASSED
tests/wraps/tensorflow/test_tf_23_accuracy.py::TestTensorFlow23Accuracy::test_super_pre_run <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_23_accuracy.py::TestTensorFlow23Accuracy::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_23_accuracy.py::TestTensorFlow23Accuracy::test_verify_multiple_should_include PASSED
tests/wraps/tensorflow/test_tf_23_accuracy.py::TestTensorFlow23Accuracy::test_run_noop PASSED
tests/wraps/tensorflow/test_tf_23_accuracy.py::TestTensorFlow23Accuracy::test_run[2.3.0] PASSED
tests/wraps/tensorflow/test_tf_23_dict_bug.py::mypy PASSED
tests/wraps/tensorflow/test_tf_23_dict_bug.py::TestTensorFlow23DictSummary::test_provided_unit_tested <- tests/base.py PASSED
tests/wraps/tensorflow/test_tf_23_dict_bug.py::TestTensorFlow23DictSummary::test_provided_package_version <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_23_dict_bug.py::TestTensorFlow23DictSummary::test_default_configuration <- tests/base.py PASSED
tests/wraps/tensorflow/test_tf_23_dict_bug.py::TestTensorFlow23DictSummary::test_super_pre_run <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_23_dict_bug.py::TestTensorFlow23DictSummary::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_23_dict_bug.py::TestTensorFlow23DictSummary::test_verify_multiple_should_include PASSED
tests/wraps/tensorflow/test_tf_23_dict_bug.py::TestTensorFlow23DictSummary::test_run_noop PASSED
tests/wraps/tensorflow/test_tf_23_dict_bug.py::TestTensorFlow23DictSummary::test_run[2.3.0] PASSED
tests/wraps/tensorflow/test_tf_intel.py::mypy PASSED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_provided_unit_tested <- tests/base.py PASSED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_provided_package_version <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_default_configuration <- tests/base.py PASSED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_super_pre_run <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_verify_multiple_should_include PASSED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_include[13-6-RecommendationType.STABLE] PASSED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_include[13-6-RecommendationType.TESTING] PASSED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_include[13-6-RecommendationType.LATEST] PASSED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_include[13-6-RecommendationType.PERFORMANCE] PASSED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_include[13-6-RecommendationType.SECURITY] PASSED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_no_include[None-RecommendationType.LATEST-666-6-linux-x86_64] PASSED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_no_include[None-RecommendationType.STABLE-13-666-linux-x86_64] PASSED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_no_include[None-RecommendationType.LATEST-13-6-win-amd64] PASSED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_no_include[DecisionType.RANDOM-None-13-6-linux-x86_64] PASSED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_run PASSED
tests/wraps/tensorflow/test_tf_mkl_threads.py::mypy PASSED
tests/wraps/tensorflow/test_tf_mkl_threads.py::TestMKLThreadsWrap::test_provided_unit_tested <- tests/base.py PASSED
tests/wraps/tensorflow/test_tf_mkl_threads.py::TestMKLThreadsWrap::test_provided_package_version <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_mkl_threads.py::TestMKLThreadsWrap::test_default_configuration <- tests/base.py PASSED
tests/wraps/tensorflow/test_tf_mkl_threads.py::TestMKLThreadsWrap::test_super_pre_run <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_mkl_threads.py::TestMKLThreadsWrap::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_mkl_threads.py::TestMKLThreadsWrap::test_verify_multiple_should_include PASSED
tests/wraps/tensorflow/test_tf_mkl_threads.py::TestMKLThreadsWrap::test_run_justification_noop PASSED
tests/wraps/tensorflow/test_tf_mkl_threads.py::TestMKLThreadsWrap::test_run_add_justification PASSED
tests/wraps/tensorflow/test_tf_mkl_threads.py::TestMKLThreadsWrap::test_run_add_justification_intel_tf PASSED
::mypy <- . PASSED

=================================== FAILURES ===================================
_____________________________ TestBeam.test_remove _____________________________

self = <tests.test_beam.TestBeam object at 0x7f9f1f717358>

    def test_remove(self) -> None:
        """Test removal of a state from beam."""
        beam = Beam(width=2)
    
        state1 = State(score=0.0)
        beam.add_state(state1)
        beam.remove(state1)
    
        state2 = State(score=1.0)
        beam.add_state(state2)
        beam.remove(state2)
    
        state3 = State(score=2.0)
        beam.add_state(state3)
        beam.remove(state3)
    
        assert beam.size == 0
    
        beam.add_state(state1)
        beam.add_state(state2)
        beam.add_state(state3)
    
        assert state1 not in beam.iter_states()
        assert state2 in beam.iter_states()
        assert state3 in beam.iter_states()
    
        with pytest.raises(ValueError):
>           beam.remove(state1)
E           Failed: DID NOT RAISE <class 'ValueError'>

beam       = Beam(width=2, keep_history=False, _beam_history=[], _heap=<eheapq.ExtHeapQueue object at 0x7f9f2c5fcdc8>)
self       = <tests.test_beam.TestBeam object at 0x7f9f1f717358>
state1     = State(score=0.0, iteration=0, unresolved_dependencies={}, resolved_dependencies={}, _parent=None, advised_runtime_environment=None, advised_manifest_changes=[], justification=[])
state2     = State(score=1.0, iteration=0, unresolved_dependencies={}, resolved_dependencies={}, _parent=None, advised_runtime_environment=None, advised_manifest_changes=[], justification=[])
state3     = State(score=2.0, iteration=0, unresolved_dependencies={}, resolved_dependencies={}, _parent=None, advised_runtime_environment=None, advised_manifest_changes=[], justification=[])

tests/test_beam.py:251: Failed
------------------------------ Captured log call -------------------------------
ERROR    thoth.adviser.beam:beam.py:215 Encountered exception reported in https://github.com/thoth-station/adviser/issues/1541, ignoring...
Traceback (most recent call last):
  File "/workspace/repo/thoth/adviser/beam.py", line 212, in remove
    self._heap.remove(state)
ValueError: the given item was not found in the heap

----------- coverage: platform linux, python 3.6.8-final-0 -----------
Name                                                      Stmts   Miss  Cover
-----------------------------------------------------------------------------
thoth/adviser/__init__.py                                    26      0   100%
thoth/adviser/beam.py                                       113     37    67%
thoth/adviser/boot.py                                         8      0   100%
thoth/adviser/boots/__init__.py                               8      0   100%
thoth/adviser/boots/_debug/__init__.py                        3      3     0%
thoth/adviser/boots/_debug/memtrace.py                       49     49     0%
thoth/adviser/boots/fully_specified_environment.py           24      1    96%
thoth/adviser/boots/platform.py                              34      1    97%
thoth/adviser/boots/python_version.py                        36      2    94%
thoth/adviser/boots/rhel_version.py                          27      1    96%
thoth/adviser/boots/solved_software_environment.py           35      1    97%
thoth/adviser/boots/ubi.py                                   26      1    96%
thoth/adviser/cli.py                                        240    240     0%
thoth/adviser/context.py                                    108      0   100%
thoth/adviser/dependency_monkey.py                           89     11    88%
thoth/adviser/digests_fetcher.py                             23     23     0%
thoth/adviser/dm_report.py                                   16      0   100%
thoth/adviser/enums.py                                       24      4    83%
thoth/adviser/exceptions.py                                  45      3    93%
thoth/adviser/pipeline_builder.py                           276     10    96%
thoth/adviser/pipeline_config.py                             93      6    94%
thoth/adviser/predictor.py                                   49      7    86%
thoth/adviser/predictors/__init__.py                         10      0   100%
thoth/adviser/predictors/annealing.py                       100     47    53%
thoth/adviser/predictors/hill_climbing.py                    51     29    43%
thoth/adviser/predictors/latest.py                           73     25    66%
thoth/adviser/predictors/mcts.py                             44      5    89%
thoth/adviser/predictors/package_combinations.py             22      7    68%
thoth/adviser/predictors/random_walk.py                      58     32    45%
thoth/adviser/predictors/sampling.py                         51     29    43%
thoth/adviser/predictors/td.py                              103     18    83%
thoth/adviser/product.py                                     57      4    93%
thoth/adviser/pseudonym.py                                   14      0   100%
thoth/adviser/pseudonyms/__init__.py                          5      0   100%
thoth/adviser/pseudonyms/_debug/__init__.py                   3      0   100%
thoth/adviser/pseudonyms/_debug/alias.py                     32      1    97%
thoth/adviser/pseudonyms/intel_tensorflow.py                 47      2    96%
thoth/adviser/pseudonyms/tensorflow_gpu.py                   41      2    95%
thoth/adviser/report.py                                      44      1    98%
thoth/adviser/resolver.py                                   676     93    86%
thoth/adviser/run.py                                         90     90     0%
thoth/adviser/sieve.py                                       10      0   100%
thoth/adviser/sieves/__init__.py                             18      0   100%
thoth/adviser/sieves/abi_compat.py                           43      3    93%
thoth/adviser/sieves/backports/__init__.py                    7      0   100%
thoth/adviser/sieves/backports/enum34.py                     36      1    97%
thoth/adviser/sieves/backports/functools32.py                36      1    97%
thoth/adviser/sieves/backports/importlib_metadata.py         36      1    97%
thoth/adviser/sieves/backports/importlib_resources.py        36      1    97%
thoth/adviser/sieves/backports/mock.py                       36      1    97%
thoth/adviser/sieves/filter_index.py                         30      3    90%
thoth/adviser/sieves/index_enabled.py                        39      2    95%
thoth/adviser/sieves/locked.py                               33      2    94%
thoth/adviser/sieves/pandas/__init__.py                       3      0   100%
thoth/adviser/sieves/pandas/py36_drop.py                     41      1    98%
thoth/adviser/sieves/prereleases.py                          30      1    97%
thoth/adviser/sieves/setuptools/__init__.py                   3      0   100%
thoth/adviser/sieves/setuptools/py36.py                      37      1    97%
thoth/adviser/sieves/solved.py                               50      1    98%
thoth/adviser/sieves/tensorflow/__init__.py                   4      0   100%
thoth/adviser/sieves/tensorflow/tf_cuda.py                  112      2    98%
thoth/adviser/sieves/tensorflow/tf_py39.py                   51      2    96%
thoth/adviser/sieves/version_constraint.py                   35      3    91%
thoth/adviser/solver.py                                      74      1    99%
thoth/adviser/state.py                                      122     24    80%
thoth/adviser/step.py                                        22      0   100%
thoth/adviser/steps/__init__.py                              17      0   100%
thoth/adviser/steps/_debug/__init__.py                        5      0   100%
thoth/adviser/steps/_debug/generate_score.py                 53     21    60%
thoth/adviser/steps/_debug/mock_score.py                     48     17    65%
thoth/adviser/steps/_debug/set_score.py                      35      8    77%
thoth/adviser/steps/aicoe.py                                 35      3    91%
thoth/adviser/steps/cve.py                                   61      6    90%
thoth/adviser/steps/dropout.py                               28      2    93%
thoth/adviser/steps/security_indicators.py                   63      2    97%
thoth/adviser/steps/tensorflow/__init__.py                   10      0   100%
thoth/adviser/steps/tensorflow/tf_113_numpy.py               45      2    96%
thoth/adviser/steps/tensorflow/tf_114_gast.py                48      2    96%
thoth/adviser/steps/tensorflow/tf_21_h5py.py                 45      2    96%
thoth/adviser/steps/tensorflow/tf_21_urllib3.py              46      2    96%
thoth/adviser/steps/tensorflow/tf_22_numpy.py                48      4    92%
thoth/adviser/steps/tensorflow/tf_22_prob.py                 43      1    98%
thoth/adviser/steps/tensorflow/tf_avx2.py                    38      2    95%
thoth/adviser/steps/tensorflow/tf_rm_scipy.py                56      3    95%
thoth/adviser/stride.py                                       9      0   100%
thoth/adviser/strides/__init__.py                             5      0   100%
thoth/adviser/strides/one_version.py                         37      2    95%
thoth/adviser/strides/random_decision.py                     22      2    91%
thoth/adviser/strides/unique_stack.py                        29      2    93%
thoth/adviser/unit.py                                       103     14    86%
thoth/adviser/utils.py                                       16      2    88%
thoth/adviser/wrap.py                                         9      0   100%
thoth/adviser/wraps/__init__.py                               8      0   100%
thoth/adviser/wraps/no_onservation.py                        18      1    94%
thoth/adviser/wraps/python/__init__.py                        3      0   100%
thoth/adviser/wraps/python/no_semantic_interposition.py      23      1    96%
thoth/adviser/wraps/pytorch/__init__.py                       3      3     0%
thoth/adviser/wraps/tensorflow/__init__.py                    6      0   100%
thoth/adviser/wraps/tensorflow/tf_23_accuracy.py             35      4    89%
thoth/adviser/wraps/tensorflow/tf_23_dict_bug.py             35      4    89%
thoth/adviser/wraps/tensorflow/tf_intel.py                   28      1    96%
thoth/adviser/wraps/tensorflow/tf_mkl_threads.py             32      2    94%
-----------------------------------------------------------------------------
TOTAL                                                      4962    951    81%

===================================== mypy =====================================
Success: no issues found in 99 source files
============================ Hypothesis Statistics =============================
tests/test_beam.py::TestBeam::test_initialization_positive:

  - during generate phase (0.16 seconds):
    - Typical runtimes: 0-1 ms, ~ 41% in data generation
    - 100 passing examples, 0 failing examples, 0 invalid examples

  - Stopped because settings.max_examples=100


tests/test_beam.py::TestBeam::test_initialization_not_positive_error:

  - during generate phase (0.15 seconds):
    - Typical runtimes: 0-1 ms, ~ 39% in data generation
    - 100 passing examples, 0 failing examples, 0 invalid examples

  - Stopped because settings.max_examples=100


tests/predictors/test_annealing.py::TestAdaptiveSimulatedAnnealing::test_temperature_function:

  - during generate phase (0.31 seconds):
    - Typical runtimes: ~ 1ms, ~ 66% in data generation
    - 100 passing examples, 0 failing examples, 0 invalid examples

  - Stopped because settings.max_examples=100


tests/predictors/test_annealing.py::TestAdaptiveSimulatedAnnealing::test_acceptance_probability:

  - during generate phase (0.39 seconds):
    - Typical runtimes: 0-1 ms, ~ 67% in data generation
    - 100 passing examples, 0 failing examples, 37 invalid examples

  - Stopped because settings.max_examples=100


tests/predictors/test_annealing.py::TestAdaptiveSimulatedAnnealing::test_run:

  - during generate phase (0.60 seconds):
    - Typical runtimes: 1-11 ms, ~ 18% in data generation
    - 100 passing examples, 0 failing examples, 0 invalid examples

  - Stopped because settings.max_examples=100


tests/predictors/test_hill_climbing.py::TestHillClimbing::test_run:

  - during generate phase (0.87 seconds):
    - Typical runtimes: 1-11 ms, ~ 5% in data generation
    - 100 passing examples, 0 failing examples, 0 invalid examples

  - Stopped because settings.max_examples=100


tests/predictors/test_latest.py::TestApproximatingLatest::test_run:

  - during generate phase (0.75 seconds):
    - Typical runtimes: 1-11 ms, ~ 6% in data generation
    - 100 passing examples, 0 failing examples, 0 invalid examples

  - Stopped because settings.max_examples=100


tests/predictors/test_random_walk.py::TestRandomWalk::test_run:

  - during generate phase (0.77 seconds):
    - Typical runtimes: 1-11 ms, ~ 6% in data generation
    - 100 passing examples, 0 failing examples, 0 invalid examples

  - Stopped because settings.max_examples=100


tests/predictors/test_sampling.py::TestSampling::test_run:

  - during generate phase (0.82 seconds):
    - Typical runtimes: 1-11 ms, ~ 5% in data generation
    - 100 passing examples, 0 failing examples, 0 invalid examples

  - Stopped because settings.max_examples=100


tests/predictors/test_td.py::TestTemporalDifference::test_acceptance_probability:

  - during generate phase (0.42 seconds):
    - Typical runtimes: 0-1 ms, ~ 68% in data generation
    - 100 passing examples, 0 failing examples, 64 invalid examples

  - Stopped because settings.max_examples=100


tests/predictors/test_td.py::TestTemporalDifference::test_temperature_function:

  - during generate phase (0.32 seconds):
    - Typical runtimes: 1-2 ms, ~ 65% in data generation
    - 100 passing examples, 0 failing examples, 0 invalid examples

  - Stopped because settings.max_examples=100


=========================== short test summary info ============================
FAILED tests/test_beam.py::TestBeam::test_remove - Failed: DID NOT RAISE <cla...
================= 1 failed, 1096 passed, 79 skipped in 31.86s ==================

[todo]

uncomment once fixed #1541

adviser/tests/test_beam.py

Lines 250 to 255 in 275fc72

	# TODO: uncomment once fixed https://github.com/thoth-station/adviser/issues/1541
	# with pytest.raises(ValueError):
	# beam.remove(state1)
	assert beam.max() is state3

---

This comment was generated by todo based on a TODO comment in 275fc72 in #1548. cc @thoth-station.