Skip to content

Non-flaky tests with asynchronous tasks #1610

Open
@Damtev

Description

@Damtev

Description

For now, tests for methods that create some tasks asynchronously, are potentially flaky - we do not know how much time is required to finish the task, so asserts in the tests could be executed before finishing the task and accordingly fail. Also, such tests could not be generated using concrete execution, for the same reasons.

We need to find a way to fix it somehow - perhaps just warn a user, or disable such tests by default with a reasoning message, or use some time limit.

Expected behavior

The most reasonable expected behavior should be investigated.

Environment

Check tests in org.utbot.examples.threads package.

Potential alternatives

Not investigated yet.

Context

No additional context.

Metadata

Metadata

Assignees

Labels

comp-codegenIssue is related to code generatorcomp-symbolic-engineIssue is related to the symbolic execution enginectg-enhancementNew feature, improvement or change request

Type

No type

Projects

Status

Todo

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions