Skip to content

Add timeout tests to SARIF report #1496

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Dec 9, 2022

Conversation

mmvpm
Copy link
Collaborator

@mmvpm mmvpm commented Dec 8, 2022

Description

Tests that fall by timeout are now supported in SARIF report. This is necessary to display them on the Problems tab:

image

To add a new exception to SARIF we need the stacktrace, but UtTimeoutException doesn't have a stack trace, so I'll have to construct it from UtExecution.coverage.

image

Fixes #1391

Type of Change

  • New feature (non-breaking change which adds functionality)

How Has This Been Tested?

Regression and integration tests

org.utbot.sarif.SarifReportTest

Automated Testing

org.utbot.sarif.SarifReportTest

Manual Scenario

  1. Run test generation on the method that executes too long
  2. Check that there is a result on the Problems view if the test with annotation @timeout

Checklist:

  • The change followed the style guidelines of the UTBot project
  • Self-review of the code is passed
  • The change contains enough commentaries, particularly in hard-to-understand areas
  • New documentation is provided or existed one is altered
  • No new warnings
  • New tests have been added
  • All tests pass locally with my changes

@Vassiliy-Kudryashov Vassiliy-Kudryashov merged commit 1042fb7 into main Dec 9, 2022
@Vassiliy-Kudryashov Vassiliy-Kudryashov deleted the ideaseeker/timeout_tests_in_sarif branch December 9, 2022 13:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Display failing on Timeout tests on the Problems tool window
2 participants