Testing of UI checklist 2.1 RC#165

[alisevych]

UI plugin checklist

Install plugin
Build under test - https://github.com/UnitTestBot/UTBotJava/actions/runs/3172776185

• Open IntelliJ IDE
• Uninstall previously installed UTBot plugin (if present)
• Install the downloaded plugin
• Clone or reuse UTBot project (https://github.com/UnitTestBot/UTBotJava.git)
• Open the project in the IDE

Make the following checks for IntelliJ, Maven, Gradle projects with different JDK 8/11

Open dialog

• Open the utbot-sample/src/main/java/org/utbot/examples/algorithms/ArraysQuickSort.java file
• From code. Open context menu, select Generate..., select Create tests with UTBot... => Dialog is opened
• Context menu item is disabled for non Java classes, for example resources, configuration files

Dialog. Members

• From Project view. Right-click on a package with several classes, select Create tests with UTBot... => Dialog is opened. All classes from package are listed and selected
• From Project view. Select several classes, right-click, select Create tests with UTBot... => Dialog is opened. Selected classes are listed and selected
• From Project view. Right-click on one class, select Create tests with UTBot... => Dialog is opened. All methods of the class are listed and selected (except private)
• Create a public class with 4 different methods: private, without access modifier, protected, public. Open UTBot test generation for the class => all methods except private are in list. - check for Kotlin/Java
• Make the class package-private (remove "public") => check the same

Dialog. Settings

Verify tests are generated with all these options

• Dialog. Test source root is defaulted (if test source root is set in project)
  reproducing UI. Default Test source root in Gradle project #786
• Dialog. Test source root (if no test sources root set in project) => suggests to create a new one (red) - create => verify created
• check in Gradle UTBot doesn't show test source from other modules for Gradle project #1060
• check in IntelliJ
• check in Maven (@alisevych )
• Dialog. Test framework => is defaulted to JUnit5
• Dialog. Test framework (for project with JDK 8) => JUnit4, JUnit5 only
• Dialog. Test framework (for project with JDK 11) => JUnit4, JUnit5, TestNG (not existing in project dependencies must have red text "(will be installed)")
• check in Gradle
• check in IntelliJ
• check in Maven (@alisevych)
• Dialog. Mock strategy => 1) Do not mock, 2) Mock package environment, 3) Mock class environment
• Dialog. Mock strategy "Do not mock" is selected => Mock static methods is unchecked and disabled
• Dialog. Mock strategy - select 2) and 3) options => Mock static options: 1) 'Mock static methods' checked, 2) 'Mock static methods' unchecked.
• Dialog. Mock strategy (for a project without Mockito in dependencies) => 2), 3) options have red text "(will be installed)"
• check in Maven (@alisevych)
• Dialog. Timeout for class => default to 60 sec, only natural numbers can be saved, up and down arrows work
  to correct field Settings revision, 2nd iteration #977
• Dialog. Timeout for class => minimize, check on ArrayQuickSort or some other code with conditions and loops
  bug Test generation timeout is exceeded 15 sec - 1 min for every run #1028
• Dialog. Parametrized test => 2 options: Not parametrized / Parametrized
• Dialog. Parametrized test - select "Parametrized" => "No mocks" and "No static mocking" are chosen and both disabled
• Dialog. Destination package. Check not present // change request:
  UI. IDEA plugin dialog. Hide UI possibility to change destination package #488

SARIF report

• Dialog. Uncheck "Parametrized tests" , generate tests => SARIF report is generated into resources folder - in correct package
• do this for a single class => check place, package, file
• do this for several classes in different packages
• Dialog. Check "Parametrized tests", generate tests => no SARIF report is generated
  Unnecessary error window appears when UTbot fails to generate test #980

File -> Settings... -> UTBot

• Force static mocking. Add a class...
• Code analysis. Select Simplest, Deepest, 1st mark from left, 1st mark from right, somewhere in the middle...
  No percent shown when 'Test generation method' is set to 'Symbolic executuion' #1064

[alisevych]

new bug #1059 - Maven / IntelliJ projects - Test sources root folder