Fuzzing platform smoke testing

[tyuldashev]

Initial set-up

Check that the IntelliJ Idea UTBot plugin can be successfully installed

• Download plugin (https://github.com/UnitTestBot/UTBotJava/actions/runs/3627568077)
• Reuse UTBot project (https://github.com/UnitTestBot/UTBotJava.git) and Fuzzing Platform (FP) Samples

IntelliJ IDEA 2022.2.3
JDK 11

Go through manual scenarios

Primitive type

• byte
• short
• int
• long
• float
• double
• boolean
• char

Manual scenario #2

• Collections
• Arrays
• User Objects initialization
• More complex scenarios with user objects

Manual scenario #3

• Test generation timeout applied
• Combination of Fuzzer and Symbolic analysis
• Finding parameters which causes exceptions and proper handling them

[tyuldashev]

Current problems with summaries on Intigers.java:

• Not every test have JavaDoc comment
  

• Tag @utbot.methodUnderTest sometimes has class under test as first parameter (but should not), so link is not resolved.
  

• @DisplayName could name parameters as arg_0 instead of real names.

• @DisplayName could have phrases like mutated from min instead of actual values
  

[tyuldashev]

Note about objects:
Now they could be init twice, first time through constructor and second time through direct field assignment. Here is the sample for tests on Arrays.Point#equals from Arrays file

        Point point = new Point(0, 1);
        point.x = 0;
        point.y = Integer.MIN_VALUE;
        Point point1 = new Point(-1, Integer.MAX_VALUE);
        point1.y = Integer.MIN_VALUE;
        point1.x = 0;

Previously only constructor was used, without later re-asignemnt:

        Point point = new Point(-1934310868, -1464141532);
        Point point1 = new Point(-1934310868, -1934310868);

[tyuldashev]

One more note about @DisplayName: there could be phrases like mutated from 3 while actual parameter value is still 3 (not mutated).

Here is one of the tests for Enums.java

    /**
     * @utbot.classUnderTest {@link Enums}
     * @utbot.methodUnderTest {@link Enums#test(int)}
     */
    @Test
    @DisplayName("test: x = mutated from 3 -> return 3")
    public void testTestReturns3() {
        Enums enums = new Enums();

        int actual = enums.test(3);

        assertEquals(3, actual);
    }