✅ examples test from subfolder()[jvm]
✅ examples test()[jvm]

✅ test for splitByNonEscaped()[jvm]
✅ basic test()[jvm]
✅ should resolve placeholders()[jvm]
✅ should join multiline directives()[jvm]

✅ example for findAllFilesMatching()[jvm]
✅ create relative path in case of branchy file tree()[jvm]
✅ example for findDescendantDirectoriesBy()[jvm]
✅ create relative path when config and test resource located in the same directory()[jvm]

✅ simple check with redirection()[jvm]
✅ change multiple echo commands with redirections 2()[jvm]
✅ change multiple echo commands with redirections 3()[jvm]
✅ simple check with redirection without whitespaces at all()[jvm]
✅ check stdout()[jvm]
✅ one long echo()[jvm]
✅ check stdout with redirection()[jvm]
✅ change multiple echo commands with redirections()[jvm]
✅ extra whitespaces shouldn't influence to echo()[jvm]
✅ simple check with redirection without first whitespace()[jvm]
✅ simple check()[jvm]
✅ command without echo()[jvm]
✅ empty command()[jvm]

✅ check stderr with additional warning()[jvm]
✅ check stderr()[jvm]

✅ basic test[macosX64]
✅ should resolve placeholders[macosX64]
✅ should join multiline directives[macosX64]
✅ test for splitByNonEscaped[macosX64]

✅ example for findAllFilesMatching[macosX64]
✅ example for findDescendantDirectoriesBy[macosX64]
✅ create relative path when config and test resource located in the same directory[macosX64]
✅ create relative path in case of branchy file tree[macosX64]

✅ empty command[macosX64]
✅ check stdout[macosX64]
✅ check stdout with redirection[macosX64]
✅ command without echo[macosX64]
✅ simple check[macosX64]
✅ simple check with redirection[macosX64]
✅ simple check with redirection without first whitespace[macosX64]
✅ simple check with redirection without whitespaces at all[macosX64]
✅ one long echo[macosX64]
✅ change multiple echo commands with redirections[macosX64]
✅ change multiple echo commands with redirections 2[macosX64]
✅ change multiple echo commands with redirections 3[macosX64]
✅ extra whitespaces shouldn't influence to echo[macosX64]

✅ checking escaping of percents[macosX64]

✅ check stderr[macosX64]
✅ check stderr with additional warning[macosX64]

✅ config detector regression test on directories()[jvm]

✅ should fail on the invalid file()[jvm]
✅ should detect single file from a directory()[jvm]
✅ should detect multiple files starting from the middle()[jvm]
✅ should detect starting from bottom with multiple parent configs()[jvm]
✅ should detect starting from bottom()[jvm]
✅ should detect single file()[jvm]
✅ should detect config file from single Test file()[jvm]
✅ should detect multiple files starting from top()[jvm]

✅ execute fix plugin on separate files()[jvm]
✅ execute fix plugin in sarif mode()[jvm]
✅ executing fix plugin on save-toml file in directory()[jvm]
✅ executing fix plugin on parental save-toml file()[jvm]
✅ execute fix plugin on folder()[jvm]
✅ check NoIgnoreLines()[jvm]
✅ check IgnoreLines()[jvm]
✅ tests with the same name()[jvm]
✅ check IgnoreLinesIsEmpty()[jvm]

✅ execute warn-plugin with expected warnings from SARIF()[jvm]
✅ executing warn plugin so that no resources will be found()[jvm]
✅ lines that match ignoreLines should be ignored()[jvm]
✅ execute warn-plugin with actual and expected warnings from SARIF()[jvm]
⚪ execute warn plugin with default testFiles()[jvm]
✅ test output file set()[jvm]
⚪ executing warn plugin on parental directory()[jvm]
✅ tests should have a relative path()[jvm]
✅ execute warn plugin on separate files()[jvm]
✅ executing warn plugin on directory()[jvm]
⚪ execute warn plugin with timeout()[jvm]
✅ executing warn plugin on parental save-toml file()[jvm]
✅ executing warn plugin on directory when files are set with regex()[jvm]
⚪ execute warn plugin with included and excluded suites()[jvm]
✅ execute warn-plugin with actual warnings from SARIF()[jvm]
⚪ executing warn plugin on save-toml file in directory()[jvm]

✅ execute fix-and-warn plugin on the directory chapter1()[jvm]
✅ execute fix-and-warn plugin on the directory chapter2()[jvm]
✅ execute fix-and-warn plugin on the directory chapter3()[jvm]

✅ execute fix plugin()[jvm]
✅ execute fix plugin on the directory chapter1()[jvm]

⚪ execute warn plugin on root directory()[jvm]
⚪ execute warn plugin on the directory chapter1()[jvm]
⚪ execute warn plugin on the directory chapter2()[jvm]
⚪ execute warn plugin on the directory chapter3()[jvm]
⚪ execute warn plugin on the directory chapter4()[jvm]

✅ load save toml from middle hierarchy()[jvm]
✅ merge and override two incomplete configs 2()[jvm]
✅ merge and override general configs()[jvm]
✅ merge and override two configs with different fields()[jvm]
✅ merge configs with many parents()[jvm]
✅ override real toml configs()[jvm]
✅ merge real toml configs with empty execFlag in child()[jvm]
✅ merge and override two incomplete configs()[jvm]

✅ should execute single test()[jvm]
✅ detect plugins()[jvm]

✅ resolve value()[jvm]
✅ parse properties file()[jvm]
✅ read not existed properties file()[jvm]
✅ read properties file()[jvm]
✅ read invalid properties file()[jvm]
✅ parse properties file from not existed folder()[jvm]

✅ validate warn section()[jvm]
✅ invalid general section()[jvm]
✅ set defaults to warn section()[jvm]
✅ set defaults to general section()[jvm]
✅ set defaults to fix section()[jvm]
✅ validate warn section 2()[jvm]
✅ validate warn section 3()[jvm]
✅ validate warn section 4()[jvm]

✅ config detector regression test on directories[macosX64]

✅ should detect single file[macosX64]
✅ should fail on the invalid file[macosX64]
✅ should detect single file from a directory[macosX64]
✅ should detect starting from bottom[macosX64]
✅ should detect starting from bottom with multiple parent configs[macosX64]
✅ should detect multiple files starting from top[macosX64]
✅ should detect multiple files starting from the middle[macosX64]
✅ should detect config file from single Test file[macosX64]

✅ execute fix plugin on separate files[macosX64]
✅ executing fix plugin on save-toml file in directory[macosX64]
✅ executing fix plugin on parental save-toml file[macosX64]
✅ execute fix plugin on folder[macosX64]
✅ check NoIgnoreLines[macosX64]
✅ check IgnoreLinesIsEmpty[macosX64]
✅ check IgnoreLines[macosX64]
✅ execute fix plugin in sarif mode[macosX64]
✅ tests with the same name[macosX64]

⚪ execute warn plugin with default testFiles[macosX64]
✅ execute warn plugin on separate files[macosX64]
⚪ execute warn plugin with timeout[macosX64]
✅ executing warn plugin on directory[macosX64]
✅ executing warn plugin on directory when files are set with regex[macosX64]
✅ lines that match ignoreLines should be ignored[macosX64]
✅ test output file set[macosX64]
⚪ executing warn plugin on parental directory[macosX64]
⚪ executing warn plugin on save-toml file in directory[macosX64]
✅ executing warn plugin on parental save-toml file[macosX64]
✅ executing warn plugin so that no resources will be found[macosX64]
⚪ execute warn plugin with included and excluded suites[macosX64]
✅ tests should have a relative path[macosX64]
✅ execute warn-plugin with expected warnings from SARIF[macosX64]
✅ execute warn-plugin with actual warnings from SARIF[macosX64]
✅ execute warn-plugin with actual and expected warnings from SARIF[macosX64]

✅ execute fix-and-warn plugin on the directory chapter1[macosX64]
✅ execute fix-and-warn plugin on the directory chapter2[macosX64]
✅ execute fix-and-warn plugin on the directory chapter3[macosX64]

✅ execute fix plugin[macosX64]
✅ execute fix plugin on the directory chapter1[macosX64]

⚪ execute warn plugin on the directory chapter1[macosX64]
⚪ execute warn plugin on the directory chapter2[macosX64]
⚪ execute warn plugin on the directory chapter3[macosX64]
⚪ execute warn plugin on the directory chapter4[macosX64]
⚪ execute warn plugin on root directory[macosX64]

✅ merge and override general configs[macosX64]
✅ merge and override two incomplete configs[macosX64]
✅ merge and override two incomplete configs 2[macosX64]
✅ merge and override two configs with different fields[macosX64]
✅ merge configs with many parents[macosX64]
✅ merge real toml configs with empty execFlag in child[macosX64]
✅ override real toml configs[macosX64]
✅ load save toml from middle hierarchy[macosX64]

✅ detect plugins[macosX64]
✅ should execute single test[macosX64]

✅ parse properties file[macosX64]
✅ parse properties file from not existed folder[macosX64]
✅ resolve value[macosX64]
✅ read properties file[macosX64]
✅ read invalid properties file[macosX64]
✅ read not existed properties file[macosX64]

✅ set defaults to general section[macosX64]
✅ invalid general section[macosX64]
✅ set defaults to warn section[macosX64]
✅ validate warn section[macosX64]
✅ validate warn section 2[macosX64]
✅ validate warn section 3[macosX64]
✅ validate warn section 4[macosX64]
✅ set defaults to fix section[macosX64]

✅ base test()[jvm]

✅ base test[macosX64]

✅ should detect two files()[jvm]
✅ should calculate diff of discovered files()[jvm]
✅ should detect two files - among other files()[jvm]
✅ test for batchSize()[jvm]

✅ should detect two files[macosX64]
✅ should detect two files - among other files[macosX64]
✅ should calculate diff of discovered files[macosX64]
✅ test for batchSize[macosX64]

✅ should filter out warnings from other files - absolute paths with testRoot being relative()[jvm]
✅ should filter out warnings from other files - relative paths()[jvm]
✅ should filter out warnings from other files()[jvm]
✅ should convert SARIF report to SAVE warnings()[jvm]
✅ should filter out warnings from other files - absolute paths with testRoot being absolute()[jvm]

✅ should compare warnings()[jvm]

✅ checking the creation of regex messages from strings()[jvm]
✅ regression with regular expressions()[jvm]
✅ checking the search of delimiters in the string()[jvm]

✅ should extract warnings from different text with no line but col()[jvm]
✅ should extract warnings from different text with line and col()[jvm]
✅ should extract warnings from different text with line but no col()[jvm]

✅ warn-plugin test exception()[jvm]
⚪ warn-plugin test - multiple warnings and ignore technical comments()[jvm]
✅ warn-plugin test - multiple warnings and no line-col()[jvm]
✅ warn-plugin test for batchSize()[jvm]
✅ basic warn-plugin test with exactWarningsMatch = false()[jvm]
✅ regression - test resources in multiple directories()[jvm]
✅ warn-plugin test with default warning without line()[jvm]
⚪ basic warn-plugin test with ignoreTechnicalComments=true()[jvm]
✅ warn-plugin test - multiple warnings()[jvm]
✅ basic warn-plugin test()[jvm]
✅ warn-plugin test for all mods()[jvm]

✅ should convert SARIF report to SAVE warnings[macosX64]
✅ should filter out warnings from other files[macosX64]
✅ should filter out warnings from other files - relative paths[macosX64]
✅ should filter out warnings from other files - absolute paths with testRoot being relative[macosX64]
✅ should filter out warnings from other files - absolute paths with testRoot being absolute[macosX64]

✅ should compare warnings[macosX64]

✅ checking the search of delimiters in the string[macosX64]
✅ checking the creation of regex messages from strings[macosX64]
✅ regression with regular expressions[macosX64]

✅ should extract warnings from different text with line and col[macosX64]
✅ should extract warnings from different text with no line but col[macosX64]
✅ should extract warnings from different text with line but no col[macosX64]

✅ basic warn-plugin test[macosX64]
✅ warn-plugin test with default warning without line[macosX64]
✅ warn-plugin test for all mods[macosX64]
✅ basic warn-plugin test with exactWarningsMatch = false[macosX64]
⚪ basic warn-plugin test with ignoreTechnicalComments=true[macosX64]
✅ warn-plugin test - multiple warnings[macosX64]
⚪ warn-plugin test - multiple warnings and ignore technical comments[macosX64]
✅ warn-plugin test - multiple warnings and no line-col[macosX64]
✅ warn-plugin test for batchSize[macosX64]
✅ regression - test resources in multiple directories[macosX64]
✅ warn-plugin test exception[macosX64]

✅ should produce valid serialized Report when plugin crashes()[jvm]
✅ should produce valid serialized Report from ordinary data()[jvm]

✅ should produce valid serialized Report from ordinary data[macosX64]
✅ should produce valid serialized Report when plugin crashes[macosX64]