Issue with Scenario Outline Discovery in Test Explorer and YAML Pipeline after Migrating from SpecFlow to Reqnroll

[srinivasxtg]

After migrating from SpecFlow to Reqnroll, we are facing an issue with discovering Scenario Outline tests in Visual Studio 2022.

In SpecFlow, the Scenario Outline was identified by the first attribute in the example, and when searching in the Test Explorer,
it was displayed as createanewemployee_David.

Example:

Scenario Outline: Create a new employee
Given ...
When ...

Examples:
| empname | country |
| David   | US      |
| Greg    | US      |

In this case, the scenario would appear in Test Explorer as createanewemployee_David.

However, after migrating to Reqnroll, the scenario now appears as createanewemployee ("David","US")
and isn't discovered when searched as createanewemployee_David. It only gets discovered if the search is written as createanewemployee David.

This is causing an issue with our YAML pipeline in Azure DevOps, where we previously used the filter Name=createanewemployee_David to run the test.
Now, no tests are being discovered when applying filters either way, even after trying with the fully qualified name.

Can you please suggest any changes I should make in my project to resolve this issue?

[ajeckmans]

You can revert back to the old behaviour by setting the allowRowTests setting to false. See also https://docs.reqnroll.net/latest/installation/configuration.html#generator

[srinivasxtg]

Thank you so much!!
Can this setting be applied in the reqnroll.json file? If not, could you please specify which file I should modify to apply this setting?

[gasparnagy]

Yes, putting this into a reqnroll.json file does the trick:

{
  "$schema": "https://schemas.reqnroll.net/reqnroll-config-latest.json",

  "generator": {
    "allowRowTests": false
  }
}

[srinivasxtg]

Thanks a lot @gasparnagy
The issue has been resolved in both VS and pipeline after adding this generator setting.

{
"$schema": "https://schemas.reqnroll.net/reqnroll-config-latest.json",
"trace": {
"stepDefinitionSkeletonStyle": "RegexAttribute"
},
"bindingCulture": {
"language": "en-us"
},
"language": {
"feature": "en-us"
},
"generator": {
"allowRowTests": false
}
}