Running SpecFlow Scenario Outlines from Test Plans in Azure DevOps (VSTS) or update test plan after test execution

Question

I am using azure devops release pipeline to deploy the tests once the test execute in release it should update test plan. for that i am using visual studio task - option-Test Plan Test cases with scenario get updated in test plan but scenario outline is not updating

Answer 1

SpecFlow generates multiple test methods for Scenario Outline. However, one test case can only be associated to one test method in Azure devops. I suppose this is why the scenario outline is not updating in your test plan. See here for more information.

The workaround is to use Scenario Outline wrappers as mentioned in above link. Refer below steps.

For the unit test providers that generate multiple test methods for the Scenario Outlines, SpecSync can generate a special wrapper method, which wraps the execution of the individual Scenario Outline examples and can be associated with the automated test case.

1,Specify testSuiteBasedExecutionWithScenarioOutlineWrappers as testExecutionStrategy in the synchronization/automation section of the configuration file.

{
  ...
  "synchronization": {
    ...
    "automation": {
      "enabled": true,
      "testExecutionStrategy": "testSuiteBasedExecutionWithScenarioOutlineWrappers"
    },
    ...
  },
  ...
}

2, Install the SpecSync SpecFlow plugin to your project as a NuGet package. For example for SpecFlow v2.4.*, install SpecSync.AzureDevOps.SpecFlow.2-4.

Check document Test Suite based execution with Scenario Outline wrappers strategy for more information.

Another workaround is to create multiple test cases in azure devops and associate with the test methods generated for the Scenario Outlines one by one.