How to fail the build pipeline if "Tests Failed" in azure pipelines?

Question

I want to fail the build pipeline if a single test failed with azure pipelines.

Azure can successfully detect that my tests entered a failed state however it gives a success state to the entire build pipeline:

The question is how to make azure give a failed build state if the tests stage failed?

Here's my azure-pipelines.yml :

# Build ASP.NET Core project using Azure Pipelines
# https://learn.microsoft.com/azure/devops/pipelines/languages/dotnet-core?view=vsts

pool:
  vmImage: 'Ubuntu 16.04'

variables:
  buildConfiguration: 'Release'

steps:
- script: |
    dotnet build --configuration $(buildConfiguration)
    dotnet test dotnetcore-tests --configuration $(buildConfiguration) --logger trx
    dotnet publish --configuration $(buildConfiguration) --output $BUILD_ARTIFACTSTAGINGDIRECTORY

- task: PublishTestResults@2
  inputs:
    testRunner: VSTest
    testResultsFiles: '**/*.trx'

- task: PublishBuildArtifacts@1

Hi, did you try my answer? – Shayki Abramczyk Apr 16 '19 at 10:42 — Shayki Abramczyk, Apr 16 '19 at 10:42

score 14 · Answer 1 · edited Oct 16 '19 at 14:28

14

The original answer didn't work for me, but it looks like there was a lot of discussion on this, and there's now a failTaskOnFailedTests param for the task. That seems to work.


- task: PublishTestResults@2
  inputs:
    testRunner: VSTest
    testResultsFiles: '**/*.trx'
    failTaskOnFailedTests: true

I'm still surprised this wasn't default behavior.

edited Oct 16 '19 at 14:28

Benjh

5
4

answered May 30 '19 at 21:41

Jake Kreider

950
7
12

score 5 · Answer 2 · answered Oct 14 '18 at 10:42

5

Try to add failOnStandardError: 'true' in the task inputs:

- task: PublishTestResults@2
  inputs:
    testRunner: VSTest
    testResultsFiles: '**/*.trx'
    failOnStandardError: 'true'

answered Oct 14 '18 at 10:42

Shayki Abramczyk

36,824
16
89
114

score 1 · Answer 3 · answered Jul 06 '20 at 15:07

1

Untick the below-highlighted option

answered Jul 06 '20 at 15:07

tech-gayan

1,373
1
10
25

This is a good answer too because it allows you to do this at the pipeline level where you could have multiple pipelines with different behavior, using the code approach is good too but would then give you identical results in each pipeline where this doesn't. So it depends on your outcome, this is valid. – fr332lanc3 Feb 24 '21 at 16:07

How to fail the build pipeline if "Tests Failed" in azure pipelines?

3 Answers3

Linked