NCrunch is launching the ApprovalTests DiffReporter

Question

How do I get NCrunch to stop launching the DiffReporter when it is running tests in the background, but easily get the DiffReport when I manually run a test?

I've been trying to get this working for a while now, but none of the combinations I've tried are giving me the results I'm looking for. I am currently leaving the [UseReporter(typeof(DiffReporter))] attribute commented out. When a test starts failing I will come back and un-comment it until I fix the issue, then comment it back out, but this is getting especially cumbersome for methods with multiple [TestCase]. From what I've been reading on the ApprovalTests blog, it seems like this should be possible.

My diff software is Beyond Compare, and my code currently looks like this:

TestProject/AssemblyInfo.cs

[assembly: UseReporter(typeof(NCrunchReporter))]

TestProject/ClassTests.cs

public class ClassTests
{
    [Test]
    //[UseReporter(typeof(DiffReporter))]
    [TestCase(1, 1)]
    [TestCase(1, 2)]
    [TestCase(2, 1)]
    [TestCase(3, 1)]
    public void TestCase(int errorNumber, int )
    {
        using (ApprovalResults.ForScenario(errorNumber, testCaseSubtestNumber))
        {
            var results = DoSomething();

            Approvals.Verify(results);
        }
    }
}

Update:
I'm using the following NuGet packages:
- ApprovalTests v3.0.11
- ApprovalUtilities v3.0.11
- NUnit v3.2.1

Have you tried "show coverage for selected test only" right-clicking on your test case in ncruch tests window? — Gleb Sevruk, Jul 15 '16 at 19:29

llewellyn falco · Accepted Answer · 2016-07-15T22:49:12.510

2

It should be the default behavior. The actual code you want is

[assembly: FrontLoadedReporter(typeof(NCrunchReporter))]

But NcrunchReporter is part of the DefaultFrontLoadedReporter. These reporters go in front of any reporter you use and block if the situation is detected.

Perhaps NCrunch has changed though. Could you try running this via NCrunch and reporting the results

Approvals.SetCaller();
Assert.IsTrue(NCrunchReporter.INSTANCE.IsWorkingInThisEnvironment("a.txt"));

It should be true, if it is not NCrunch has changed and we will need to update the reporter accordingly.

edited Jul 15 '16 at 22:49

answered Jul 15 '16 at 20:52

llewellyn falco

2,281
16
13

I get `System.NullReferenceException : Object reference not set to an instance of an object. at ApprovalTests.Reporters.NCrunchReporter.IsWorkingInThisEnvironment(String forFile)`. I'm using ApprovalTests v3.0.11 – tehDorf Jul 15 '16 at 22:09
Sorry, try this: Approvals.SetCaller(); Assert.IsTrue(NCrunchReporter.INSTANCE.IsWorkingInThisEnvironment("a.txt")); – llewellyn falco Jul 15 '16 at 22:47
Okay, that cleared up the exception. The function returns `false`, though, so the Assert fails. – tehDorf Jul 15 '16 at 22:54
Can you try this version. [Ncrunch Reporter](https://raw.githubusercontent.com/approvals/ApprovalTests.Net/master/ApprovalTests/Reporters/NCrunchReporter.cs) – llewellyn falco Jul 17 '16 at 00:02
Yes, that's working - NCrunch does not launch the `DiffReporter`, but ReSharper and Visual Studio test runners do. – tehDorf Jul 18 '16 at 17:20

NCrunch is launching the ApprovalTests DiffReporter

1 Answers1