Stack Overflow
Stack Overflow

Questions tagged [ordered-test]

A feature of Visual Studio used for strategically executing tests in order, an ordered test is a container that holds other tests and guarantees that tests run in a specific order.

A feature of Visual Studio used for strategically executing tests in order, an ordered test is a container that holds other tests and guarantees that tests run in a specific order. Use this tag for questions regarding issues regarding ordered tests.

31 questions
5
votes
0 answers

C# unit testing - ordered test with runsettings file

I'm trying to develope an automated regression test framework as unit tests. So I use ordered test to combine the different test steps and combine them in an easy to use way. For configuration purposes i wanna use the runsettings file, especially…
FloHiwg
  • 61
  • 7
3
votes
0 answers

How to get the name of the currently executing OrderedTest

I have some ordered tests containing test methods. Some test methods are used in multiple ordered tests. ...
Stephan Bauer
  • 9,120
  • 5
  • 36
  • 58
2
votes
1 answer

MSTest log file shows invalid counts for results of orderedtest

I have tried many orderedtests and the .trx file always shows the wrong count? for instance, if i had an orderedtest with 2 tests, the results look like this in the .trx file (results summary node):
schmoopy
  • 6,419
  • 11
  • 54
  • 89
2
votes
0 answers

Test results for group of tests (ordered test) are displayed only like one test result per group

in our company, we have many UI tests which are arranged in playlists (*.orderedtest file). In release definition are running this tests like ordered tests: VSTest_configure. After running tests, the test results are displayed only like one test…
SuperMario
  • 21
  • 3
2
votes
1 answer

TFS 2017 build of ordered CodedUI unit tests doesn't give detailed results - Consider all tests as one test

I'm using tfs 2017 to run CodedUI ordered unit tests. These are my build steps: These are my "Run Functional Tests" configurations: And these are the "Publish Test Results" (I'm not sure they are correct): The TestAgent is deployed and the tests…
Amir M
  • 508
  • 1
  • 8
  • 28
2
votes
1 answer

Run TestFixtures in Order with NUnit

I need to have ordered test fixtures in my NUnit c# Application. I have an example on how to run ordered test methods from this page, and I've tried to implement the same logic for test fixtures with the same methods provided in the example…
Morgan Soren
  • 563
  • 4
  • 14
  • 33
2
votes
1 answer

Test method from base class not executed after a test method from derived class is executed

I have a test class Navigation and I have derived class LeadExTest that is derived from Navigation class. Both class are of [TestClass] type Now i have a ordered test file, that has a few tests i need to be executed in the order i have shown…
Rahul Lodha
  • 3,601
  • 7
  • 25
  • 34
1
vote
1 answer

MS Test .orderedtest file details

I'm using scaffolding to dynamically generate UI tests with MS Test and Selenium. I've generated the selenium tests just fine and want to generate .orderedtest files to order the test. The .orderedtest file is xml based:
cmikeb1
  • 1,054
  • 9
  • 19
1
vote
2 answers

Test results for ordered test are grouped in Azure Devops pipeline

I am running a few ordered tests using Azure DevOps pipelines. The result for the tests is grouped into a single ordered test. It is becoming very difficult to interpret the result. Is it possible to obtain a separate pass/fail result? In the…
Zankhana Rana
  • 169
  • 2
  • 16
1
vote
1 answer

Coded ui VS2017 ordered list alternatives

I have a UWP application and codedui testcases project for this app which I put them in playlist in visual studio 2017 but the playlist doesn't run testcases in order so I searched online and people suggested using orderedtest, but when I try to…
memok
  • 27
  • 8
1
vote
1 answer

runsettings' DeploymentEnabled flag not taken into account in Ordered Tests

For some reason, the DeploymentEnabled flag is not taken into account when I run my tests from an orderedtest; i.e., the DirectoryPath is as if DeploymentEnabled was True, although I explicitly set it to False in the .runsettings file. My question…
CTZStef
  • 1,675
  • 2
  • 18
  • 47
1
vote
0 answers

vs 2012 ordered test - customize path to tests dll

When I create ordered test, add some tests to it and open the *.orderedtest file with some text editor I have hardcoded path to test dll, for example: storage="bin\Debug\sometest.dll" I would like to have this path set based on visual studio…
masterkawaster
  • 199
  • 1
  • 8
1
vote
2 answers

Visual Studio 2012 Ordered Test, how to monitor test execution

I have an ordered test that have some tests that run properly. My problem is that during the test execution I can't see which test is running. How can I monitor the execution of the ordered tests?
theLaw
  • 1,261
  • 2
  • 11
  • 23
1
vote
1 answer

Selenium test runs on Windows Server 2008 R2 doesn't work?

I'm working with Selenium in VB.NET using IEDriver. I want to launch my ordered tests suite on my windows server 2008 R2 (My server used IE 11). I launch my test by command line : vstest.console.exe. When I launch this on Windows 7, that works. I…
Lunaat
  • 43
  • 1
  • 8
1
vote
1 answer

Visual Studio 2013: Creating ordered tests

Can someone suggest a way to run tests in a specific order in Visual Studio 2013 Express? Is there a way to create a playlist for the tests, which also defines the order in which to run them? By the way: These are functional tests, using Selenium,…
user2119841
1
2 3