Stack Overflow
Stack Overflow

Questions tagged [system-testing]

System testing of software or hardware is testing conducted on a complete, integrated system to evaluate the system's compliance with its specified requirements.

System testing of software or hardware is testing conducted on a complete, integrated system to evaluate the system's compliance with its specified requirements. System testing falls within the scope of black box testing, and as such, should require no knowledge of the inner design of the code or logic.

137 questions
2
votes
1 answer

Integration of System Tests in the build process

I am continuing the development of a serialization layer generator. The user enters a description of types (currently in XSD or in WSDL), and the software produces code in a certain target language (currently, Java and ansi C89) which is able to…
Tetha
  • 4,826
  • 1
  • 16
  • 17
2
votes
3 answers

With mock testing, are unit tests + system tests enough?

Before you jump to an answer, let's define what I mean (note that you may have different definitions, and that's part of the problem, but this is what I'm using) mock testing aka behavior-based testing--- tests the code does the right thing i.e.,…
U Avalos
  • 6,538
  • 7
  • 48
  • 81
2
votes
1 answer

Replication of production env database to staging prior to deployment with Octopus

In order to verify the deployment of my database scripts better, I'd like to pre-initialize my Staging database with a mirror image of the Production database as a first step in my Octopus deployment. I'm using SQL Azure and DACFX. I'm curious if…
jt000
  • 3,196
  • 1
  • 18
  • 36
2
votes
2 answers

Test integration between two rails apps

I am developing a system composed of two different rails applications (server and client) which communicate via rest web services. I have tests for each app individually, but I would like to add some test for the integration between the two…
alberto
  • 553
  • 1
  • 4
  • 7
1
vote
3 answers

How to rollback/tear down/clear the database changes after a system test runs?

I have a test method, using NUnit and Selenium, which opens a browser on our website which is on the Production Server and registers a user and verifies that the registration is successful. (I know ideally the system tests should run on a separate…
The Light
  • 26,341
  • 62
  • 176
  • 258
1
vote
1 answer

Result Execution and Presentation when Blackbox Testing

I have developed a Blackbox Test Environment in Python 3.2 for testing a piece of hardware. In this environment I have a TestExecution.py module where I run my tests as follows: while(True): TestWithRestart("Test122") …
Baz
  • 12,713
  • 38
  • 145
  • 268
1
vote
1 answer

Non-GUI Automated System Test Framework

I am looking for an automated test framework for testing a system with the following characteristics: 1. Non-GUI System 2. Has backend nodes running on multiple Linux/Unix hosts 3. Has remotely executing processes against which we must test 4.…
Sudeep
  • 107
  • 1
  • 11
1
vote
1 answer

NullPointerExeption in selenium test

I have this test class that extend SystenTestCase package org.corallosmart.e2e.GestioneContributo; import org.corallosmart.e2e.SystemTestCase; import org.junit.Assert; import org.junit.Before; import org.junit.jupiter.api.Test; import…
Graziano Giuseffi
  • 11
  • 1
1
vote
1 answer

Use map object in karate framework

I am trying to create a scenario where: Scenario Outline: Create a request Given print 'reason=, detail=, metainfo=' When call create_request Then match response.message == "#notnull" * call json_to_proto…
Ishita
  • 109
  • 2
  • 10
1
vote
2 answers

Capybara testing with RSpec in Ruby

on my index page I have this div:
1
vote
1 answer

Testing Qt application with Qt Test

I have looked at the 5 Qt testing examples including the one about GUI events, but these examples are way too simple. I want to test my program by launching it, simulating some clicks, and checking the value of instance variables that have been…
The Coding Wombat
  • 805
  • 1
  • 10
  • 29
1
vote
0 answers

CMake/CTest - execute processes in parallel as a test

in my team we develop a library which coordinates multiple applications over some network back-end. The building is handled by CMake 3.10.4 and we run our tests with CTest. We currently support only Linux, but Windows and MacOS support is on the…
Frederic Simonis
  • 21
  • 4
1
vote
1 answer

How do you set the server port in Rails system tests?

The Rails server starts on a different port every time you run the system tests. Is there any way to specify which port this should be and not have it change on every run? I would like to test clicking a link from an ActionMailer message in my…
ayushn21
  • 305
  • 2
  • 7
1
vote
0 answers

Capybara test fails only when using non-headless Chrome (passes with headless Chrome)

I have some system tests using Minitest/Capybara, but one part invariably fails when using NON-headless Chrome, even though it passes just fine when using the headless version. This setup works: # application_system_test_case.rb class…
reesaspieces
  • 1,600
  • 4
  • 18
  • 47
1
vote
1 answer

How do regression tests best fit within a CI/CD workflow?

I'm writing an API that consists of several microservices. I have the code in a private Gitlab repo. I have a custom CI/CD pipeline configured to run a couple of different steps automatically on every commit to master (e.g. build, test, deploy to a…
soapergem
  • 9,263
  • 18
  • 96
  • 152
1 2 3
…
9 10