9

Is there some way to have complete control over execution of test methods (including before/after methods) in JUnit5, similar to JUnit4 @RunWith annotation)?

I'm trying to build a JUnit5 Arquillian extension, but since Aquillian basically needs to execute each test in a container, I'm coming to a problem when running Arquillian from a Junit5 extension.

My code is here: BasicJunit5ArquillianTest.java

The test should run all methods (including before/after) in a separate container, which can be a separate JVM, remote or embedded server or anything isolated. My extension runs the test method from beforeEach hook, using Arquillian to transfer the test class and run it in a container using LauncherFactory.create(), collect test results and transfer them back.

The problem is that the test methods are executed twice - via normal JUnit5 execution and via my Arquillian extension from a beforeEach hook. I'd like to run tests only via Arquillian and skip normal execution of methods.

Is this possible in a JUnit5 extension? Or I need to create a custom test engine, possibly extending the Jupiter test engine?

OndroMih
  • 7,280
  • 1
  • 26
  • 44
  • My first guess would have been: look into extensions; isn't that the whole point of having them ... but I just started with Junit5 myself; so I cant help further than that ;-( – GhostCat Apr 10 '17 at 09:04
  • The point is that extensions only allow to add stuff, not block methods from being executed. The only way t block a method I know is to implement a condition - but that would ignore the test completely, even if the Arquillian runner is executed. – OndroMih Apr 10 '17 at 12:58
  • For more information about the Arquillian JUnit 5 work, please go to this GitHub issue: https://github.com/arquillian/arquillian-core/issues/137 TLDR: As JUnit5 doesn't provide enough SPI points to hook in, then (for now) it's not possible to implement Arquillian JUnit 5 engine or extension. – Matouš Jobánek Jan 17 '18 at 16:42

1 Answers1

5

There is no extension point (yet?) that allows you to define where or how tests are run. This is already true for threads, which means there is no way to run them on JavaFX application thread or Swing EDT.

You might have to go deeper and implement an engine but that means that users have to choose between writing Arquillian tests or writing Jupiter tests.

UPDATE: In a newer version of JUnit 5 released since this answer was accepted, JUnit 5 now provides the InvocationInterceptor extension point, which is exactly what is needed to implement a custom runner as an extension, which has a full control over how the tests are executed and can even replace the body of the test method with something completely different (e.g. run the test in a different JVM and return the result).

OndroMih
  • 7,280
  • 1
  • 26
  • 44
Nicolai Parlog
  • 47,972
  • 24
  • 125
  • 255
  • I supposed this is the only option. I already started looking into extending Jupiter engine to do what I want, but I don't know if I can rely on its internal API. I can couple it with an extension, which would disable the tests in Jupiter, but a tricky part is to get the extension know by which engine it was started. – OndroMih Apr 10 '17 at 13:00
  • Here's a related issue: https://github.com/junit-team/junit5/issues/157 – Sam Brannen Apr 10 '17 at 23:16