JUnit and Spock test with maven-surefire-plugin

Question

I have JUnit tests in src/test/java/ and groovy tests in src/test/groovy/. I can run every tests in IDE, but I want to add them to mvn test.

If I use:

<plugin>
      <groupId>org.apache.maven.plugins</groupId>
      <artifactId>maven-surefire-plugin</artifactId>
      <version>3.0.0-M5</version>
      <configuration>
      <argLine>${arg}</argLine>
      <includes>
          <include>**/*Test.class</include>
      </includes>
</plugin>

mvn test run all from groovy package, but if I add junit for surefire like here:

<plugin>
   <groupId>org.apache.maven.plugins</groupId>
   <artifactId>maven-surefire-plugin</artifactId>
   <version>3.0.0-M5</version>
   <configuration>
      <argLine>${arg}</argLine>
      <includes>
         <include>**/*Test.class</include>
      </includes>
   </configuration>
   <dependencies>
      <dependency>
         <groupId>org.apache.maven.surefire</groupId>
         <artifactId>surefire-junit47</artifactId>
         <version>3.0.0-M5</version>
      </dependency>
   </dependencies>
</plugin>

mvn test run all from java package. I've tried a lot of things, but I can't configure maven to run both in one build. How is it possible to do that?

I guess we are taking about Spock 1.x, probably 1.3? You should have mentioned that, because for Spock 2.x you use the JUnit 5 platform, not JUnit 4. — kriegaex, Dec 09 '21 at 14:59
I used Spock 2.0, JUnit 4 and after added dependency junit-vintage-engine everything is working fine. — damlit, Dec 10 '21 at 15:28
Spock 2 definitely needs the JUnit 5 platform. The vintage engine is for backward compatibility to tests using JUnit 4 specific stuff like runners. Without a complete minimal example it is hard to tell why your tests would need the vintage engine. Therefore, neither your question nor the answer are particularly insightful. — kriegaex, Dec 10 '21 at 15:35

score 1 · Answer 1 · answered Dec 10 '21 at 21:12

See the Spock-Example project on how to correctly configure the maven build to run Spock 2.x.

<?xml version="1.0"?>
<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
         xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/maven-v4_0_0.xsd">
  <modelVersion>4.0.0</modelVersion>
  <groupId>org.spockframework</groupId>
  <artifactId>spock-example</artifactId>
  <version>1.0-SNAPSHOT</version>
  <packaging>jar</packaging>
  <name>Spock Framework - Example Project</name>

  <properties>
    <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
    <project.reporting.outputEncoding>UTF-8</project.reporting.outputEncoding>
    <groovy.version>3.0.9</groovy.version>
  </properties>

  <build>
    <plugins>
      <!-- Mandatory plugins for using Spock -->
      <plugin>
        <!-- The gmavenplus plugin is used to compile Groovy code. To learn more about this plugin,
        visit https://github.com/groovy/GMavenPlus/wiki -->
        <groupId>org.codehaus.gmavenplus</groupId>
        <artifactId>gmavenplus-plugin</artifactId>
        <version>1.12.0</version>
        <executions>
          <execution>
            <goals>
              <goal>compile</goal>
              <goal>compileTests</goal>
            </goals>
          </execution>
        </executions>
      </plugin>
      <plugin>
        <artifactId>maven-surefire-plugin</artifactId>
        <version>3.0.0-M5</version>
        <configuration>
          <useModulePath>false</useModulePath> <!-- https://issues.apache.org/jira/browse/SUREFIRE-1809 -->
          <useFile>false</useFile>
          <includes>
            <include>**/*Test</include>
            <include>**/*Spec</include>
          </includes>
          <statelessTestsetReporter implementation="org.apache.maven.plugin.surefire.extensions.junit5.JUnit5Xml30StatelessReporter">
            <disable>false</disable>
            <version>3.0</version>
            <usePhrasedFileName>false</usePhrasedFileName>
            <usePhrasedTestSuiteClassName>true</usePhrasedTestSuiteClassName>
            <usePhrasedTestCaseClassName>true</usePhrasedTestCaseClassName>
            <usePhrasedTestCaseMethodName>true</usePhrasedTestCaseMethodName>
          </statelessTestsetReporter>
        </configuration>
      </plugin>
    </plugins>
  </build>

  <dependencyManagement>
    <dependencies>
      <dependency>
        <groupId>org.spockframework</groupId>
        <artifactId>spock-bom</artifactId>
        <version>2.0-groovy-3.0</version>
        <type>pom</type>
        <scope>import</scope>
      </dependency>
    </dependencies>
  </dependencyManagement>

  <dependencies>
    <!-- Mandatory dependencies for using Spock -->
    <dependency>
      <groupId>org.spockframework</groupId>
      <artifactId>spock-core</artifactId>
      <scope>test</scope>
    </dependency>
    <!-- Optional dependencies for using Spock -->
    <dependency> <!-- use a specific Groovy version rather than the one specified by spock-core -->
      <groupId>org.codehaus.groovy</groupId>
      <artifactId>groovy</artifactId>
      <version>${groovy.version}</version>
    </dependency>
    <dependency> <!-- enables mocking of classes (in addition to interfaces) -->
      <groupId>net.bytebuddy</groupId>
      <artifactId>byte-buddy</artifactId>
      <version>1.11.0</version>
      <scope>test</scope>
    </dependency>
    <dependency> <!-- enables mocking of classes without default constructor (together with ByteBuddy or CGLIB) -->
      <groupId>org.objenesis</groupId>
      <artifactId>objenesis</artifactId>
      <version>3.2</version>
      <scope>test</scope>
    </dependency>
    <dependency> <!-- only required if Hamcrest matchers are used -->
      <groupId>org.hamcrest</groupId>
      <artifactId>hamcrest-core</artifactId>
      <version>2.2</version>
      <scope>test</scope>
    </dependency>
  </dependencies>
</project>

On my side Spock tests run fine with `maven-surefire-plugin:3.0.0-M4`, starting with `3.0.0-M5` the tests are not run. — ron190, Jul 30 '23 at 20:46
@ron190 have you tried this example code? If you can't get it to work, then you best ask a question and provide a reproducer. — Leonard Brünings, Jul 31 '23 at 11:50
Sure. Instead I'll retry with other versions when teams release new artifacts, though you can try to reproduce directly from the project: https://github.com/ron190/jsql-injection/blob/master/model/pom.xml — ron190, Jul 31 '23 at 20:56

score 0 · Answer 2 · answered Dec 09 '21 at 10:56

I had to use junit-vintage-engine instead of surefire-junit-47

<plugin>
   <groupId>org.apache.maven.plugins</groupId>
   <artifactId>maven-surefire-plugin</artifactId>
   <version>3.0.0-M5</version>
   <configuration>
      <argLine>${arg}</argLine>
      <includes>
         <include>**/*Test.class</include>
      </includes>
   </configuration>
   <dependencies>
      <dependency>
         <groupId>org.junit.vintage</groupId>
         <artifactId>junit-vintage-engine</artifactId>
         <version>5.8.2</version>
      </dependency>
   </dependencies>
</plugin>

score 0 · Answer 3 · answered Aug 07 '23 at 21:28

Using Spock tests with Junit5 is not detecting any test to run on >= 3.0.0-M5, also Maven logs are showing that Surefire is picking JUnit4Provider instead of any JUnit5 provider.

Adding surefire-junit-platform to the plugin dependencies worked for me:

<plugin>
    <groupId>org.apache.maven.plugins</groupId>
    <artifactId>maven-surefire-plugin</artifactId>
    <version>${maven-surefire-plugin.version}</version>
    <dependencies>
        <dependency>
            <!-- Required to detect tests on version > 3.0.0-M4 -->
            <groupId>org.apache.maven.surefire</groupId>
            <artifactId>surefire-junit-platform</artifactId>
            <version>${maven-surefire-plugin.version}</version>
        </dependency>
    </dependencies>
</plugin>

JUnit and Spock test with maven-surefire-plugin

3 Answers3