1

I'm not able to run scalding test with JobTest class. Below is the command. How to send command of that?

Hadoop jar com.scala-0.0.1-SNAPSHOT.jar com.twitter.scalding.JobTest com.scala.etl --hdfs --input --output

facing below problem:

Exception in thread "main" java.lang.NoSuchMethodException: com.twitter.scalding.JobTest.main([Ljava.lang.String;)

rtruszk
  • 3,902
  • 13
  • 36
  • 53
Ray
  • 21
  • 1

1 Answers1

1

JobTest is not executed on Hadoop - they are executed in scalatest/JUnit. The way you run the test depends on how your project is built.

For example, take a look at this test file: https://github.com/danosipov/scalding-word-histogram-example/blob/master/src/test/scala/WordHistogramJobSpec.scala

That test is executed by running sbt test in the home directory, which runs the test locally on the development machine.

Dan Osipov
  • 1,429
  • 12
  • 15