2

So far I'm using scala 2.11 with Java 8 to build the library used by the Glue ETL job. We're planning to upgrade to Scala 2.12 with Java 11 but not sure if they are supported by the Glue ETL.

seiya
  • 1,477
  • 3
  • 17
  • 26

1 Answers1

1

The glue versions are listed here. The latest version supports Spark 2.4.3.

In Spark 2.4.3, the default version of Scala is 2.11.

Marcin
  • 215,873
  • 14
  • 235
  • 294
  • 3
    Thanks for the answer. I've also confirmed with AWS that Glue ETL only supports Java 8 for the moment. The is are feature requests for supporting Spark 3.x with Java 11 but it's not yet implemented. – seiya Feb 03 '21 at 14:59
  • @seiya No problem. Glad my answer was helpful:-) – Marcin Feb 03 '21 at 21:58