Can JavaPairRDD ever take an Array instead of a Tuple2 in Spark Java?

Asked May 02 '18 at 21:49

Active May 03 '18 at 11:08

Viewed 214 times

I reading the "Learning Spark" book and for example 5-14, I noticed that a JavaPairRDD<String[]> was declared. I'm pretty sure that JavaPairRDD's can only take Tuple2s (i.e. for Key and Value) but I wasn't sure if there was some weird implicit conversion going on from String[] to Tuple2 somehow.

I can't find any other examples of this online except for this exact example.

Here's a link to the page in the book.

edited May 03 '18 at 11:08

Adrien Brunelat

4,492
4
29
42

asked May 02 '18 at 21:49

howard

1

It cannot. JavaPairRDD is parameterized with two types, and the map method on the right hand side doesn't return JavaPairRDD. It is clearly a mistake in print. – Alper t. Turker May 02 '18 at 23:13
formatting issues – Adrien Brunelat May 03 '18 at 11:08
Ah yeah I didn't even consider the method on the right hand side! Thanks! – howard May 04 '18 at 00:10

Can JavaPairRDD ever take an Array instead of a Tuple2 in Spark Java?

0 Answers0