how to extract values in array of array strings in RDD

Question

val rdd :Array[Array[String]] = Array(Array("2345","345","fghj","dfhg")
                                ,Array("2345","3450","fghj","dfhg")
                                ,Array("23145","1345","fghj","dffghg")
                                ,Array("23045","345","feghj","adfhg"))

this is my input. I need to extract first two elements of each array in the form of key value pair.

I would like to get output

(2345,345)
(2345,3450)
(23145,1345)
(23045,345)

Ramesh Maharjan · Accepted Answer · 2018-03-16T06:07:29.907

2

You can simply do

rdd.map(array => (array(0), array(1)))
//res0: Array[(String, String)] = Array((2345,345), (2345,3450), (23145,1345), (23045,345))

If you want the output in Map then you can add .toMap function call

rdd.map(array => (array(0), array(1))).toMap
//res0: scala.collection.immutable.Map[String,String] = Map(2345 -> 3450, 23145 -> 1345, 23045 -> 345)

edited Mar 16 '18 at 06:07

answered Mar 16 '18 at 06:01

Ramesh Maharjan

41,071
6
69
97

im getting as array output .i would like to get as key value pair – premon Mar 16 '18 at 06:03

how to extract values in array of array strings in RDD

1 Answers1