spark 2.1.1 : Parsed JSON values do not match with class constructor

Question

I've a strange problem with spark 2.1.1 and json4s.jackson.

I upgraded my streaming project from spark 1.5.1. Now when I execute code in IDE everything works fine.

But after assembly and code standalone execution with spark-submit

I got the following error

Caused by: org.json4s.package$MappingException: Parsed JSON values do not match with class constructor
args=
arg types=
constructor=

My Environemnt:

spark=2.1.1,

scala=2.11,

json4s-jackson=3.2.11

Has somebody has faced the same problem before? If yes, how did you solve it?

Many thanks.

https://github.com/json4s/json4s/issues/252 – philantrovert Jul 31 '17 at 08:47 — philantrovert, Jul 31 '17 at 08:47
Where is your JSON? Please show an example of the JSON. – SPlatten Aug 02 '17 at 12:33 — SPlatten, Aug 02 '17 at 12:33

vaquar khan · Answer 1 · 2017-08-01T16:59:26.037

1

Seems Like json4s-jackson bug search in following link "Parsed JSON values do not match with class constructor"

You need to modify your json

edited Aug 01 '17 at 16:59

answered Aug 01 '17 at 16:46

vaquar khan

I can find that bug in the link you've provided. But I don't know what I am supposed to do with it - it doesn't link to any ticket or solution. – akki Jan 28 '19 at 08:20

score 0 · Answer 2 · answered Jan 03 '18 at 17:32

0

Upgrade to latest Spark vesrion 2.2.x solved the problem. Looks like bug in Spark 2.1.x fixed now in Spark 2.2.x

answered Jan 03 '18 at 17:32

Toren

2 Answers2