0

I've noticed that Kryo is using up a lot of application CPU and turned off genericTypes in order to debug. Based on the documentation, it seems like Scala case classes should be serialized by a Flink Serializer, not Kryo, but I'm getting this error:

org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: Generic types have been disabled in the ExecutionConfig and type KeyedOutputEvent2 is treated as a generic type.

Here is the case class

case class KeyedOutputEvent2(
  org_id: Long,
  index: Int,
  maid: String,
  os: Int,
  app: Long,
  ts: Long,
  flags: Int,
  lat: Double,
  lon: Double,
  ha: Double,
  vel: Double,
  iso3: String,
  ip: String,
  conn_type: String,
  carrier: String,
  make: String,
  model: String,
  ua: String,
  us: String)

Note that the case class is being used between subtasks--it's not coming directly from a Source. Unless I'm reading the documentation wrong, it doesn't seem like Kryo should be needed for this. What am I doing wrong?

kellanburket
  • 12,250
  • 3
  • 46
  • 73

0 Answers0