Stack Overflow
Stack Overflow

Questions tagged [kryo]

Kryo is a fast and efficient object graph serialization framework for Java. The goals of the project are speed, efficiency, and an easy to use API. The project is useful any time objects need to be persisted, whether to a file, database, or over the network.

431 questions
0
votes
0 answers

SpringXD Kryo-shaded-3.0.3.jar and NoClassDefFoundError and ClassNotFoundException And Enum

I just noticed that we are facing Kryo Issues with a new payload in one of our new Streams in Spring XD (We are planning to jump to Spring Cloud Data Flow soon, so suggestion based on it, might no be applicable right now :( This is part of the log I…
Columb1a
  • 463
  • 2
  • 11
  • 25
0
votes
2 answers

What is the difference between saveAsObjectFile and persist in apache spark?

I am trying to compare java and kryo serialization and on saving the rdd on disk, it is giving the same size when saveAsObjectFile is used, but on persist it shows different in spark ui. Kryo one is smaller then java, but the irony is processing…
supernatural
  • 1,107
  • 11
  • 34
0
votes
0 answers

How do I get a list of all unregistered classes for Kryo serialization?

How to get all unregistered list of classes used, because say I have a spark job and I am getting this class is not registered exception only on runtime, and these classes are the internal classes which are accessible say…
supernatural
  • 1,107
  • 11
  • 34
0
votes
1 answer

Kryo Serialization not registering even after registering the class in conf

I made a class Person and registered it but on runtime, it shows class not registered.Why is it showing so? Exception in thread "main" org.apache.spark.SparkException: Job aborted due to stage failure: Failed to serialize task 0, not attempting to…
supernatural
  • 1,107
  • 11
  • 34
0
votes
1 answer

Storm topology stops emitting after StormServerHandler Netty error caused by OptionalDataException

We have a storm cluster running with 3 nodes and multiple topologies. We use apache-storm-1.2.2 with java 1.8.0_162 Currently we have the problem that a random topology stops emitting at random times after an error occurs and the Netty server is…
Daniel Storch
  • 979
  • 3
  • 10
  • 25
0
votes
0 answers

How do I read a Maps values to my serializer?

I would like to read the values that are stored in my Redis database (by another program) into my Kryo serializer. Right now when I perform a cluster.hgetall I get all the values I have stored in the database as a Map. I'd like to be able to turn…
Jumala
  • 1
  • 2
0
votes
0 answers

customised serialisation in Java

I am aware of Java Serialization and also have heard about Custom Java serialization. Personally, I haven't ever done any custom serialization, however a bit of custom serialization I am aware of that we need to provide writeObject() and…
CuriousMind
  • 8,301
  • 22
  • 65
  • 134
0
votes
1 answer

Spark Dataset with Json output comes out as Kryo encoded

I wanted to convert CSV data in a specific JSON format, not the usual flat thing. So I tried the following: case class CityInfo(lat : Double, long : Double) case class City(name: String, country: String, info : CityInfo) implicit def…
gotch4
  • 13,093
  • 29
  • 107
  • 170
0
votes
0 answers

Can I use kryo output on same jvm to do deep compare of instances of exact same class?

I have two instances of exact same class which I want to compare. I am already using kryo to serialize and send it to DB. I was wondering, can I compare both byte[] produced by Kryo (default configuration) and determine if both are same or not? I…
Jags
  • 799
  • 7
  • 19
0
votes
0 answers

How to use Kryo FieldSerializer with Lombok @Data annotation in SpringBoot

I am trying to use Kryo Serializer as default serailzer in SpringBoot 2.1. However, Kryo serializer do nothing for Box class with lombok @Data annotation. It always return {}. Is there a way I can use the @Data annotation with Kyro…
Stonpid
  • 349
  • 1
  • 3
  • 14
0
votes
1 answer

Buffer Overflow In KryoNet Trying To Recive A Object Graph

I'm sending an object which contains a 2X45x45 big 3-dimensional array. In every slot, there is a custom object which I also registered in kryonet. It seems to send fine but trying to recive it I keep getting this annoying error, Exception in…
user9407009
0
votes
1 answer

How can i get kryo log in Akka project

I have an Akka-cluster project developed in Java. Where I used kryo serialization. How can I get the log of kryo serialization ? I want to know all non mapping classes because here idstrategy = "explict". Currently if I missed to add a class in the…
junsid
  • 335
  • 3
  • 14
0
votes
0 answers

Kryo Serialization issue Spark

I am trying to register below class for Kryo Serialization in spark code but I am receiving an error. Code: class KafkaSink(createProducer: () => KafkaProducer[String, String]) extends Serializable { lazy val producer = createProducer() def…
Deepak Janyavula
  • 348
  • 4
  • 17
0
votes
2 answers

Spark - Kryo vs JavaSerialization. Same size?

I'm using cache with Spark. Right now, I use several caches, and some of them are about 20gb in memory. I tried first with cache() and later with persist and MEMORY_SER and the size was huge so I changed to java serialization, getting about 20gb in…
Guille
  • 2,248
  • 3
  • 24
  • 42
0
votes
1 answer

use the result of function as a new function's parameter, but why exception occurred?

i wrote a lite RPC framework and use kryo serialize object. but exception occurred when i wrote like this RpcResponse rpcResponse = new RpcResponse(input.readInt(), kryo.readClassAndObject(input), input.readBoolean()); so i use another way to init…
carl
  • 41
  • 5
1 2 3
…
28 29