Questions tagged [kryo]

Kryo is a fast and efficient object graph serialization framework for Java. The goals of the project are speed, efficiency, and an easy to use API. The project is useful any time objects need to be persisted, whether to a file, database, or over the network.

431 questions
0
votes
0 answers

Spark serialization with Kryo fail

Locally I have succesfully launched a spark application locally. To do that I have start on my machine a spark master and a worker. I have then execute spark-submit (execution was succesfull). Production When passing my work on production the same…
Theophile Champion
  • 453
  • 1
  • 4
  • 20
0
votes
0 answers

Spark 1.6 with Kryo 2.21 and ArrayList

I am trying to use Spark 1.6.0 with Kryo 2.21. Its really frustrating as I am not able to figure out what is causing this error. I do not see anything at line 234 in Arraylist class which could cause a Null Pointer. Does having kryo 2.22 as well on…
Amit Kumar
  • 2,685
  • 2
  • 37
  • 72
0
votes
1 answer

Java Kryonet RSAPublicKeyImpl not registered

I'm trying to send a PublicKey (java.security.PublicKey) from a Kryonet server to a client by using connection.sendTCP(key); I get this exception when doing so: Exception in thread "pool-1-thread-1" java.lang.IllegalArgumentException: Class is not…
Wesley S
  • 3
  • 1
0
votes
1 answer

opencv: Failed to write core dump

I'm developping an object tracking that is supposed to run on storm cluster. I'm using kryo serialization to transmit opencv::Mat between spout and bolt. upon receiving the tuple, the algothim generate this error: 2018-02-28 19:39:23.536 STDERR…
user3244172
  • 1,202
  • 2
  • 9
  • 8
0
votes
1 answer

com-esotericsoftware-kryo-io-unsafeoutput-error-while-creating-spark-session

I am working on https://github.com/capitalone/Hydrograph. While upgrading Spark version to 2.2.1, I am seeing below error at line 89 in…
0
votes
1 answer

Kryo classloader issue

I have 2 applications : Application1 Serializes a Javaobject using Kryo serializer and application2 deserializes kryo serialized byte[] saved by application1 on external storage. Application1 has kryo-shaded-3.0.3.jar in its classpath and…
user1846749
  • 2,165
  • 3
  • 23
  • 36
0
votes
1 answer

Custom serializer in Apache Storm 1.1.0

I use custom serializer in Storm topology config like this : config.put(Config.TOPOLOGY_FALL_BACK_ON_JAVA_SERIALIZATION, false); config.registerSerialization(ObjectNode.class, ObjectNodeSerializer.class); ObjectNodeSerializer.class is well…
robynico
  • 157
  • 1
  • 12
0
votes
1 answer

How to Store non-serialized object into rediscache using kryoSerialzation

I'm using redis cache on my spring boot application and i need to store an unknown type of response object into redisTemplate. so i'm using kryoSerialzation on my redisTemplates, Exception : org.objenesis.ObjenesisException:…
Ratheesh
  • 631
  • 8
  • 8
0
votes
2 answers

Using Kryo serialization with Gemfire or Geode

I am looking to use the Kryo serialization library (https://github.com/EsotericSoftware/kryo) with Pivotal Gemfire 8.x onwards. However, there is not much information available on how to do that. If anyone has a code/config snippet to show how to…
jcools
  • 71
  • 4
0
votes
1 answer

Spark Kryo Registrator

I'm using kryo as serializer in spark 2.1 I have set registration as required but I have facing a problem, I can't register this…
Angel F O
  • 76
  • 6
0
votes
2 answers

Unable to load class exception during Kryo deserialization

I am using Kryo for serialization / deserialization and not registering classes beforehand (I am working on that). That said, upon deserialization, I am getting the exception: Unable to load class shell.api.model.BatteryStatuo with kryo's…
Walter
  • 1,290
  • 2
  • 21
  • 46
0
votes
1 answer

com.esotericsoftware.kryo.KryoException: Class cannot be created (missing no-arg constructor): scala.Tuple2

I can't go through the simplest example of serialization using Kryo on scala. Do i need to register a specific serializer for this? thanks val kryo = new Kryo() kryo.setRegistrationRequired(false) kryo.register(classOf[scala.Tuple2[Any,…
Jeff Saremi
  • 2,674
  • 3
  • 33
  • 57
0
votes
1 answer

(Scala) Recognize the type a serialized object by Kryo which is sent through network using UDP

Currently I am having a problem of recognizing a receiving serialized object which is sent through network using UDP. I have an abstract class called MsgType: sealed abstract class MsgType case class Msg(message : String) extends MsgType case class…
Lup
  • 27
  • 5
0
votes
1 answer

Import Twitter/chill to Scala code using Intellij IDE

I have to do some assignments with Scala and I'm a newbie for this language. In the assignment, the prof requests me to implement serialization and deserialization, using twitter/chill. https://github.com/twitter/chill/ However, I don't know how to…
Lup
  • 27
  • 5
0
votes
1 answer

Apache spark - what happens if you incorrectly spell properties

I am modifying default properties in Apache spark. I spin the clusters using EMR on AWS. However, I am setting properties, and unsure how to check if my new configurations are replacing the default configurations. As an example, I want to modify…
javid
  • 339
  • 4
  • 14