Questions tagged [avro-tools]
112 questions
0
votes
0 answers
Avro : Custom deserialiser for a field
I have an avro schema with below as one of the fields:
"name": "UUId",
"type": {
"name": "FixedBytesUUId",
"type": "fixed",
"size": 16
}
Now, when I deserialise a record with value "1234567891234567", it gets deserialised like…
Darshan Mehta
- 30,102
- 11
- 68
- 102
0
votes
1 answer
Cannot print Kafka Avro decoded message
I have a legacy C++ based system which spits out binary encoded Avro data that supports confluent Avro schema registry format. In my Java application, I successfully deserialized the message using KafkaAvroDeserializer class but could not print out…
cucucool
- 3,777
- 8
- 48
- 63
0
votes
2 answers
Generate Avro file based on java file
There are plugins that can generate java file using Avro schema. Is there a reverse of that? I would like to generate Avro schema based on java file.
RSM
- 423
- 3
- 7
- 20
0
votes
1 answer
Logstash avro output cannot be decoded by apache avro-tools
I am a beginner with both Logstash and Avro.
We are setting up a system with logstash as producer for a kafka queue. However, we are running into the problem that the avro serialized events produced by Logstash cannot be decoded by the avro-tools…
Joep van Genuchten
- 63
- 6
0
votes
1 answer
Data Conversion for a field using AVRO
I am new to AVRO. We have started using AVRO schema to read data.
Now we have a use case where I need to truncate the data while reading.
Suppose my avro schcema is like this
{
"name": "table",
"namepsace": "csd",
"type": "record",
…
user7538424
- 1
- 2
0
votes
1 answer
Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Cannot validate serde: org.apache.hadoop.hive.serde2.avro.AvroSerde
I am creating a hive table using avro serde to store twitter data.
Here's the code-
create table tweets
row format serde
'org.apache.hadoop.hive.serde2.avro.AvroSerde'
stored as inputformat
…
vinay
- 167
- 1
- 4
- 12
-1
votes
2 answers
Writing Invalid avro file: length is negative: -40
I'm attempting to write an avro file from python, for the most part following the official tutorial.
I have what appears to be a valid schema:
{"namespace": "example.avro",
"type": "record",
"name": "Stock",
"fields": [
{"name":…
Erty Seidohl
- 4,487
- 3
- 33
- 45