Pure JavaScript implementation of the Avro specification.
Pure JavaScript implementation of the Avro specification (https://github.com/mtth/avsc).
Questions tagged [avsc]
26 questions
0
votes
1 answer
Java - Dynamically Change Kafka Data Type By Input for SpecificAvroSerde
import KafkaDataType;
...
...
final Serde eventSchema = new SpecificAvroSerde<>();
...
...
StreamsBuilder builder = new StreamsBuilder();
KStream eventStream = builder.stream(STREAM_TOPIC);
My KafkaDataType is…
NLI
- 3
- 4
0
votes
1 answer
Cannot generate class from avsc file using maven
I have a problem with generating classes from avsc files. In the pom.xml I added the appropriate dependencies:
org.apache.avro
avro
…
Paweł Bocian
- 3
- 3
0
votes
1 answer
How to deserialize avro schema message in node.js
I'm using kafka to receive data from the source, I'm working on the consumer app which is written in Node.js and using kafka-node to connect to kafka server. On other hand the producer is written in Java and they are using some kafka streaming…
Saurabh Sharma
- 804
- 6
- 16
- 42
0
votes
1 answer
Create a new avro schema using Kafka schema-registry API
I am trying to create a new schema using the kafka-schema-registery api. I followed the steps mentioned in this post. Register a new avro schema using Kafka schema-registry API
My Avro Schema:
{
"doc": "Sample schema to help you get started.",
…
user1912
- 35
- 1
- 8
0
votes
1 answer
How to generate Avro .avsc files in ANT build
I need to generate files from .avsc file (avro) in ANT build. I'm not sure what plugin should I use for this. I tried with xjc.XJC2Task for generating the files but it seem to not work. Can some one suggest what plugin / class should I use to…
Heisenberg
- 147
- 1
- 4
- 14
0
votes
1 answer
Register a new avro schema using Kafka schema-registry API
I am trying to create a new schema using the kafka-schema-registery api. below is the implementation :
let value = JSON.stringify(avroSchema);
let type= {"schema" : value};
fetch(`${process.env.SCHEMA_REGISTRY_URL}/subjects/${topic}/versions`,
…
programoholic
- 4,830
- 5
- 20
- 59
0
votes
1 answer
Spark: How to use Avro schema to create a dataset?
I have a set of avro files saved in aws S3 with known schema defined in a .avsc file. Is there a way to create a dataset of objects in spark with the schema defined?
The schema look like:
{
"type" : "record",
"name" : "NameRecord",
…
HLiu
- 1
- 1
0
votes
0 answers
Unable to convert RDD[Java Class] to Dataframe in spark scala
I have avro message and .avsc file. I have generated the java class from .avsc file. Now I want to convert the avro(json) message into data frame. I read the message. Successfully decoded the message and I got RDD[Product] but I am unable to convert…
lucy
- 4,136
- 5
- 30
- 47
0
votes
1 answer
Python - How to convert .txt/.csv file holding table schema to .avsc file
Need to extract table schema (using describe\list columns) into .txt or .csv file and later want to convert those files into .avsc(avro schema) file using python.
sample.txt:
COLUMN_NAME …
Prabhanj
- 262
- 2
- 3
- 16
0
votes
1 answer
Creating Avro Schema without Class(-Object)
At the moment i'm serializing a class to an avsc schema. This works pretty good:
DatasetDescriptor desc = new DatasetDescriptor.Builder().schema(ClassName.class).build();
But, I need to create an AVSC without any given class dynamically. Is this…
br0ken.pipe
- 850
- 3
- 17
- 32
-1
votes
1 answer
Handle common schema in avro while generating code using avro maven plugin
I am using avro maven plugin to generate java code for avro .avsc schema file, I have one common schema which is getting used at multiple places as separate record, when i give different namespace at each place, it is able to generate java code, but…
Amit Kumar
- 825
- 1
- 9
- 19