Serialize avro into Kafka using schema registry and spark

Asked Mar 18 '19 at 10:40

Active Mar 18 '19 at 16:19

Viewed 584 times

I want to serialize an Avro data into Kafka using Schema Registry, Spark SQL, Kafka and Avro.

I tried to utilize to_avro method that accepts only the column parameter. I want to utilize the schema registry to write into Kafka an Avro data. Schema registry normally returns an ID to identify an Avro schema.

Is there a solution to this problem?

edited Mar 18 '19 at 16:19

Ram Ghadiyaram

28,239
13
95
121

asked Mar 18 '19 at 10:40

mham

You are using which big data distribution platform ? – Rohit Yadav Mar 18 '19 at 10:57
No, I use just spark ! – mham Mar 18 '19 at 11:57
This will help you https://blog.xebia.fr/2018/10/25/spark-structured-streaming-avec-kafka-schema-registry/ – Rohit Yadav Mar 19 '19 at 18:07

Serialize avro into Kafka using schema registry and spark

0 Answers0