Stack Overflow
Stack Overflow

Questions tagged [confluent-schema-registry]

Schema Registry provides a store, backed by Kafka, for storing and retrieving Avro schemas. It also provides Avro serializers for Kafka clients.

Schema Registry is part of Confluent Open Source Stream Processing Platform.

It provides a serving layer for your metadata. It provides a RESTful interface for storing and retrieving Avro schemas. It stores a versioned history of all schemas, provides multiple compatibility settings and allows evolution of schemas according to the configured compatibility setting. It provides serializers that plug into Kafka clients that handle schema storage and retrieval for Kafka messages that are sent in the Avro format.

1076 questions
0
votes
0 answers

com.google.gson.internal.LinkedTreeMap cannot be cast to com.google.gson.internal.LinkedTreeMap

I have written a java class to retrieve schema from schema registry using feignHttp. Above exception is thrown when I try to retrieve a schema. Client class: import com.google.gson.internal.LinkedTreeMap; import feign.Feign; import…
Shenzo
  • 31
  • 4
0
votes
2 answers

On KafkaProducer.send(message), I am getting "exception Error serializing Avro message"

I am using Avro to generate class. Here is my code in producer looks like TweetInfo tweetInfo = TweetInfo.newBuilder() .setTweetId(status.getId()) .setTweetCreatedAt(status.getCreatedAt().toString()) …
BountyHunter
  • 89
  • 2
  • 10
0
votes
1 answer

Schema Registry - Confluent AvroSerializer/AvroDeserializer

Based on the my understanding Producer : In First call local cache of Schema registry is empty.Then schema related to the object definition to serialize is loaded. then produces looks in the local cache to check whether the schema correspondant…
Karthikeyan Rasipalay Durairaj
  • 1,920
  • 13
  • 35
0
votes
1 answer

Schema Registry VS Different Topic Handling

What is the downside of handling a breaking contract change, which can adversely affect some of the consumers on the same pipeline [i.e. producer, topic, consumer tuple], through different topic altogether? Or use a flattened Object structure that…
Divs
  • 1,578
  • 2
  • 24
  • 51
0
votes
1 answer

amazon athena and confluent schema registry

We are planning to offload events from Kafka to S3 (e.g via using kafka connect). The target is to spin up a service (e.g. like amazon Athena) and provide a query interface on top of the exported avro events. The obstacle is that amazon Athena avro…
Vassilis
  • 914
  • 8
  • 23
0
votes
0 answers

Schema Registry for a 3 Node Kafka Cluster with SSL

I am configuring a 3 node Kafka Cluster ( 3 brokers and 3 zookeepers with SSL enabled) using docker. Now I need to set up a schema registry. If I just need to use one schema registry is it possible? If Yes how does my SSL trust store and key store…
Krishnakanth Jc
  • 183
  • 1
  • 14
0
votes
0 answers

Kafka state store returns null when using Avro

We have a kTable where we map the values and materialize to KeyValueStore using the following code: @Bean public KTable kTable(StreamsBuilder kStreamBuilder, …
Thiru
  • 2,541
  • 4
  • 25
  • 39
0
votes
1 answer

KafkaProducer is always picking localhost:8081 for schema registry in Java API

KafkaProducer is not able to pick schema.registry.url defined in its properties . As we can see in following screenshot , the schema registry url is a dummy url // variable which is being debugged private KafkaProducer…
Divyanshu Jimmy
  • 2,542
  • 5
  • 32
  • 48
0
votes
0 answers

Kafka avro console consumer is not displaying any messages from kafka connect

Steps followed Installed/extracted confluent 5.0.0.-2.11 Modified kafka-connect-jdbc/source-quickstart.properties to point to my local db…
suseelkumar annamraju
  • 33
  • 4
0
votes
2 answers

org.apache.kafka.connect.errors.DataException: Invalid JSON for array default value: "null"

I am trying to use the confluent Kafka s3 connector using confluent-4.1.1. s3-sink "value.converter.schema.registry.url": "http://localhost:8081", "value.converter": "io.confluent.connect.avro.AvroConverter", "key.converter":…
Ayush Chauhan
  • 441
  • 7
  • 25
0
votes
1 answer

Does confluent-4.1.1 supports nested avro with ksql cli?

I am working on confluent-4.1.1 with ksql cli. Can I create stream for nested avro data format in this version as i tried with version-5 and it was working fine but no useful link found where mentioned about nested avro schema in confluent-4.1.1 I…
Ritu
  • 21
  • 5
0
votes
0 answers

Understanding Schema ID allocation in Confluent Schema Registry

I am trying to understand how globally unique UUIDs are generated for schemas in schema registry but fail to understand the following text present on this page. Schema ID allocation always happen in the master node and they ensure that the Schema…
Viraj
  • 777
  • 1
  • 13
  • 32
0
votes
1 answer

Problems with Avro deserialization in Kafka sink connectors

I'm trying to read data from DB2 using Kafka and then to write it to HDFS. I use distributed confluent platform with standard JDBC and HDFS connectors. As the HDFS connector needs to know the schema, it requires avro data as an input. Thus, I have…
D.M.
  • 131
  • 1
  • 4
0
votes
0 answers

Is CachedSchemaRegistryClient thread safe?

As far as I can tell by looking at the code, this class seems thread safe, with synchronized in the right place. But there's no comments/javadoc so it's not very explicit. I'm wondering if it's safe to use one instance per schema registry…
0x26res
  • 11,925
  • 11
  • 54
  • 108
0
votes
0 answers

Exception in serializing AVRO data with schema

I have registered the schema under subject called physics in the schmema registry. curl -X POST \ http://localhost:8081/subjects/physics/versions \ -H 'accept: application/vnd.schemaregistry.v1+json' \ -H 'cache-control: no-cache' \ -H…
tryingSpark
  • 143
  • 2
  • 15
1 2 3
…
71 72