Questions tagged [confluent-cloud]
154 questions
1
vote
1 answer
Cannot create new kafka topic in confluent cloud
I'm trying to create a new kafka topic in confluent cloud, but it gives me an 'authorization failed' error.
hellosongi
- 19
- 3
1
vote
1 answer
configure prometheus service monitor for external services like confluent cloud kafka
I'm trying to configure prometheus service monitor to fetch confluent cloud(kafka) metrics.
According to their documentation…
santosh.a
- 503
- 5
- 20
1
vote
1 answer
Kafka MicrosoftSqlServerSource Connect - Duplicate entries in topic
We have a requirement to set up Kafka MicrosoftSqlServerSource connect.
This is to capture all the transactions(insert/update) performing in one of the sales table in Azure SQL database.
In order to bring the support for the above source connect,…
user19196595
- 11
- 1
1
vote
1 answer
Kafka How to not move offset until message processing is succeeded
We are reading messages from a Kafka-topic. I was under the (false) impression that by setting the EnableAutoOffsetStore/enable.auto.offset.store = false you, as a consumer could choose when you wanted to move the offset.
We were using this like…
Cowborg
- 2,645
- 3
- 34
- 51
1
vote
1 answer
Confluent CLI commands to fetch offset and consumer group details
Hi I am looking for a confluent cli command to use GetOffsetShell to get the earliest and latest offsets and to get consumer group details.
Looking for Confluent cli commands for below kafka commands,
Fetching offset…
Sindhu Raju
- 183
- 1
- 12
1
vote
2 answers
Authenticate Kafka CLI with Kafka running on Confluent
I'm having a Kafka cluster running on Confluent Cloud but I'm not able to reset the commit offset from the UI. Hence, I'm trying to do it via Kafka's CLI as below:
kafka-consumer-groups --bootstrap-server=my_cluster.confluent.cloud:9092…
knl
- 969
- 11
- 35
1
vote
1 answer
How to allow push queries to be streamed continuously/ for more than ten minutes at a time?
I am working on a java consumer for ksqlDB, that uses PULL and PUSH queries.
Currently, a single push query may be streamed for a maximum of ten minutes at a time, after which the server closes the connection if consumer is idle. Even if there is a…
Sheetal Shivagunde
- 61
- 1
- 8
1
vote
1 answer
Unable to provision Confluent Cloud Kafka cluster with PrivateLink using ccloud CLI?
I am trying to provision a dedicated Kafka cluster using the ccloud CLI (version 1.38.0), but I don't see the option to create a privatelink in the ccloud kafka create cluster command:
Examples:
Create a new dedicated cluster that uses a…
tintin
- 5,676
- 15
- 68
- 97
1
vote
1 answer
Managing Quota In Kafka Confluent Cloud
I've been reading the documentation on Confluent Cloud (Not the Confluent Platform) and couldn't find a way to manage network and request quotas.
Is this not supported in Confluent Cloud ?
psaw.mora
- 868
- 1
- 7
- 18
1
vote
1 answer
ProduceResponse from confluent cloud broker using confluent-kafka-python
This log is available with debug=all config in confluent-kafka-python producer client for confluent cloud.
How to parse ProduceResponse for rtt? Can it be done using on_delivery callback?
|RECV|rdkafka#producer-1|…
Darkwing Duck
- 11
- 1
1
vote
1 answer
How to expand confluent cloud kafka cluster?
I have set up a confluent cloud multizone cluster and it got created with just one bootstrap server. There was no setting for choosing number of servers while creating the cluster. Even after creation, I can’t edit the number of bootstrap servers.
I…
sd99
- 13
- 4
1
vote
1 answer
is transforms working in confluent.cloud(Kafka) to elastic cloud
I am creating the elastic sink connector in confluent.cloud(Kafka). here, if I use transforms, it is not working. will confluent.cloud(kafka) supports transforms?.
Below is my script,
{
"name": "ElasticConnectorTest5",
"config": {
…
bala n
- 61
- 6
1
vote
1 answer
Creating Elastic Sink Connector between Confluent.Cloud(Kafka) to Elastic Cloud
I am creating the sink connector between Confluent.Cloud(Kafka) and Elastic Cloud
The following details I have added there,
{
"name": "ElasticsearchSinkConnector_1",
"config": {
"topics": "sinktest",
"input.data.format": "AVRO",
…
bala n
- 61
- 6
1
vote
2 answers
org.apache.avro.AvroTypeException: Unknown union branch EventId
I am trying to convert a json to avro using 'kafka-avro-console-producer' and publish it to kafka topic.
I am able to do that flat json/schema's but for below given schema and json I am getting
"org.apache.avro.AvroTypeException: Unknown union…
MHegde
- 329
- 3
- 14
1
vote
1 answer
How to send Confluent cloud metrics to Datadog?
I want to get Confluent cloud metrics into Datadog so I followed the this instruction. Instead of using CCLOUD_USER: ${CCLOUD_USER} and CCLOUD_PASSWORD: ${CCLOUD_PASSWORD} I used CCLOUD_API_KEY and CCLOUD_API_SECRET as environment variables for the…
bramvdk
- 1,347
- 4
- 21
- 31