Stack Overflow
Stack Overflow

Questions tagged [kafka-topic]

202 questions
0
votes
1 answer

I want to validate if the created topic name is in the specified format like [a-z]*_[1-2]* in kafka when creating in terminal, how to achieve this?

bin/kafka-topics.sh --create --topic topic name --bootstrap-server localhost:9092 in here, I wanted to check if the topic name is in the format -[a-z]_[0-9]. Example: topic name - demo_123
Supriya Pasupuleti
  • 3
  • 2
0
votes
1 answer

Ordering guarantees in Kafka in case of multiple threads

As far as I understand both Kafka Producer and Consumer have to use a single thread per topic-partition if we want to write / read records in an order. Am I right or maybe they use multiple threads in such situations?
I.D.M
  • 57
  • 8
0
votes
3 answers

How to send none values (tombstones) to a kafka topic using Faust

I'm trying to send data from one topic in Kafka to another using Faust. If the value in the original topic is None (the message is a tombstone), I'm sending the current key with a None value to the target topic. async def order_delete(key,…
Dmitriy Fedotov
  • 1
0
votes
0 answers

Modified request-reply pattern with dynamic Kafka topics

In my current project, I implemented a Kafka consumer using the poll mechanism directly instead of @KafkaListener. My question is: Can I dynamically create both a request and a reply topic in the runtime by parsing the request body data? If such a…
Mel
  • 13
  • 5
0
votes
1 answer

The broker does not support INCREMENTAL_ALTER_CONFIGS

When trying to alter a docker container kafka topic retention.ms (in order to purge it) I am encountering this error: Error while executing config command with args '--bootstrap-server localhost:9092 --entity-type topics --alter…
Tom Carmi
  • 385
  • 1
  • 5
  • 18
0
votes
1 answer

Kafka topic purge programmatically

I tried to purge Kafka topic from Java as below by setting retention time to 1sec and then returning back to original value. But the the messages were not deleted from topic. What is wrong? Map> altConf =…
Benzion
  • 25
  • 3
0
votes
0 answers

Kafka consumer denied to receive message after 4 days

I have created 4 topics in Kafka consumer. It was receiving data(message) only for within 4 days, after some couple of days unable to receive any data. I am also checking producer it successfully sending data. When i am creating new topic and assign…
Bimal Kumar Dalei
  • 196
  • 5
  • 14
0
votes
0 answers

Persistent kafka topic configuration settings

I am trying to setup some persistent data kafka topics where none of the messages expire so I can do backfills and run ksqldb. I understand that retention.ms set to -1 is the most important parameter but could anyone suggest any other settings that…
robcxyz
  • 68
  • 1
  • 6
0
votes
0 answers

Becoming a Kafka Consumer with Kerberos

I'm new to Apache-kafka and I'm involved in a project where I have to setup a Kafka Consumer in RHEL7. The goal is to subscribe into topics in an external server. I installed Apache Kafka and set up a sample producer and a sample consumer, both…
dab92
  • 155
  • 8
0
votes
1 answer

Kafka Streams Internal Topics Redirection

Currently working with Kafka Streams to aggregate events in a client's system. When running our prototype with fake events, everything works perfectly. However, when using actual data, we noticed that in the process of aggregation, Streams…
Lauren A.
  • 11
  • 3
0
votes
1 answer

Kafka-producer duplicate check

How can I verify duplication of messages in a particular topic? I have producer which sends messages to topic and consumer consumes those messages. so I wnt to verify that the messages consumed by consumer are not duplicated.
Pinky
  • 15
  • 1
  • 5
0
votes
1 answer

Topics per entity in kafka

Trying to design a service that can take order requests and start the transportation process for those orders. Trying to do these in an event-driven way. So the service of the order will emit a transport request event but I am not able to figure out…
Ak67
  • 1
0
votes
1 answer

Send multiple oracle tables into single kafka topic

I'm using JDBC source connector to transfer data from Oracle to Kafka topic. I want to transfer 10 different oracle tables to same kafka topic using JDBC source connector with table name mentioned somewhere in message(e.g: header) . Is it possible?
Sugaan
  • 43
  • 5
0
votes
1 answer

Sustaining node failure in Kafka cluster

If we have 3 brokers in a cluster with replication factor as 3, how many nodes failure can it sustain. If my understanding is correct, then there will be a leader and 2 followers on 2 brokers. So, does it mean that, the cluster can sustain 2 node…
zilcuanu
  • 3,451
  • 8
  • 52
  • 105
0
votes
2 answers

Error while Deserializing object when sending to Kafka topic

I am new to Kafka. I am trying to send a message to Kafka topic which contains header and payload. Below is the error: "org.apache.kafka.common.errors.SerializationException: Can't convert value of class com.cabservice.request.CabLocationPayload to…
Srikanth Sridhar
  • 2,317
  • 7
  • 30
  • 50
1 2 3
…
13 14