Questions tagged [kafka-join]
21 questions
0
votes
1 answer
What is the best approach to merge two events from same topic using Kafka Streams Api?
I am new to kafka streams and i have the following scenario. There is a topic that contains records of type Event some of them are additional info of the actual Event (something like an update). Those two records are generated almost at the same…
mharis
- 1
0
votes
1 answer
Kstream-Kstream join based on common field
We want to do Kstream-Kstream join based on the common Field(primary key). Currently with the below code we are getting result as just merging 2 Streams without any primary key constraint.
val userRegions: KStream[String, String] =…
0
votes
1 answer
Does KTable and KStream join publish a new record when there's an update on KTable?
I've implemented a KTable and a KStream join in my application and expecting output messages in the following cases;
A new message in KStream and there's a matching record in the KTable
An updated message came in KStream and there's a matching…
J.GS.Han
- 117
- 1
- 9
0
votes
1 answer
Kafka KStream to KStream join | restart performance
I'm planning on joining two topics as KStreams over a long window (~1week). Assuming there will be hundreds of millions of records accumulated in this window, how long will the joining consumer take to restart? I'm asking this because I was unable…
Atom
- 616
- 1
- 5
- 14
0
votes
1 answer
Kafka Streams join by key with complex condition
I'm trying to join KStream with GlobalKTable by key, but with specific logic.
StreamsBuilder builder = new StreamsBuilder();
KStream stream = builder.stream(inputTopic1); // key = "ABC"
GlobalKTable…
Nementaarion
- 222
- 2
- 13
0
votes
1 answer
KStream to KTable Left Join Returns Null
I am currently trying to use a KStream to KTable join to perform enrichment of a Kafka topic. For my proof of concept I currently have a Kafka Stream with about 600,000 records which all have the same key and a KTable created from a topic with 1…
mattdonders
- 1,328
- 1
- 19
- 42