Questions tagged [kafka-streams-binder]
9 questions
1
vote
1 answer
Prevent key based repartitioning in kafka-streams
I have a slightly strange use case where our applications are not using standard kafka partitioning. Instead we have a custom partitioning strategy, where we use a specific field within a compound key to decide how to partition. This is generally…
M21B8
- 1,867
- 10
- 20
1
vote
0 answers
Consume Messages in Batches using KStreams
I have the following BiConsumer
@Bean
public BiConsumer, GlobalKTable> process() {
return (userEvent, shopEvent) -> {
userEvent
…
Olga Klassen
- 11
- 2
1
vote
1 answer
KStream-KStream leftjoin doesn't produce any value when the second matching value is not present
We have theses POJOs:
@Data
@NoArgsConstructure
@AllArgsConstructure
class MyPost {
private String content;
private SeenInfo seenInfo;
}
@Data
@NoArgsConstructure
@AllArgsConstructure
class SeenInfo {
private Integer seenCount;
…
Office Kafka
- 19
- 2
0
votes
0 answers
Spring cloud streams kafka unable to set session.timeout.ms property
I using spring boot (v2.5.1) and spring cloud (v2020.0.3). I have some kafka stream consumers in my service.
I am trying to set the session.timeout.ms property using application.property but am unable to do so.
I have tried setting the following…
Pinaki
- 473
- 1
- 3
- 14
0
votes
0 answers
Spring Cloud Streams Error Handling Not Working
There are so few examples of different methods of error-handling in spring cloud streams, and the few that are provided partially via the documentation don't seem to work either.
I have a test repository with multiple methods of error capture…
StevenPG
- 311
- 4
- 16
0
votes
0 answers
Access GlobalKTable via InteractiveQueryService in multiple bindings
I would like to create a service to access some reference data coming from Kafka in my kafka-streams applications using kafka-streams-binder via GlobalKTable and the InteractiveQueryService. That is quite easy when I add that GlobalKTable as an…
m-kay
- 260
- 1
- 11
0
votes
0 answers
Spring cloud kafka stream binder- Kafka Streams poll.ms
We are trying non blocking retry pattern in our kafka kstream application using spring cloud stream kafka binder library with the below configuration for the retry topics:
processDataRetry1:
applicationId: process_demo_retry_1
…
user21638404
- 1
- 1
0
votes
0 answers
Manually create spring cloud stream bindings based on dynamic configuration
I have a requirement where one or more spring cloud stream kafka-streams bindings need to be created based on dynamic configuration. By dynamic config I mean stream bindings (input-output) will be specified run-time. Either via external property…
Shades88
- 7,934
- 22
- 88
- 130
0
votes
1 answer
Why Kafka streams creates topics for aggregation and joins
I recently created my first Kafka stream application for learning. I used spring-cloud-stream-kafka-binding. This is a simple eCommerce system, in which I am reading a topic called products, which have all the product entries whenever a new stock of…
Prashant Bhardwaj
- 156
- 2
- 14