An Apache Kafka Binder for Spring-Cloud Streams.
Documentation: https://cloud.spring.io/spring-cloud-stream-binder-kafka/spring-cloud-stream-binder-kafka.html
Related:
Questions tagged [spring-cloud-stream-binder-kafka]
472 questions
0
votes
1 answer
Kakfa message is committed before database transaction
I could not make spring-cloud-stream-binder-kafka work for following use case:
Start @transaction (Rest controller)
DB update/inserts
Send Kafka message
Before the transaction has committed, the consumer (configured with @EnableBinding and…
santhosh
- 33
- 1
- 5
0
votes
2 answers
Unable to set serde, producer and consumer properties per topic/binder level in spring cloud kafka
I'm trying to bring up simple pub-sub application using spring cloud kafka binder. However I'm unable to set Serializer, DeSerialzer property and other producer and consumer properties in application.yml. I consistently get…
Karthik Prasad
- 9,662
- 10
- 64
- 112
0
votes
1 answer
Materialize KStream into a globally shared store?
I am using the Kafka Streams API in a Java application (Spring Cloud Stream). I have a particular use case, as follows:
My application will consume from topic A, and produce and consume to/from topic B.
For each message on topic A there is a set of…
Boon
- 1,073
- 1
- 16
- 42
0
votes
1 answer
Why doesn't KStreamBinder have a lifecycle for DefaultBinding?
I'm using KStream parameter in @StreamBuilder.
This will create a DefaultBinding through KStreamBinder.
My requirement is to use Binding visualization and control.
However
return new DefaultBinding <> (name, null, outboundBindTarget, null);
You…
jaehun.lee
- 3
- 1
0
votes
1 answer
Kafka stream state store rocksdb file size not decreasing on manual deletion of messages
I am using processor api to delete messages from state store. Delete is working successfully, i confirmed by using interactive queries call on state store by kafka key, but it does not reduce the kafka streams file size on local disk under directory…
R K
- 382
- 5
- 25
0
votes
1 answer
Spring Cloud Stream - query topic without consuming a KTable/KStream explicitly?
I'm using Spring Cloud Stream library in a Java application. I want to use the Kafka Streams binder for a state store. The application will post messages to a topic, and I wish to use the Kafka Streams InteractiveQueryService to retrieve data from…
Boon
- 1,073
- 1
- 16
- 42
0
votes
1 answer
Aggregation (summation) of number of events from different Kafka topics
My application has three topics that receive some events belonging to users:
Event Type A -> Topic A
Event Type B -> Topic B
Event Type C -> Topic C
This would be an example of the flow of messages:
Message(user 1 - event A - 2020-01-03)…
codependent
- 23,193
- 31
- 166
- 308
0
votes
1 answer
Spring cloud stream branch stream not working as expected
Below is the code for branching, it streams to only one topic (the first one). As I understand, it should stream to all three topics?
Anyway I can stream to three topics using branch?
@Bean
public Function,…
jka
- 77
- 2
- 8
0
votes
1 answer
Kafkalistener as serverless or functional
We have a Kafka listener consuming messages from topic. We want to make this bean as functional so we can spin up multiple instances of function using server less architecture when there is heavy load. Can anyone show me a right direction
nani21984
- 911
- 2
- 13
- 21
0
votes
1 answer
What is a Sink in springframework.cloud.stream.messaging package?
The application i am running, would behave as a consumer in kafka streams. I have kafka messaging configured via spring's stream.
How to figure out whether its consuming from the right topic?
Also whats is SINK in…
Nilotpal
- 3,237
- 4
- 34
- 56
0
votes
1 answer
KafkaConsumer not polling all messages
I have a code similar to the one below:
KafkaConsumer kafkaConsumer = new KafkaConsumer<>(properties);
partitions = Collections.singletonList(new TopicPartition(topic,…
Sandeep G
- 13
- 4
0
votes
1 answer
spring cloud stream kafka KTable as input not working
Spring Cloud Stream Kafka, KTable as input not working
Sink.java
public interface EventSink {
@Input("inputTable")
KTable inputTable();
}
MessageReceiver.java
@EnableBinding(EventSink .class)
public class MessageReceiver {
…
Pratap A.K
- 4,337
- 11
- 42
- 79
0
votes
2 answers
Sping Cloud Stream Kafka - Consume messages in batch mode and send out as single processed messages
I try to prepare our application for the next Spring Cloud Stream release. (currently using 3.0.0.RC1).
Using the Kafka Binder.
Right now we receive one message, process it and resend it to another topic. Handling each message separately results in…
lbernau
- 1
- 1
0
votes
1 answer
Spring Cloud Stream/Function: Kotlin lambdas without the use of Java Function/BiFunction
I have a Kafka stream processing application written using Spring Boot, using spring-cloud-function and spring-cloud-stream-binder-kafka-streams. The method which processes a couple of streams is annotated with @Bean, so that it should be picked up…
Yoni Gibbs
- 6,518
- 2
- 24
- 37
0
votes
2 answers
How to send only custom Header using spring cloud stream
I have to set a custom header in the kafka message, my kafka cluster natively supports headers (1.x.x). I am currently using springCloudVersion=Finchley.RELEASE.
When I am setting property
default:
producer:
headerMode: none
None of the…
so-random-dude
- 15,277
- 10
- 68
- 113