An Apache Kafka Binder for Spring-Cloud Streams.
Documentation: https://cloud.spring.io/spring-cloud-stream-binder-kafka/spring-cloud-stream-binder-kafka.html
Related:
Questions tagged [spring-cloud-stream-binder-kafka]
472 questions
0
votes
1 answer
Spring cloud stream handling poison pills with Kafka DLT
spring-boot 2.5.2
spring-cloud Hoxton.SR12
spring-kafka 2.6.7 (downgraded due to issue: https://github.com/spring-cloud/spring-cloud-stream-binder-kafka/issues/1079)
I'm following this recipe to handle deserialisation errors:…
Kinght007
- 59
- 1
- 10
0
votes
1 answer
Spring Cloud Stream + Kafka enable.auto.commit
I have a project that I've upgraded to a recent version of spring boot and spring cloud and noticed some unexpected behaviour.
spring-boot: 2.5.2
spring-cloud 2020.0.3
Also worth noting, I have downgraded spring-kaka due to issue…
Kinght007
- 59
- 1
- 10
0
votes
2 answers
Kafka topic is not doing load balance for springboot consumer applications
I am new to KAFKA and would like help
I have a topic XXXX and I have some applications consuming this topic, all listening to the same…
Peter Parker
- 91
- 1
- 10
0
votes
0 answers
Kafka Stream app goes down when one of the broker goes down and other brokers are running
We have a Kafka Stream app using Spring Cloud Stream connecting to 3 brokers with replication factor 3 using AWS MSK.
Now there is a regular patching once in every month where at a time only single broker is down. But the Kafka stream app goes down…
DEEPAK R.L.
- 19
- 2
0
votes
1 answer
Spring Cloud Stream Kafka Binder KafkaTransactionManager results in a cycle in application context
I am setting up a basic Spring Cloud Stream producer with Kafka. The intent is to accept a HTTP POST, save the result of the post to a database with Spring Data JPA, and write the results to a Kafka topic using Spring Cloud Stream Kafka Binder. I…
Bert S.
- 155
- 2
- 12
0
votes
1 answer
Spring Cloud Stream Kafka - How to handle exceptions in batch mode
For my kafka batch consumer there are two types of situations I would like to handle.
Deserialization exceptions that occur before the listener has received the records. Not much point retrying these, just send straight to DLQ.
Exceptions that…
Adam
- 1
- 1
0
votes
0 answers
Spring Cloud Stream PAUSE/RESUME Kafka binders
In the Spring Cloud Stream application with Kafka binders, I am trying to PAUSE/RESUME the input binders. I searched and all of those sample solutions suggest using…
Swapnil
- 801
- 3
- 19
- 42
0
votes
1 answer
Can we use spring cloud stream kafka with spring web application?
I have seen lots of examples in the internet spring cloud stream kafka. But most of them don't use it as a web application. It's just a application as a consumer. I want to know that, If i use the spring cloud stream kafka in my web application, is…
Mafei
- 3,063
- 2
- 15
- 37
0
votes
1 answer
Is multiple brokers possible in one Kafka Streams Topology(Spring Cloud Stream)?
We have a topology reading from input topic (with binder: x - broker address: x) and the records are processed and written to output topic (with binder: y - broker address: y) using spring cloud stream kafka streams. Records are not written to…
omerstack
- 535
- 9
- 23
0
votes
1 answer
An attempt was made to call a method that does not exist: ContainerProperties.setAckOnError()
I am developping a simple spring boot application using spring cloud stream and kafka.
I get this error when I added kafka consumer bean.
Spring boot version: 2.5.0
Spring cloud version: 2020.0.3-SNAPSHOT
Kafka client version: 2.7.1
Error log:
An…
Amir Choubani
- 829
- 2
- 14
- 28
0
votes
0 answers
Spring Cloud Stream Kafka: How to delay sending a message in a method annotated with @Transactional
I need the producer to send messages to the topic after the completion of the method annotated as @Transactional, and if an exception is thrown in the method, the message should not be sent to the topic (or rolled back before the consumer reads…
pickstar
- 21
- 5
0
votes
1 answer
Spring Cloud Stream: Are commit calls guaranteed to happen after method annotated @StreamListener("errorChannel") if enableAutoCommitOnError=true?
Consider I have set SCS property enableAutoCommitOnError=true (and enableAutoCommitOffset=true and ackEachRecord=true as well)
And I have a method that listens for errors as follows:
@StreamListener("errorChannel")
public void…
NinjaTurtle
- 93
- 1
- 6
0
votes
1 answer
what is the use of the property spring.cloud.stream.bindings..consumer.partitioned
What will happen If partitionCount (spring.cloud.stream.bindings..producer.partitionCount) is greater than 1 and consumer.partitioned (spring.cloud.stream.bindings..consumer.partitioned) is false (Using Kafka)
shagun
- 63
- 1
- 5
0
votes
1 answer
How spring-cloud-stream Kafka Reactive stream partition assignment working with concurrent processing
For example, I configure a topic have 2 partitions, but in my application with 1 instance, I use Flux.parallel(10) to consume the message, and it has 1000 message lag on that topic, what will happen?
Will it poll 10 messages per time? from 2…
Toffee Lu
- 103
- 2
- 8
0
votes
1 answer
Spring Cloud Stream Kafka Binder Health Indicator is Failing when Auto-commit is true
We are building the custom DB Sink with Spring cloud stream using Kafka binders. We are using following versions of Spring Cloud and Spring Boot…
