An Apache Kafka Binder for Spring-Cloud Streams.
Documentation: https://cloud.spring.io/spring-cloud-stream-binder-kafka/spring-cloud-stream-binder-kafka.html
Related:
Questions tagged [spring-cloud-stream-binder-kafka]
472 questions
1
vote
1 answer
Configuration of 'sasl.jaas.config' when you have 2 separate topics, each having separate connection key?
I am looking for instructions on the configuration of sasl.jaas.config when you have 2 separate topics, each having separate connection key? I am using spring-cloud-starter-stream-kafka version 3.1. I am not using…
djangofan
- 28,471
- 61
- 196
- 289
1
vote
1 answer
Accessing RecordMetadata in spring-cloud-stream-kafka binder: how to specify recordMetadataChannel
I am writing a Kafka Producer and Consumer using spring cloud stream Kafka binder. I want access to the following information in both the producer and consumer
a) Topic
b) Partition
b) Offset
I did check the documentation, and am not really able to…
Ani
- 11
- 1
- 2
1
vote
1 answer
Spring Cloud Stream Kafka send message
How can i send a message with the new Spring Cloud Stream Kafka Functional Model?
The deprecated way looked like this.
public interface OutputTopic {
@Output("output")
MessageChannel output();
}
@Autowired
OutputTopic outputTopic;
public…
Sven Weisker
- 13
- 3
1
vote
2 answers
How to Grab Auto-Generated KafkaTemplate in Spring Cloud Stream?
A few examples for implementing HealthIndicator needs a KafkaTemplate. I don't actually manually create a KafkaTemplate but the HealthIndicator requires one. Is there a way to automatically grab the created KafkaTemplate (that uses the…
TypicalTypingTom
- 49
- 3
1
vote
1 answer
How to apply retention time configuration for Dead Letter Queue in Spring Cloud Stream Kafka Binder?
I have an application using Spring Cloud Stream Kafka.
For user defined topics I can delete records from specified topics by giving the configuration I mentioned below. But this configuration doesn't work for DLQ Topics.
For example in the…
omerstack
- 535
- 9
- 23
1
vote
1 answer
Multiple ProducerIds are created when there are multiple instances of Producers
In the .yaml file, we have set
spring.cloud.stream.kafka.binder.configuration.enable.idempotence as true.
Now when the application starts up, we can see a log like
[kafka-producer-network-thread | test_clientId]…
Sandeep G
- 13
- 4
1
vote
1 answer
How to Properly Unit Test Dlq within Spring Cloud Stream
There's some native configurations like enableDlq within spring cloud stream kafka binder, but there's not any example's that i've found on how to properly unit test if the enableDlq is working properly. Are there any examples out there of how to…
TypicalTypingTom
- 49
- 3
1
vote
1 answer
Spring Cloud Stream Kafka Replication Factor and Retention Problem at Runtime
I have a spring boot project using Kafka. I configured it with Spring Cloud Stream Kafka auto configuration. I want to create my topics automatically with 3 replicas and 1 day retention. For this I added replication factor and retention.ms to my…
bugrayildirim
- 13
- 3
1
vote
0 answers
Kafka stream branching with type safety
We are currently developing a spring cloud stream application using kafka streams. (The problem seems to be not specific to spring cloud streams but to kafka streams)
Our processor needs to transform events from an incoming kstream and produces two…
user15327431
1
vote
1 answer
Unable to set GroupId in spring-cloud-stream-binder-kafka-streams:3.1.1
I am using spring-cloud-stream-binder-kafka-streams:3.1.1 with functional programming. I have tried a number of combinations to set GroupId but the Consumer is always printing GroupId as the spring.application.name.
pom.xml
user2459396
- 99
- 10
1
vote
1 answer
Spring cloud stream unexpected shutdown is not covered by DLQ
We are using Spring Cloud Stream 2.2 with the Kafka binder. Something we have noticed is if the pod is killed in the middle of doing the job for whatever reason, then we will miss the message to be sent to DLQ.
We are managing exceptions by catching…
Ali
- 1,759
- 2
- 32
- 69
1
vote
1 answer
Spring Cloud Stream - multiple functions
Is it possible to use 2 functions where the output of the first function it the input of the second one?
My functions:
@Configuration
public class StringStream {
@Bean
public Supplier> stringSupplier() {
return () ->…
Ben Keil
- 1,050
- 1
- 10
- 30
1
vote
1 answer
Only auto-create producer topics using spring cloud stream kafka streams binder
Is it possible to enable spring.cloud.stream.kafka.streams.binder.auto-create-topics in the application.yml only for topics that the application produces and not auto-create topics that the application consumes? I'd like for my producers to only be…
monker
- 110
- 1
- 7
1
vote
1 answer
How to delay initialization of Spring Cloud Stream StreamListener?
I have problem with StreamListener initializing. I can not solve my problem.
I am using Spring Cloud Stream Kafka and Spring Cache in my project. Spring Cache is initialized after SmartLifeCycle's start() method. But StreamListener starts consuming…
omerstack
- 535
- 9
- 23
1
vote
2 answers
Injected dependency in Customized KafkaConsumerInterceptor is NULL with Spring Cloud Stream 3.0.9.RELEASE
I want to inject a bean into the customized ConsumerInterceptor as ConsumerConfigCustomizer is added in Sprint Cloud Stream 3.0.9.RELEASE. However, the injected bean is always NULL.
Foo (The dependency to be injected into…
ChiGuy001
- 31
- 4