An Apache Kafka Binder for Spring-Cloud Streams.
Documentation: https://cloud.spring.io/spring-cloud-stream-binder-kafka/spring-cloud-stream-binder-kafka.html
Related:
Questions tagged [spring-cloud-stream-binder-kafka]
472 questions
1
vote
0 answers
Spring Cloud Stream Kafka Binder Async Producer error handling and handle retries
I am using Spring Cloud Stream Kafka Binder to produce message into Kafka. I have kept producer sync to false.
spring.cloud.stream.kafka.bindings..producer.sync: false
I faced one issue while producing asynchronously to Kafka, some…
Ranjit Meher
- 41
- 4
1
vote
1 answer
Configured group ID is ignored in spring-cloud-streams
The goal
I must setup a group id for the kafka stream consumer, that matches a strict naming convention.
I cannot find a way that works after having followed deeply the documentation. As I still believe that I may have misundersood something, I…
Danduk82
- 769
- 1
- 10
- 29
1
vote
1 answer
Why does Spring Cloud Stream with Kafka binder hash keys differently than a standard Kafka Producer?
I've run into a problem where I need to repartition an existing topic (source) to a new topic (target) with a higher number of partitions (a multiple of the number of previous partitions).
The source topic was written to using Spring Cloud Stream…
filpa
- 3,651
- 8
- 52
- 91
1
vote
1 answer
Error in startup application when using @ServiceActivator in Spring cloud Stream
I put @ServiceActivator to log all messages that gave error to kafka:
@ServiceActivator(inputChannel = "errorChannel")
public void handleErrors(final ErrorMessage in) {
log.error("encountered exception" + em.toString());
}
and I'm also setting…
victor hugo
- 85
- 1
- 1
- 8
1
vote
1 answer
spring cloud stream kafka binder retry
I have spring cloud stream application with kafka binder that consumes and send messages.
In application i configure custom error handler with retry policy, and add not retryable exception to handler. Configuration exaple:
@Bean
public…
Vichukano
- 99
- 8
1
vote
1 answer
KafkaMessageChannelBinder cannot be cast to class TestSupportBinder
In our project we are using the spring-cloud-starter-stream-kafka for consuming the messages from Kafka, after adding the @ComponentScan for "org.springframework.cloud.stream.binder.kafka" package, the integration tests started failing with the…
SANN3
- 9,459
- 6
- 61
- 97
1
vote
0 answers
Kafka binder: how to produce message in functional style
The manual describes well how to consume simple messages using java.util.function.Consumer and make a through processing in a single processor method with java.util.function.Function, but it isn't clear the way to produce a message…
meridbt
- 304
- 1
- 11
1
vote
1 answer
Spring Cloud Stream: consumer for different message types
With a StreamBridge I send messages with two different types of objects to a single Kafka topic.
Is there a way to define a functional consumer with Spring Cloud Stream capable of consuming both types of messages?
Gianni
- 35
- 4
1
vote
1 answer
Apache Kafka ProducerConfig internal.auto.downgrade.txn.commit isn't a known config
I'm not sure how to title this issue. But we have a Kafka producer project which has this warning show up on the logs.
o.a.k.clients.producer.ProducerConfig : The configuration 'internal.auto.downgrade.txn.commit' was supplied but isn't a known…
Matthew S
- 343
- 3
- 11
1
vote
1 answer
How to pass the *Customizer to a Spring Cloud Stream's binder context
I noticed several customizers in the KafkaBinderConfiguration, which we can pass to customize the binder. But in the case of multiple binders, the customizer beans won't be picked up. It may relate to this line in DefaultBinderFactory:
boolean…
Xiaolu Dai
- 21
- 3
1
vote
1 answer
spring kafka map headers differently for inbound vs outbound
we are using spring-kafka, and for non-spring apps that communicate with us that don't set the spring_json_header_types header, we are specifying that certain headers should be mapped in as Strings by adding them as rawMappedHeaders. We do this for…
superdupe
- 13
- 3
1
vote
1 answer
StreamBridge binding instead of EnableBinding and Output annotations which are deprecated since 3.1 version of Spring Cloud Stream
I have multiple APIs that talk with each other through kafka (produce and consume messages). In one of the APIs I produce messages based on an HTTP request trigger (when an endpoint is called, a meesage is produced and sent to kafka) with @Output…
Diana Fagateanu
- 11
- 1
- 3
1
vote
0 answers
How to process Kafka Stream using the custom timezone?
I'm trying to run my Kafka streams application under the "Asia/Istanbul" timezone. I'm not talking about the Timestamp extractor feature of Kafka streams. It means that I want to use windowing at different timezone. And after processing has been…
Kadir Alan
- 209
- 1
- 13
1
vote
1 answer
Using Spring Cloud Stream Kafka Streams with Avro input/output with nativeEncoding/decoding=false
We're testing the use of Kafka Streams via Spring Cloud Stream function support with Avro input/output records, but setting nativeEncoding=false and nativeDecoding=false in order to use a custom MessageConverter where we do the Avro conversion.
The…
José María Lora
- 29
- 4
1
vote
1 answer
Equivalent to ChannelInterceptor for Spring Cloud Stream Kafka Streams Binder
We develop an internal company framework on top of Spring Boot and we'd like to support Kafka-Streams with Spring Cloud Stream. We need to automagically inject some headers to all outbound messages. We've achieved this with standard Spring Cloud…
José María Lora
- 29
- 4