An Apache Kafka Binder for Spring-Cloud Streams.
Documentation: https://cloud.spring.io/spring-cloud-stream-binder-kafka/spring-cloud-stream-binder-kafka.html
Related:
Questions tagged [spring-cloud-stream-binder-kafka]
472 questions
1
vote
1 answer
How to enable Stateful Retry using spring-cloud-stream-binder-kafka and RetryTemplate?
I am wondering if there is a way to enable Stateful RetryTemplate using spring-cloud-stream-binder-kafka.
I noticed that there is a constructor
RetryingMessageListenerAdapter(MessageListener messageListener, RetryTemplate retryTemplate,…
jskim1991
- 40
- 1
- 5
1
vote
0 answers
Serialize/Deserialize generic types in Spring Cloud Kafka Streams
The main purpose is to read a stream from a topic, apply some transformations and then send two events to other topics. For that we are using Kstream.branch() function and using functional style programming. The code is:
Input…
Nuno Ferreira
- 23
- 6
1
vote
1 answer
Spring Cloud Function and Kafka
I'm struggling to understand how I should go about testing an application that makes use of Kafka Binder while also using Spring Cloud function.
Let's use this very simple example:
@SpringBootApplication
public class DemoKafkaApplication {
public…
nmarques
- 151
- 12
1
vote
1 answer
Caused by: com.fasterxml.jackson.databind.exc.InvalidDefinitionException: No serializer found for class org.springframework.core.convert.support.Defa
I am working on Spring Cloud Stream Apache Kafka example. I am developing code taking reference from : https://www.youtube.com/watch?v=YPDzcmqwCNo.
org.springframework.messaging.MessageDeliveryException: failed to send Message to channel 'pvout';…
PAA
- 1
- 46
- 174
- 282
1
vote
1 answer
when using @StreamListener, customization to KafkaListenerContainerFactory are getting reflected in generated KafkaMessageListenerContainer?
I am using spring-cloud-stream with kafka binder to consume message from kafka . The application is basically consuming messages from kafka and updating a database.
There are scenarios when DB is down (which might last for hours) or some other…
seeker27
- 117
- 1
- 3
- 13
1
vote
1 answer
how to set concurrency (or other configurations) for ConcurrentKafkaListenerContainerFactory per StreamListener
We have scenario where our application(spring boot, spring-cloud-stream based) listens to multiple Kafka topics (TOPIC_A with 3 partitions, TOPIC_B with 1 partition,TOPIC_C with 10 partitions) i.e. 3 @StreamListener methods.
…
seeker27
- 117
- 1
- 3
- 13
1
vote
1 answer
Spring cloud stream: multiple binder for Kafka Producer and Consumer with separate jaas configuration doesn't work together
I am trying to implement Kafka consumer and Kafka producer within same Spring boot application using spring cloud and binder. Both run successfully if executed separately, but if executed together only Kafka Producer is able to connect successfully…
jitin sharda
- 31
- 1
- 5
1
vote
0 answers
reliable async batch kafka producer using spring cloud stream
i want to setup some transformation (consume from one topic, produce to another) using spring cloud stream. also i want it to be
reliable - lets say 'at least once'
fast produce - perform producer.flush() once per batch, not per message
fast…
avalyaev
- 33
- 6
1
vote
1 answer
num.stream.threads creating idle threads
I have a spring boot kafka stream application with 2 topics consider topics A and B.Topic A has 16 partition and Topic B has 1 partition.Consider the application is deployed in 1 instance having num.stream.threads=16.
I ran kafka-consumer-groups.bat…
Vijaya
- 157
- 1
- 16
1
vote
2 answers
Is there an option to configure num stream thread for specific topic(s) instead of all?
In our application we have multiple topics where some topics will be created with 16 partition and some topics will be created with 1 partition. Is there any spring.cloud.stream.kafka.bindings property/option available to achieve this?
Kathirvel Subramanian
- 666
- 8
- 15
1
vote
1 answer
No DB commits after message consumption in Spring cloud stream Azure Event Hub binder
I have an event listener Spring boot application which performs the operation Read from Azure Event Hub Topic -> Persist the event into DB.
I used the spring-cloud-azure-eventhubs-stream-binder(Version - 1.2.1)'s Sink to listen for events from my…
Maalai
- 61
- 5
1
vote
1 answer
Spring Cloud Stream (Hoxton) Kafka Producer / Consumer not working in integration tests with EmbeddedKafka
I have a working application that uses the latest update for Producers that came with Hoxton. Now I'm trying to add some integration tests, asserting that the Producer is actually producing a message as expected. The problem is, the consumer I use…
codependent
- 23,193
- 31
- 166
- 308
1
vote
1 answer
java.lang.ClassCastException: class .$Proxy143 cannot be cast to class .MessageChannel (... are in unnamed module of loader 'app')
I am writing the tests for a Spring Cloud Stream application. This has a KStream reading from topicA. In the test I use a KafkaTemplate to publish the messages and wait for the KStream logs to show up.
The tests throw the following…
codependent
- 23,193
- 31
- 166
- 308
1
vote
0 answers
Sleuth with Spring Cloud Stream Binder Kafka Streams
I have the following functional style topology:
1) KStream input
2) filter
3) flapMap
4) aggregate
5) filter
6) map
7) KStream output
The input KStream comes with sleuth headers, but they get lost in the kafka stream.
FlapMap split one record into…
Javier Gonzalez Benito
- 354
- 2
- 7
1
vote
1 answer
Spring Cloud Stream 3.0 with kafka consumer in batch mode fetches single record in list instead of more
Trying to consume kafka messages in batch mode using Spring Cloud Stream 3.0.
Consumer receives a list containing single record, instead of more.
below is the yml , consumer coded used
spring:
cloud:
stream:
bindings:
…
user991444
- 11
- 1
- 4