Stack Overflow
Stack Overflow

Questions tagged [spring-cloud-stream-binder-kafka]

An Apache Kafka Binder for Spring-Cloud Streams.

Documentation: https://cloud.spring.io/spring-cloud-stream-binder-kafka/spring-cloud-stream-binder-kafka.html

Related:

472 questions
0
votes
1 answer

Spring cloud stream kafka transaction configuration

I am following this template for Spring-cloud-stream-kafka but got stuck while making the producer method transactional. I have not used kafka earlier so need help with this in case any configuration changes needed in kafka It works well if no…
Amit Naik
  • 983
  • 1
  • 5
  • 16
0
votes
0 answers

Error in returning Generic Record in spring cloud stream

I am trying a transformer in spring cloud stream to consume a json and generate an avro schema record. Can you give me an idea as to what is the right way to right this? After following all the documentation I wrote the following transformer …
tsar2512
  • 2,826
  • 3
  • 33
  • 61
0
votes
1 answer

Integration testing for spring cloud stream, how to ensure application resources are not used

I'm trying to do some integration testing for my cloud streaming application. One of the main issues I'm observing so far is that the TestChannelBinderConfiguration keeps picking up the configuration specified in…
tsar2512
  • 2,826
  • 3
  • 33
  • 61
0
votes
1 answer

KafkaBindingRebalanceListener Bean not autowired with Multi-binder

There is another post about a similar issue. The accepted answer works well with a single top-level binder. But I don't have luck with multi-binder. Not sure I mess up something or this technique only supports a single top-level binder. Working YAML…
ChiGuy001
  • 31
  • 4
0
votes
1 answer

Fail to setup multiple bindings to the same destination and group on the consumer side using Spring Cloud Stream

I intend to setup multiple bindings for Kafka Consumer resiliency. More specifically, the backup listener has the same destination and group as the main listener expect the broker IPs. The backup listener's autoStartUp is turned off at startup, but…
ChiGuy001
  • 31
  • 4
0
votes
1 answer

Unable to send custom header using spring cloud stream kafka

I have two microservices written in Java, using Spring Boot. I use Kafka, through Spring Cloud Stream Kafka, to send messages between them. I need to send a custom header, but with no success until now. I have read and tried most of the things I…
Jose Luis Ojosnegros Manchon
  • 21
  • 3
0
votes
1 answer

spring cloud stream ibm qm binder implementation

is there a cloud stream ibm qm binder for spring cloud stream? I have seen this one https://github.com/spring-cloud/spring-cloud-stream-binder-ibm-mq but if I understand well, due to license constraints I must manually install the library (which is…
soung
  • 1,411
  • 16
  • 33
0
votes
1 answer

Spring Cloud Stream content-based routing on payload

We are using Spring Cloud Stream v2.2 with Kafka and Avro (native encoder/decoder). We are trying to use content-based routing based on a condition on the payload. I understand that according to Spring Cloud Stream docs content-based routing is only…
Ali
  • 1,759
  • 2
  • 32
  • 69
0
votes
1 answer

KeyValueStore.get() returns inconsistent results

stateStore.get() returns inconsistent results, when used from transform() on KStream. It returns null, even though corresponding key-value has been put() into the store. Can someone explain this behavior of KeyValueStore<>? @Component public class…
Nilesh
  • 2,089
  • 3
  • 29
  • 53
0
votes
1 answer

Can we use standalone Spring Cloud Schema Registry with Confluent's KafkaAvroSerializer?

I have a project using Spring cloud stream with Kafka Streams binder. For the output of a stream, I am using Avro, with the Serde provided by Confluent(io.confluent.kafka.streams.serdes.avro.SpecificAvroSerde). I am able to use it with the Confluent…
jubatus
  • 59
  • 7
0
votes
0 answers

What happens to the already polled events with spring cloud stream kafka on a gracefull shutdown

I would like to know what happens to the already polled events on a gracefull shutdown eg. a SIGTERM was received. All events from the poll will be handled and the offset will be commited, bindings will be unregistered The current event will be…
Chr3is
  • 387
  • 5
  • 21
0
votes
1 answer

How to add headers to a message before posting to Kafka Topic using Spring Cloud Stream

I just realised that the message once received on Kafka Topic looses the headers. Is there a way to add headers to the message before posting it to Kafka Topic and then read it at the consumer? I am using Java 11, Spring Cloud Hoxton.SR6, Spring…
Shakun
  • 11
  • 2
0
votes
1 answer

Google Functons recieving message from Kafka via spring-cloud-stream and spring-cloud-functions

I am aware that using Kafka Connect you can create connector sink all kafka messages to a PUBSUB topic. I would like to know if I can use Spring Cloud Stream binders in combination with Spring Cloud Function and deploy all this to Google…
Alexander Petrov
  • 9,204
  • 31
  • 70
0
votes
1 answer

Spring Cloud Stream Kafka Exception Handling

I am working on an application where the event causes spring data repository to save data; Entity entity = entityRepository.save((Entity) event.getPayload()); this code can throw various exceptions, like DataIntegrityViolationException which is…
Zafar Ali
  • 37
  • 1
  • 8
0
votes
1 answer

Programmatic way to read message using spring cloud stream kafka

I have a topic and DLQ associated with it. I am using @StreamListener for the topic. I wanted to read/process the messages from the DLQ on demand using a controller endpoint. is it possible to do this using spring cloud stream Kafka. We are not…
Chandresh Mishra
  • 1,081
  • 3
  • 24
  • 45
1 2 3
…
31 32