Stack Overflow
Stack Overflow

Questions tagged [spring-cloud-stream-binder-kafka]

An Apache Kafka Binder for Spring-Cloud Streams.

Documentation: https://cloud.spring.io/spring-cloud-stream-binder-kafka/spring-cloud-stream-binder-kafka.html

Related:

472 questions
4
votes
2 answers

Check if StateStore is fully populated

I have a compact topic with approx 30Mio Keys. My App materializes this topic to a KeyValueStore. How can I check if the KeyValueStore is completely populated? If I lookup a key via InteractiveQuery I need to know if the key is not present because…
Frank
  • 129
  • 1
  • 6
4
votes
2 answers

Unable To Set groupId and clientId when using Spring Cloud Stream Kafka Binder

I am having serious problems dealing with the Spring Cloud Stream Kafka Binder. There is a lot of ambiguity and consistency issues related the configuration settings for Spring Cloud 3.0.2.RELEASE. I have been trying to set the group ids and the…
superflux
  • 117
  • 2
  • 10
4
votes
0 answers

Spring Cloud Stream Kafka Producer transactionality in a reactive Spring Webflux application

I am working with Spring Cloud Stream Binder Kafka 3.0.0 in a Spring Webflux applications that exposes an API that receives some data and publishes it to a Kafka topic using an @Output: @Autowired private lateinit var producer: Producer …
codependent
  • 23,193
  • 31
  • 166
  • 308
3
votes
0 answers

JSON array serialization issue after spring-cloud-stream update

I use spring-cloud-stream-binder-kafka to connect to the kafka broker I updated spring-cloud-dependencies version to 2021.0.1 I went from this [INFO] +- org.springframework.cloud:spring-cloud-stream-binder-kafka:jar:3.0.11.RELEASE:compile [INFO] | …
Hayi
  • 6,972
  • 26
  • 80
  • 139
3
votes
0 answers

Spring Cloud Stream - JsonParseException when consuming messages

I'm running two instances of Spring Cloud Stream application with Kafka binder. One instance uses scs 3.1.3 version and produces messages using StreamBridge. streamBridge.send("produceMessage-out-0", MessageBuilder .withPayload(message) …
Vin
  • 701
  • 1
  • 9
  • 30
3
votes
1 answer

Spring Cloud Stream pollable consumer dlq and errorChannel don't work if a different thread is being used

In order to manage a long-running task with Spring Cloud Stream 3.1.1 with Kafka binder, we need to use a Pollable Consumer to manage the consumption manually in a separate thread so Kafka does not trigger the rebalance. To do that, we have defined…
Ali
  • 1,759
  • 2
  • 32
  • 69
3
votes
1 answer

How to get the Message headers in a consumer

Using the new function based programming model of Spring Cloud Stream I need to have access to some of the headers of the message I consume. I figured I would consume Message instead of only MyDto, but if I do this MyDto properties are all…
Sébastien Nussbaumer
  • 6,202
  • 5
  • 40
  • 58
3
votes
1 answer

How to retrieve/set header using functional approach in spring-cloud-stream-binder-kafka-streams:3.1.1

I am using spring-cloud-stream-binder-kafka-streams:3.1.1 with functional programming. How can I retrieve all headers in processor function Java code @SpringBootApplication public class KafkaMessageApplication { public static void main(String…
user2459396
  • 99
  • 10
3
votes
1 answer

Enable/Disable spring cloud stream binder based on conditional properties

Created Library which has one cloud stream consumer and cloud stream producer and this library injected in all the micro services as a dependency, this works fine for me. I have requirement that some micro services doesn't need consumer. So looking…
sbogadhi
  • 31
  • 1
  • 3
3
votes
1 answer

Using Custom Kafka State Stores in kstreams application

We are using Kafka-streams included within the spring cloud stream Hoxton RC7 project (and therefore use the Kafka-streams and Kafka-client versions provided [2.3.1]) ext { set('springCloudVersion', 'Hoxton.SR7') } ... dependencies { //…
tunichgud
  • 41
  • 6
3
votes
1 answer

spring-cloud-stream-binder-kafka configuration for Confluent Cloud Schema Registry Unauthorized error

I'm having trouble configuring a connection to Confluent when using spring-cloud-stream-binder-kafka. Possibly somebody can see what is wrong? When I use the example from…
Ronan Hughes
  • 198
  • 1
  • 1
  • 10
3
votes
1 answer

Is it possible to configure multiple bindings to the same Processor in Spring Cloud Stream?

I have a simple Spring Integration flow that binds to Processor for input and output. I've configured the Kafka binder to map an input and output topic. That works perfectly. Say I want to bind 3 Kafka topics to input, resulting in 3 configured…
Gabriel Bauman
  • 2,270
  • 1
  • 22
  • 36
2
votes
0 answers

Spring Cloud Stream Kafka Streams binder shows only 1 thread in the health indicator

I am running a Kafka Streams application in Spring Boot using the Spring Cloud Stream binder. The application has several instances with every instance having 4 threads (num.stream.threads=4). However when navigating to the Actuator health endpoint…
user2732824
  • 141
  • 1
  • 5
2
votes
1 answer

Spring Cloud Stream: Spring Boot 3.x: JsonProperty, JsonIgnoreProperties behaving unexpectedly with Jackson in Message Converter

I am currently working on a Spring Boot application (version 3.0.6) and using Spring Cloud (version 2022.0.2). I have two different endpoints ("/mvc" and "/message") that use two different request objects (DummyMessage1 and DummyMessage2), and I'm…
Vadiraj Purohit
  • 898
  • 8
  • 20
2
votes
1 answer

How to retrieve a batch of kafka avro messages with message headers for acknowledgement using Spring Cloud Stream

I'm using spring-cloud-stream 4.0.2 with spring-cloud-stream-binder-kafka 4.0.2 and spring-cloud-stream-schema 2.2.1.RELEASE. I'm trying to configure Spring Cloud Stream Consumer for Kafka Avro topic with confluent schema and manual AckMode. It…
Mestru
  • 387
  • 3
  • 11
1
2
3
…
31 32