Stack Overflow
Stack Overflow

Questions tagged [spring-cloud-stream]

Spring Cloud Stream allows a user to develop and run messaging microservices using Spring Integration and run them locally, or in the cloud, or even on Spring Cloud Data Flow. Just add @EnableBinding and run your app as a Spring Boot app (single application context). You just need to connect to the physical broker for the bus, which is automatic if the relevant bus implementation is available on the classpath.

Use this tag for questions about the Spring Cloud Stream project. It is not intended for general questions about integrating other Spring projects with other technologies.

Spring Cloud Stream's Official Project Site

Spring Cloud Stream's Github Repo

How to contribute

Related tags , , .

2724 questions
4
votes
2 answers

Unable To Set groupId and clientId when using Spring Cloud Stream Kafka Binder

I am having serious problems dealing with the Spring Cloud Stream Kafka Binder. There is a lot of ambiguity and consistency issues related the configuration settings for Spring Cloud 3.0.2.RELEASE. I have been trying to set the group ids and the…
superflux
  • 117
  • 2
  • 10
4
votes
1 answer

Spring cloud stream rabbitmq binder - spring cloud function error handling

i am using spring cloud stream rabbit binder with spring cloud function and defining listeners like: public Function, Flux> foo() { //some code } I also reroute failed messages to DLQ. Problem is when fatal error like…
kluzamic
  • 41
  • 2
4
votes
1 answer

Concurrency settings for Spring Cloud Stream consumer with GCP pubsub

My application is receiving messages using Spring Cloud Stream bound to GCP pubsub. I'm experimenting with the following configuration…
Dave McCullough
  • 43
  • 2
  • 5
4
votes
0 answers

Spring Cloud Stream Kafka Producer transactionality in a reactive Spring Webflux application

I am working with Spring Cloud Stream Binder Kafka 3.0.0 in a Spring Webflux applications that exposes an API that receives some data and publishes it to a Kafka topic using an @Output: @Autowired private lateinit var producer: Producer …
codependent
  • 23,193
  • 31
  • 166
  • 308
4
votes
1 answer

kafka streams hopping windowed aggregation causing multiple windows at timestamp zero

Kafka Streams DSL windowed aggregation causing multiple windows. @StreamListener("input") public void process(KStream DataKStream) { JsonSerde DataJsonSerde = new…
Pratap A.K
  • 4,337
  • 11
  • 42
  • 79
4
votes
1 answer

Spring Cloud Data Flow Grafana Prometheus not showing stream data

I launch Spring cloud data flow with docker-compose base on this website. https://dataflow.spring.io/docs/installation/local/docker/ I created 3 apps, Source, Processor & Sink. I ran export…
Ninja Dude
  • 1,332
  • 4
  • 27
  • 54
4
votes
2 answers

operation queue.declare caused a channel exception not_found: no queue for spring amqp

I've two applications using the same spring-amqp and spring-cloud-stream configuration. However, when one of the rabbitmq cluster node goes down, one application is redeclaring anonymous queues while the second one fails. The only difference I found…
Jakub Kubrynski
  • 13,724
  • 6
  • 60
  • 85
4
votes
1 answer

How to perform a graceful application shutdown when using Spring Cloud Stream with Kafka?

I have a spring boot (v.1.57) application which uses Spring Cloud Stream (v1.3.0) and Kafka (v1.1.6). I want to be able to gracefully shut it down, i.e., when shutting down, all stream listeners (i.e., annotated with @StreamListener) should: Stop…
Eyal Ringort
  • 601
  • 6
  • 19
4
votes
2 answers

KStream-KStream inner join throws java.lang.ClassCastException

In the process method of @StreamListener, I am mapping school KStream to person KStream and via .through() method to populate a topic "person" from which I generate a KStream inside another process1 method of @StreamListener.…
Muhammad Arslan Akhtar
  • 491
  • 7
  • 23
4
votes
2 answers

KStream-KStream inner join based on messages with matching composite-key

I am trying to perform an inner join between KStream-KStream. I have observed that the join doesn't work when the messages from both KStreams have composite-keys (e.g a java pojo with many attributes) even though the pojo used as the composite-key…
Muhammad Arslan Akhtar
  • 491
  • 7
  • 23
4
votes
1 answer

Kafka KStreams Issue in Aggregation with Time Window

I have an issue with KStreams aggregation and windows. I want to aggregate a record into a list of records which have the same key as long as it falls inside a time window. I have chosen SessionWindows because I have to work with a moving window…
ojimenol77
  • 41
  • 2
4
votes
0 answers

KafkaStreams throws FileNoFoundException for .checkpoint.tmp

I am running locally an app (Spring Boot & Spring Cloud Stream & Kafka Binder & Kafka Streams Binder) that consumes from and produces to several topics from which all have 4 partitions. I have some stateful stream processing inside using…
redfox
  • 178
  • 1
  • 9
4
votes
1 answer

StreamRetryTemplate for Spring Cloud Streams not retrying in integration tests

We are utilizing Spring Cloud Streams that listen to a Kafka topic and call a rest service. We also implement a custom StreamRetryTemplate to specify what kind of errors we deem recoverable and which we do not. I cannot get consistent results…
chas spenlau
  • 325
  • 1
  • 2
  • 12
4
votes
4 answers

Is it possible to have multiple @StreamListener in Spring Cloud Stream?

I using Spring cloud strema Kstream. I test one topic & one @StreamListner. It's Ok. I modify my code for two KStream Input. (two @StreamListener) But, spring cloud error.. *************************** APPLICATION FAILED TO…
Jeahyun Kim
  • 283
  • 1
  • 3
  • 8
4
votes
1 answer

Streaming application with state stores takes up to 1 hour to restart

We are using spring cloud stream with Kafka 2.0.1 and utilizing the InteractiveQueryService to fetch data from the stores. There are 4 stores that persist data on disk after aggregating data. The code for the topology looks like…
mmelsen
  • 636
  • 1
  • 8
  • 24
1 2 3
…
99 100