Questions tagged [spring-cloud-stream]

Spring Cloud Stream allows a user to develop and run messaging microservices using Spring Integration and run them locally, or in the cloud, or even on Spring Cloud Data Flow. Just add @EnableBinding and run your app as a Spring Boot app (single application context). You just need to connect to the physical broker for the bus, which is automatic if the relevant bus implementation is available on the classpath.

Use this tag for questions about the Spring Cloud Stream project. It is not intended for general questions about integrating other Spring projects with other technologies.

Spring Cloud Stream's Official Project Site

Spring Cloud Stream's Github Repo

How to contribute

Related tags , , .

2724 questions
0
votes
0 answers

Records in a Kafka topic getting deleted automatically while producer is still running

I am seeing a very weird issue with my Kafka topic, I have a Spring Cloud Kafka stream app where I am reading from INPUT_TOPIC with around 20 million records and then grouping records by keys and aggregating based on values of other fields into a…
0
votes
1 answer

Cloud stream not able to track the status for down stream failures

I have written the following code to leverage the cloud stream functional approach to get the events from the RabbitMQ and publish those to KAFKA, I am able to achieve the primary goal with caveat while running the application if the KAFKA broker…
0
votes
0 answers

Error : org.apache.avro.AvroRuntimeException: Not an array: in nested objects

I have this payload and set this payload to avro classes { "tradeQuantity":13, "tradeMarket":"sssss", "stockName":"teststock", "tradeType":"testtype", "price":12.2, "amount":12.5, "address":{ "stret" : "aaa", "city" : "bbb" …
0
votes
1 answer

Spring cloud stream consumer poll timeout has expired

We have a small microservice to read from a kafka topic and write to mqtt, using Spring Cloud Stream. It works fine, but after some time we get the following exception and no further messages are published to mqtt: "2022-10-18 16:22:29.861 WARN 1…
0
votes
1 answer

How to publish a message to Kafka topic using spring cloud stream in reactive way [using webflux]?

Publish a message to kafka topic without using StreamBridge as it uses deprecated components.
0
votes
2 answers

Kafka Streams Binding: Store (prod-id-count-store) not available to Streams instance

I'm trying to run interactive queries on Kafka Streams using Spring Cloud Stream Kafka Binder. I stuck on retrieving key value store from InteractiveQueryService. I'm keep getting always the same error on my code and even on code from…
MBec
  • 2,172
  • 1
  • 12
  • 15
0
votes
1 answer

Confusing messaging regarding the future of Spring Cloud Schema Registry

Here, it's explained that "starting with 3.2.x release of Spring Cloud Stream, we stopped shipping the schema registry clients (artifacts such as spring-cloud-schema-registry-client) as part of Spring Cloud Stream." If this is true, then can someone…
0
votes
0 answers

Spring cloud streams Kafka header based routing for multiple topics

We are upgrading the cloud stream library, converting it to a functional style from imperative. @StreamListener(target = Channel.ALPHA, condition = "headers['type']=='ALPHA1'" ...) handleAlpha1{...} @StreamListener(target = Channel.ALPHA, condition…
0
votes
1 answer

How to add a header in Spring Cloud Streams

There aren't any documentation examples of adding or manipulating a header in the spring cloud streams documentation, only accessing the headers. There are examples online that show usage of the ProcessorContext. However, using this results in…
0
votes
0 answers

Application won't start when adding function.routing.enabled=true with AWS Kinesis binder

I have a Spring Cloud Stream application where I'm using the AWS Kinesis Binder. I have the following configuration in the application.yml file: cloud: stream: bindings: customerEvents-out-0: binder: kinesis …
0
votes
0 answers

ConnectionFactoryCustomizer don't work with multiple rabbit binder

I want to create two rabbit binder, both use autintefication with TLS. @Bean fun connectionFactoryCustomizer(rabbitProperties: RabbitProperties): ConnectionFactoryCustomizer { return if (rabbitProperties.ssl.enabled == true) { …
0
votes
0 answers

spring cloud stream Kafka binder fails sending message from Kafka consumer to message channel at runtime works in tests

My consumer works with following configuration in tests @Bean public Function>>, Mono> handle() { ... } @SpringBootTest(webEnvironment = SpringBootTest.WebEnvironment.DEFINED_PORT) @EmbeddedKafka( …
0
votes
1 answer

Spring Cloud Stream routing function custom header not present in consumer

I'm following this guide for event routing: https://docs.spring.io/spring-cloud-stream/docs/3.2.5-SNAPSHOT/reference/html/spring-cloud-stream.html#_event_routing This is the configuration for the kinesis producer cloud: stream: …
0
votes
2 answers

Routing events type (Avro-SpecificRecordBase) to right Consumer from one topic in reactive programming

I use spring-cloud-stream:3.2.2 spring-cloud-stream-binder-kafka:3.2.5 spring-cloud-stream-binder-kafka-streams:3.2.5 I want to write consumer kafka in reactive programming. I work with avro schema registry. In my case i have multiple events type in…
0
votes
1 answer

Spring Cloud Stream multiple consumers for multiple event types in same kinesis stream

High level overview: different types of events are published to the same kinesis stream: OrderCreated, OrderUpdated, CustomerCreated, etc. Those messages are to be consumed by a Spring Cloud Stream application by writing some Consumer functions and…