Questions tagged [spring-cloud-stream-binder-kafka]

An Apache Kafka Binder for Spring-Cloud Streams.

Documentation: https://cloud.spring.io/spring-cloud-stream-binder-kafka/spring-cloud-stream-binder-kafka.html

Related:

472 questions
2
votes
1 answer

why kafka listener annotated with @StreamListener behaving different then kafka listener implements Consumer Interface?

we are upgrading spring boot 2.2.6.release to 2.7.8 and facing below issue on Kafka listener. Scenario -1: Previously we were using SCS 3.0.4.Release and using @StreamListener to consume Kafka messages. we have below one scenario where one single…
2
votes
0 answers

How to fix Spring Cloud Kafka Binder WARN from IndicativeQueryService "Store (store) could not be found in Streams context"?

We are using spring-cloud-stream-binder-kafka-streams dependency in the project. The service is communicating with other services using Kafka, these are listeners set up in application.yaml: spring: cloud: kafka: stream: …
Dima
  • 21
  • 4
2
votes
1 answer

How to use Spring Cloud Stream producer property to set the partition of a message in functional outbound channel?

I have a very simple application that uses the functional approach to consume messages from a Kafka topic, process their payloads and send them to a different topic. I am using Spring Boot 2.7.5 and Spring Cloud Starter Stream Binder Kafka 3.2.6…
2
votes
1 answer

Is it a problem if I set spring.json.trusted.packages = '*' while consuming data in Spring Cloud Stream?

I am using Spring Cloud Stream in my project. I haven't started consuming with functional stream yet. I'm still consuming data with @StreamListener. I also consume the data as batch. Since I consume the data as batch, I have to give deserializer. I…
2
votes
1 answer

Producer callback in Spring Cloud Stream using StreamBridge

I'm wondering a way to perform a callback using StreamBridge, I want to do something similar to KafkaTemplate.send that returns a ListenableFuture. Is it possible with spring cloud stream to publish some events using kafka binder and use a callback…
2
votes
1 answer

Kafka producer threads keep increasing

We are using Spring Cloud Stream Kafka Binder and we are facing a problem with our application that consumes one topic and process the messages then outputs them to different topics. These topics are also consumed within the same application and…
2
votes
2 answers

Spring Batch ChunkRequest throws stackOverflow

I am struggling with Spring Batch RemoteChunking with newer versions of Spring boot. First i try to send ChunkRequest as event, it wasn't possible because it has no public default constructor. As solution I had to create a custom serializer and…
2
votes
1 answer

TracingKafkaClientSupplier error "Implementations of KafkaClientSupplier should implement the getAdmin() method"

I'm upgrading a Spring Boot application to Boot 2.6.1, Cloud 2021.0.0 and Cloud Stream 3.2.1. This application has a bunch of KStreams such as: @Bean fun processEvent() = Function, KStream
2
votes
1 answer

Alternative to StreamBridge

My Requirement in completely same as what is described here There are producer issues with spring cloud stream 3.0 by @hero-zh I found that @Oleg Zhurakousky is suggesting to use StremBridge but when i looked into the class there is…
2
votes
1 answer

Spring Cloud Stream Consumer is not reading messages from KAFKA topic

I am trying to consume a kafka topic from spring boot application. I am using Spring cloud stream with below mentioned version Spring-boot-starter-parent: 2.5.7 Spring cloud version: 2020.0.4 Below are the code and…
2
votes
1 answer

Spring cloud stream - Content based routing

I am trying to use the Content-based routing in the latest version of the Spring Cloud stream. As per this document -> Content-based routing, it mentions how to use it in the legacy system/StreamListener. This is my code with…
2
votes
0 answers

org.apache.kafka.common.errors.TimeoutException: Global task did not make progress to restore state within x ms when redeploying an application on K8s

This application uses Spring Cloud Stream to create a GlobalKTable and is deployed on Kubernetes as a StatefulSet, mounting a volume for the rocksdb content using a persistence volume claim for a Google Cloud Regional Persistent disk: apiVersion:…
2
votes
0 answers

spring cloud stream kafka binder not able to consume messages in functional style

I have been using @StreamListener to consume single messages, Now I want to consume in a batch. As per documentation, @StreamListener doesn't work with batches, So moving to functional style, but I am not able to consume the message. When I run the…
2
votes
2 answers

Getting java.lang.ClassCastException: [B cannot be cast to org.springframework.messaging.Message exception after consuming batch

I am using spring-cloud-stream-kafka-binder-3.0.4 to consume the messages in batch, after consuming, converting the Message into object but getting the above exception. Here is the code: @StreamListener(ActivityChannel.ACTIVITY_INPUT_CHANNEL) public…
1 2
3
31 32