Questions tagged [spring-cloud-stream-binder-kafka]

An Apache Kafka Binder for Spring-Cloud Streams.

Documentation: https://cloud.spring.io/spring-cloud-stream-binder-kafka/spring-cloud-stream-binder-kafka.html

Related:

472 questions
0
votes
2 answers

spring-cloud-stream sample projects raises NoSuchBeanDefinitionException of KafkaStreamsFunctionProcessor

I'm trying to touch spring-cloud-stream, and creating a sample project of the official blog. Implementation is totally same as the article. @SpringBootApplication public class SimpleConsumerApplication { @Bean public…
0
votes
1 answer

Unable to set custom security configuration for Kafka

I am trying out the functional style of using Kafka Streams and have a need to set the truststore and keystore for my app. Below is a very small snippet: spring: cloud: stream: kafka: binder: brokers: blah …
Winston Lee
  • 261
  • 1
  • 7
0
votes
1 answer

Cannot get custom store connected to a Transformer with Spring Cloud Stream Binder Kafka 3.x

Cannot get custom store connected to my Transformer in Spring Cloud Stream Binder Kafka 3.x (functional style) following examples from here. I am defining a KeyValueStore as a @Bean with type StoreBuilder>: @Bean public…
0
votes
1 answer

How to consume messages from kafka topics using protocol buffers (protobuf) by spring cloud stream binder kafka streams dependency?

I have an application that consumes messages in a protobuf format and when I run it I am getting this error: Exception in thread "NotificationProcessorService-process-applicationId-0300a3f8-6dab-4f3f-a631-8719178823ce-StreamThread-1"…
0
votes
1 answer

How to enable function routing with two different input topics

I am in the process of migrating an application to the new function based programming model of Spring Cloud Stream but block on event routing. I have to route events coming from two different kafka topics, and I don't see how I can bind…
0
votes
1 answer

spring-cloud-stream with functional programming

in my application kafka messages were consumed from multiple topics by streamlistner but i want to add functional consumer bean for one topic is this possible some topics consuming by streamlistner and some with consumer bean in same…
0
votes
1 answer

Spring Cloud Stream with KTable Binder configuration - Throws java.lang.IllegalArgumentException: Method must be declarative

Have a requirement to use KTable with Spring-Kafka binder configuration, here is the sample code used to read data from topic and print it on the console. But the application terminated with Throw java.lang.IllegalArgumentException: Method must be…
0
votes
2 answers

Spring Cloud Stream 3.0 StreamsBuilderFactoryBeanCustomizer

I am unable to configure custom handlers for my stream consumer using StreamsBuilderFactoryBeanCustomizer. @Bean public StreamsBuilderFactoryBeanCustomizer customizer() { return fb -> { …
0
votes
1 answer

How to Handle Deserialization Exception & Converting to New Schema with Spring Cloud Stream?

I am have trouble understanding how to properly handle a deserialization exception within Spring Cloud stream. Primarily because the framework implemented does not support headers and the DLQ is supposed to be a separate schema than the original…
0
votes
1 answer

org.springframework.messaging.converter.AbstractMessageConverter.([Lorg/springframework/util/MimeType;)V Spring Cloud Stream

I am getting below error when I simply run the code from : https://github.com/schacko-samples/s1p-2019-scst-kafka-talk/tree/master/hello-streams-application. Error starting ApplicationContext. To display the conditions report re-run your application…
Jeff Cook
  • 7,956
  • 36
  • 115
  • 186
0
votes
1 answer

Is there a way to dynamically change destination in Spring Cloud Stream Reactive method?

I know that if I implement SC Stream Function in Spring reactive way, I can't send DLQ like traditional imperative way. To do this, I am trying to manually change the Destination in the MessageHeader so that the message goes to the DLQ…
0
votes
1 answer

Can't produce and consume events to and from Kafka in same spring boot application

Running Kafka on my local machine localhost:9092 Created a topic ProductOrders with Replica 1 and Partition 3 Created a spring-boot 2.4.3, spring-kafka 2.6.6 and spring-cloud-stream 3.1.1 application with a POJO OrderEvent, OrderEventPublisher, and…
0
votes
1 answer

is it possible to skip logging stacktrace by SeekToCurrentErrorHandler?

I just configured SeekToCurrentErrorHandler in spring cloud stream with kafka project and I see tons of logs (one stacktrace per each delivery attempt) which I would like to silence. Is it possible? PS. I do not know if it is relevant (and whether I…
0
votes
1 answer

spring cloud stream kafka binder enableDlq is not working as I expected

I'm using spring-cloud-stream kafka binder with schema registry. (not kakfa streams) What I'm trying to do is when un-deserializable message has got into an input topic, send the un-deserializable message to dlq. So I tried like below configuration…
0
votes
0 answers

Kafka Streams Applications - Can we have 2 stream applications in a microservice?

We have created a kafka stream application which consumes from source topic and writes to a destination topic. Now we have a requirement where we will have another set of source and destination topics , and the core logic written in the above…