Stack Overflow
Stack Overflow

Questions tagged [spring-cloud-stream-binder-kafka]

An Apache Kafka Binder for Spring-Cloud Streams.

Documentation: https://cloud.spring.io/spring-cloud-stream-binder-kafka/spring-cloud-stream-binder-kafka.html

Related:

472 questions
0
votes
1 answer

duplicate consumption of messages with Spring Cloud Stream Kafka binder

We have several micro-services using Spring Boot and Spring Cloud Stream Kafka binder to communicate between them. Occasionally, we observe bursts of duplicate messages received by a consumer - often several days after it was first consumed and…
Alex Glikson
  • 401
  • 4
  • 13
0
votes
1 answer

How to write a method subscribing to a topic in Spring Cloud Stream Kafka binding?

I want to write a consumer method which subscribes to a topic using KafkaListener. I found an answer which suggested this - @KafkaListener(id = "foo", topics = "dead-out") public void dlq(Message in) { System.out.println("DLQ:" + in); } Now,…
shreyas.k
  • 181
  • 1
  • 2
  • 15
0
votes
1 answer

Spring Cloud Stream - Adding fasterxml ObjectNode to trusted package of kafka

I am using Spring-cloud-stream version 3.0.4 I am writing a JSON consolidator, which listens to multiple streams, store the JSONs in state-stores and then consolidates it to produce an output JSON. Since my service is just a JSON aggregator I dont…
Anupam Gupta
  • 1,591
  • 8
  • 36
  • 60
0
votes
2 answers

Spring Cloud Stream Kafka won't connect

I'm using this docker compose: version: '2' services: zookeeper: image: confluentinc/cp-zookeeper:4.1.1 hostname: zookeeper ports: - "32181:32181" environment: ZOOKEEPER_CLIENT_PORT: 32181 ZOOKEEPER_TICK_TIME:…
italktothewind
  • 1,950
  • 2
  • 28
  • 55
0
votes
1 answer

Writing to a topic from a Processor in a Spring Cloud Streams Kafka Stream application

I am using the Processor API to do some low level processing into a state store. The point is I also need to write into a topic after storing into the store. How can it be done in a Spring Cloud Streams Kafka applications? @Bean fun processEvent() =…
codependent
  • 23,193
  • 31
  • 166
  • 308
0
votes
1 answer

Spring Cloud Stream Kafka Binder and Spring Cloud Azure EventHub compatible version for Spring Boot >1.5.20

I have successfully used Spring Cloud Stream Kafka Binder (org.springframework.cloud:spring-cloud-starter-stream-kafka:3.0.1.RELEASE) and Spring Cloud Azure Event Hubs (com.microsoft.azure:spring-cloud-starter-azure-eventhubs:1.2.3) with Spring Boot…
java_geek
  • 17,585
  • 30
  • 91
  • 113
0
votes
1 answer

How to provide Kafka Streams properties via Spring Cloud Stream in YAML?

I'd like to move spring.kafka.streams.* under spring.cloud.stream - is this possible? I thought of streams-properties similarly to consumer-properties or producer-properties, but it doesn't work. spring: cloud: config: …
Andras Hatvani
  • 4,346
  • 4
  • 29
  • 45
0
votes
1 answer

Abstracting Spring Cloud Stream Producer and Consumer code

I have a Service that is Producing and Consuming messages from different Spring Cloud Stream Channels (bound to EventHub/Kafka topics). There are several such Services which are setup similarly. The configuration looks like below public interface…
java_geek
  • 17,585
  • 30
  • 91
  • 113
0
votes
1 answer

Spring Clould Stream Resolving Input Channel dynamically based on Message

I need a way of resolving an Inbound Channel dynamically based on the type of the Incoming Message. I am not looking for any header based solution which is already mentioned in this…
java_geek
  • 17,585
  • 30
  • 91
  • 113
0
votes
1 answer

Using Spring Integration Router with Spring Cloud Stream

I have been trying to use the Spring Integration's @Router with Spring Cloud Stream with Kafka binding. My understanding is that when you return a List of channel names from the method annotated with @Router they should be produced to the destined…
cannot_mutably_borrow
  • 679
  • 8
  • 25
0
votes
1 answer

How do I access header information in kafka materialized views?

how do I access custom headers in a materialized view? I'm trying to build some custom dlq logic in my application and want to build a retry mechanism based on header information. The actual retry is triggered by a scheduler which should look up…
Fabian Lang
  • 78
  • 1
  • 8
0
votes
2 answers

Spring cloud function to create a GlobalKTable from strem

Is there an example of how to create a GlobalKTable to keep count from a KStream using Spring Cloud stream and using Functional approach?
jka
  • 77
  • 2
  • 8
0
votes
0 answers

Error creating bean with name 'compositeMessageChannelConfigurer' defined in org.springframework.cloud.stream.config.BinderFactoryAutoConfiguration

enter image description here Micro service 1: artefact id - microservice1 Defined KafkaStreams.java interface where in defined the binder properties like below. public interface KafkaStreams { String OUTPUT = "kafka-output"; String INPUT =…
sbogadhi
  • 31
  • 1
  • 3
0
votes
1 answer

How do I Connect Spring Cloud Stream Functional Beans to a Kafka Binder?

I'm using the Spring Cloud Streams Documentation to try and work out how to connect my micro service to Kafka via the binder already downloaded in Gradle. I've tried creating a simple @Bean Function() method within my Spring Boot…
Kirkland
  • 798
  • 1
  • 8
  • 20
0
votes
1 answer

Spring cloud stream infinite retry caused by Avro deserializaton exception

I am using Spring Cloud Stream version 2.2.0 with Kafka binder and Avro. Apparently, an incorrect record has been published to one of the Kafka topics where it is causing all the consumers to return deserialization error and goes to some sort of…
Ali
  • 1,759
  • 2
  • 32
  • 69
1 2 3
…
31 32