Questions tagged [spring-cloud-stream]

Spring Cloud Stream allows a user to develop and run messaging microservices using Spring Integration and run them locally, or in the cloud, or even on Spring Cloud Data Flow. Just add @EnableBinding and run your app as a Spring Boot app (single application context). You just need to connect to the physical broker for the bus, which is automatic if the relevant bus implementation is available on the classpath.

Use this tag for questions about the Spring Cloud Stream project. It is not intended for general questions about integrating other Spring projects with other technologies.

Spring Cloud Stream's Official Project Site

Spring Cloud Stream's Github Repo

How to contribute

Related tags , , .

2724 questions
0
votes
0 answers

Handle partially failed batch with spring cloud streams

When using spring-cloud-stream for streaming application (functional style) with batches, is there a way to retry/DLQ a failed message but also process (stream) the non-failing records? for example: function received batch of 10 records, and…
0
votes
2 answers

org.springframework.expression.spel.SpelEvaluationException: EL1008E: Property or field 'fastPassId' cannot be found on object of type 'byte[]'

I am following video series from here: https://app.pluralsight.com/course-player?clipId=5133b583-6d21-4f49-b069-95f5ae7a60d8 and last section is not quite working well for me. The only thing I changed is I'm using latest version of Spring Boot…
PAA
  • 1
  • 46
  • 174
  • 282
0
votes
1 answer

How to send a message with priority to RabbitMQ with StreamBridge

I'm using RabbitMQ. I've defined a queue with priority, and I can send messages to this queue with some priority value using RMQ GUI, and consumers also get the messages in sorted order, but when I try to send the message from my java code using…
0
votes
0 answers

Spring Cloud Stream app consuming same message from Kinesis

We have a spring cloud stream app consuming from Kinesis stream with a single shard. The application has a consumer.concurrency of 2 and the spring.cloud.stream.instanceIndex and spring.cloud.stream.instanceCount are correctly set on each…
0
votes
0 answers

Access Spring Cloud Stream Kafka materialized view with external client

Let's pretend that my Java application using Spring Cloud Streams Kafka creates a materialized view (KTable) that will be used to fulfil get(id) request. How can I see the data from "outside" if I would like to do some maintenance or…
0
votes
1 answer

Spring Cloud Stream Kafka Producer force producer.flush

I am creating a kafka streams/in-out kind of application. Sample code looks like the following private MessageChannel output; public void process(List input) { --somelogic output.send() } Based on my understanding, kafka buffers the…
Rachit Agrawal
  • 685
  • 4
  • 13
  • 35
0
votes
0 answers

Is there an integration between Spring Batch and Spring Cloud Stream?

My project has a lot of Spring Batch Jobs. I have requirement to create externalized configuration for message brokers (example Kafka, rabbitMQ etc.). I want to use spring cloud stream since it has various binders to solve this problem. Hence i…
kiro
  • 1
  • 1
0
votes
0 answers

Spring Cloud Data Flow long term support and maintenance roadmap

We are in the process of building a new interoperability platform for our company, and we're looking into several data integration platforms as potential foundation candidates. One of these candidates is Spring Cloud Data Flow. We would like to know…
0
votes
2 answers

Get topic name from Spring Cloud Stream MessageChannel

We are using Kafka Cloud Stream in a Spring Boot application to send data to Kafka. like this producerChannel.send(MessageBuilder .withPayload(data) .setHeader(MessageHeaders.CONTENT_TYPE,…
Sandeep G
  • 13
  • 4
0
votes
1 answer

NoSuchMethodError when trying to map Kafka binder to input method

The following is prompted in console when trying to launch a spring cloud streams project with the Kafka binder active: org.springframework.context.ApplicationContextException: Failed to start bean 'inputBindingLifecycle'; Caused by:…
czr_RR
  • 541
  • 5
  • 16
0
votes
1 answer

How to log around Spring Cloud Stream functions?

I have a simple Spring cloud Stream function package com.example @Configuration public class Processor { @Bean public Function, Message> mapper() { return msg -> { // do stuff }; …
0
votes
1 answer

Listing all my kafka consumers informations

I want to list all my kafka consumers and inspect their state, group ... Before I was using just spring-kafka so I did the following and it works private final KafkaListenerEndpointRegistry kafkaListenerEndpointRegistry; var listenerContainers =…
Hayi
  • 6,972
  • 26
  • 80
  • 139
0
votes
1 answer

Spring Cloud Stream - failed to deserialize - failed to resolve class name. Class not found

Application A writes to a Kafka Topic below User object (json): public class UserEvent { private UUID id; private Object payload; // contains User fields name etc. } Application B is trying to consume this User object (User.java resides in…
0
votes
0 answers

Kafka Streams app that windowing aggregates blocked and never produce any output event

I have been developing a Kafka Streams App that windowing aggregates id of events by 10 sec window size. Here is the function of the stream app I want. input receiveLog : { id : "a" }, receiveLog : { id : "b" } output receiveLogSet : { idList:…
0
votes
0 answers

Access to custom headers in KStream

I produce a Message (org.springframework.messaging) in application X. I've implemented a custom MessageConverter that implements SmartMessageConverter. The message is sent to a topic with custom headers and with a CLI consumer the custom headers are…
Paulofski
  • 1
  • 4
1 2 3
99
100