Spring Integration Extension for Amazon Web Services.
The full explanation can be found on project github page
Questions tagged [spring-integration-aws]
122 questions
0
votes
1 answer
Spring Integration Flow DSL with SQS and Reactive
How can I setup a reactive flow using DSL for the following steps:
Receive an SQS Message using SqsMessageDrivenChannelAdapter
Validate the Json message [JsonSchemaValidator class with validate method]
Transform the json to objects
Pass the objects…
Nikhil
- 345
- 2
- 13
0
votes
1 answer
ThreadPoolTaskExecutor with just one thread on pool not processing messages from AWS queue
I've created an on demand ChannelAdapter, AsyncTaskExecutor and a Channel for every queue registered on the application. I noticed that when the number of maxPoolSize of the AsyncTaskExecutor is equal to one, the messages are not being processed.…
Rafael Ferreira Rocha
- 907
- 3
- 9
- 18
0
votes
1 answer
Aggregated Future/Response for SQS Acks/Error on multiple queues with Spring Integration SQS
I am using a Gateway and inside the gateway I am looping over to send the message to 2 queues via sqs-outbound adapter.
I want to achieve something like this:
jsonArray.forEach(data -> {
Future result =…
Nikhil
- 345
- 2
- 13
0
votes
1 answer
Spring Integration: Only Ingest New Files Since Last Poll
I'm using Spring Integration to poll for files from an S3 bucket. I cannot delete the files after processing and so I added the S3PersistentAcceptOnceFileListFilter. I have a lot of files and poll frequently which is causing unneeded stress on the…
JDrost1818
- 1,116
- 1
- 6
- 23
0
votes
1 answer
AWS Async Response routing to success-channel for sqs-outbound-channel-adapter
I have registered an AsyncHandler and also added a success-channel to an SQS outbound flow. The success-channel has a int:logging-channel-adapter endpoint. However I am not able to see any logs from this adapter. The AsyncHandler is able to receive…
Nikhil
- 345
- 2
- 13
0
votes
0 answers
Reordering AWS Standard SQS messages with Spring Integration
I am currently working with SNS and SQS to integrate disparate remote systems. The producer sends messages to an AWS SNS with a SQS subscribed. The consumer is a Spring Boot application with spring integration enabled that polls the SQS with an…
Lucas Favaro
- 97
- 6
0
votes
1 answer
SerializationFailedException: Spring Cloud Stream Kinesis binder with kpl-kcl-enabled:true
I am currently evaluating the possibility of using spring cloud stream kinesis binder in a new project but I am having some issues.
When I have kcl-kpl-enabled: false everything works fine. However when I have kcl-kop-enabled I keep getting the…
frm
- 53
- 6
0
votes
1 answer
Use multiple aws outbound adaptor in a single integration flow
***strong text***I want to use 2 aws outbound adaptor in a single integration flow. One is outbound S3 adaptor and one outbound SQS adaptor. I have to move file from smb share to S3 bucket then use the transformer and then use the SQS adaptor to…
user7868770
0
votes
1 answer
Understanding SqsMessageDrivenChannelAdapter behaviour
I'm trying to understand the behavior of SqsMessageDrivenChannelAdapter to address memory issue.
The upstream system dumps thousands of messages in aws-sqs-queue, all of the messages are received immediately by SqsMessageDrivenChannelAdapter. On…
Megha
- 21
- 3
0
votes
1 answer
int-aws:s3-outbound-channel-adapter or int-aws:s3-outbound-gateway is not throwing any error when there is no access permission at bucket level
I am facing one issue in both int-aws:s3-outbound-gateway and int-aws:s3-outbound-channel-adapter . The issue is, Suppose if i don't have the bucket access permission which is already configured as a destination bucket the adapter should throw run…
Las
- 37
- 4
0
votes
1 answer
Kinesis Binder Default Read capacity and write capacity on dynamo db tables
As per the documentation in Spring Aws Kinesis Binder, the default values for readCapacity and writeCapacity are 1…
Patan
- 17,073
- 36
- 124
- 198
0
votes
1 answer
IdleBetween pools not pulling Messages as specified
I am consuming messages in batch mode. I wanted to pull 8 messages each 250 ms from stream.
spring:
cloud:
stream:
kinesis:
bindings:
input:
consumer:
listenerMode: batch
…
Patan
- 17,073
- 36
- 124
- 198
0
votes
1 answer
File data validation before moving to the target system
I want to validate the data(to maintain data integrity) inside the file using some logic before sending to target system. For that I am using files and its checksum files logic like this,
abc.txt is the original file abc.txt.checksum is the…
Las
- 37
- 4
0
votes
1 answer
Spring Kinesis Binder filling the Heap space quickly leading to frequent GC flush and is slowing down message process
My application is consuming from one stream and then pushing the messages on three streams
Binder:
public interface MyBinder {
@Input("input1")
SubscribableChannel input1();
@Output("output1")
MessageChannel output1();
…
Patan
- 17,073
- 36
- 124
- 198
0
votes
1 answer
No records for on kinesis stream suspending messages for 1 sec
I am using spring kinesis binder for consuming messages in batch mode
Some times I am not able to consume the messages from streams. This is not happening all the time
No records for…
Patan
- 17,073
- 36
- 124
- 198