Spring Integration Extension for Amazon Web Services.
The full explanation can be found on project github page
Questions tagged [spring-integration-aws]
122 questions
1
vote
1 answer
Spring Cloud Aws kinesis Binder All JVMs in group consume same message at different intervals
We have three containers connecting to Kinesis stream as consumers using Spring cloud AWS kinesis binder.
We have used consumer groups for load balancing across three containers. The requirement is that containers share the load and it shall be…
Patan
- 17,073
- 36
- 124
- 198
1
vote
1 answer
Timeout waiting for connection from pool while polling S3 for Objects
I am working on a backend service which polls S3 bucket periodically using spring aws integration and processes the polled object from S3. Below is the implementation for…
Aarish Ramesh
- 6,745
- 15
- 60
- 105
1
vote
1 answer
How to get object count in S3 bucket for current date using spring-integration-aws?
Have a spring integration application where files are routed from a folder to S3 buckets using s3-outbound-channel-adapter. I need to know the number of files/object that are stored under S3 bucket for today's date(current date) and files having…
Jessie
- 963
- 5
- 16
- 26
1
vote
1 answer
Generate Spring-integration daily statistics report
Have a spring integration application where files are routed from a folder to S3 buckets using s3-outbound-channel-adapter. If the file processed successfully, then file will be moved to corresponding target-bucket. if any error , file move to error…
Jessie
- 963
- 5
- 16
- 26
1
vote
1 answer
Spring integration : Facing issue while updating the header value again
Trying to place a file in multiple directories using single outbound adapter using spring-integration-file.
In order to achieve that, having a loop in front of the file:outbound-gateway to modify message header target directory on each iteration and…
Jessie
- 963
- 5
- 16
- 26
1
vote
1 answer
Local Directory expression in s3 inbound channel adaptor
Can i have local-directory-expression in s3 inbound adapter. My local-directory path is an expression . How to assign expression variable in the local-directory attribute ?
Config details below
…
Las
- 37
- 4
1
vote
1 answer
Can spring-integration-aws for s3 replicate bucket subdirectories?
I was using the sample configuration from https://github.com/spring-projects/spring-integration-aws for an Inbound Channel Adapter, but I have a bucket that will contain subdirectories with CSV's inside.
Is there a way to replicate locally the…
luisroot
- 35
- 6
1
vote
1 answer
Spring boot Failed to load applicationcontext
Have a springboot application which reads files from source directory using file-inbound-adapter.Written junit testcases for it. Junit testcase execute successfully in my local eclipse. but facing issue while running it from bamboo/jenkins which is…
Jessie
- 963
- 5
- 16
- 26
1
vote
1 answer
aws s3 Spring Integration File Modification Monitor
I am looking for AWS s3 Spring Integration File Modification Monitor sample.
Requirement: whenever a file gets modified from the AWS S3 bucket, the latest changes has to be transferred from s3 to EC2 instance.
We have the watch-event for file…
Las
- 37
- 4
1
vote
1 answer
Passing renamed file as input to Outbound adapter/gateway
In spring-boot-integration app, wrote a custom locker to rename the original file before locking (fileToLock.getAbsolutePath() + ".lock") and expected lock on file so that any other instance will not be able to process the same file .
When file is…
Jessie
- 963
- 5
- 16
- 26
1
vote
0 answers
How to pass byte[] to input channel - file-to-bytes-transformer?
my spring-boot-integration app, could be running on multiple servers(nodes) but they all are supposed to read a common directory.Now, I wrote a custom locker which takes the lock on file so that any other instance will not be able to process the…
Jessie
- 963
- 5
- 16
- 26
1
vote
1 answer
How to check if aws s3 bucket available before uploading file using outbound gateway
using aws s3 outbound adapter in spring boot application,trying to upload files in s3 bucket. would like to check if bucket available before uploading file. if bucket is not available need to throw error.
suggest on…
Jessie
- 963
- 5
- 16
- 26
1
vote
1 answer
Spring Aws Kinesis Binder Acquiring and Releasing lock issues in Dynamo DB while consuming messages
Sometimes, when we are stopping the application abruptly exception occurs that unlocking has been failed. Then the same group will never gets the messages. Other groups are getting messages.
I am using the aws kinesis binder snapshot version.
This…
Patan
- 17,073
- 36
- 124
- 198
1
vote
1 answer
Records are not consumed when adding checkpointer
I have following configuration for KinesisMessageDrivenChannelAdapter, when I remove dynamoDbMetaDataStore as checkpointer, messages are received correctly, but when I add it back records are always empty.
I debugged the code and…
sansari
- 558
- 1
- 7
- 17
1
vote
0 answers
Dynamic kinesis checkpoint with DynamoDbMetaDataStore
I have following configuration for checkpoint store:
public DynamoDbMetaDataStore dynamoDbMetaDataStore() {
String url = consumerClientProperties.getDynamoDB().getUrl();
final AmazonDynamoDBAsync amazonDynamoDB =…
sansari
- 558
- 1
- 7
- 17