Questions tagged [spring-integration-aws]

Spring Integration Extension for Amazon Web Services.

The full explanation can be found on project github page

122 questions
1
vote
1 answer

Checkpointing with Spring AWS Integration

According to Spring release notes, spring-integration-aws.1.1.0.M1 does not include DynamoDB MetaDataStore implementation. There is still ConcurrentMetadataStore class which is a key-value based store and based on implementation I suppose it maps…
1
vote
1 answer

Deserialization in Spring Cloud

I have a producer with following configuration for content-type spring: cloud: stream: bindings: eventOut: destination: lab_csi content-type: application/json On consumer side I use spring integration…
1
vote
1 answer

Internal Failures when using Spring-Integration-Kinesis Message Driven Adapter

I have set up this KinesisMessageDrivenChannelAdapter: @Bean public KinesisMessageDrivenChannelAdapter kinesisInboundChannel(AmazonKinesis amazonKinesis, MetadataStore store) { KinesisMessageDrivenChannelAdapter adapter = new…
1
vote
1 answer

spring integration error handling different types

I am using spring integration XML and want to know what is the best way to deal with error handling. I am connecting to s3 using s3-inbound-streaming-channel-adapter and then transforming the csv file from s3 bucket. Potential errors that can happen…
user2279337
  • 691
  • 5
  • 13
  • 26
1
vote
1 answer

Spring Integration AWS s3-inbound-streaming-channel-adapter stream from multiple s3 buckets

I am using XML based spring integration and use s3-inbound-streaming-channel-adapter to stream from a single s3 bucket. We now have a requirement to stream from two s3 buckets. So is it possible for s3-inbound-streaming-channel-adapter to stream…
1
vote
1 answer

spring integration - how to aggregate split lines into batch of x?

We need to send events to kinesis and due to aws pricing we are planning to put records on to kinesis in batches. We read in a csv files and then use the file splitter to spit out lines and transform each line into json. So after transformation to…
user2279337
  • 691
  • 5
  • 13
  • 26
1
vote
1 answer

Spring Integration: MessageSource doesn't honor errorChannel header

I've the following flow: @Resource(name = S3_CLIENT_BEAN) private MessageSource messageSource; public IntegrationFlow fileStreamingFlow() { return IntegrationFlows.from(s3Properties.getFileStreamingInputChannel()) …
Abhijit Sarkar
  • 21,927
  • 20
  • 110
  • 219
1
vote
1 answer

Unable to consume messages as batch mode in Kinesis Binder

I am trying to consume messages from Kinesis stream as batch I am using compile('org.springframework.cloud:spring-cloud-starter-stream-kinesis:1.0.0.BUILD-SNAPSHOT') Application.yml spring: cloud: stream: bindings: input: …
Patan
  • 17,073
  • 36
  • 124
  • 198
1
vote
1 answer

Spring cloud aws stream, messages are consumed by multiple instances in consumer group

I have written a sample application with spring cloud aws binder compile('org.springframework.cloud:spring-cloud-starter-stream-kinesis:1.0.0.BUILD-SNAPSHOT') Code @StreamListener(Processor.INPUT) public void receive(Message message) { …
Patan
  • 17,073
  • 36
  • 124
  • 198
1
vote
0 answers

spring integration sqs outbound gateway

I tried using https://github.com/3pillarlabs/spring-integration-aws project for SQS outbound gateway but I ended up in an error: Cannot resolve the name 'int-aws:permissionsType' to a(n) 'type definition' component. I am aware that the official…
Preethi
  • 123
  • 8
1
vote
1 answer

Spring AWS Context Credentials - Not Working

I am having a similar issue to one mentioned here. I am using spring xml configurations. I have my global AWS context credentials specified. I am using S3 outbound channel adapter to download a file from S3. I have my keys specified in my…
Preethi
  • 123
  • 8
1
vote
1 answer

How to downgrade AWS SDK in Spring-integration-aws

Is there anyway we can leverage the massaging handler capability that is part of spring-integration-aws-1.1.0-RC1 we just downgrade the AWS SDK version to aws-sdk-core-1.4.x ? As I would like to integrate with a proprietary CMS application [Hitachi…
1
vote
1 answer

Spring Integration Service Activator handler business logic

I am currently new to Spring Integration. Basically trying to poll onto multiple file locations asynchronously with Java Spring integration DSL. I am required to get the file name and perform some operations with filename and push the file to S3…
1
vote
1 answer

Using Spring integration AWS, how to download a file from S3 using ETag rather key i.e. fileName

Using spring-integration-aws, is it possible to download a existing file from AWS S3 using file ETag rather key. The objective to add a ETag as constrain beside the file name as headers key.
Sam
  • 63
  • 1
  • 8
1
vote
0 answers

spring-integration-aws vs aws-java-sdk for simple read and write operations to S3

I need to access AWS S3 to read and upload some json files. The use cases i have are: Retrieve a json file based on the ObjectId from S3 and extract certain fields out of the json. Write a json file to S3, and sometimes re-write/update the same…
1 2 3
8 9