Questions tagged [apache-camel-aws]
37 questions
0
votes
0 answers
How to read a S3 file from a REST Endpoint using Apache Camel 2.X
I need to read a file from S3 bucket based on the file name passed from a REST endpoint. The file name will be passed as a uri parameter. The camel route I am using is given below.
rest().get("/file")
…
Sarun
- 161
- 1
- 8
0
votes
0 answers
Camel AWSS3 Component with Idempotent Consumer EIP throws software.amazon.awssdk.services.s3.model.NoSuchKeyException:The specified key does not exist
I am trying to use Camel AWS2 S3 component to retrieve objects from AWS S3 service.
Since more than one instance of this route will be running, I am using Idempotent
Consumer EIP in the route to filter out duplicates. I am using hazel cast…
Lakshmeesh
- 1
- 1
0
votes
0 answers
Apache Camel memory leak and open threads issue with AWS S3 consumer and pollEnrich
The application reads a lot of different files from AWS S3 and then sends them to some recipients.
Issues:
Instantly growing number of live threads (it grows untill 1030-1040 threads and then stops at that limit. Almoust all threads are threads to…
Workin_Man
- 93
- 9
0
votes
1 answer
Understanding Apache Camel routing for Amazon SQS
I have an SQS queue. The objective that I am looking to accomplish is to filter message based upon message attributes and delete the same if it matches the filter criteria. So I have a function in Java which looks something like this
public String…
Rakshith
- 644
- 1
- 8
- 24
0
votes
0 answers
Camel Kafka S3 Source Connector with multiple connectors for same bucket
I am trying to define Camel S3 Source connectors. I have searched quite a bit without success to find answers to below questions.
How can I set up my connector such that the file in the S3 bucket doesn't get deleted but can be moved to another…
adbdkb
- 1,897
- 6
- 37
- 66
0
votes
1 answer
Error when defining Camel S3 source connector
I am trying to define a Camel S3 Source Connector in our confluent environment.
This is the configuration I am using
{
"name": "CamelAWSS3SourceConnector",
"config": {
"connector.class":…
adbdkb
- 1,897
- 6
- 37
- 66
0
votes
1 answer
How to have disposable routes in Camel?
Usecase:
We generate a csv file when user hits an endpoint, which we want to upload to different sources (FTP & S3). We need to encrypt & transform the files before uploading. Here's how the routes look like (oversimplified):
FTP…
Lakshmikant Deshpande
- 826
- 1
- 12
- 30
0
votes
1 answer
Apache Camel's aws-s3 component does not recognize parameter delimiter
I try to apply prefix and delimiter for my aws-s3 consumer endpoint. For some reason delimiter parameter is not recognized:
org.apache.camel.ResolveEndpointFailedException: Failed to…
Astrowie
- 195
- 2
- 17
0
votes
1 answer
How to send the contents of a file as a response back in apache camel?
I have a rest api using apache camel. When I hit a post request on a route, it should get a file from S3 and send the contents of the file as a response back. I am sending json data(filename, bucketName, accesskey, secretkey, region) in order to…
Adi shukla
- 173
- 3
- 11
0
votes
3 answers
Response body is of type string, how do I change it to JSON object
The body of my post request to rest camel component is not in the form of a json. Hence I am not able to extract the key-value pairs. How do I convert body into json?
I sent a json object of this type
{
"filename": "hello.txt",
"bucketName":…
Adi shukla
- 173
- 3
- 11
0
votes
1 answer
Accesing json data sent through a post request in Apache Camel
I am new to Apache Camel. I want to access the data sent through a post request in order to download a file from S3. This is the router that I wrote.
public static class HelloRoute extends RouteBuilder {
@Override
public void…
Adi shukla
- 173
- 3
- 11
0
votes
0 answers
How to execute a from statement inside a rest component in camel?
I am using apache camel for this.I have an http server. When I do a get request on a url it should fetch a file from a bucket in aws s3 and then create a file in my local directory.
public static class HelloRoute extends RouteBuilder {
…
Adi shukla
- 173
- 3
- 11
0
votes
1 answer
Reading files from S3 bucket with camel
I am new to Camel and need some guidance. I need to read some files from an S3 bucket. The structure is like so.
S3 Bucket
```
Incoming
+xls
-file1.xls
-file2.xls
-file3.xls
+doc
…
Jeeves
- 1
- 1
0
votes
1 answer
Camel S3: Listing S3 bucket files with scheduler turned off
I am having following Camel route which is trying to read the list of files from an S3…
adesai
- 370
- 3
- 22
0
votes
1 answer
Camel AWS-S3 - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection
I am using camel-aws to poll a file onto the remote S3 bucket to check if it has arrived or not.
I am not interested in the content of the…
adesai
- 370
- 3
- 22