I'm currently building a data pipeline that ingests data with the usage of a vector agent running in an ecs cluster that's being managed by Terraform. Also, the docker image read its' configuration file from a s3 bucket.
So, right now the vector…
I'm using vector.dev to send logs to Parseable. I need to send a header took from log event.
For example, if vector receive this log:
{
"message":"Hello Vector!",
"service":"education"
}
it should send header:
X-P-Stream: education
I tried to…
i want to transform a spark pipeline into a vector.dev pipeline, so that i can benchmark the efficiency of both agents.
with spark i can connect to kaka using sasl/ssl with the following code, but i can't find the same options in vector.dev…
**I am using a tool called vector.dev to upload the data from local to S3 but not able to upload data to s3 Please help and let me know what changes are required to push it to s3 **
The Things I have commented is for the sake so that I can just do…