Questions tagged [minio]

MinIO offers high-performance, S3 compatible object storage. Native to Kubernetes, MinIO is the only object storage suite available on every public cloud, every Kubernetes distribution, the private cloud and the edge. MinIO is software-defined and is 100% open source under GNU AGPL v3.

MinIO offers high-performance, S3 compatible object storage on any cloud environment.

Resources :

  1. Official Website
  2. GitHub
  3. License and Paid (SLA backed) Support
  4. Community support
906 questions
1
vote
0 answers

Unable to make any minio operations from a different container to the Minio container

I'm trying to build a containerized application that will basically read from a storage service do some operations and write a "processed" file into the same storage service. I tried using NFS as a storage service but hit a few bottlenecks which led…
rishab ajain445
  • 155
  • 1
  • 10
1
vote
0 answers

Retrieving object metadata while traversing S3 using Minio client's list_objects method

I am using the list_objects method of the python minio client and trying to retrieve the metadata for each object while traversing folders in S3. I attempted to do this by setting the include_user_meta parameter of the method to True. However, when…
evermean
  • 1,255
  • 21
  • 49
1
vote
1 answer

The SSL connection could not be established

I am using a third party library (MinIo dotnet SDK) in my .NET application. I successfully send the requests on the localhost, but at the time of publish on the IIS server, the requests are met with the following error. MinIO API responded with…
1
vote
1 answer

Is there way to setup user(!) policy using Minio Java Client API?

I want to have an ability to setup user policy using Minio java SDK. Based on MINIO UI console I can achieve it by: Add user Add policy Assign policy to user Is there way to achieve it using Minio Java Client API ?
gstackoverflow
  • 36,709
  • 117
  • 359
  • 710
1
vote
0 answers

Conflict when overwriting hadoop S3 configuration on Spark

I have two MinIO storages as follow version: "3.9" services: minio: image: quay.io/minio/minio:latest ports: - "9000:9000" - "9001:9001" environment: MINIO_ROOT_USER: "user" MINIO_ROOT_PASSWORD: "pwd" …
1
vote
1 answer

How to setup user policy for the minio bucket using s3Client?

We use Minio as our backend service but we communicate with it through software.amazon.awssdk.services.s3.S3Client I see that this class contains method putBucketPolicy but I don't see any method which allow to assign policy to user. Is there any…
gstackoverflow
  • 36,709
  • 117
  • 359
  • 710
1
vote
0 answers

Bad Request with STS in minio

I am trying to get a temporary access id and access secret from minio with AssumeRole SDK in java. the problem is I could get the correct access key and access secret from minio response with aws client. but it always fails with the java sdk. here…
Bill Wu
  • 11
  • 2
1
vote
1 answer

Error to write hudi table into minio s3 bucket by flink SQL

The Problem I'm trying to write a hudi table into minio s3 bucket by flink SQL, but it fails. The hudi table is created, but only contains meta data diretory .hoodie the directory tree is as follows: myminio/flink-hudi └─ t1 └─ .hoodie ├─ .aux │ …
he wang
  • 11
  • 2
1
vote
0 answers

how to create minio client for GCS

I try to put some data to the s3 bucket (on storage.googleapis.com). client = Minio( endpoint='storage.googleapis.com', access_key=settings.S3_ACCESS_KEY, secret_key=settings.S3_SECRET_KEY, ) However, I get an error: S3 operation…
1
vote
1 answer

minio folder under a bucket is not automatically created by kafka s3 sink connector distributed mode

I've set up kafka s3 sink connector in both standalone mode and distributed mode. They both worked fine, however I observe a difference in the behavior on minio storage side. I specified topics.dir in sink properties to store the parquet files…
1
vote
0 answers

how to upload client files directly to minio?

is there any way to uplaod files directly from client to minio s3? im working nodejs with express and want to have something to do this without proxing hosting to upload files like using multer. in the below example i used cloudinary and multer with…
mahdi
  • 207
  • 1
  • 15
1
vote
0 answers

How to upload client files directly from express to minio ? ( nodejs )

im using express framework and i want to have a middleware to be able to upload files directly from clients to minio s3, how is that possible ? i tried using multer-s3 package but it gave me error, here is the opened issue on multer-s3's…
mahdi
  • 207
  • 1
  • 15
1
vote
1 answer

How to upload my data to Minio after check the capacity of Minio

I want to upload many videos to my minio server ,but i think i should to check my minio's capacity remaining first,i check the doc and the api witch minio provide but there is still no clue,also i try prometheus ,should i check the prometheus…
cunyu61
  • 11
  • 2
1
vote
1 answer

How to create multiple profiles using Minio and aws-cli

I'm trying to connect to several profiles of local Minio instances using aws-cli without success. The problem persists when I remove --endpoint_url from the command. You will find the configuration files below With --endpoint-url: aws --profile…
Adil Blanco
  • 616
  • 2
  • 6
  • 23
1
vote
0 answers

MinIO Distributed on Docker Swarm Error: "Invalid command line arguments: no endpoint pointing to the local machine is found."

I'm pretty new to docker but for the life of me can not figure out what is going on here. The directory /export exist on each vm in the swarm but it still complains about not being able to find a suitable endpoint? The docker installation was done…
Joel Parker
  • 295
  • 1
  • 4
  • 17