Questions tagged [minio]

MinIO offers high-performance, S3 compatible object storage. Native to Kubernetes, MinIO is the only object storage suite available on every public cloud, every Kubernetes distribution, the private cloud and the edge. MinIO is software-defined and is 100% open source under GNU AGPL v3.

MinIO offers high-performance, S3 compatible object storage on any cloud environment.

Resources :

  1. Official Website
  2. GitHub
  3. License and Paid (SLA backed) Support
  4. Community support
906 questions
2
votes
1 answer

Error uploading large files to MinIO server

this is my code: public async Task UploadFile(string bucketName, Stream fileStream, string fileName, long fileSize, string contentType) { bool found = await minioClient.BucketExistsAsync(bucketName); if (!found) …
danilonet
  • 1,757
  • 16
  • 33
2
votes
1 answer

Rails: getting plain text path to file uploaded to Minio

I have a Minio server where I upload files with ActiveStorage and it upsets me that I can't seem to get the "real" file name for my uploads, for instance if I upload "vader.jpg" I get this path: image_tag user.avatar.variant(resize:…
Nick M
  • 2,424
  • 5
  • 34
  • 57
2
votes
1 answer

PySpark - Getting BufferOverflowException while running dataframe.sql on CSV stored in S3

I was getting the BufferOverflowException when I tried Spark SQL query on CSV stored in S3. Here is the link to the CSV and the data schema. I am actually using GZIP compressed CSV in S3. from pyspark.sql.types import * schema = StructType([…
c0degeas
  • 762
  • 9
  • 19
2
votes
0 answers

Django: get_or_create() and FileField

I like the get_or_create() and update_or_create() methods a lot. They don't seem to work with FileField. If I try this: blob, created = Blob.objects.get_or_create(name='foo2', defaults=dict(content_file='my_content')) ... I…
guettli
  • 25,042
  • 81
  • 346
  • 663
2
votes
0 answers

Minio/S3 scenarios where files have to be moved in batch

I searched but haven't found a satisfying solution. Minio/S3 does not have directories, only keys (with prefixes). So far so good. Now I am in the need to change those prefixes. Not for a single file but for a whole bunch (a lot) files which can be…
monty
  • 7,888
  • 16
  • 63
  • 100
2
votes
2 answers

Usage of presigned urls in a (e.g. Angular) SPA blows up browser cache

In our project we decided to use presigned urls as basic authentication mechanism. Trimmed down our setup involves the storage server the api server the client (angular SPA running in the browser) We use presigned urls for uploading and…
monty
  • 7,888
  • 16
  • 63
  • 100
2
votes
2 answers

How to get list of objects from s3 bucket sorted by last modified timestamp using minio-go api?

I went through the documentation of minio-go-api. But didn't get any solution for that, as objects are sorted based on the alphabetic order. A hack way, will be to first read all the objects and then take last modified date from each object and form…
Siddhanta Rath
  • 976
  • 3
  • 21
  • 37
2
votes
3 answers

Any way to configure what signature version a Minio server accepts?

I have a Minio server set up and everything appears to be running normally. For my CLI, I have this in my config.json: "myalias": { "url": "https://myurl", "accessKey": "myaccesskey", "secretKey": "mysecretkey", …
RossD
  • 620
  • 2
  • 6
  • 13
2
votes
1 answer

Amazon S3: Change bucket policy with Java SDK

I am testing with Amazon S3 compatible Minio using "aws-java-sdk-s3" in Java (Servlet). Minio wants to set this as "Prefix: *, Read Only" because the initial value of the bucket policy is None. I added the source code when creating the bucket I…
salud
  • 103
  • 1
  • 1
  • 8
2
votes
0 answers

upload non seekable streams in minio using dotnet client

I create streams on the fly and I want to upload then to a minio storage. However PutObjectAsync expects the length of the stream, which is unknown, as the stream is non seekable. Is there any workaround about this ? Of course I could read my…
2
votes
1 answer

Adding disks to Minio object server

I have used the minio service binary (https://dl.minio.io/server/minio/release/linux-amd64/minio) and my /etc/default/minio options are as follows: MINIO_VOLUMES="/sdc1/minio/" MINIO_OPTS="-C /etc/minio --address localhost:9000" Could someone tell…
wmac
  • 1,023
  • 1
  • 16
  • 34
2
votes
1 answer

In what folder/directory does Minio store its objects/files on local disk?

I'm running a Minio instance on my local machine, on http://localhost:9000. I created a bucket called foo, and uploaded a single file test.txt to it. Since this Minio instance is running on my local machine, where is the "uploaded" binary test.txt…
Bill Mei
  • 717
  • 1
  • 10
  • 22
2
votes
0 answers

Will minio be suitable for frequently uploads and downloads

I am making a website in which there can be frequently uploads of users sharing multipart files. and there will be frequently downloads also. I am thinking of using minio for this. For storage needs it will be best but i don't know whether it will…
Dhiresh Budhiraja
  • 2,575
  • 5
  • 17
  • 26
2
votes
1 answer

How to override endpoint in AWS-SDK-CPP to connect to minio server at localhost:9000

I tried something like: Aws::Client::ClientConfiguration config; config.endpointOverride = Aws::String("localhost:9000"); It does not work. It seems that AWS-SDK-CPP by default uses virtual hosting: https://bucket-name/s3.amazonaws.com However, to…
Tianyi Cai
  • 103
  • 2
  • 9
2
votes
1 answer

Is Minio supports MIME type check?

Is Minio supports MIME type check? For example, when uploading file user can specify what MIME type should be for this file. Than Minio analyzes this file and if it is a correct (e.g it's valid image) save, if not response with an error.
Vladyslav Moisieienkov
  • 4,118
  • 4
  • 25
  • 32