MinIO offers high-performance, S3 compatible object storage. Native to Kubernetes, MinIO is the only object storage suite available on every public cloud, every Kubernetes distribution, the private cloud and the edge. MinIO is software-defined and is 100% open source under GNU AGPL v3.
Questions tagged [minio]
906 questions
1
vote
1 answer
DeltaTable.create fails with Minio identifier due to syntax error
Take this code:
Here's the output:
boolean is false
Exception in thread "main" org.apache.spark.sql.catalyst.parser.ParseException:
Syntax error at or near ':'(line 1, pos 3)
== SQL ==
s3a://spark-test/delta-table-three
---^^^
Why is the…
Jon Hayden
- 153
- 1
- 1
- 7
1
vote
1 answer
Why do minio tenants need their own namespace?
I am trying out the minio-operator.
This is a two part question regarding namespaces mentioned in the docs.
I would like have a namespace in which I deploy different kinds of operators.
Eventhough the docs require a dedicated namespace for the…
sekthor
- 464
- 5
- 15
1
vote
0 answers
Passing BytesIO to BufferedReader results in warning message
I am trying to create a BufferedReader from a BytesIO object but my IDE (PyCharm) is warning me that BufferedReader Expected type 'RawIOBase', got 'BytesIO' instead.
The logic seems to work but I'd like to solve this properly if there is a way to do…
keith.g
- 900
- 9
- 19
1
vote
1 answer
Minio+Hudi throws:Could not load Hoodie properties from hoodie.properties after second overwrite using Spark
Apache Hudi version 0.13.0
Spark version 3.3.2
I'm very new to Hudi and Minio and have been trying to write a table from local database to Minio in Hudi format. I'm using overwrite save mode for the upload. While the table is written successfully…
Adi
- 11
- 1
1
vote
0 answers
How to restrict minio bucket from deleting files?
I have a user with readwrite policy
"Version": "2012-10-17",
"Statement": [
{
"Effect": "Allow",
"Action": [
"s3:*"
],
"Resource": [
"arn:aws:s3:::*"
…
Nazar Kalytiuk
- 1,499
- 1
- 11
- 21
1
vote
1 answer
MinIO fails to start as systemctl service but manual start using command line works
I am trying to setup MinIO cluster (4 VMs) using the guide here https://min.io/docs/minio/linux/operations/install-deploy-manage/deploy-minio-multi-node-multi-drive.html
All the VMs are identical in configuration. All the VMs have one drive mounted…
dealbitte
- 191
- 1
- 2
- 7
1
vote
0 answers
Cant fetch bucket items while accessing minio server from domain [Websocket error]
When I am accessing server of minio directly from ip 159.XX.XXX.XX:9000
then it able to fetch items of bucket but are not been able to fetched while accessing from domain inventory.vmplay.ml.conf
both files for apache configuration are :-
` GNU…
Vishnu Mali
- 11
- 1
1
vote
0 answers
Pod not scheduling on a specific node due to unsatisfied podAffinity
I have a really weird problem that I can't figure out.
I am trying to set up a self-managed MinIO tenant, with 3 pods with 3 drives each, one for each node in my 3 node K3S setup in a embedded etcd HA configuration :
NAME STATUS ROLES …
John Kim
- 1,081
- 10
- 26
1
vote
2 answers
java.lang.ClassCastException while saving delta-lake data to minio
I am using minio as storage for my spark driver as well as executor pod. I'm downloading some data and then uploading it to minio. Later I'm reading the data and saving it in delta-lake entries. I'm able to read data from minio with delta-spark.…
Aman
- 193
- 2
- 15
1
vote
1 answer
Can you set auto deletion for every bucket and every future bucket on MinIO
I'm using MinIO and want to set a service-wide lifecycle policy that will delete every bucket that's old than a specific period of time (In my case it's 1 day).
I also want this policy to work on buckets that will be created at the future
I wonder…
user16713791
- 59
- 3
1
vote
1 answer
Is there any way to copy folder and files to minio bucket deployed from Helm after post deployment?
I want to copy folder and its subdirectory to MinIO server which is deployed using MinIO Helm.
Is there any way to copy folder to MinIO bucket which is deployed on cloud using helm after postdeployemtn of Helm service using Helm?
Harsh Gajjar
- 51
- 7
1
vote
1 answer
Why Valero not able to find minio service and host and velero Backup Fail?
I have setup minio with NFS storage and also install velero on kubernetes cluster. I have one master and 2 worker nodes onperm. Both pods (minio and velero) are running with no error. When I try Velero backup create testbackup --include-namespaces…
tauqeerahmad24
- 358
- 8
1
vote
0 answers
AWS config with local endpoint environment variable to use with 3rd party tools like MinIO
I am running MinIO docker instance in my local environment for testing(integration) my SAM(Lambda) application.
MinIO gives all the standard AWS S3 facility locally. And it can be connected locally as following
awsSession :=…
Kuldeep Yadav
- 1,664
- 5
- 23
- 41
1
vote
1 answer
Is there a way to serve the video part, providing start end seconds?
I am trying to use the backend to serve the video from the storage. I use Go + GIN It works but I need to implement video requests with start and end parameters. For example, I have a video with 10 mins duration and I want to request a fragment from…
STK90
- 321
- 8
- 11
1
vote
1 answer
How to connect python s3fs client to a running Minio docker container?
For test purposes, I'm trying to connect a module that intoduces an absration layer over s3fs with custom business logic.
It seems like I have trouble connecting the s3fs client to the Minio container.
Here's how I created the the container and…
KaizenCat
- 11
- 2