MinIO offers high-performance, S3 compatible object storage. Native to Kubernetes, MinIO is the only object storage suite available on every public cloud, every Kubernetes distribution, the private cloud and the edge. MinIO is software-defined and is 100% open source under GNU AGPL v3.
Questions tagged [minio]
906 questions
0
votes
1 answer
How to configure Harbor on k8s cluster?
I'm trying to deploy Harbor(private docker registry) on k8s cluster(provisioned by Rancher) using helm(values.yaml).
below is my valuse.yaml.
Network
I have nginx front of k8s ingress nginx controller.
nginx(http 301 redirect to https, ex.…
권기범
- 11
- 4
0
votes
1 answer
Gitlab runner fail to use cache with minio
I installed a self-hosted Gitlab using the Helm chart on a Kubernetes cluster.
Everything is working fine except one thing: the cache.
In my .gitlab-ci.yml file I have
cache:
paths:
- .m2/repository/
- target/
But when running the job I…
MHogge
- 5,408
- 15
- 61
- 104
0
votes
0 answers
Create a MinIO Bucket in NiFi - Using ExecuteScript processor and (J)python
The 5 S3 related processor present in NiFi cannot create a Minio Bucket.
ListS3
PutS3Object
DeleteS3Object
FetchS3Object
TagS3Object
So I tried to use the ExecuteScript processor and import the python minio module inside of it
In order to do that…
NeitoFR
- 716
- 1
- 11
- 23
0
votes
0 answers
cannot insatll python plugin though I can see pip3 installation goes well
I am facing a very strange issue
I followed this video
https://www.youtube.com/watch?v=huoXr1pbzUQ
and here is the steps I took:
virtualenv -p /usr/local/bin/python3.7 .venv
source .venv/bin/activate
pip3 install minio
pip3 freeze >…
Learner
- 1,686
- 4
- 19
- 38
0
votes
1 answer
Changes to minio browser do not appear when running minio server
My goal is to modify the Minio browser for front end appearance in house. I'd like to add features too but can't seem to get either to work and feel like I'm missing something about how go accesses npm or the browser.
I have made changes to the…
Lou
- 51
- 1
0
votes
0 answers
Getting "server keep idle connection" errors using MinIO with Go as I open many connections in a row, how can I solve the issue?
I have a service which wants to open 28 connections to different S3 objects to save them there for later reuse.
At this time, I'm testing my code against localstack to make sure it will work and avoid potential confusion in our real S3…
Alexis Wilke
- 19,179
- 10
- 84
- 156
0
votes
0 answers
Dockerised Google Cloud Storage for sandboxed environments
Can anyone recomend a good docker service that I can use in place of Google Cloud Storage in a sandboxed environment.
Previously when using AWS, I have swapped out the S3 buckets for a minio server running in a docker container as it has the same…
x20mar
- 479
- 5
- 17
0
votes
1 answer
Process stream data using producer-consumers with 1 synchronous producer
I have an application with the following workflow.
Users upload row-based json file(each line is a record) using minio
Then they send the application request to process it.
The application then starts downloading data as a stream using this…
JaK
- 66
- 1
- 9
0
votes
1 answer
Appending chunked data to a variable gives an unexpected result
I'm trying to add a JSON object which comes from minio file to MongoDB
But the data is like undefined[{"field":"value"}]
Here is my code:
var miniData
minioClient.getObject(fileData.type,fileData.userId+fileData.fileName,function(err,exData) {
…
Caner Ünver
- 61
- 9
0
votes
1 answer
ERR_TOO_MANY_REDIRECTS for Minio via NGINX Ingress Controller
I have a Minio ClusterIP service running in a Kubernetes cluster. And on top of it, I have a NGINX Ingress Controller. NGINX Ingress needs to forward Minio traffic to the Minio service, and other traffic to their corresponding services.
My Ingress…
Yuci
- 27,235
- 10
- 114
- 113
0
votes
1 answer
Unique resource identifiers for S3 blobs
Is there any "standard" way to uniquely identify an S3 blob using a single string?
There are multiple services that support the S3 protocol: AWS, Minio, GCS.
Usually, to access an S3 blob, you must provide endpoint (+region), bucket and key. The…
Ark-kun
- 6,358
- 2
- 34
- 70
0
votes
2 answers
how to store tfstate remotely Terraform backend by s3 bucket
My available resources are
OS - ubuntu 18.04 | Terraform cli - Terraform v0.12.9 | user - root login
My problem is - I want tfstate to store remotely backend by s3 so I created manually, a
s3 bucket - sellist-infra
for that I created…
soldier
- 101
- 1
- 10
0
votes
1 answer
C# Minio PutBucket Request: A WebException with status NameResolutionFailure was thrown
I'm working on an Amazon s3 Compatible Object Storage solution (Minio).
I have an Minio server on e.g 192.168.235.143:9000
I have tried to get List of buckets on C# version of Amazon s3 Api.
Everything works fine.
When I try to Put a Bucket into…
RezaNoei
- 1,266
- 1
- 8
- 24
0
votes
1 answer
Which s3 compatible blob storage?
I want deploy a s3 compatible blob storage in my Kubernetes Cluster. I already use GlusterFS for volumes like mongodb, and I tried to set up minio with the helm chart https://github.com/helm/charts/tree/master/stable/minio. I just realize I can't…
Antoine
- 310
- 1
- 5
- 14
0
votes
1 answer
Write delta file to S3 (MinIO) - PySpark 2.4.3
I am currently trying to write a delta-lake parquet file to S3, which I replace with a MinIO locally.
I can perfectly fine read/write standard parquet files to S3.
However, when I use the delta lake example
Configure delta to s3
It seems I can't…
Thelin90
- 37
- 2
- 11