Download entire directory in a bucket of MinIO

Question

Here is my MinIO tree

bucket1
|
|-dir1
|-dir2
    |-file1
    |-file2
    |-file3

I want to download the entire directory "dir2" using python API.

The only way I can think of is to download files one by one. Is there another way / API call to download entire directory?

score 3 · Answer 1 · answered Oct 06 '20 at 12:38

3

If you simply need to download the files use minio client copy. mc cp (source) (destination) --recursive

answered Oct 06 '20 at 12:38

AshithR

98
1
9

2

OP states "using python API"? – jtlz2 Jul 07 '21 at 14:02
I find this simpler than using the API. – david.perez Jun 29 '23 at 09:49

score 1 · Answer 2 · answered Mar 25 '22 at 13:45

if u are using api lookelike python u can use this:

client = Minio(
    "storage_address",
    access_key="XXXXXXXXXXX",
    secret_key="XXXXXXXXXXXXXXXXXXXXXX",
)

for bucket in client.list_buckets():
    for item in client.list_objects(bucket.name,recursive=True):
        client.fget_object(bucket.name,item.object_name,item.object_name)

recursive=True will open all folders and fget_object will save file with file name and folder

score 0 · Answer 3 · answered Nov 04 '19 at 11:59

I don't think that it is possible right now. The closest approach is to use the ComposeObject function just like on the Golang SDK API Reference. However, it is not clear that the file extension will be an archive just like ZIP or not. The most possible approach is to download the files one by one.

Download entire directory in a bucket of MinIO

3 Answers3