Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [s3fs]

s3fs is FUSE-based filesystem that stores files in AWS S3.

s3fs is FUSE-based filesystem that stores files/data in AWS S3.

65 questions
1
vote
1 answer

S3 Bucket for hosting media, s3fs mount catch-22

I'm attempting to use an S3 bucket to host media files (images, video and static files) for a small web application and came across a strange catch-22... According to the S3 documentation, to serve a static website (it's not a static website, just…
mwieczorek
  • 121
  • 3
1
vote
0 answers

sharing a S3 storage mount via samba: Permission denied

At work we've recently deployed several S3 storage servers. However, not all of our customers have the ability to work with S3 storage due to old hardware/software. We tried to work around the problem by creating a samba "proxy" that mounts the S3…
Shadur
  • 1,337
  • 1
  • 11
  • 20
1
vote
0 answers

Subdomain pointing to deleted S3 bucket

I am stuck in my present (AP-SOUTH) and deleted (US-EAST) S3 bucket. I had mistakenly created a bucket in US-EAST (cdn.example.com.s3-website-us-east-1.amazonaws.com) and mapped my subdomain - cdn.example.com I allowed read public access and added…
kandav
  • 11
  • 2
1
vote
2 answers

AWS S3 no space left on device

I am mounting a S3 bucket on a amazon EC2 instance using S3FS. Things have been working great for now over 18 months. Today I've tried to download a 5GB file using wget directly on the S3 bucket (things I already done before without issue) and I…
magdmartin
  • 121
  • 1
  • 6
1
vote
1 answer

Best manner to access files in S3 Bucket from EC2 instance

I have tried several packages (goofys, s3fs, fuse) and have not been able to find a solution to my problem. I have an S3 Bucket with several thousand files currently in it and will continue to grow. Most applications to map S3 to EC2 work for…
Steven K7FAQ
  • 277
  • 2
  • 3
  • 13
1
vote
0 answers

Root user permission issues with SFTP and S3FS on Amazon EC2

I have setup an SFTP server using OpenSSH. The home directory for users is /sftp/%user. I'm mounting an S3 bucket at /sftp using S3FS. The problem is that S3FS cascades user permissions down through it's directory structure, meaning: I can…
T. Brian Jones
  • 927
  • 4
  • 17
  • 29
1
vote
0 answers

Amazon S3 sync theory

I'm setting up a backup of my vital data (database and images, mainly) to S3 from my Ubuntu box. I've set up Amazon S3, and installed S3FS to mount the bucket on my machine. This is working well, but when I test my script, I'm getting a…
dKen
  • 193
  • 9
1
vote
1 answer

Fuse module for s3fs

I am trying to install the s3fs software. I however keep coming upon this error: $ sudo /usr/bin/s3fs bucketname /mnt fuse: device not found, try 'modprobe fuse' first $ modprobe fuse FATAL: Module fuse not found. When I checked if the kernel, it…
frazras
  • 193
  • 1
  • 9
1
vote
1 answer

What's the best way to enforce a maximum size on a file directory?

I'd like to create directory with a maximum size of, let's say 500MB. The directory may contain any number and depth of subdirectories. When the maximum size limit of the directory is surpassed, I would like to purge the directory of the last…
Jim D
  • 501
  • 1
  • 5
  • 12
1
vote
4 answers

Shared encrypted filesystem for ec2 instances

Me and my company intend to start using ec2 for distributing some cpu-intensive pieces code, involving a few 10s of gb of data, however I have some concern about the protection of the intellectual property which the code holds (and to a much lesser…
itai
  • 111
  • 2
1
vote
1 answer

Getting errors running mount on Amazon Linux after installing s3fs (`MOUNT_2.22' not found required by mount)

Followed these instructions to install s3fs on Amazon Linux. It worked fine on one of my systems, however on a different system (following the same instructions) I am getting the following errors when running /bin/mount [root@ip-10-99-1-35 lib64]#…
Kladskull
  • 1,255
  • 5
  • 15
  • 32
1
vote
1 answer

Mounting an S3 bucket onto a AWS Ubuntu instance issues

i'm using s3fuse to mount an s3 bucket onto ubuntu, so that i can take advantage of the storage space. here are some environment info: System Info: Linux ip-xxx-xxx-xxx-xxx 2.6.38-8-virtual #42-Ubuntu SMP Mon Apr 11 04:06:34 UTC 2011 x86_64 x86_64…
Robert Van Sant
  • 259
  • 2
  • 6
1
vote
0 answers

S3FS mount does not work as non-root user

I'm trying to mount an Exoscale bucket to an Exoscale VM running Ubuntu 20.04 using s3fs. After reading the s3fs README and a few online tutorials here what I have done. Please, bear in mind, I'm doing it as the ubuntu default user and not as root.…
Sig
  • 141
  • 4
1
vote
1 answer

S3FS Mount does not seem to work: Am I doing something wrong?

So I've just a brand new VPS which I'll be using for nextcloud. I followed this guide. I did (on a brand new machine): Apt install s3fs Create a /etc/passwd-s3fs file with key:secret key Chmoded it 600 Ran s3fs nameofmywasabibucket /mnt/wasabi…
Matthieu B
  • 41
  • 4
1
vote
3 answers

mysqldump using a lot of space

I have a server and the / partition is 20GB in size. Databases are stored in /mnt/mysql-data partition is 500GB in size. Now here's the problem. Whenever I run mysqldump it fills up / partition to 100%. I have already moved the tmpdir to…
Christian Noel
  • 129
  • 9
1 2
3
4 5