Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [s3fs]

s3fs is FUSE-based filesystem that stores files in AWS S3.

s3fs is FUSE-based filesystem that stores files/data in AWS S3.

65 questions
0
votes
1 answer

s3fs does not parse NO_PROXY / no_proxy env variables

I am running s3fs on a node in corporate network which is behind proxy. I am trying to mount S3 bucket on another node next to it. Both nodes are in 10.88.97.65/27 network and should be able to communicate directly. On both nodes I have set…
Vuk Gojnic
  • 1
0
votes
0 answers

S3FS and Fuse, scale out or scale up

I have an infra where I have multiple machines (eg FTP servers, get/put and Samba/NFS servers) that need to share out the same (HA) storage. So I figured to use s3fs and fuse. I got this all setup and this works fine, I have two servers each…
user292026
  • 133
  • 4
0
votes
1 answer

Automate s3fs-fuse install

I'm trying to write script to install s3fs-fuse, but i don't know how to change directory in a bash script. These are the script I want to automate git clone https://github.com/s3fs-fuse/s3fs-fuse.git cd s3fs-fuse ./autogen.sh ./configure make sudo…
Casper
  • 117
  • 8
0
votes
1 answer

Is S3 a proper choice to keep live linux user home directories?

We are building an RDP cluster using Amazon EC2/S3. Users' home directories are on S3 (single bucket) and all EC2 nodes mount the same S3 bucket using S3FS. Each EC2 node uses the appropriate home directory of the user that logs in to that node. It…
Vij Vijay
  • 23
  • 1
  • 6
0
votes
1 answer

Does linux count s3fs mounts as local disk usage?

I have an s3 bucket mounted on an EC2 instance whose main disk is an EBS volume. Whenever I run something like du -h /path/to/mount it tells me the size of the folders within those. I'm wondering now if Linux is counting the space used in those…
FaCE
  • 201
  • 1
  • 5
0
votes
1 answer

AWS: Best solution for syncing files across autoscaled EC2 instances?

I'm working on setting up autoscaling on EC2; Instances will be running a web app with big traffic spikes. The first solution I tried for syncing files across instances (since the web app will write files to disk) was S3 with s3fs for mounting.…
ddario
  • 511
  • 1
  • 3
  • 12
0
votes
1 answer

autoscale static content on ec2 using local cache

Hello Serverfault members. I want to achieve the following setup on EC2: A load balancer starts and stops instances which only serve static content. (a javascript based application) I do not want to manually update the code of the application on the…
McFarlane
  • 113
  • 4
0
votes
1 answer

Subsequent runs of rsync locally don't reduce data transferred

I have an EC2 instance with data I want to sync to a mounted, but remote, volume, as a backup. rsync seems like the way to go with this, so as a test I took my test file (a Postgres pg_dump file) and used rsync -v to copy it to the mounted…
sharakan
  • 115
  • 5
0
votes
1 answer

configure s3fs mount for write-only

I am using s3fs to mount a S3 buckets on an Ubunutu server to store my daily backups there. Considering security this would allow a potential hacker to delete all my backups from the mounted bucket. Is there a way to prohibit that? Maybe mounting…
Thomas Einwaller
  • 288
  • 1
  • 3
  • 12
0
votes
1 answer

s3fs and fuse: failed to open /dev/fuse: Permission denied

Just installed Debian 6 box. I wanted to mount my S3 bucket for some backups. So I followed instructions for http://code.google.com/p/s3fs/ . 1) I installed all perquisites asked in installation instruction. 2) Compiled and installed s3fs. 3)…
Edgars Jekabsons
  • 103
  • 1
  • 3
0
votes
3 answers

Bacula over s3fs

We are constantly running out of space on our backup server so I want to move the backups to S3. Does it make sense to run Bacula on top of s3fs? Does anybody have experience with that? Is it reliable? What about bandwidth use? Can I expect s3fs to…
Pablo Fernandez
  • 7,438
  • 25
  • 71
  • 83
0
votes
0 answers

VSFTPD - Issue with chroot and s3fs

I have a small issue with VSFTPD, and I'm not able to resolve it yet, so I'm coming here to get your tips ! The user has a ftp directory in its home, which is a mount point through s3fs, to access a S3 bucket. Settings to start my s3fs : s3fs…
Arthur Deslauriers
  • 13
  • 3
0
votes
0 answers

Cannot mount S3 bucket on Opensuse 15.1

I am trying to mount an AWS S3 bucket on my Opensuse 15.1 system but the command never finishes. After activating debug functions, this is where it gets stuck eternally. Any ideas on how to address this issue? * Connection #0 to host…
ThisGuyWithALotOfQuestions
  • 1
0
votes
1 answer

mount a readonly public s3 bucket with s3fs

We have minio server with a public readonly bucket. I want to mount it using s3fs but cannot figure out how to mount it. s3fs always wants credentials from me.
gdkrmr
  • 103
  • 3
0
votes
1 answer

Bandwidth consumption of Amazon S3 bucket mounted with S3fs on a VPS

I have : VPS server on Vultr with web server and Wordpress installed. Uploads folder is mounted on Amazon S3 bucket using s3fs. If a user downloads a 1GB file from my website will the traffic be served to him from Amazon S3 directly or it will be…
Imad Sid
  • 1
  • 1
1 2 3
4
5