Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [lustre]

Lustre is an Open Source, high performance, parallel, highly scalable distributed file system.

Lustre is distributed file system generally used for large-scale cluster computing. It is often used in supercomputers because of its high performance capabilities.

The name Lustre is derived from Linux + Cluster.

OpenSFS(http://opensfs.org) supports the continued evolution and success of the Lustre file system by ensuring that Lustre remains vendor-neutral, open, and free.

Official site for Lustre http://lustre.org/

24 questions
0
votes
1 answer

Lustre: find where inodes are being used

I'm looking for a command that will list the number of files across several directories simultaneously. Currently, I can do this for a single directory: lfs find DIRECTORY -type f | wc -l But this is tedious to do iteratively. Can someone think of…
Evan
  • 101
  • 4
0
votes
1 answer

Lustre: inode/files quota: dependent on striping?

My understanding of the Lustre file system is that every file uses one inode on a metadata target (MDT), and then one inode per stripe on the object storage targets (OSTs). My question is, which of these numbers counts towards my file number (inode)…
Evan
  • 101
  • 4
0
votes
2 answers

Is it possible to have a directly attached SHARED Storage (accessed at block level) other than SAN or NAS?

We need storage specifically for HPC Lustre failover setup, where it is must that two servers should share same block level storage to have failover configuration. With very limited knowledge on hardware, I have the below understanding: NAS can be…
GP92
  • 681
  • 2
  • 9
  • 27
0
votes
1 answer

Change the Hard Drive in RAID using tw_cli while lustre file system is mounted

I've setup RAID-5 array disk, but recently one of the Hard drives is reallocating excessive sectors: (Reallocated Sectors = 323) # tw_cli /c0/p1 show all /c0/p1 Status = OK /c0/p1 Model = ST31000340NS /c0/p1 Firmware Version = SN05 /c0/p1 Serial =…
Mishooq
  • 1
  • 1
0
votes
1 answer

Mongodb over Lustre?

I need to install a mongodb instance with a lot of data storage. We have a Lustre FS with hundreds of terabytes, but when monogdb start show me this error: Mon Jul 15 12:06:50.898 [initandlisten] exception in initAndListen: 10310 Unable to lock…
UnixEng
  • 1
0
votes
1 answer

How do we configure Lustre to block client requests when under load, rather than failing?

We are using Lustre in a cluster with approximately 200TB of storage, 12 Object Storage Targets (that connect to a DDN storage system using QDR Infiniband), and roughly 160 quad and 8-core compute notes. Most of the users of this system have no…
vy32
  • 2,088
  • 2
  • 17
  • 21
0
votes
1 answer

MySQL files on Lustre?

Our MySQL installation stores several Tb of data that doesn't get accessed too often. Over the next six months we're going to be moving to a Lustre based system for much of our data storage and Im wondering how MySQL would behave if it were storing…
ethrbunny
  • 2,369
  • 4
  • 41
  • 75
0
votes
1 answer

Lustre - issues with simple setup

Issue: I'm trying to assess the (possible) use of Lustre for our group. To this end I've been trying to create a simple system to explore the nuances. I can't seem to get past the 'llmount.sh' test with any degree of success. What I've done: Each…
ethrbunny
  • 2,369
  • 4
  • 41
  • 75
0
votes
0 answers

how to check if a lustre directory has been set by chattr +P for project quota

lustre doc wrote: To limit quota usage for a specific project ID on a specific directory ("/mnt/testfs/dir" in this example), run: $ chattr +P /mnt/testfs/dir $ chattr -p 1 /mnt/testfs/dir $ lfs setquota -p 1 -b 307200 -B 309200 -i 10000 -I 11000…
Tintervenor
  • 33
  • 2
1
2