Stack Overflow
Stack Overflow

Questions tagged [lustre]

A highly scalable distributed file system.

Lustre is a highly scalable distributed file system. http://lustre.org/

44 questions
0
votes
1 answer

How to add the lustre file system client to a BlueData container?

I'm trying to set up a lustre client (docs) inside a docker container running on BlueData. As per this post, I've modified the BlueData config on each worker and the controller node: $ vi…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
1 answer

Determine Filesystem at runtime in C/C++

How can I determine if a file my code is reading or writing is mounted on a path on top of Lustre, GPFS, or NFS at runtime, from within a C/C++ code? Edit: Working code: #include #include int main(int argc, char** argv) { …
user14717
  • 4,757
  • 2
  • 44
  • 68
0
votes
1 answer

Loading lustre kernel modules on AWS linux

I'm trying to load lustre modules into a Linux instance running Linux 4.15.0-1040-aws and a 18.04 Ubuntu disk image (the 18.04 AMI). I've downloaded and installed (i.e. dpkg -i) the lustre client debs for 18.04 from Ubuntu 18.04 - Lustre 2.12.2: -…
init_js
  • 4,143
  • 2
  • 23
  • 53
0
votes
1 answer

User Level Library for Loopback Storage (no loopback device for Spark applications in HPC)

Cray recommends using loopback devices for running Spark on HPC cluster with Lustre file systems [1]. The problem is most HPC clusters do not provide access to loopback devices for their users. So I wonder if there is a library that opens only one…
M.Rez
  • 1,802
  • 2
  • 21
  • 30
0
votes
1 answer

Significance of LOV and LLITE metrics in Lustre

I am looking for metrics that affect/reflect user I/O performance. So far I understand OST and MDT metrics are significant. But is there any other metrics which get updated during file write/read operation? Mainly I want to know what is the…
Masudul Hasan
  • 137
  • 2
  • 17
0
votes
1 answer

Lustre Client on Linux Kernel 4+

Does anyone know if it is possible to install lustre client software on a linux machine that has kernel 4+? From what I have experimented so far, all the working examples are on kernel 3.10. And if I try to install kmod-luster-client on 4+ machine,…
Alex
  • 247
  • 3
  • 12
0
votes
2 answers

error: SERVER does not appear in AM_CONDITIONAL

I am trying to install Lustre on CentOS 7. I followed this link. When I try to run sh ./autogen.sh to generate the configure script I get the above error as illustrated below. [root@localhost lustre-release]# sh ./autogen.sh configure.ac:10:…
wokesleepyninja
  • 1
  • 1
0
votes
1 answer

Is it possible to over-ride underlying filesystem using docker container?

I want to use bazel to build tensorflow on CentOS 6.6 cluster which uses Lustre filesystem. This filesystem doesn't support locking. Refer this issue on github. I have read that docker can provide virtualisation. Will it be possible for me to use…
Joy Chopra
  • 120
  • 1
  • 2
  • 11
0
votes
2 answers

Lustre file system: how many OSTs?

Is there a way, besides bugging the sys admins, to determine how many Lustre OSTs a parallel system has?
bob.sacamento
  • 6,283
  • 10
  • 56
  • 115
0
votes
1 answer

Lustre hangs while mounting oss

I have installed Parallel file system "Lustre" along with this slide with RPM. Have set node A, B. Installed mds and mdt to node A. Its mount was successful. But, After format oss to node B using mkfs.lustre, then I mounted it, but it began…
Jafffy
  • 115
  • 8
0
votes
1 answer

Parallel HDF5: "make check" hangs when running t_mpi

I've being struggling to get the parallel HDF5 to work on the cluster for a whole week but without any progress. I wish if anyone could help me with this. Thanks! I'm building the Parallel HDF5 (hdf5-1.8.15-patch1) on a lustre file system with…
Yang Yuan
  • 81
  • 4
0
votes
1 answer

Duration of starting Mysqld is too long on Lustre file system (InnoDB: Unable to lock ./ibdata1, error: 38)

I can start mysqld and use it normally. But the duration of start is very long (over 3 minuts). When I check log file (/var/log/mysqld.log), I found InnoDB: Unable to lock ./ibdata1, error: 38. Recently, I moved my mysql data from /var/lib/mysql…
BooksE
  • 69
  • 1
  • 3
0
votes
1 answer

Mongodb over Lustre?

I need to install a mongodb instance with a lot of data storage. We have a Lustre FS with hundreds of terabytes, but when monogdb start show me this error: Mon Jul 15 12:06:50.898 [initandlisten] exception in initAndListen: 10310 Unable to lock…
Anibal
  • 1
  • 1
-1
votes
1 answer

How to rebuild Lustre Properly for MOFED

I've been struggling lately in how to get o2ib to function properly with a particular MOFED version. What I've tried so far is to install the Lustre kernel, rebuild MOFED for that Lustre kernel (which appears to be working) and then observe that ib0…
brinker
  • 1
1 2
3