0

I have 2 hosts in isolated networks (no network access from one to another). There is a storage system accessible over fibre channel from both hosts.

Is it possible to have both hosts have a safe read-write access to the same LUN?

If yes, what are the performance implications?

Tair
  • 276
  • 3
  • 10
  • The correct answer is to use a cluster-aware filesystem, but I do not know how many of those will work if there's no network connectivity between the hosts. – mfinni Apr 24 '14 at 15:22

3 Answers3

2

You did not mention the operating system you use.

With Linux, there is GFS, OFCS, GPFS, CXFS and other parallel file systems which you could use. How they perform, is heavily depending on a workload your environment has. Lots of reads? Even more of writes? Tons of small files or just a bunch of huge files?

The performance... well.. if you have millions or more of small files, a catastrophe is a word I could use. A reasonable number of files, no matter of their size, a much better situation.

But this truly varies from system to system and from filesystem to another filesystem. You truly should be more specific.

Janne Pikkarainen
  • 31,852
  • 4
  • 58
  • 81
2

Yes but you need two things, or kind of one thing in a way, you need a cluster-aware filesystem and a locking mechanism - sometimes these come as one thing.

You don't mention a filesystem but for VMWare's ESXi the default VMFS filesystem IS cluster aware and handles the locking directly itself. For Windows the default NTFS (or ReFS) is NOT cluster aware by default and requires you to either use the cluster services (part of the Enterprise versions) or a third-party solution such as Symantec Foundation. For Linux it depends on your distro but I use Oracle's OCFS2 and it works a treat.

Maybe come back with your OS and any further questions and I'll see what we can do.

Chopper3
  • 101,299
  • 9
  • 108
  • 239
1

Yes, but you'll need to do it as a cluster. Or you'll need to direct attach the storage and share across a network (CIFS/NFS) to the other).

Otherwise you'll find that you have some awful junk and corrupt data. The reason for this is because locally attached disk is pretty slow, when compared to processors and memory. There's therefore a lot of things your system does to optimise it's usage - including read caching, write caching and separating out the process of updating a block on disk and then the file allocation table.

For all these reasons, you'll end up with an utter mess if you 'just' present a LUN to two servers concurrently - I tried it once for the sake of interest, and it gets messy fast.

So what you'll need is 'some way' for the servers to arbitrate disk access between them - and whilst you could reinvent the wheel, cluster software does it for you. NFS across a fast network is not nearly as bad a performance problem as you might imagine either.

Sobrique
  • 3,747
  • 2
  • 15
  • 36
  • With no network connectivity between hosts, doing it as a fileshare won't work, of course. – mfinni Apr 24 '14 at 15:22
  • Granted, and a good point. I merely mention it as an option for arbitrating the access. Of course, FC is a network layer, and you can run IP over it without too much difficulty. So perhaps converting one of the HBAs (or perhaps the spare ports if you've dual port) to run IP might work? Then you can have NFS over Fiberchannel, and make all sorts of people shudder in horror. – Sobrique Apr 24 '14 at 15:38
  • Unfortunately I can't use IP over Fibre. The underlying storage must be dumb, because IP is prohibited between those 2 networks (no link allowed) – Tair Apr 24 '14 at 16:50
  • Whilst I don't doubt that's a thing, it's a daft policy - FC is a network protocol too, and almost no one firewalls or uses NIDS on their SAN. – Sobrique Apr 24 '14 at 16:54
  • The scheme is this: Host A -> FC Switch A -> Storage <- FC Switch B <- Host B – Tair Apr 24 '14 at 16:58
  • 1
    Slightly less daft then. But I think it'll be a challenge - I _think_ there's clustering options that do so via quorum disk only, but it's not something I've found necessary often. – Sobrique Apr 24 '14 at 19:46