Questions tagged [fibre-channel]

Fibre-channel is a communications protocol widely used in storage networks. It's most widely deployed in enterprise SAN environments, where large amounts of storage need to be shared amongst a number of different hosts, potentially over longer distances. The protocol is primarily used over fibre optic media (hence the name), but can also be used with copper interconnects.

Fibre channel is a communications protocol widely used in storage area networks (SANs).

The protocol itself is used to communicate storage commands and data flow (typically SCSI) between a particular storage controller and a host to which the storage is exposed. It has a number of different speed variants, most commonly seen are 2G, 4G and 8G with bandwidth limitations of 2Gbit, 4Gbit and 8Gbit respectively. 16Gbit has recently been introduced.

A fibre channel network can have a number of topologies. This can be a loop (called FCAL - Fibre Channel Arbitrated Loop) where a single host bus adaptor is connected to a single loop with one or more devices on it. FCAL is normally used to connect a controller to a disk array as fibre channel disks typically don't directly support switched fabrics.

A fabric is a switched network using one or more switches to connect hosts to controllers1 in a M:M relationship. Fibre channel supports multiple paths between hosts and controllers, and fibre channel disks actually support two loop interfaces through a SCA-40 plug. This allows the implementation of architectures with no single point of failure. Controller pairs can synchronise caches and a host with multi-pathing support can use both controllers in a pair or fail over from one to the other.

Fibre channel is most widely deployed in enterprise SAN environments where a large amount of storage must be shared amongst different hosts. Single mode fibre connections allow storage area networks to cover campus or metropolitan areas tens of kilometres. Replication over wider areas typically requires the controllers to be connected through another WAN protocol such as ATM.

Native Fibre Channel can be run over copper or fibre optic interconnects, although a protocol known as Fibre Channel Over Ethernet (FCoE) encodes the payload over Ethernet frames, allowing the use of cheaper Ethernet cabling and switches.

1 A controller is something like a SAN controller that presents one or more volumes to the SAN through Logical Unit Numbers (LUNs). A SAN can have more than one controller.

186 questions
3
votes
2 answers

What is a proper procedure for unplugging fiber chanel from ESXi

In my DC admins have to unplug my FC connection from ESXi5 (from EMC VNX) (temporary, some maintance works). I have never done that before and have some doubt about my own procedure... My first thought was to turn off all VM's (but only few are…
B14D3
  • 5,188
  • 15
  • 64
  • 83
3
votes
2 answers

How do you remove attached FC LUNS from CentOS 6?

We have a Qlogic QLE2560 HBA running on a Centos 6 server. I am needing to remove the attached LUNS remotely. I do not have any software from qlogic installed on the device. Their are 2 LUNS attached to a P200 G3 SAN and I can not find anything…
Justin S
  • 350
  • 3
  • 15
3
votes
1 answer

Is it possible to connect a FC HBA 8 Gb through 10 Gb Ethernet SFP+?

I have to connect an IBM Server with a QLogic EP2532 to an IBM DS3512 with a PMC PM8032. I need two 8 Gb FC LX 1310 nm SFP+ modules and since they seem to be hard to get, I thought would it be possible to take two 10 GbE FC SFP+? I know there's a…
JohnnyFromBF
  • 1,259
  • 6
  • 21
  • 25
3
votes
1 answer

Linux Fiber Channel Host Setup Basic

I've been googling for about 4 hours now with no luck. I am trying to setup a Linux server running Oracle Server 6.3 as a Fiber Channel host. And then connect it to a Dell Compellent Fibre Channel Host contain a 500GB Volume. The Oracle server…
Jim
  • 988
  • 7
  • 20
  • 33
3
votes
1 answer

How to get multipath working for Ubuntu Server 12.04

I'm working on a project which aims to make use of Ubuntu servers running on enterprise class hardware. In our case that means IBM HS23E blade servers, QLogic 4GB fibre channel extension cards and quite old IBM DS4500 disk array with two…
mlampi
  • 31
  • 1
  • 2
3
votes
1 answer

Fiber Channel Loop vs Point to Point

So, I'm playing with a couple of QLogic QLA2340s connected directly together. I've got options here to either have them act as a loop, or in point to point mode. What's the difference if I'm only going to have two machines connected together? Is…
RandomInsano
  • 451
  • 1
  • 5
  • 19
3
votes
3 answers

Merit and demerits for various Linux fiberchannel multipath options

On our Linux servers, we currently use HPs qla2xxx drivers, because it has multipathing (active/passive) built in. The are, however, various other options, like Red Hats device-mapper-multipath with the stock qla2xxx drivers (multibus and failover)…
wzzrd
  • 10,409
  • 2
  • 35
  • 47
3
votes
1 answer

COMSTAR and ZFS zvol giving bursty write pattern

I've just built a small NAS/SAN box and am doing some testing with it. Configuration is: 2GB RAM 2x Opteron 265s Iwill DK8N 5x500GB SATA drives (1 spare, rest mirrored) = 1TB usable space Emulex LPC10000DC NexentaCore 3.0.2 The first thing I'm…
growse
  • 8,020
  • 13
  • 74
  • 115
3
votes
1 answer

Fibre Channel zoning best practices

I'm hoping that this will be useful for more people than just me. Right now I've got a fibre channel switch, a NetApp filer, and some servers running Oracle. All of the servers can see the same LUNs on the filer, and there's some internal…
Bill Weiss
  • 10,979
  • 3
  • 38
  • 66
3
votes
3 answers

Which OS can work as a fiber-channel target?

Just for the research, which OS can work from the box or with some 3rd-party software as a fc-target? I know only the following: Solaris (currently only OpenSolaris+COMSTAR), Windows Storage Server. Is that the only two above can?
disserman
  • 1,850
  • 2
  • 17
  • 35
2
votes
0 answers

fsck.ext4 complaining that the device is in use. Can't find what exactly is using it

Our setup is a 3-node RHEL 7.3 bare-metal Kubernetes cluster running on Docker. We have a multipath FC SAN block device discovered on all three nodes. This device is used as a Kubernetes Persistent Volume with ext4 filesystem. The definition of this…
2
votes
2 answers

Fibre channel zoning with VMware datastores

If I have multiple VMware ESXi servers controlled by vCenter that share a datastore over FibreChannel, what is the best practice for zoning those connections? I see two obvious ways to do this: Create one zone per server, each zone containing the…
wfaulk
  • 6,878
  • 7
  • 46
  • 75
2
votes
0 answers

Blade Server Networking Connectivity Solution

We are looking at purchasing 4 of the Dell M1000e Blade Chassis', along with 16x Half Height Servers in each. For our LAN Connection, we are looking at 2x MXL 10/40 GbE IO's per Chassis. From my understanding, each side of the chassis can be daisy…
2
votes
0 answers

FibreChannel-SAN SCSI-block-devices get lost

There are 3 LUNs on a FC-SAN I want to access using 2 HBAs (with two paths each. When the system is booted, everything seems fine, but after a while the sd*-devices from the second HBA disappeared and I have no Idea why or how to get them back…
Christian
  • 341
  • 1
  • 2
  • 10
2
votes
1 answer

VMware ESXi config pass-through for Fibre Channel

I want to config pass-through for FC in VMware ESXi 5.5 (FC HBA: ISP2532-based 8Gb Fibre Channel to PCI Express HBA) follow the link https://tinkertry.com/usb3passthru. But when I turn on the virtual machine, I receive error: Failed to start the…
Waveter
  • 564
  • 2
  • 6
  • 23