Questions tagged [fibre-channel]

Fibre-channel is a communications protocol widely used in storage networks. It's most widely deployed in enterprise SAN environments, where large amounts of storage need to be shared amongst a number of different hosts, potentially over longer distances. The protocol is primarily used over fibre optic media (hence the name), but can also be used with copper interconnects.

Fibre channel is a communications protocol widely used in storage area networks (SANs).

The protocol itself is used to communicate storage commands and data flow (typically SCSI) between a particular storage controller and a host to which the storage is exposed. It has a number of different speed variants, most commonly seen are 2G, 4G and 8G with bandwidth limitations of 2Gbit, 4Gbit and 8Gbit respectively. 16Gbit has recently been introduced.

A fibre channel network can have a number of topologies. This can be a loop (called FCAL - Fibre Channel Arbitrated Loop) where a single host bus adaptor is connected to a single loop with one or more devices on it. FCAL is normally used to connect a controller to a disk array as fibre channel disks typically don't directly support switched fabrics.

A fabric is a switched network using one or more switches to connect hosts to controllers1 in a M:M relationship. Fibre channel supports multiple paths between hosts and controllers, and fibre channel disks actually support two loop interfaces through a SCA-40 plug. This allows the implementation of architectures with no single point of failure. Controller pairs can synchronise caches and a host with multi-pathing support can use both controllers in a pair or fail over from one to the other.

Fibre channel is most widely deployed in enterprise SAN environments where a large amount of storage must be shared amongst different hosts. Single mode fibre connections allow storage area networks to cover campus or metropolitan areas tens of kilometres. Replication over wider areas typically requires the controllers to be connected through another WAN protocol such as ATM.

Native Fibre Channel can be run over copper or fibre optic interconnects, although a protocol known as Fibre Channel Over Ethernet (FCoE) encodes the payload over Ethernet frames, allowing the use of cheaper Ethernet cabling and switches.

1 A controller is something like a SAN controller that presents one or more volumes to the SAN through Logical Unit Numbers (LUNs). A SAN can have more than one controller.

186 questions
4
votes
2 answers

IBM XIV (Storage Array) - Anyone?

Is anyone here using the IBM XIV storage array? Anything you would like to share of your experience so far? We're evaluating an HP EVA along with the XIV which is very different (using commodity hardware, SATA drives, Linux appliance-like 'modules…
JFA
4
votes
2 answers

How to check the current queue depth value?

I have an OEL server connected via fibre to a NetApp SAN. How can I view the queue depth as the OS sees it? Output from lspci: 05:00.0 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel to PCI Express HBA (rev 02) 05:00.1 Fibre Channel:…
에이바
  • 642
  • 5
  • 11
  • 34
4
votes
1 answer

UCS FC Adapter Aborts

So here's the scenario, and I'm hoping @Chopper3 can chime in here. For our SAN fabric, we have a pair of Cisco MDS 9513 FC switches with three EMC frames and four Cisco UCS domains directly attached. The behavior we are seeing is that the CNA's on…
SpacemanSpiff
  • 8,753
  • 1
  • 24
  • 35
4
votes
1 answer

Is IP over FC still crazy complex?

In the link below, it is explained that 4 years ago IP over FC was crazy complex: How do I set up IP over FC? Is that still the case on CentOS 6?
Sandra
  • 10,303
  • 38
  • 112
  • 165
4
votes
1 answer

Cisco FC SAN switch decision

I've got to buy a bunch of FC SAN switches in the next week or so, I have to, and want to, buy Cisco MDSs. Servers are HP BL490c G6's in C7000 chassis with Virtual-Connect Flex-10 ethernet interconnects and VC FC interconnects (Emulex HBAs btw), all…
Chopper3
  • 101,299
  • 9
  • 108
  • 239
4
votes
1 answer

Brocade ISL port monitoring

I have a pair of Brocade switches with ISLs running between them. I'd like to know if it's possible to be alerted when one of the ISL ports goes from an E_PORT to anything else (particularly a U_PORT). I am about to write a /sh script on a…
Basil
  • 8,851
  • 3
  • 38
  • 73
4
votes
3 answers

Is it possible to multipath across FC and iSCSI?

Perhaps a silly question this one, but I was wondering if it were possible to multipath a storage array across a FC connection and an iSCSI connection? Given that the main point of multipathing seems to be to increase resiliancy in the face of…
growse
  • 8,020
  • 13
  • 74
  • 115
4
votes
1 answer

ESX shut down VMs when some but not all storage paths failed

I've been on hold now for an hour waiting for VMware support and am betting serverfault can beat them to the answer! I am running ESX 4.0 and 4.1 on 6 HP blades, using FibreChannel LUN storage. We did some FC network maintenance over the weekend and…
carillonator
  • 815
  • 3
  • 12
  • 22
4
votes
5 answers

Building cheap SAN

Note: Some of you may ask, why not just use a cheap hardware solution. The solution is not so cheap in the country it has to be installed in, with as much as 100% import tax on high end technology. It's much cheaper to get a couple of new…
Erik Funkenbusch
  • 600
  • 10
  • 27
4
votes
2 answers

Understanding Linux SCSI queue depths

I'm experimenting with the effects of different SCSI queue depth values on a Dell server running CentOS Linux 5.4 (x86_64). The server has two QLogic QLE2560 FC HBAs connected via multipathing to a storage system. The storage system has allocated…
Troels Arvin
  • 652
  • 7
  • 17
3
votes
0 answers

How to setup nvmetcli for FC loopback mode?

I have a NVMe SSD, KC1000, from Kingston and a HBA, QLE2672 2-port 16Gb Fibre Channel Adapter, from QLogic and are installed on Linux kernel 4.16.6. Then I would like to set up a scenario which has a fc loop mode which is to use the sole FC HBA as…
codexplorer
  • 181
  • 5
3
votes
2 answers

Hyper-V Point to Point using FC HBA

Is it possible to connect Point to Point two Hyper-V servers using FC HBA to replicate data without connection to external storage?
user397399
  • 85
  • 2
3
votes
2 answers

FC-Multipath: Which path_selector performs best?

So I learned that since Red Hat 6 it is possible to choose between 3 algorithms for loadbalancing between different paths to my FC-SAN, the default dumb round-robin - and new - queue-length and service-time. I have been searching for a long time…
Christian
  • 341
  • 1
  • 2
  • 10
3
votes
1 answer

Can't Repair SR in XenCenter

I've added in a 4th host to my Xen 6.2 cluster and I'm unable to get it to successfully attach to my existing storage repositories. I'm using 3 older IBM hosts and the 4th new one which is CPU masked so that it successfully joins the pool. I have…
sgtbeano
  • 340
  • 5
  • 14
3
votes
1 answer

Are FC and SAS DAS devices standard enough?

Before I ask my questions, here is some background info that may or may not be useful: For the first time I find myself needing a DAS solution. My priority is data through-put in a single direction. I can write large blocks, and I don't need to…
Jay
  • 33
  • 3
1 2
3
12 13