Building network automation solutions

9 module online course

Start now!

Is Fibre Channel Still a Thing?

Here’s another “do these things ever disappear?” question from Enrique Vallejo:

Regarding storage, is Fibre Channel still a thing in 2022, or most people employ SATA over Ethernet and NVMe over fabrics?

TL&DR: Yes. So is COBOL.

To understand why some people still use Fibre Channel, we have to start with an observation made by Howard Marks: “Storage is different.” It’s OK to drop a packet in transit. It’s NOT OK to lose data at rest.

That (absolutely correct) mentality resulted in highly reliable black-box systems called storage arrays that had to be accessed (due to their high costs) by many systems. Unfortunately, we had a gazillion of server operating systems in late 1980s, and the simplest way forward was to emulate the existing SCSI adapters and the 50-pin SCSI cable, resulting in Fibre Channel lossless network requirements.

Fibre Channel has been around for ~30 years, and storage has changed in the meantime – we got scale-out software-defined storage (SDS) and hyper-converged infrastructure (HCI). Using Fibre Channel in SDS or HCI would be like using COBOL to develop a new snazzy web app; these solutions use proprietary access methods (example: VMware VSAN) or look like an iSCSI/NFS target (example: Nutanix).

Regardless of AWS S3 durability marketing, some data is too precious to be put into a distributed storage system; you might still want to use a dedicated storage array for your production transactional database.

Do you have to use Fibre Channel if you decide you still need a storage array? Absolutely not. It’s cheaper1 to build a dedicated Ethernet fabric2 to run iSCSI or NFS than it is to build a new Fibre Channel network.

Would Fibre Channel give you better performance? Probably not. Years ago, I was told that FC works better than iSCSI because the transport stack is simpler and more standardized whereas every vendor uses a slightly different variant of TCP stack that has to be tuned for maximum performance. I hope that real-life experience and Moore’s Law brought us way beyond the “good enough” point.

Does that make Fibre Channel dead? Of course not. People who have been building and upgrading their FC-based SAN for the last 30 years will keep doing so. Would I use Fibre Channel in a new deployment? Absolutely not.

Finally, a word on ATA-over-Ethernet: it’s a simple protocol running directly on top of Ethernet. I considered that a bad idea in 2010 (the vendor using ATAoE strongly disagreed) and I haven’t changed my mind even though someone had great experience running ATAoE on Debian.


  1. I wanted to write better, but then remembered that better depends on what metric you like to choose ;) ↩︎

  2. Or two if you believe in strict SAN-A/SAN-B separation ↩︎

1 comments:

  1. I strongly recommend to go back to FC from iSCSi in my company, because no one wanted to pay for even one, not two separate Ethernet fabric. They're more happy to pay for old, refurbished FC gear, now. And I can upgrade switches again without waiting endlessly for storage maintenance window.

    Replies
    1. I have nothing relevant to contribute, but just wanted to say thank you for the series of posts. Interesting how much valuable information can be triggered from a few questions about "old" technology in current days.

      Oh, and the original question pretended to ask about FC vs iSCSI and NVMe-oF, not ATA-over-Ethernet (that was another example of old technology I was thinking of similar but not as widespread as FC, but I messed up the acronyms, sorry).

Add comment
Sidebar