Building a L2 Fabric on top of VXLAN: Arista or Cisco?
One of my readers working as an enterprise data center architect sent me this question:
I've just finished a one-week POC with Arista. For fabric provisioning and automation, we were introduced to CloudVision. My impression is that there are still a lot of manual processes when using CloudVision.
Arista initially focused on DIY people and those people loved the tools Arista EOS gave them: Linux on the box, programmability, APIs… However , if you want to enter the traditional enterprise segments where people don’t want to build their own tools or play a system integrator, there’s an enormous amount of work to be done to implement everything enterprise users might want to use and package it in a form factor that looks great in PowerPoint.
Unfortunately, most network management/provisioning solutions built by hardware vendors focus more on what sells to CxO (and looks great in PPT) than on the needs of ops people. Some people claim that Cisco’s Nexus Fabric Manager might be better than that – if you have hands-on experience, please write a comment.
However, that was not the only challenge my reader encountered. He said…
Also, the so-called VXLAN control plane from Arista with CVX is certainly inferior to Cisco's BGP EVPN VXLAN control plane.
Update 2016-06-01: Rewrote the following paragraph which incorrectly stated that CVX doesn't provide control-plane MAC learning
BGP EVPN and Arista's CVX provide control-plane MAC address learning, EVPN using a standard protocol that's potentially interoperable across vendors, CVX with an Arista-specific protocol. However, at least Cisco's implementation of EVPN provides end-to-end routing based on host routes (which also enables intra-subnet proxy ARP functionality) and symmetrical IRB (which could limit the flooding scope), and I found nothing equivalent in currently-shipping EOS.
However, keep in mind that the biggest problem you have when building a layer-2 fabric on top of an VXLAN overlay is provisioning:
- mapping VLANs into VXLAN VNIs;
- configuring subnets;
- configuring anycast gateways.
You have to do these tasks “manually” (or using an automation/orchestration solution) on either Arista or Cisco (or use the APIC controller with Nexus 9000 fabrics).
The real benefits of EVPN as compared to flood-and-learn approach to VXLAN are automatic discovery of VTEPs and replacement of flood-and-learn MAC address discovery with deterministic BGP-based propagation of information.
Need more information?
- Lukas Krattiger discussed the details of EVPN with VXLAN in Leaf-and-Spine Fabric Architectures webinar, which also covers numerous ways of building layer-2 and layer-3 data center fabrics;
- Data Center Fabrics webinar covers VXLAN implementations from Arista, Brocade, Cisco, Dell, HP and Juniper, and it’s updated every year to keep the information up-to-date;
- For a deep dive into data center design challenges, join the Building Next-Generation Data Center online course.
https://eos.arista.com/vxlan-without-controller-for-network-virtualization-with-arista-physical-vteps/#6_VXLAN_implementation_differences
With Standalone CVX - it does adv and withdraw MAC-vtep binding. With plugins like Openstack & NSX on cvx helps one to deploy with different orchestration.
You are able to see what ever you want regarding VXlan and the mac/topo information. You have a normal NX-OS cli for debugging and there is no magic other then proven protocols melted together as a packaged solution.
What you can´t see is show running-config :) of the fabric it self.
ACI will soon be able to peer EVPN with the outside!!
It does all the overlay provisioning for you, with integration to vCenter or OpenStack. It even comes with a software forwarder for doing the VTEP all the way on the host, called VTF (based on XR code and VPP dataplane), which increases scale om leaf VNI mappings, as well as increases flexibility.
VTS also acts as EVPN route-reflector for VTEP's to overcome scaling issues on the switches RIB and controlplane in very large deployments. Further it can provision the DCI routers (if ASR9K)
Joachim Jerberg Jensen
Cisco Systems Engineer
I found the Avaya SPBM solution "right on the money" to that L2+ fabric
Will do deploy Avaya SPBM?