Interconnect Solutions Blog

As with organic life forms, the nodes and links of the world-wide web seem to have a varying rhythmic process of differentiation and then integration. At certain inflection points in the process, one can see an intended integration effort cause some differential effects which in turn meld together after another natural cycle. More than any other IO interface, Ethernet has expanded well beyond the original LAN section of the web that it has dominate for many years since it overcame the  rival Token Ring and VG AnyLAN interfaces.

Responding to Ethernet’s expansion and absorption of rivals, champions and evangelists of other IO interfaces like Fibre Channel have created newer standard interface versions using a convergent tunneling method that preserves the native protocol but uses Ethernet physical transport system. Think of protocols tunneling thru any other faster physical transport layer as a packet spaceship traveling thru wormholes in space, from one datacenter galaxy to another.

Recently, the Ethernet Community has evolved their technology to converge LAN with SAN into one physical network. This was partially accomplished with implementation of the recent Ethernet standard 10GBaseCR. This two pair, serial single lane link was expedited without a detailed connector IEEE standard specification clause but achieved compliance and interoperability thru an Ethernet Alliance PlugFest process.

This has caused the Fibre Channel community to create a FCoE, Fibre Channel over Ethernet specification that helps to preserve the native protocol and its installed base. The InfiniBand community has similarly created their RoCE, RDMA over Converged Ethernet standard specification. RDMA is Remote Direct Memory Access, a low latency and low power technology used with InfiniBand architecture. So now these four interfaces, 10GBaseCR, 10GFCoE, 10GFC and 10GRoCE are implemented using the same SFP+ single lane, passive copper cabling. 10G SFP+ usage as grown dramatically because active copper and active optical SFP+ have enabled increased market segments and longer length applications like Digital Signage and AV systems.

Besides Fibre Channel, other storage interfaces like NAS, iSCSI,  iSATA and ATAoE are tunneled over Ethernet 10GBaseCR. These other storage interfaces are also tunneled over Ethernet 10GBaseT using Category 6a and Catergory7a cabling. There are open and closed Consortia defacto standards using these multi-protocols on so called collapsed architectural fabrics like the Unified Computing System which also use the SFP+ cabling.

Besides UCS, there are several other defacto standard unified style networks which also use the SFP+ but with different encryption in memory mapping of the embedded plug EPROMs. One wonders if all of these IO interfaces will expand and use the newly developing 25/26/28Gb/s QSFP++ module and cabling system which is being standardized thru the SFF-8661/2/3 specification. See www.sffcommittee.org,  www.t11.org and www.fibrechannel.org to learn more or contact me..

Ethernet 40GBaseCR4, 40GFCoE and InfiniBand 40G QDR standards are using the same four lane QSFP+ SFF-8436 connector, module and cabling. The SAS storage interface uses QSFP+ AOC, (Active Optical Cables) for longer reach applications as does the CameraLink-2 video networking standard. Will these various interface communities stay converged using the new SFF-8661 QSFP++ connector system for next generation 100GBaseCR4, 100GFCoE, 100GFC SAN and InfiniBand 100G EDR?

There are many other convergent IO interfaces like FCoIB FibreChannel over InfiniBand, UAS USB attached SCSI, UoSATA USB over SATA and of course SoU SATA over USB which is 3G SATA over 4.8G USB implementation. Watching Ethernet, the other very high volume IO standard, HDMI, has recently released their new revision-1.4 spec. This spec has 1G Ethernet running thru the new microHDMI cabling system. However HDMI and DVI video IO signaling is run thru Ethernet category cabling systems as does the HDBaseT signaling and HomePlugAlliance’s cabling adapters. So one could say that the shielded CAT-6a, CAT-7a, SFP+ and QSFP+ are the three primary multi-protocol interconnects for now and several years. Much more on newer convergence in the second part of this guest blog

Lo, looming ahead is a potential round of interface collisions, convergence and collapsed interconnect. It is starting at the desktop level with DisplayPort, USB, SATA, HDMI and PCI-E converged and transformed to the new multi-protocol LightPeak optical-only single fiber interface. It is rumored that LightPeak would replace short reach SAS as well. It seems that there is a 10G and 28G version of LightPeak. We will hear more about this at the Intel Developers Forum this September.

At the 25/26/28/40G per lane data rate, electrically signaling has very limited copper cable length reach, like 1-3 meters. Active optical cabling seems at this data range to have an equal portion of the forecasted TAM volume versus copper. So it is no wonder that there is also looming another generation beyond, a new optical interface which can be supported by developing chips that currently work in labs at 50G per lane and supporting up to 2km distances. Its next generation of 100G per lane is being co-developed. This optical technology interface is beyond the LightPeak interface and could supplant even Ethernet, InfiniBand, Fibre Channel and other IO interfaces within newer datacenters within five years

Coinciding with this new Optical interface’s emergence is a very new generation of Internal Active Optical Cables that connect from either Printed Circuit Boards or nascent Fiber Circuit Boards to other boards/modules and to optical backplanes These Internal AOCs also are also being driven by the continual port densification evolution as the Internal AOCs connect to the bulkhead with MPO type connectors and achieved double port density versus either SFP+ or QSFP+ AOC connector/cabling ports. But there will be a large part of the market and systems that stay longer using the various small form-factor pluggable media types, the causing the usage of many different hybrid cables like QSFP+ SFF-8436 to QSFP++ SFF-8661 and hydra cables like three SFP++ SFF-xxxx (number is soon to be assigned) cable legs going into one QSFP++  SFF-8661 See www.sffcommittee.org

These Internal AOCs and other new CMOS photonic chips may evolve beyond using the QuickPath, HyperTransport and other chip to chip IO interfaces. As the highest performance and largest size DataCenter systems end-users look at using many thousands of Mobile Phone processor chips like Intel’s Atom, the ARM chip or SmoothStone’s new chip to save on power consumption and cooling needs, they are considering a further collapsed optical interface and interconnect that absorbs the LightPeak interface..

You can have fun trying to overlay all these IO roadmaps into one chart! In a parallel universe, voice communication interfaces are melding into Ethernet. Consider that telephony IO interfaces like SS7, TMDS, Utopia, FrameRelay, ATM, PBT and MPLS, are merging into a VoIP and Ethernet network. Even IB-WAN, EoS Ethernet over SONET, SONET and SDN are being replaced by enhanced Carrier Ethernet. The same is true for all the old 6-8 Industrial IO interfaces converging into Industrial Ethernet cabling. Within Commercial Infrastructures various IO interfaces are also quickly melding into a ConvergeIT interconnect network.

Just think if these dozens of interfaces converged into one optical interface in the fuzzy future, we will have many less acronyms to track of! But will this nascent Camelot interface be called sometime cryptic like the existing IPoDWDM interface? (Internet Protocol over Dense Wave Division Multiplexing)

In the ten years past, the SFF-8470, a primarily dedicated twinaxial copper cabling system was selected and or implemented in many industry and defacto standards like InfiniBand, Ethernet, SAS, RapidIO, Myrinet and in the very many separate NICs and homogenous switch boxes. Then heterogeneous switches and NICs appeared with the common SFF-8470 cabling handling the different interfaces in one box or rack. Then there were high port count multi-protocol chips. Now the protocols run thru one slimmer QSFP+ or SFP+ cable assembly using one transport layer. In some SDD (Solid State Drive) devices the FC and SAS or SATA and USB interfaces are integrated into one chip. I have heard the many wireless interface people are working on their Camelot next generation convergent interface as well.

How fast will the new datacenter power and cooling requirements as well as disruptive CMOS Photonic technologies impact further convergence and wide market acceptance? So what is your convergence view or vision of interfaces and interconnects over this coming decade?