Top gun2014 n9k_hardware

0 %
100 %
Information about Top gun2014 n9k_hardware
Technology

Published on February 20, 2014

Author: gseltzer

Source: slideshare.net

Description

Annual Top Gun: Nexus 9k

Cisco Nexus 9000 Series Hardware Overview

Market Trends  Customers > Network Agility = Easier to Operate & Easier to Customize  Competitors trying to lower bar of entry – disaggregation discussion > VMware: Network Overlay > Arista: All HW innovation available in merchant Silicon > Cumulus: Box Overlay Cumulus OS + White-box  Speed Transition in Switching > Finally 1-> 1/10G access > 10/40G aggregation This presentation contains materials that are either copyright © 2011 IBM Corporation or copyright © 2011 Cisco Systems, Inc. All rights reserved. 2

Innovate - Built a Better Switch • ASIC: Merchant+ Foundation • Hardware: State of the Art Mechanical Design • Software/ OS: - Two Modes of Operation - Programmable OS This presentation contains materials that are either copyright © 2011 IBM Corporation or copyright © 2011 Cisco Systems, Inc. All rights reserved. 3

Cisco Nexus 9000 ASICs “Everything that can be invented has been invented" -- US Patent Office commissioner, 1800's 28 Nanometer ASICs 40 Nanometer ASIC ALE & ASE “Switch architecture has stabilized to the point where it is no longer possible to drive significant feature differentiation at the silicon level.” Arista, March 27th, 2009 * *http://www.aristanetworks.com • • • • • • NFE (T2) • 1/10/40G MAC Scale - Penalty Free • Port Density Caching, Sharding for • Layer 2 & Layer v4/v6, Encapsulation 3 Forwarding Normalization • Buffering Efficiency - Dynamic LB & • Port Counters Flow Prioritization Telemetry - Atomic Counters, Latency Metrics Optimization – Service Insertion, Flood Elimination Application Policy - Line Rate Policy Enforcement Extended Buffering This presentation contains materials that are either copyright © 2011 IBM Corporation or copyright © 2011 Cisco Systems, Inc. All rights reserved. 4

Innovations in Software, Hardware, ASICs and Systems MERCHANT+ ASIC APPROACH Innovation in Cisco ASICs PRICE COST PERFORMANCE POWER PROGRAMMABILITY PORT JSON/XML API EFFICIENCY Linux Container for DENSITY STATE OFapps ART THE customer BACKPLANE FREE 20% HIGHER STRUCTURE INDUSTRY LEADING for 1G PRICE / to 1/10GT LINE CARD BANDWIDTH and 10G to 1.92 Tbps per slot 40G 100G ready migration 50% less ASICS DESIGN Non-blocking 15% greater Density power and cooling efficiency NEXUS 9500 PRICE PERFORMANCE PORT DENSITY PROGRAMMABILITY This presentation contains materials that are either copyright © 2011 IBM Corporation or copyright © 2011 Cisco Systems, Inc. All rights reserved. 5 POWER EFFICIENCY

Nexus 9508 – Breaking Performance Records NEXUS 9508 Lowest Latency Observed on Core Switches To Date 1/3 the time of the previous record w/ 3x traffic load 288 40GbE - 100% Throughput – Not a Single Drop Multicast ~ 3x faster than any other core switch tested 11.5 Tbs - No Head of line blocking Unicast and multicast consistency Most power efficient modular DC switch 10GbE of only 3.85 Watts 15.4 Watts per 40GbE (100% load) This presentation contains materials that are either copyright © 2011 IBM Corporation or copyright © 2011 Cisco Systems, Inc. All rights reserved. 6

Chassis Architecture Front Back 8 Linecard (LC) Slots 3 Fan Trays 6 Fabric Modules (FM) (behind Fan Trays) 2 Supervisor Modules 2 System Controllers 4 (max 8) Power Supplies (3000W AC) Front to Back Airflow No Midplane for LC to FM connectivity Designed for Power & Cooling Efficiency Designed for Reliability Designed for Future Scale This presentation contains materials that are either copyright © 2011 IBM Corporation or copyright © 2011 Cisco Systems, Inc. All rights reserved. 7

Modular Switch Platform – Nexus 9508 Dimensions • 13 RU high, 30 inch deep, 17.5in wide Capacity • 30Tbps fabric today • Up to 288p 40G & 1,152p 10G • Headroom for 100G densities (connectors, power) Control Plane Scale • Supervisors w/ quad core CPU and default 64GB SSD • Separate processors on LC and Fabric Module • Separate System Controller for “chassis management” This presentation contains materials that are either copyright © 2011 IBM Corporation or copyright © 2011 Cisco Systems, Inc. All rights reserved. 8

Modular Switch Platform – Nexus 9500 40G Aggregation 36 ports 40G QSFP+ (Non Blocking) FCS NOW • 6 Fabric Modules • 3 NFE (T2) • 4, 8-slot chassis support 1/10G Access and 10/40G Aggregation 48 ports 10G SFP+ & 4 ports 40G QSFP+ 48 ports 1/10G-T & 4 ports 40G QSFP+ (non blocking) • 3 Fabric Modules • 2 NFE (T2) & 2 ALE • 4, 8, 16-slot chassis support FCS Feb’14 36 ports 40G QSFP+ ((1.5:1 oversubscribed) FCS Q2’CY14 This presentation contains materials that are either copyright © 2011 IBM Corporation or copyright © 2011 Cisco Systems, Inc. All rights reserved. 9

Nexus 9508 – Designed For Reliability “The hybrid approach offers the best MTBF which equates to higher availability and reliability just when the market is calling for this in data center underlay network design “ BROADCOM DUNE/ARAD DESIGN NEXUS 9500 WITH CISCO ASIC LINECARD 55,996 Hours System MTBF* 36p 40G line-rate 19,981 Hours System MTBF* 2.8 X 30p of 36p 40G line-rate *288 ports 40G in 8 slot chassis, redundant Supervisors, Power Supplies, 6 Fabric Modules This presentation contains materials that are either copyright © 2011 IBM Corporation or copyright © 2011 Cisco Systems, Inc. All rights reserved. 10

Platform Architecture Supervisor Module  Redundant half-width supervisor engine  Common for 4-, 8-, and 16- slot chassis  Performance/ Scale focused > Sandy Bridge, Quad Core, 1.8GHz > 16GB Memory > 64 GB SSD (default)  Range of Management Interfaces > 2 USB Ports > Console Port > Management Port  External Clock Input (PTP) This presentation contains materials that are either copyright © 2011 IBM Corporation or copyright © 2011 Cisco Systems, Inc. All rights reserved. 11

Platform Architecture System Controller Module  Offload supervisor from switch “control plane” tasks  Redundant half-width system controller  Common for 4-, 8-, and 16- slot chassis  Performance/ Scale focused > Dual Core ARM Processor, 1.3GHz  Central Point of Chassis Control > EOBC (Ethernet Out-of-Band Channel) switch between Sups and Line cards > Power Supplies via SMB (System Management Bus) > Fan Trays This presentation contains materials that are either copyright © 2011 IBM Corporation or copyright © 2011 Cisco Systems, Inc. All rights reserved. 12

Platform Architecture Power Supplies 3000W AC PSU • • • Single 20A input, 200-240V Support for range of international cabling options 92%+ Efficiency • Range of PS configurations – – – – • Minimum 1 PS 2 PS for fully loaded chassis (3 for 1/10GT linecards) N+1 redundancy N+N grid redundancy 2x head room for future port densities, bandwidth, and optics – Up to 8 PS total * 80 Plus Platinum is equivalent to Climate Saver/ Green Grid Platinum rating This presentation contains materials that are either copyright © 2011 IBM Corporation or copyright © 2011 Cisco Systems, Inc. All rights reserved. 13

Platform Architecture Fan Tray & Fabric Modules  Up to 6 Fabric Modules > Different cost points for 1/10G access (3 FM) and 40G aggregation (6 FM) > Flexibility for future generation of fabric modules  Quad Core ARM CPU 1.3 GHz for Supervisor offload  3 Fan Trays > 3 dual fans per tray > Dynamic speed control driven by temperature sensors > Straight Airflow across LC and FM  N+1 Redundancy per Tray and across Trays This presentation contains materials that are either copyright © 2011 IBM Corporation or copyright © 2011 Cisco Systems, Inc. All rights reserved. 14

Fixed Switch Platform – Nexus 9300 Uplink Module Nexus 9396PQ  48 port 10G SFP+ & 12 port 40G QSFP+  2 RU  FAN1  100-240V (650W AC) • Nexus 93128TX • • • • 96 port 1/10G-T & 8 port 40G QSFP+ 3 RU FAN2 100-120V (800W AC), 200-240V (1200W AC) • 12 port 40G QSFP+ • Additional 40MB buffer Full VXLAN Bridging & Routing Capability Nexus 9300 - Common • • • Redundant FAN (3) and Power Supply (2) Front-to-back and Back-to-Front airflow Dual or Quad Core CPU with default 64GB SDD This presentation contains materials that are either copyright © 2011 IBM Corporation or copyright © 2011 Cisco Systems, Inc. All rights reserved. 15

Fabric Extenders Nexus 2000 FEX Support Jun’14 Nexus 2248TP Nexus 2248TP-E Jun’14 Radar Radar B22 FEX – Pending OEM validation Nexus 2232PP-10G Nexus 2232TM-10G This presentation contains materials that are either copyright © 2011 IBM Corporation or copyright © 2011 Cisco Systems, Inc. All rights reserved. 16

Nexus 9000 Series Full Line-Rate Throughput Performance Unprecedented, Full Line-Rate Performance: Proven with RFC 2544, RFC 2889, RFC 3918 throughput tests Results were taken using a fully loaded Nexus® 9508 switch with 288 40 GE ports: • All ports are line rate at 100% unicast traffic load • All ports are line rate at 100% multicast traffic load • Full line rate for all packet sizes (64 to approx. 9216 Bytes) 1.2E+012 (frames) 1.0E+012 8.0E+012 TX Frames 6.0E+012 RX Frames 4.0E+012 2.0E+012 0.0E+012 1- 64-1 1- 128-1 1- 256-1 1- 512-1 1- 1024-1 1- 1280-1 1- 1518-1 1- 9216-1 This presentation contains materials that are either copyright © 2011 IBM Corporation or copyright © 2011 Cisco Systems, Inc. All rights reserved. 17

Nexus 9000 Series Low-Latency Performance Low Latency (Same for Both Unicast and Multicast): Proven with RFC 2544, RFC 2889, RFC 3918 throughput tests Results were taken using a fullyloaded Nexus® 9508 switch with 288 40 GE ports: • Unicast latency at 100% traffic load: ̶ 1.6 usec (64-Byte packets) 3.5 usec (9216-Byte packets) ̶ • Multicast latency at 100% traffic load: ̶ ̶ 1.6 usec (64-Byte packets) 3.5 usec (9216-Byte packets) This presentation contains materials that are either copyright © 2011 IBM Corporation or copyright © 2011 Cisco Systems, Inc. All rights reserved. 18

Agenda  Hardware  Optics  Deployment Scenarios & Scale  Positioning  Roadmap This presentation contains materials that are either copyright © 2011 IBM Corporation or copyright © 2011 Cisco Systems, Inc. All rights reserved. 19

Cisco Optical Innovation Removing 40G Optics and Cabling Barriers Problem 40G Optics are significant portion of network CAPEX 40G Optics require new cabling Solution Re-use existing 10G MMF cabling infrastructure Re-use patch cables (same LC connector) Cisco 40G SR-BiDi QSFP vs QSFP SR4 QSFP pluggable Dual LC Connector Support for 100m on OM3 and 125m+ on OM4 TX/RX on 2 wavelength @ 20G each Available Jan’14 Supported across all Cisco QSFP ports This presentation contains materials that are either copyright © 2011 IBM Corporation or copyright © 2011 Cisco Systems, Inc. All rights reserved. 22

Multimode fiber is FORWARD and BACKWARD Compatible Speed 1G 10G 40G Data Center Campus Max Link Lengths over Multi Mode Fiber (MMF) 1G SX 550m 300m 10G SR 40G BiDi 2-strand (duplex) MMF cabling can be leveraged for 40G and 100G 150m No need to replace fiber 100G Future ~100m* Relevant Distance in DC *100G technology under development; target estimate of link length This presentation contains materials that are either copyright © 2011 IBM Corporation or copyright © 2011 Cisco Systems, Inc. All rights reserved. 23

Scale Up & Scale Out Architectures L2 and L3 Protocol Support at Scale DC Fabric (non-blocking) DC Core DC Aggregation DC Access DC PODs Nexus 9300 ToR Nexus 9300 ToR Nexus 9300 ToR Nexus 22xx ToR Nexus 9300 ToR Nexus 22xx U C S Nexus 9500 EoR 10GE Server Access 1GE/10GE Server Access Up to 12-way DC Spine Nexus 9500 Up to 288 Leafs DC Leaf Nexus 9300 (ToR) Nexus 9500 (EoR) Nexus 22xx Nexus 22xx This presentation contains materials that are either copyright © 2011 IBM Corporation or copyright © 2011 Cisco Systems, Inc. All rights reserved. 24

Scale Out – 200 to 200,000 10G Host ports 2 to 16 wide Spine ... 2 200 to 27,000 10G host ports 3 ... Up to 220,000 10G host ports 4 to 288 wide Leaf 2 to 16 wide Spine ... 1 4 to 288 wide Leaf 288p 40G 1,152p 10G Up to 4,608 TOR Switches This presentation contains materials that are either copyright © 2011 IBM Corporation or copyright © 2011 Cisco Systems, Inc. All rights reserved. 25

Agenda  Hardware  Optics  Deployment Scenarios & Scale  Positioning This presentation contains materials that are either copyright © 2011 IBM Corporation or copyright © 2011 Cisco Systems, Inc. All rights reserved. 26

Agenda  Hardware  Optics  Deployment Scenarios & Scale  Positioning This presentation contains materials that are either copyright © 2011 IBM Corporation or copyright © 2011 Cisco Systems, Inc. All rights reserved. 28

Add a comment

Related presentations