Modernization and TDM to IP/MPLS Migration - Cisco Live

#CLUS

Brent Foster, Consulting Systems Engineer

BRKOPT-1001

Transport Network Modernization and TDM to IP/MPLS Migration

© 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public#CLUS

Agenda

• Solution Overview

• MPLS Architecture

• Circuit Emulation Details

• HDLC/PPP/Ethernet Interworking

• Hardware & Software Platforms

• Manageability & Orchestration

• Migration Use-Cases & ROI Study

• Conclusion

BRKOPT-1001 3

Questions? Use Cisco Webex Teams to chat with the speaker after the session

Find this session in the Cisco Live Mobile App

Click “Join the Discussion”

Install Webex Teams or go directly to the team space

Enter messages/questions in the team space

How

Webex Teams will be moderated by the speaker until June 16, 2019.

1

2

3

4


Cisco Webex Teams

cs.co/ciscolivebot#

4

BRKOPT-1001

Solution Overview


TDM2IP Migration Drivers

DCS/ADM End of Sale

Enable NG IP Services

Higher Capacity Needs

Better CAPEX Efficiencies

Network Consolidation

Automation Power Savings

Network Simplicity

Kw/GE

KW/GE

New

Old

EoS

BRKOPT-1001 6


Classical TDM Architecture

ADM ADM ADM

LO XC

LO XC

LO XC

Existing STS

Newly provisioned STS

OC-48 Ring OC-48 Ring

Existing VT

Newly provisioned VT

Site 1 Site 2 Site 3

4321

4321

BRKOPT-1001 7

ADM … Add Drop MultiplexerLO XC … Low Order Cross Connect (aka DCS)



ADM ADM ADM

LO XC

LO XC

LO XC

Existing STS


OC-48 Ring STM4 Ring

Existing VT



4321

4321


BRKOPT-1001 8



9BRKOPT-1001

ADM ADM ADM

3/1DCS

3/1DCS

3/1DCS

OC-48 Ring OC-48 RingT1

STM1

T1

STM1


4321

4321


Existing STS


Existing VT




10BRKOPT-1001

ADM ADM ADM

3/1DCS

3/1DCS

3/1DCS

OC-48 Ring OC-48 Ring

OC-48 Ring

T1

STM1

T1

STM1


4321

4321

4321

Existing STS


Existing VT




TDM over MPLS Architecture

11BRKOPT-1001

NCS4200

NCS4200

MPLS-TE LSP

MPLS-TE LSP Size is adjusted by the Edge Nodes as TDM Services get mapped into it

MPLS Midpoints are not aware of TDM Services, all they know are MPLS-TE LSPs

T1 SAToP Pseudowire

STS CEP Pseudowire

T1

STS

T1

STS

Site 1 Site 3Site 2

LSP … Label Switched Paths

Services are mapped to Circuit Emulation (CEM) pseudowires


The Transport Network Modernization Solution Ingredients

Tight Chip Integration

+ +

Control Plane Management & SDN

• Increased Bandwidth

• Reduced Cost

• Reduced Power

• Massive Simplification

• Single MPLS Infrastructure for TDM, MEF and L3VPN Services

• Reduced OPEX

• Single NMS User Interface for TDM, MEF and L3VPN Services

• Northbound API for SDN and OSS Integration

BRKOPT-1001 12


Key Requirements for TDM2IP Migration

13BRKOPT-1001

ScalabilityBandwidth Commitment & Latency

<50msec ProtectionService Provisioning & OAM

MPLS Architecture


Capability Classic RSVP-TE

MPLS-TP RSVP-TE with Transport Enhancements

Data Plane MPLS MPLS MPLS

Control Plane IP/MPLS – RSVP-TE None : NMS or controller driven IP/MPLS – RSVP-TE

LSP config / Mgmt CP Signalled – RSVP-TE Static CP Signalled – RSVP-TE

Bidirectional LSP No Yes Yes, via associated LSPs

Co-routed LSP Yes – Requires explicit path Yes Yes, via associated LSPs

LSP protection Control plane fast re-route (FRR) OAM driven path protection OAM driven path protection (with wrap protection optimization)

LSP OAM Probe based (LSP ping/trace) GAL/G-ACh channel• BFD for CC• Fault OAM (LDI, LKR)

GAL/G-ACh channel• BFD for CC (HW accelerated)• Fault OAM (LDI, LKR)

• RSVP-TE with transport enhancements is fully backward compatible with classic RSVP-TE:

• All nodes can share same set of links

• Bi-directional co-routed LSP’s can be established on a per LSP basis

• Classic RSVP-TE LSP’s (unidirectional) can be established from same node over the same set of links

Comparing MPLS TechnologiesTechnology Choice for

Transport Network Modernization

BRKOPT-1001 15


Asymmetric LSP path routing

Classic RSVP-TERSVP-TE with Transport

Enhancements

Associated Co-Routed LSPs

https://tools.ietf.org/html/rfc7551

RSVP-TE with Transport Enhancements :Unidirectional versus Associated Co-Routed LSPs

• Classic RSVP-TE treats LSP’s as unidirectional independent paths

• Forward and reverse paths can asymmetrical

• RSVP-TE with transport enhancements associates two LSPs between common end-points to ensure co-routing to emulate a logical bidirectional path

• Classic RSVP-TE and transport enhances LSP’s can co-exist on the same set of links and nodes.

• Fully defined by IETF with RFC 7551

BRKOPT-1001 16



• Standby LSP path:

• explicit path or dynamically computed by head-end

• Dynamic path computation:

• Head-end attempts to compute node-disjoint (except source and destination nodes) first. If there is no such path, it will attempt to compute link-disjoint path

• Revertive Mode:

• If primary LSP comes backup, traffic is automatically reverted to the primary LSP

• Hot standby LSP:

• Standby LSP is programmed in the forwarding plane prior to failure

Primary LSP pair

Standby LSP pair

RSVP-TE with Transport Enhancements :1:1 Path Protection

BRKOPT-1001 17


1:1 Path Protection Steady State

A1

A2

Z2

Z3

B C

D E

Z1

Signaled LSP (in use)

Signaled LSP (programed but not in use)

Sticky Path remembered by Software

BRKOPT-1001 18


Failure in Working Path (Wrap)

A1

A2

Z2

Z3

B C

D E

Z1

X

<50msec Protection Switchover




BRKOPT-1001 19


Failure in Working Path (Switch to Protect)

A1

A2

Z2

Z3

B C

D E

Z1

X





BRKOPT-1001 20


Re-Optimization

A1

A2

Z2

Z3

B C

D E

Z1

Make before Break




X

BRKOPT-1001 21


1:1 Path Protection Steady State (with “sticky” path and non-revertive)

A1

A2

Z2

Z3

B C

D E

Z1




BRKOPT-1001 22


Failure in Working “Sticky” Path

A1

A2

Z2

Z3

B C

D E

Z1

X





BRKOPT-1001 23


Working Path available again and recovers after Single Failure, No Traffic Switch

A1

A2

Z2

Z3

B C

D E

Z1




BRKOPT-1001 24

Non-RevertiveSwitching


Traffic Switch on Manual Reversion

A1

A2

Z2

Z3

B C

D E

Z1

Make before Break




BRKOPT-1001 25


SONET Protection Compared to MPLS Protection

ADM

1+1 APS

ADM ADM

ADM ADM

ADMUPSR NGM

1+1 APS

NGM NGM

NGM NGM

NGMMPLS

1+1 APS

1+1 APS

BRKOPT-1001 26


Capability MPLS for Data Services MPLS with Transport Enhancements for Connection Oriented Services

Data & Control Plane MPLS with RSVP-TE MPLS with RSVP-TE

LSP Operation Unidirectional Bi-directional and co-routed

LSP protection Fast re-route (FRR) Path protection (with wrap protection optimization)

BW Management LSP Auto-bandwidth (dynamically drivenby traffic load)

Strict allocation through provisioning and admission control

Protection Bandwidth Not pre-allocated Pre-reserved

QoS Strategy 4 classes (RT, Premium, Data, Basic) 1 strict priority class (connection oriented)

LSP OAM On-demand Probe based (LSP ping/trace)

In-band OAM channel (GAL, GA-ch)• BFD for CC (HW accelerated)• Fault OAM (LDI, LKR)

• Unified MPLS implementation supports both data services and connection oriented services

• MPLS with transport enhancements is fully backward compatible with classic MPLS implementations:

• Data and connection oriented services share same set of nodes and links

• Bi-directional co-routed LSP’s can be established on a per LSP basis

Combining Data and Connection Oriented Services

BRKOPT-1001 27


PW

Cross Connect

PWCEM

Uplink Ethernet

Port (NNI)

A Z

Control Plane (RSVP-TE) for bir-directional Tunnel (LSP) Setup

CEM

Uplink Ethernet

Port (NNI)

Node A Node Z

Path with Constraints

Cross Connect

Bi-directional MPLS Tunnel (LSP)

Touch Point #1

Touch Point #2

Provisioning Tool

STS/VT1.5 or VC-4/-

12

Access STS/VC

Controller (UNI)

Access STS/VC

Controller (UNI)T-LDP signaled Pseudowire (PW)

MappingMapping

STS/VT1.5 or VC-4/-

12

CEM Service ProvisioningHO … High Order (SONET STS, SDH VC-4)LO …. Low Order (SONET VT1.5, SDH VC-12)UNI … User Network InterfaceNNI … Network Network Interface

BRKOPT-1001 28


PW

Ethernet Circuit Provisioning

Cross Connect

PWEFP

Access Ethernet

Port (UNI)

Uplink Ethernet

Port (NNI)

A Z

Control Plane (RSVP-TE) for Tunnel (LSP) Setup

EFP

Access Ethernet

Port (UNI)

Uplink Ethernet

Port (NNI)

Node A Node Z

Cross Connect

Bi-directional or Uni-directional Tunnel

Touch Point #1

Touch Point #2

Provisioning Tool

EPL ……Ethernet Private Line (Port based VPWS)EVPL … Ethernet Virtual Private Line (VLAN based VPWS)UNI …….User Network InterfaceNNI …….Network Network Interface

BRKOPT-1001 29

T-LDP signaled Pseudowire (PW)

MappingMapping


• Link Level Queuing

• Queuing is used on each MPLS Link to prioritize Traffic accordingly

• EPL and CEM Traffic used for Modernization will never get dropped

• Auto-Bandwidth

• Dynamically adjust bandwidth reservation based on measured traffic

• Optional minimum and maximum limits

• LSP Preemption

• Traffic may be routed away from “best” path to increase the overall network utilization

• The design is ensuring that CEM LSPs never get moved by E-Line LSPs

Traffic Management Mechanisms

BRKOPT-1001 30


Generic Node QoS Model

Ingress Interface Egress InterfaceNode Global

Incoming Packet

Outgoing Packet

Traffic Class(Qos-Group)

Drop Precedence(Discard-Class)

1

WRED

Queuing

Per Queue Marking

Classification

Policing

Marking

BRKOPT-1001 31


Example Queue Definition

Network Control 6

Connection Oriented 7

Real-Time Data 5

Queue Group SchedulerQueue # Queue Mode Class (EXP, COS)

0Strict Priority

Level 16

1Strict Priority

Level 17

2Strict Priority

Level 25

3CB-WFQ

4

4CB-WFQ

3+2

5CB-WFQ

1+0

6CB-WFQ

Future Use

7CB-WFQ

Future Use

Future Use

Future Use

Premium Data 4

Data 3+2

Basic 1+0

Used by E-Line

LSP Traffic

Used by Modernization

LSP Traffic

BRKOPT-1001 32


Auto Bandwidth Overview

• Dynamically adjust bandwidth reservation based on measured traffic

• Optional minimum and maximum limits

• Sampling and resizing timers

• Tunnel resized to largest sample since last adjustment

• Actual resizing can be subject to adjustment threshold and overflow detection

Min

Max

Total bandwidth

for all TE

tunnelson a path

Bandwidthavailable to

other tunnels

Tunnel resized to

measured rate

BRKOPT-1001 33


PQ Level 1 - TDM Traffic (7)

MPLS-TE ”in Action”

0%

100%

RSVP Bandwidth

BRKOPT-1001 34

TDM Traffic = co-routed/bi-directional LSPs with fixed Bandwidth




0%

100%

RSVP Bandwidth

PQ Level 2 - Realtime (5)

Data Traffic = TE-FRR with Auto-BW Packet Drops in WFQ Classes

Reaction Time of Auto-BW

WFQ – Other Data Classes (0,1,2,3,4)

BRKOPT-1001 35




0%

100%


RSVP Bandwidth

PQ Level 2 - Realtime (5)

No Packet Drop in any Class

Data Traffic = TE-FRR with Auto-BW Packet Drops in WFQ Classes

Reaction Time of Auto-BW

Short Term Congestion due

to TE-FRR

WFQ – Other Data Classes (0,1,2,3,4) Watch out for QoS Violations

BRKOPT-1001 36



• With proper Priority configured Working and Protect Modernization LSPs will always preempt Data LSPs

• Short-term Congestion is handled by QoS

• Using Level 1 Priority Queue for Modernization ensures no Modernization LSPs drop any Packets

• Data LSPs can use Level 2 Priority and CB-WFQs to provide needed QoS Treatment

• Protect LSP Bandwidth can not be used by Data LSPs

• No need to design and continuously adjust VLAN TE-Link Bandwidth nor DS-TE Bandwidth Pool Network wide

LSP Preemption

BRKOPT-1001 37


LSP Preemption Example: Steady State

20G / 20G working20G / 0G protect

80G / 80G DataLink Utilization

100%

80G / 80G

20G / 0G

100% reserved

Signaled BW / Used BW80% utilized

BRKOPT-1001 38


LSP Preemption Example:Failure State

20G / 0G working (down)20G / 20G protect

80G / 80G DataLink Utilization

100%

80G / 80G

20G / 20G

100% reserved & utilized

Signaled BW / Used BW

X

BRKOPT-1001 39


LSP Preemption Example:Failure State, Additional Modernization LSP added


80G / 80G Data

20G / 0G protect

20G / 20G working

Link Utilization

100%

20G / 20G80G / 80G

20G / 20G

100% reserved

& 120% utilized


X

BRKOPT-1001 40


Failure State, Additional Modernization LSP added, Data LSP is moved away (Preemption)


60G / 60G Data

20G / 0G protect

20G / 20G working

Link Utilization

100%

20G / 20G60G / 60G

20G / 20G

100% reserved & utilized


20G / 20G Data

40%

Link Utilization

40% reserved &

20% utilized

X

BRKOPT-1001 41


• IS-IS

• RFC5305, https://tools.ietf.org/html/rfc5305

• TE Default Metric (Sub-TLV Type 18)

• ISIS

• RFC3630, https://tools.ietf.org/html/rfc3630

• Traffic Engineering Metric (Sub-TLV Type 5)

• These Metrics can be used to influence CSPF without changing IGP SPF decisions

IGP Extensions for MPLS-TE

BRKOPT-1001 42

For Reference Only




Periodic Network Planning - Cisco WAE

43BRKOPT-1001

• Use Cases

• “What if” analyzes

• Growth planning

• Network augmentation

• Capabilities

• Model of the complete topology

• MPLS-TE Path computation

• Bandwidth, Affinities, SRLG

• Failure analysis

• Link/Node FRR

• Path protection

• Traffic class aware (QoS violations)

Circuit Emulation Details


• Three Different Modes:

1. SAToP = Frame agnostic DS1/DS3 (RFC4553)

2. CESoP = Frame aware NxDS0 (RFC5086)

3. CEP = SONET/SDH Container (VT1.5, STS, AUG) (RFC4842)

TDM Frames

CEM capable Packet Node

CEM Packets

CEM capable Packet Node

TDM Frames

PSN Header

PWMux

Control Word

Parts of TDM Frame

Pseudowire Identifier

Transport between CEM Nodes

AIS and RDI Generation on Remote End

Ingress CEM Node samples TDM Frames for

Packetization

Egress CEM Node collects Packets and reconstructs TDM

Frames

Circuit Emulation (CEM) - Standards

BRKOPT-1001 45


DS1/DS3 CEM Modes – SAToP (RFC 4553)

MPLS42xx 42xx

Cell Tower

DS1Channelized OC3/OC12

BSC

TDM Payload

192 Bytes(Default Size for T1 SAToP)

OH

12 Bytes

Pseudowire Packet

DS1 Frame inside VT1.5 Payload

DS1 Example(SAToP is also applicable to DS3)

Physical DS1 Interface / Frame

BRKOPT-1001 46


E1/E3 CEM Modes – SAToP (RFC 4553)

MPLS

Cell Tower

T1Channelized STM-1/-4

E1 Frame inside VC-12

E1 Example(SAToP is also applicable to E3)

Physical T1 Interface / Frame

TDM Payload

256 Bytes(Default Size for T1 SAToP)

OH

12B

Pseudowire Packet

2.048 Mbps

(E1)

1 2 3 32

32 Bytes

1 2 3 32VC-12

35 Bytes

POH (Lower Order)

1 2 3 32C-12

34 Bytes

Stuffing Bytes

For Reference Only

BRKOPT-1001 47


Full VT1.5 Container (POH + Payload)

SONET CEM Modes – CEP (RFC 4842)

MPLS 42xx

ADM

Channelized OC3/OC12

DCS

TDM Payload

104 Bytes(Default Size for VT1.5 CEP)

OH

12 Bytes

Pseudowire Packet

Full VT1.5 Container (POH + Payload)

VT1.5 Example(CEP is also applicable to STS, STS-Xc, STS-Nv)

UPSR 42xx

ADM

++

BRKOPT-1001 48


SDH CEM Modes – CEP (RFC 4842)

MPLS

ADM

Channelized STM-1/-4

VC-12 Example(CEP is also applicable to VC-3, VC-4,

VC-4xc, VC-4-nvc)

TDM Payload

140 Bytes(Default Size for VC-12 CEP)

OH

12B

Pseudowire Packet

UPSR

ADM

TUG-2

TU-12 TU-12 TU-12

TU-12

36 Bytes

Pointer

VC-12

TUG-2

TU-12 TU-12 TU-12

TU-12

36 Bytes

Pointer

VC-12

For Reference Only

BRKOPT-1001 49


Supported CEM Types for OC-nSTS-192

4x

STS-48

4x

STS-12

4x

SPE-48c STS-48c CEM Circuit (CEP)



OC192 Port

STS-3

3x

SPE STS-1 CEM Circuit (CEP)

VTG

STS-1

7x

VT1.54x

VT1.5 CEM Circuit (CEP)

DS1 CEM Circuit (SAToP)DS1

DS3 DS3 CEM Circuit (SAToP)

OC48 Port

OC12 Port

OC3 Port

CEP … SONET Circuit Emulation over Packet (RFC4842)SAToP … Structure agnostic TDM over Packet (RFC4553)

DS1 CEM Circuit (SAToP)28x

M13 DS1

Hig

h O

rder

Cap

acity

(HO

)Low

Ord

er C

ap

acity

(LO

)

BRKOPT-1001 50


Supported CEM Types for DS3


VTG

STS-1

7x

VT1.54x




EC-1/STS-1e Port

CEP … SONET Circuit Emulation over Packet (RFC4842) 1)

SAToP … Structure agnostic TDM over Packet (RFC4553)


M13 DS1

DS3 Port

C-Bit or M13/M23 Framed

1) DS3 CEP (EC-1) SW Support in Rel 16.7.1

BRKOPT-1001 51


• Loopbacks are supported at all Levels (Port and Circuit Level)

• DS1 Remote Loopbacks

• Can be enabled upon FDL loop code request

• Can be requested via FDL loop code request

• DS3 Remote Loopbacks (in C-Bit Framing Mode only)

• Can be enabled upon FEAC request

• Can be requested via FEAC

Loopback Support on CEM Modules

FEAC … Far End Alarm and ControlFDL … Facility Data Link

BRKOPT-1001 52


Port Level Loopbacks (Local / Network)STS-192

4x

STS-48

4x

STS-12

4x




OC192 Port

STS-3

3x


VTG

STS-1

7x

VT1.54x




OC48 Port

OC12 Port

OC3 Port



M13 DS1

Hig

h O

rder

(HO

)Low

Ord

er

(HO

)

Network

Local

BRKOPT-1001 53


DS3 Level Loopbacks (Local / Network) STS-192

4x

STS-48

4x

STS-12

4x




OC192 Port

STS-3

3x


VTG

STS-1

7x

VT1.54x




OC48 Port

OC12 Port

OC3 Port



M13 DS1

Hig

h O

rder

(HO

)Low

Ord

er

(HO

)

DS3 Network Line

DS3 Network Payload

DS3 Local

BRKOPT-1001 54


DS1 Level Loopbacks (Local / Network) STS-192

4x

STS-48

4x

STS-12

4x




OC192 Port

STS-3

3x


VTG

STS-1

7x

VT1.54x




OC48 Port

OC12 Port

OC3 Port



M13 DS1

Hig

h O

rder

(HO

)Low

Ord

er

(HO

)

DS1 Network Payload

DS1 Network Line

DS1 Local

BRKOPT-1001 55


In-Service Testing for CEM Circuits using BERTtriggered by EPN-M or OSS (via EPN-M NBI)

1 2A B

PRBS Gen

PRBS Analyzes

Loopback

Loopback

PRBS Gen

PRBS Analyzes

BRKOPT-1001 56

• Up to 16 concurrent SONET Path Level BERT Engines

• STS or STS-Nc Path

• Up to 16 concurrent PDH Level BERT Engines

• DS1 or DS3

• Configurable PRBS Patterns

• PRBS151), PRBS201), PRBS231), All 0s, All 1s

• Two possible BERT Test Directions

• Towards TDM Port

• Towards CEM PW


• Fully synchronized Platform

• SONET/SDH Interfaces: T1/T1, OCn/STMn

• SyncE Ethernet Interfaces: 1GE, 10GE, 40GE, 100GE

• IEET1588 (PTP) Support

• G.781 and GR-1244-CORE/GR-253-CORE based Clock Selection

• SONET/SDH SSM Support (G.781, G.707, G.704)

• SyncE with ESMC Support (G.8261, G.8262, G.8264)

• Service clock recovery Support

• Adaptive and Differential Clock Recovery (DCR/ACR) for PDH services

• Explicit pointer adjustment relay (EPAR) for CEP services

NCS 4200 Synchronization Architecture

BRKOPT-1001 57


SONET/SDH Metro

• Metro COs typically have BITS Distribution Infrastructure synced to the PRS

• Clock for NCS 4200 in COs can be take from

• BITS Input

• SyncE enabled Uplink

BITS and SyncE

NG Metro

ADM

42xx

PRS

ADM

SyncE

BITS BITS

42xx

SyncE

42xx

Lit Building

SyncE

Central Office Central Office

BRKOPT-1001 58


Metro

IEEE 1588-2008 (PTP) Approach

ETH ETH3rd Party Carrier

42xx ADM42xx

Ocn/STMn Handoff

#2#1

PRS

ADM

IEET1588/PTP

SONET/SDHSONET/SDH

Packet Delay Variation (PDV) / Ethernet Service SLA

• Clock for NCS4200 #1 is coming from PTP

• PTP Master can be NCS4200 #2 itself or PTP GM in CO

• Clock for NCS4200 #2 is taken from SONET/SDH link to Metro ADM

GM

SL

GM

BRKOPT-1001 59

HDLC/PPP/Ethernet Interworking


TDM to Ethernet interworking Feature

Feature Objective: Interworking feature facilitates the translation between different Layer2 encapsulations.

• L2VPN Interworking works in IP mode that facilitates transport of IPv4 payload in HDLC or PPP frames to Ethernet, over an MPLS backbone

• The Interworking command causes the Attachment Circuits to be terminated locally. • The IP keyword causes the IP packet to be extracted from the attachment circuit

and sent over the Pseudowire

• The following are two scenarios where the Interworking Feature will be supported

BRKOPT-1001 61


TDM to Ethernet interworking - Scenario 1Terminate PW to Ethernet VLAN NNI

NC4200CE ASR9K

Interface:

• T1/E1

• T3/E3

• Channelized T3

• Channelized

OC3/OC12/OC48

Ethernet, NNI

Encapsulation:

• HDLC

• PPP

IP CoreRouter

TDM IWFunction

AccessAggregation IP Edge

TDM ACPW (TYPE 11) Ethernet AC

VLAN

IP/MPLS

BRKOPT-1001 62


TDM to Ethernet interworking - Scenario 2Terminate PW to PW Head End on the IP Service Router

NC4200CE

Interface:

• T1/E1

• T3/E3

• Channelized T3

• Channelized

OC3/OC12/OC48

EthernetIP/MPLS

Encapsulation:

• HDLC

• PPP

IP Core

TDM IWFunction

Access AggregationIP Edge

TDM AC PW (TYPE 11)

ASR9KNC4200

LSR Router

PWHead-End

BRKOPT-1001 63

Hardware & Software Platforms


Packet Layer (L2)• MPLS data and control plane• Packet aggregation• Circuit emulation• Ethernet services

Metro Optical Technologies for Modernized Transport

65BRKOPT-1001

OSS

OTN Layer (L1)• GMPLS Control Plane• Sub-wavelength switching• Wave services

DWDM Layer (L0)• WSON Control Plane• 96-ch flex-spectrum• 20-degree CDC ROADM

Element Management Layer• NBI for Flow-Thru Provisioning• Trouble-shooting• Graphical Interface

OSS/SDN Layer • FCAPS• Network optimization• Services catalog & inventory

ROADM

Hybrid OTN/Packet Switching (OTN optional)

DWDM (L0)

OTN (L1)

Packet (L2)

REST API

EPN-MCisco Evolved Packet Network Manager


MPLS Aggregation Platforms

66BRKOPT-1001

NCS 4200 / ASR 900

TDM Customer Premise

NCS 4200 / ASR 900

NCS4000

- OTN+Packet- DWDM Optimized- 450 Depth- SyncE- FlexLSP/TE based

NCS 4200 / ASR 900

NCS5500

- “new DC Style” SP Approach

- No SyncE- TE/SR based

- Unified Core+Edge- Tbps / Slot- Rich IP features- SyncE- TE/SR based

ASR9000Services Edge

MPLS

MPLS Aggregation

CEM/Ethernet Services


NCS 4200 Series

NCS4216

7RU, 16 Slots, 400G

ISSU

NCS4202

1RU, 1 card slot, 64G

NCS4201

1RU, 64G

NCS4216-F2B

14RU, 16 Slots, ISSU

400G

NCS4206

3RU, 6 Slots, 400G

ISSU

8 x DS1\E1 CEM

48 x DS1\E1 CEM

48 x DS3\E3 CEM

10G CEM /iMSG (1xSFP+, 8xSFP)

(OC-3/12/48/192 or STM-1/-4/-16/-64)

Combo 8x GE/FE, 1 x 10GE SFP/SFP+

8 x 10GE Ethernet SFP+

2 x 40GE Ethernet QSFP

1 x 100GE Ethernet CPAK

TD

MP

AC

KE

T 16 x 1GE + 1 x 10GE / 18 x GE CSFP/SFP+

3G CEM / iMSG (12 x DS1/E1 + 4 x

DS3/E3 + 4 x OC-3/12/48 or STM-1/-4/-16

10G CEM (1xSFP+, 8xSFP)

(OC-3/12/48/192 or STM-1/-4/-16/-64)

2 x 100GE Ethernet QSFP28


High Capacity TDM/PDH CEM Modules

• DS1/DS3 CEM Modules

• One line card supporting 48x DS1/T1

• One Line card supporting 48x DS3/E3

• Three High Density 68 Pin Molex 71425-3001 Connectors

• Patch Panels providing RJ48C, DIN, AMP64, HDBNC Fanout

• SAToP, CEP and CESoP over PWE3

• HW ready for DS0/CESoP

• HW ready for 1:1 Card Protection

48 Port DS1/T1

48 Port DS3/E3

BRKOPT-1001 68

© 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public#CLUS 69BRKOPT-1001

PDH Electrical Patch Panels

12 of 48x PDH

12 of 48 portPatch Panel

Total height of 68”

576 PDH ports in a Rack

RJ48 (DS1)

AMP (DS1)

DIN (DS1 & DS3)

HD BNC (DS3)


10G CEM SONET/SDH/Ethernet1) Module

• Mix of 1xSFP+ and 8xSFP Ports providing

• CEM for TDM Migration and SONET/SDH Switching

• Up to 8xGE Native Ethernet Switching 1)

• Mix of OC3/12/48/192 or STM-1/-4/-16/-64 for SONET/SDH:

• Up to 10G (HO) CEM, 10G (LO) CEM/CES Switching capacity

• Up to 10G (HO) Ethernet over SONET Termination & POS 1)

• APS 1+1 and UPSR 1) Protection

• SAToP, CESoP and CEP over PWE3

• Via Channelized and Clear Channel SONET/SDH Ports

• Up to 8x 1GE Ports for Native Ethernet Services 1):

• MEF2.0 compliant EPL/EVPL and ELAN/EVLAN and ETREE

1x SFP+ and 8x SFP

1) SW Support in Future XE Release

BRKOPT-1001 70


10G CEM/iMSG SONET/SDH/Ethernet 2) Module 1)

• Mix of 1xSFP+ and 8xSFP Ports providing

• CEM and iMSG (PPP, HDLC, MLPPP, etc.) for TDM Migration and SONET/SDH Switching


• Mix of OC3/12/48/192 or STM-1/-4/-16/-64 for SONET/SDH:

• Up to 10G (HO) CEM, 10G (LO) CEM/CES Switching capacity

• Up to 2.5G iMSG (Interworking HDLC/PPP/MLPPP) Switching capacity

• Up to 10G (HO) Ethernet over SONET Termination & POS 2)

• APS 1+1 and UPSR Protection

• SAToP, CESoP and CEP over PWE3

• Via Channelized and Clear Channel SONET/SDH Ports

• Up to 8x 1GE Ports for Native Ethernet Services 2) :

• MEF2.0 compliant EPL/EVPL and ELAN/EVLAN and ETREE

1x SFP+ and 8x SFP

1) SW Support in 16.12.1 (Jul 2019) 2) SW Support in Future XE Release

BRKOPT-1001 71


• Uplink:

• 2x 100GE - 100Gbps Capacity (protected)

• LAN PHY or OTU4 Framing

• Client:

• Up to 192 DS1 or DS3

• Up to 10G of Optical CEM (OC3, OC12 or OC48)

• Up to 58x GE

• Up to 8x 10GE

• Bandwidth:

• TDM:

• 19.6 G (9.6G for DS3 + 10G for Optical CEM)

• Eth:

• 138 G (oversubscribed ~1.7:1 on uplink)

Example Mixed PDH Electrical + OCn + 1GE/10GE

1x100GE

1x100GE

DS1 or DS3

8x 1GE

18x1GE

DS1 or DS3

DS1 or DS3

DS1 or DS3

10G MS (5G Mode)

8x 1GE

8x 1GE

10G MS (5G Mode)

8x1GE

8x 1GE

4x 10GE

4x 10GE

900W 900W 900W

1x100GE Uplink (working)

1x100GE Uplink (protect)

BRKOPT-1001 72


NCS 4202 / ASR920-12SZ-IM Chassis

Compact Fixed Platform

1RU, 444 x 229 x 43.6 mm

Extended operating temp range -40c to +65c

1 slot for 42xx Line card insertion

Reliable Power Supply: Dual line feed

Field Replaceable Redundant power supplies

Fan Redundancy and field replaceable

Scalable 12 GE ports + 4 x 10GE

L2 Switching with MPLS, QOS at line rate

SyncE, 1588v2

Air Flow Front to back air flow

Ethernet + TDM – AC/DC power12 GE Fiber + 4x10GE SFP+ ports + 1 IM slot

BRKOPT-1001 73


Compact CEM/iMSG PDH/SONET/SDH Module• Supported on:

• Crete (ASR920-12SZ-IM / NCS4202-SA)

• ASR-903/RSP2A-128 / NCS4206-SA/RSP2A-128

• ASR-903/907/914/RSP3C-400 / NCS4206-SA/NCS4216-SA/RSP3C-400 (Future 16.9.1)

• DSn/En CEM Ports

• Up to 12x DS1/T1; Up to 4x DS3/E3

• High Density Molex Connector

• Cisco Patch Panels providing RJ48C and HDBNC Fanout

• DS1/T1 and DS3/E3 SAToP and DS0 CESoP over PWE3

• OCn/STMn SFP CEM Ports

• Up to 4x OC3/STM-1 or 4x OC12/STM-4 / Up to 1x OC48/STM-16

• CEP over PWE3


1) Ethernet SW Support in future release

BRKOPT-1001 74


Accessories

75BRKOPT-1001

• Mix of PDH Ports

• High Density Molex Connector

• 12x DS1/T1

• 4x DS3/E3Molex Connector 4x SFP

PANEL-3G-COMBO-2

DS1RJ48C (120 Ohm) DS3

HDBNC (75 Ohm)

PANEL-3G-COMBO-1

DS1RJ48C (120 Ohm)

DS3HDBNC (75 Ohm)

NCS4200-3GMS / A900-IMA3G-IMSG


• Supported on ASR920-12SZ-IM / NCS4201/NCS4202

• RFC4842 compliant CEP for STS, STS-3c and STS-12c

• SPE encapsulated into CEP Packet

• MPLS/PWE3 Encapsulation

• Full Software Integration

• Transport Overhead Fault and Performance Monitoring

• Local and Network Loopbacks

• ~2-8msec De-Jitter Buffer

• Pluggable Variants:

• DS3, DIN Coax Interface, 75Ohm

• OC3/OC12, LC Optical Interface, S1.1/S4.1, 1310nm, 15km

DS3 & OC3/12 CEP SFP

DS3 SFP

OC3/OC12 SFP

BRKOPT-1001 76

For Reference Only


Services Logical Flow

400

G P

acket/

DW

DM

FA

BR

IC

MP

O-LC

4x16

CD

C

NCS 4016Switching Shelf

NCS 2000CDC Photonic Shelf

QSFP with LC Connector

MPO Fiber

Fle

xS

MR

20

FIB

ER

S

HU

FFLE

Fle

xS

MR

20

ROADM DEGREE 1

ROADM DEGREE 2

400G

Packet/

DW

DM

NCS 4216Switching Shelf

1X 100GEor 2X 40GE

CEM or GE

CEM or GE

CEM or GE

CEM or GE

CEM and/or Ethernet

100GEor

40GE100G/200G

DWDM

100GE CPAK (SC Connector)

or40GE QSFP with LC

Connector

CFP2 with LC Connector

LC Connector

BRKOPT-1001 77


Multi-Layer Control Plane Summary for SONET & Ethernet

NCS 4000

NCS 2000

NCS 4000

NCS 2000

NCS 4200

NCS 4200

WSON

ISIS & RSVP-TE

T-LDP (Pseudowire)

ISIS & RSVP-TE ISIS & RSVP-TE

DWDMGMPLS

UNI

DWDMGMPLS

UNI

Small Office withService End-Point

Larger Office with Service Mid-Point

Larger Office with Service End-Point

BRKOPT-1001 78


• Deploy NCS 2000 to establish ROADM Mesh

• Add NCS 4000 Chassis in Central Offices to provide Packet Switching

• Add NCS 4200 Chassis in Central Offices to provide Low Speed Interfaces

• Enable global MPLS Control Plane

• ISIS

• RSVP-TE

Node Setup in each Central Office

NCS 4000NCS 4000

B A

NCS 4000

NCS 4000

NCS 4000

NCS

2000

NCS

2000

NCS 2000

NCS 2000

NCS 2000

NCS

4200

NCS

4200

NCS

4200

NCS

4200

BRKOPT-1001 79


Remote Building

Example Topology

Remote Building

LargeCentral Office

LargeCentral Office

Remote Building

Remote Building

Remote Building

4202 4206NCS4K-Site3 NCS4K-Site4

4216-5

4216 (1-4)

4201

SmallCentral Office

ME1200-2

ME1200-1

LargeCentral Office

LargeCentral Office

NCS4K-Site1 NCS4K-Site2

4216(1-4)

GE MPLSAccess

10GE MPLS

Access

10GE MPLS

Access

GE NIDAccess GE NID

Access

4216 (1-4)

4216 (1-4)100G Wave

100G Wave

10

0G

Wa

ve

10

0G

Wa

ve

Site 5

Site 4Site 3

Site 2Site 1

100GE MPLS Core

100GE MPLS Aggregation

BRKOPT-1001 80

Manageability &Orchestration


EPN Manager Key FeaturesProgrammable & modular for on-premise and cloud delivery

Multi Layer End to End Management (Physical & Virtual)

Metro and Access Core/Transport Data CentreSubscriber/Branch

EvolvedProgrammableNetwork (EPN)

Manager

3D MultilayerVisualization

Point- and - Click Multidomain Provisioning

OpticalCarrierEthernet

Packet-OpticalData

CenterSP WiFi

Model BasedService & Device Views

Rich API Setto OSS & 3rd Party

BRKOPT-1001 82


OSS/Controller Integration with EPN-M

A Z

Control Plane (RSVP-TE) for MPLS Tunnel (LSP) Setup

Path with Constraints

RESTCONF, MTOSI

Cisco Evolved Packet Network Manager (EPN-M)

OSS

Services:• Circuit Emulation• Ethernet• IP Interworking

API for network setup, E2E services provisioning

BRKOPT-1001 84


EPNM RESTCONF API Guide Available Now

BRKOPT-1001 85


Initial Device StagingBulk Upload of devices

or Auto-discovery

Service Provisioning:

CEM,EPL, E-Line

Infrastructure Provisioning: Global System Configuration

Service Troubleshooting

Infrastructure Provisioning: MPLS Link

Provisioning

Packet Network Manageability Process Flow

86BRKOPT-1001

UNI Provisioning:SONET, PDH,

Ethernet


Template Management: Create/Update Template

Input Parameters/Variables to Template

BRKOPT-1001 87


Discover Installed NEs, Equipment and Ports

Get All NodesGet All EquipmentGet All Termination Points

Node Configuration: ISIS, RSVP, MPLS-TE Global

Configuration

Get All TemplatesGet TemplateDeploy Template

Templates:• Global Routing Configuration

• Loopback• ISIS• RSVP-TE• MPLE-TE

• SyncE Configuration

OSS Integration – Node Level Configuration

88BRKOPT-1001


DWDM/GMPLSUNI-C

Provision Wavelength to be used for Modernization Traffic

Location A Location B

ROADM Degree

Optics

OTU4

ODU4

- ROADM Destination B- Wavelength (optional)- 100G (QPSK)- Mode OTN

ROADM Control Plane (WSON)

NCS 4000NCS 4000

NCS 2000 NCS 2000

LMP LinkLMP Link

Step 1

Step 2

OCH Trail

DWDM/GMPLSUNI-C

Step 3

BRKOPT-1001 89



DWDM Port Configuration: Port Mode and Wavelength


Get Termination PointSet Termination Point

Provision OCH Trail UNI Circuit

Provision

OSS Integration Flow: Wavelength Request to Neighboring Central Office

90BRKOPT-1001


DWDM/GMPLSUNI-C

Provision MPLS Links to enable Packet TopologyLocation A (400G Card Example) Location B (200G Card Example)

ROADM Degree

Optics

OTU4

ODU4

ROADM Control Plane (WSON)

NCS 4000NCS 4000

NCS 2000 NCS 2000

LMP LinkLMP Link

OCH Trail

DWDM/GMPLSUNI-C

100GE MPLS Link

LSPs managed by RSVP-TE Control Plane

- VLAN tagged- IS-IS enabled- RSVP-TE enabled

Static ODU4 in Mode“terminate” Packet Network Topology Setup

Packet Service Control Plane

BRKOPT-1001 91



Packet Port Configuration: OTN Port Mode and Terminate Packet


Get Termination PointSet Termination Point

Provision MPLS Link ProvisionMPLSLink

OSS Integration Flow: Enable Packet Topology and Control Plane

92BRKOPT-1001


• SONET Port Configuration

• PDH Port Configuration

• Ethernet Port Configuration

Provisioning of UNI Resources and Services

NCS 4000NCS 4000

MPLS MPLS

NCS

2000

NCS

2000

NCS 2000

NCS 2000

NCS 2000

NCS

4200

NCS

4200

NCS

4200

NCS

4200

PDH/SONET Ethernet PDH/SONET Ethernet

BRKOPT-1001 93

CEM ‘SAToP’ Provisioning Request:1. AEnd UPSR [SONET -> STS->VTG (Mode VT1.5)->T1]2. ZEnd APS [SONET-> STS->DS3(Mode CT3)->T1]3. MPLS Transport

• 1+1 Protection• Working Path – Explicit [Node and Link Inclusion] • Protect Path – Dynamic

Migration Use Cases


Where should we start?

OTNMSPPsCross

ConnectsLegacy

SONET/SDHPDH

Start with the oldest and most troublesome Equipment

BRKOPT-1001 95

© 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public#CLUS 96BRKOPT-1001

TDM Transformation Strategy Options

All three strategies may be used in various combinations or phases

TDM EquipmentReplacement

1

Central OfficeModernization

Replacing nodes and networks

in a single office (CO relief within

four walls), potentially with A and

Z locations in the same office

2

Circuit A-ZTransformation

Multi-CO transformation for

selected circuits between A

and Z locations over an

IP/MPLS network

3

ROI

DCS


ADM ADM

Lit Building

ADM

Lit Building

ADMDCS DCS

ADMOC48/OC192

UPSR

ADM

Lit Building

ADM

OC12/OC48UPSR

Lit Building

ADM

ADM

ADMOC12/OC48UPSR

OC12/OC48UPSR

OC12/OC48UPSR

OC12/OC481+1 APS

DS3OC3 1+1

DS3OC3 1+1

Voice Switch

Voice Switch

Central Office 1

Central Office 2

Central Office 3

Existing SONET/SDH DCS Infrastructure

BRKOPT-1001 97


ADM ADM

T1/T1 End-to-End Migration De-loading DCS

Lit Building

ADM

Lit Building

ADMDCS DCS

ADMOC48/OC192

UPSR

ADM

Lit Building

ADM

Lit Building

ADM

ADM

ADM

OC12/OC481+1 APS

DS3OC3 1+1

DS3OC3 1+1

Voice Switch

Voice Switch

OC12/OC48UPSR

OC12/OC48UPSR

OC12/OC48UPSR

OC12/OC48UPSR

Central Office 1 Central Office 2

Central Office 2

MPLS-based Transport

NCS4200 and NCS4k are added to the network and attached to the MPLS infrastructure. Those are then pre-provisioned for the connections that run through the DCS and the ADM connections.

BRKOPT-1001 98

4200 4200


DCS and Inter-Office ADM Replacement

Lit Building

ADM

Lit Building

ADM

ADMOC48/OC192

UPSR

ADM

Lit Building

ADM

Lit Building

ADM

ADM

ADM

OC12/OC481+1 APS

DS3OCn 1+1

DS3OCn 1+1

Voice Switch

Voice Switch

OC12/OC48UPSR

OC12/OC48UPSR

OC12/OC48UPSR

OC12/OC48UPSR

Central Office 1 Central Office 2

Central Office 2


The DCS is disconnected and the NCS nodes now assume the DCS functionality.

BRKOPT-1001 99

4200 4200


Lit Building

ADM

Lit Building

ADM

ADMOC48/OC192

UPSR

Lit Building

ADM

OC12/OC48UPSR

Lit Building

ADM

ADMOC12/OC48UPSR

OC12/OC48UPSR

OC12/OC48UPSR

OC12/OC481+1 APS

Central Office 1

Central Office 2

Central Office 3

Aggregation of Legacy Access Rings

BRKOPT-1001 100

DS3OCn 1+1

DS3OCn 1+1

Voice Switch

Voice Switch


Central Office x

ADM

ADMADM

4200 4200


Lit Building

ADM

Lit Building

OC48/OC192UPSR

Lit Building

ADM

Lit Building

ADM

ADM

OC12/OC481+1 APS

4200

OC12/OC48UPSR

OC12/OC48UPSR

OC12/OC48UPSR

Central Office 1Central Office 2

Central Office 2

Central Office x

4200MPLS-based Transport

NCS4200’s are added to the network, attached to the MPLS infrastructure, and cut into existing UPSR rings.


A1

Z1A2

Z2

OC12/OC48UPSR

ADM

4200

BRKOPT-1001 101

DS3OCn 1+1

DS3OCn 1+1

Voice Switch

Voice Switch4200 4200

ADMADM ADM


Lit Building

ADM

Lit Building

ADM

ADMOC48/OC192

UPSR

Lit Building

ADM

Lit Building

ADM

ADM

OC12/OC481+1 APS

4200

OC12/OC48UPSR

OC12/OC48UPSR

OC12/OC48UPSR


Central Office 2

4200


ADM nodes are removed from the UPSR ring leaving the 4200 as the CO ADM node.

Central Office x

4200


A1

Z1A2

Z2

OC12/OC48UPSR

BRKOPT-1001 102

Voice Switch

Voice Switch

DS3OCn 1+1

DS3OCn 1+1

ADMADM

4200 4200


Lit Building

ADM

Lit Building

ADM

ADMOC48/OC192

UPSR

Lit Building

ADM

Lit Building

ADM

ADM

4200

OC12/OC48UPSR OC12/OC48

UPSR


Central Office 2

4200


Additional UPSR rings are cut over to the NCS4200.

Central Office x

4200

… repeat for all Access Rings

A1

Z1A2

Z2

BRKOPT-1001 103

DS3OCn 1+1

DS3OCn 1+1

Voice Switch

Voice Switch

ADM

4200 4200


Lit Building

ADM

Lit Building

ADM

OC48/OC192UPSR

Lit Building

ADM

Lit Building

ADM

ADM


UPSR


Central Office 2

Central Office x

4200

10GE/OTU2 MPLS4200

NEW Lit Building

4200

NEW Lit Building

4200

4200

NEW Lit Building

4200


New systems are brought up on the NCS4200 platform

… new Buildings use Modernized Approach

BRKOPT-1001 104

Voice Switch

Voice Switch

DS3OCn 1+1

DS3OCn 1+1

ADM ADM

4200 4200


Lit Building

ADM

Lit Building

ADM

Lit Building

ADM

Lit Building

ADM

Voice Switch

Voice Switch


UPSR


Central Office x

4200

10GE/OTU2 MPLS4200

NEW Lit Building

4200

NEW Lit Building

4200

4200

NEW Lit Building

4200


Final look after DCS and ADM replacements

BRKOPT-1001 105

4200 4200


Cisco Services - TDM Transformation Service

Activitie

sAdvise ExecutePlanO

utc

om

e

Cis

co

V

alu

e A

dd

Discovery Workshop

Migration Execution

Site Engineering

Design and Validation

Migration Advisory

Migration Planning

Product and solution workshop, ROI and Opexanalysis, collect customer requirements

Solution with products and services, ROI discussion, requirements document

Automated data collection and Opex analysis, joint solution discussion

Database collection, extraction, and analysis, strategy evaluation, OSS and BoM discussion

Understanding migration options, recommendations and reviewfor migration strategy, OSS, BoM

Automated database analysis with what-if scenarios and KPIs, strategy recommendations

Create designs, solution validation, MOP generation, test OSS North Bound Interface and applications interoperability

High and low level designs, lab validation report, generic MOPs, OSS/app test results

Lab buildout, IP/MPLS designs, circuit mapping, OSS testing

Create check list, perform site survey, generate per site documentations, issue resolutions, collect online circuit data

Site audit report, resolution of any uncovered issues, circuit discrepancy and reconciliation report

Automated circuit data collection and reconciliation, discrepancy check, network and equipment floor map

Identify priority sites, circuits and equipment, methodology, etc, resource planning and scheduling

Site specific MOP,circuit and equipment cut sheet, circuit re-engineering recommendations

Automated circuit and equipment reporting, MOP generation, scheduling and logistics

Confirm circuits and equipment, cut preparation, circuit rollover, circuit test, post migration updates and decommissioning

Circuit and equipment cutover, OSS update, legacy equipment decommissioned after all circuit roll

Automated circuit migration workflow with circuit verification and reversion, expertise with NCS equipment and IP/MPLS

BRKOPT-1001 106

Conclusion


Cisco TDM2IP Solution Summary

108BRKOPT-1001

ScalabilityBandwidth Commitment & Latency

<50msec ProtectionService Provisioning & OAM

CAPEX Savings

Network Consolidation

AutomationEnable

NG IP Services

$

Complete your online session evaluation

• Please complete your session survey after each session. Your feedback is very important.

• Complete a minimum of 4 session surveys and the Overall Conference survey (starting on Thursday) to receive your Cisco Live water bottle.

• All surveys can be taken in the Cisco Live Mobile App or by logging in to the Session Catalog on ciscolive.cisco.com/us.

Cisco Live sessions will be available for viewing on demand after the event at ciscolive.cisco.com.

© 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public#CLUS BRKOPT-1001 109

http://ciscolive.cisco.com/us

https://ciscolive.cisco.com/


Continue your education

110BRKOPT-1001

Related sessions

Walk-in labsDemos in the Cisco campus

Meet the engineer 1:1 meetings

Thank you

#CLUS

Modernization and TDM to IP/MPLS Migration - Cisco Live

Documents

Transcript of Modernization and TDM to IP/MPLS Migration - Cisco Live