MicrosoftVirtual Academy

Hyper-V Storage

Symon Perriman Jeff WoolseyTechnical Evangelist Principal Program Manager

MicrosoftVirtual Academy

First Half Second Half

(01) Introduction to Microsoft Virtualization (05) Hyper-V Management

(02) Hyper-V Infrastructure (06) Hyper-V High Availability and Live Migration

(03) Hyper-V Networking (07) Integration with System

Center 2012 Virtual Machine Manager

(04) Hyper-V Storage(08) Integration with Other

System Center 2012 Components

** MEAL BREAK **

Introduction to Hyper-V Jump Start

MicrosoftVirtual Academy

• Storage Considerations

• Creating VHDs• Storage options• iSCSI• Virtual Fibre Channel

Agenda• MultiPath I/O (MPIO)

• Offloaded Data Transfer (ODX)

• Storage Virtualization with Spaces

• Hyper-V over SMB

Your input on StorageLeverage

storage array capabilities

Maximize your investment

Native access to SANs from VMs

No tradeoffs

Help reduce the cost of storage

For workloads that don’t require a SAN

Highly Scalable Virtual Disks

Big data is here

Storage ConsiderationsStorage performance is almost always the virtualization bottleneckImplement storage solutions with multiple hard drives to distribute disk I/OThe faster the drives the betterConsider deploying centralized storage SAN/File Server for High Availability & Live Migration

StorageVirtual machines require storage for virtual hard disk files, snapshots, failover clustering, and the application’s data filesPhysical

DAS (SATA, eSATA, PATA, SAS, SCSI)SAN (Fibre Channel, FCoE, iSCSI, SAS)Required for failover clustering so all nodes can access a diskHost clustering: Fibre Channel, FCoE, Serial-Attached SCSI (SAS), iSCSIGuest clustering: iSCSI, FCoE, Fibre Channel, SMB

Virtual adaptersIDE, SCSIBoot – IDE onlyFibre Channel

VHD (VHDX)Fixed, dynamic, differencingPass-throughiSCSI direct (applicable to running iSCSI in guest OS)

Creating Virtual MachinesNameLocationMemoryNetworkVirtual hard diskOperating systemNew-VM, New-VHD, New-VMSwitch

Creating VHDs

Creating VHDsUse the Virtual Disk WizardDisk Type: Fixed, Dynamically Expanding, DifferencingName & LocationConfigure Disk: Size, Contents can be copied from another location

Configuration can be changed using the

VM settingsIDE controller(s) & locationSCSI controller(s) & locationMedia: VHD, physical hard driveDiskette drive

Virtual Disk TypesDynamicGrows to a maximum size, but will only take as much space as required.

FixedSize of the disk is defined during configurationRegardless of how much is actually stored on the virtual disk, it will take up the maximum amount on the host disk

DifferencingStores the delta changes since the differencing disk was created – such as installing an operating system into the parent disk and then creating differencing disks to perform further configurations on

Hot Add/Remove StorageOverviewAdd and remove VHD and pass-through disks to a running VM without requiring a rebootHot-add/remove disk applies to VHDs and pass-through disks attached to the virtual SCSI controller

BenefitsEnables storage growth in VMs without downtimeEnables additional datacenter backup scenariosEnables new SQL/Exchange scenarios

Live VHD MergeWindows Server 2012 Hyper-V provides the ability to merge the .avhd files associated with a virtual machine without having to shut it down firstIn the past, after deleting a snapshot an administrator had to shut down the virtual machine firstMerge-VHD

Hyper-V HostLarge Sector Support – Native 4K DisksWindows Server 2012 supports native 4K disksSoftware read-modify-write512b logical sector virtual diskPerformance penalty for RMW

4K logical sector VHDX No performance penalty

VHD VHDX512

4K

SoftwareRMW

VHDX512

4K4K 4K

Native 4K Disk

VM

Hyper-V Host

VHD Stack

Increased Storage Efficiency – Unmap •Unmap

• Storage Informed Of Unused Space

•Efficiencies At Virtual Layer• Allows Reuse Of Unused Blocks

•Efficiencies At Physical Layer• VMs Unmap Passed To Hardware

•Supported On• VHDX & PassThru Disks• Virtual SCSI or Virtual Fibre Channel

VHDX

External Storage Array

VM

VHDXThe New Default Format for Virtual Hard DisksUp To 64

TB

Larger Virtual Disks

MB Alignment

Large Sector Support

Enhanced Perf

Larger Block Sizes

Internal Log

Enhanced Resiliency

Embed Custom Metadata

User Defined Metadata

VHDX Performance - 32KB Random Writes

PassThru Fixed Dynamic Differencing125000

135000

145000

155000

165000 Disk VHD VHDX

+10%

+10%

Queue Depth 16

IOPS

VHDX Performance - 1MB Sequential Writes

Pass... F Dyn Differen...0

20040060080010001200140016001800

Disk VHD VHDX

Queue Depth 16

MB/S

+25% +25%

Windows Server 2008 R2

Windows Server 2012

250,000 IOPs 1,000,000+ IOPs

Over 1 Million IOPs from a Single VM

Industry Leading IO Performance• VM storage performance on par with native

• Performance scales linearly with increase in virtual processors

• Windows Server 2012 Hyper-V can virtualize over 99% of the world’s SQL Server.

Hyper-V Storage: No Limits & DynamicWindows Server 2008 Windows Server 2008 R2 Windows Server 2012

Live Storage Migration No. Quick Storage Migration via VMM

No. Quick Storage Migration via VMM

Yes, with no limits. As many as hardware will

allow.VMs on File Storage No No Yes, SMB 3.0

Guest Fibre Channel No No Yes

Virtual Disk Format VHD up to 2 TB VHD up to 2 TB VHD up to 2 TBVHDX up to 64 TB

VM Guest Clustering Yes, via iSCSI Yes, via iSCSI Yes, via iSCSI or FC

Native 4k Disk Support No No Yes

Live VHD Merge No, offline No, offline Yes

Live New Parent No No Yes

Secure Offloaded Data Transfer (ODX)

No No Yes

Storage Options

Storage Options for Virtual MachinesIDETwo IDE controllersTwo devices each

Methods supportedPass-throughFixed-diskDynamic

SyntheticUsed for OS boot partition

SCSIFour SCSI controllers256 devices eachMethods supportedPass-throughFixed-diskDynamic

Synthetic

Choosing VM LocationsVM StorageVHDs: C:\Users\Public\Documents\Hyper-V\virtual hard disksVMs (configuration): C:\ProgramData\Microsoft\Windows\Hyper-VVirtual machinesSnapshots

ConsiderationsPerformanceHard drive spaceSecurityShared storage for failover clustering

iSCSI

Microsoft iSCSI Software TargetiSCSI is a cost effective SAN solutionSupports failover clustering

Uses the existing IP networkCan be a storage array or DAS on a serverFree downloadhttp://www.microsoft.com/download/en/details.aspx?id=19867

iSCSI InitiatorInitiator connects to the iSCSI targetTarget must be configured

Use a dedicated NICCan use any iSCSI target

Configuring iSCSITarget: Create virtual disksInitiator(s): Request access to disksTarget: Accept access request from initiator(s)Initiator(s): Refresh configuration to check connectionInitiator(s): Log in to the targetEnable automatic reconnections

Servers: Initialize, format and bring disks onlineNow you can use these disks for your VMs or cluster

Virtual Fibre Channel

External Storage Array

LUN

Hyper-V Server

VM

Virtual Fibre ChannelExtends Fibre Channel into VMsHigh-performance workloadsGuest clusteringExposes SAN functionality

Uses NPIV functionalitySupportGuest: Windows Server 2008 & laterHost: Windows Server 2012Updated NPIV HBA driver

Live migration just works

vHBAWWN

NPIV HBA

VM

vHBAWWN

Virtual Fibre Channel and Live Migration

Live Migrate

Shared Storage

WWPN A: C0:03:FF:78:22:A0:00:14

WWPN B: C0:03:FF:78:22:A0:00:15

WWPN A: C0:03:FF:78:22:A0:00:14

WWPN B: C0:03:FF:78:22:A0:00:15

1. Create A Temporary VM On Destination Hyper-V Server2. Connect Temporary VM’s HBAs To FC Fabric Using WWPN B 3. Verify Temporary VM Has Connectivity To Shared Storage

4. Complete Normal VM Live Migration (copy memory etc..) Limit IO Queue Depth To 1

5. Pause Source VM6. Change Temporary VM To Permanent VM and Start IO7. Logout of FC Fabric and Delete Source VM

Fibre ChannelTips:Requires Windows Server 2008 and later for the guest OSVerify latest drivers & firmware for FC adapterVerify NPIV is enabled on the FC adapterVerify NPIV is enabled on the FC switch port

Note: You may see NPV as a switch option, Hyper-V doesn’t use NPV.

MultiPath I/O (MPIO)

MPIO and MCSMicrosoft MPIO (Multipath IO) and MCS (Multiple Connected Sessions) work transparently with Hyper-VTwo options for multi-paths with iSCSIMultiple connections per sessionMicrosoft MPIO (multi-pathing input/output)

MPIO supported with Fibre Channel, FCoE, iSCSI, SAS

Microsoft Multipath I/O (MPIO)Use more than one path for read and write functions to your storage deviceProvides redundant failover and load-balancing support for disks or LUNsSupports bandwidth aggregationDistribute I/O transactions across multiple adaptersWindows Server feature

Offloaded Data Transfer (ODX)

Hyper-V Host

VHD Stack

Offloaded Data Transfer (ODX)Traditional data copy modelServer issues read request to SANData is read into memoryData is written from memory to SAN

IssuesIncreased CPU & memory utilizationIncreased storage trafficInefficient for SAN

External Storage Array

LUN1 LUN2

Hyper-V Host

VHD Stack

Offloaded Data Transfer (ODX)Offload-enabled data copy modelServer issues offload read request to SANSAN returns token representing requestServer issues write request to san using tokenSAN completes data copy internallySAN confirms data was copied

Reduce maintenance timeMerge, mirror, VHD/VHDX creation

Increased workload performanceVMs are fully ODX-aware and enabled

External Storage Array

LUN2LUN1

Toke

nToken

Hyper-V ODX Support•Secure Offload data transfer•Fixed VHD/VHDX Creation•Dynamic VHD/VHDX Expansion•VHD/VHDX Merge•Live Storage Migration

•Just one example…Average Desktop

ODX0

50

100

150

200

Creation of a 10 GB Fixed Disk

Time (seconds)

<1 Second!

~3 Minutes

Storage Virtualization with Spaces

Storage SpacesInbox storage virtualization solution providesPoolingResiliencySimple spaceMirror spaceParity space

Thin provisioning

Hyper-V Host

Space

JBOD

Storage Spaces & ClustersCluster supports spacesSimple Mirrored

Mirrored spaceCSV redirection from non-owning nodesUse low latency network (10 G or RDMA) for cluster network

Hyper-V Host

Hyper-V Host

CSV

Clustered

Space Space

Shared JBOD SAS

Hyper-V with Windows Server 2012 File Server and SMB 3.0

Hyper-VHyper-VHyper-VHyper-VHyper-VHyper-V

Hyper-V over SMBFile storage for virtualizationWhat is it?Store Hyper-V files in shares over the SMB 3.0 protocolInclude VM configuration, VHD files, snapshots

Works with both standalone and clustered servers File storage used as cluster shared storage

File Server

File Server

SharedStorage

Hyper-V

SQLServer

IIS

VDIDeskto

pHyper-V

SQLServer

IIS

VDIDeskto

pHyper-V

SQLServer

IIS

VDIDeskto

p

Hyper-V Cluster

File Server Cluster

Handling Intermittent Network Failure •Resiliency:

•Transparently Re-establishes Network Connection

Temporary Disconnect

X

Normal Operation

1

Connections & Handles Re-establishedApplication Does Not Receive IO Error

3

1X3

Hyper-V Host

File Server

\\FS\Share

Hyper-V Host

File Server

13 1

Handling Permanent Network Failure •Multichannel:

•Transparently Uses Alternate Network Path

Permanent Disconnect

X

Normal Operation

1

Connections & Handles Failover, Application Does Not Receive IO Error

3

X

\\FS\Share

Clustered

File Server Node B

File Server Node A

Handling File Server Node Failure

•Continuous Availability•Transparently Fails Over Share To Different File Server

Failure of File Server,Share Failed Over To New Node

X

Normal Operation

1

Connections Re-established,Application Does Not Receive IO Error

3

1

\\FS\Share\\FS\Share

3

X

Hyper-V Host

ClusteredHyper-V Host A

File Server

Handling Hyper-V Node Failure•Cluster Client Failover (CCF)•VMs communicate identity

•Enables Quick RecoveryHyper-V Host Failure, VM Starts On Different Hyper-V Node

X

Normal Operation

1

Stale Handles Shot Down, New Handles Opened Without Delay

3

1

\\FS\Share

3

Hyper-V Host B

X

Host based Backup And Restore

•Virtual Shadow Service For SMB

•No Change in Flow For Backup

File Server

Hyper-V Host

\\FS\S1

VSS Service

Backup

Agent

Remote VSS Agent

Remote VSS

Provider

\\FS\S1~ Snap

VSS Service

/ Provide

r

Hyper-V over SMBFile Storage for VirtualizationHighlightsIncreases flexibilityEases provisioning, management and migrationLeverages converged networkReduces CapEx and OpEx

Supporting featuresSMB Transparent Failover - Continuous availabilitySMB Scale-Out – Active/Active file server clustersSMB Direct (SMB over RDMA) - Low latency, low CPU useSMB Multichannel – Network throughput and failoverSMB Encryption - SecurityVSS for SMB File Shares - Backup and restoreSMB PowerShell - Manageability

Windows Server 2012 File Server Disk Deduplication

Use for Virtual Disk LibraryStore more data in less space Redundant copies of segments of VHDs are replaced by a reference to the single copyCompressed and then organized into special container filesEnable-DedupVolume Disable-DedupVolume

Deduplication on a Hyper-V Library

After Deduplication: 1.39 GB of disk used

Before Deduplication: 62.3 GB of disk used

60.9 GB of Savings!

•When picking the disk type, consider how it will be used and change over time

•Clustering requires using a shared storage• SANs• Microsoft iSCSI target is a free solution

• File Server•MPIO and MSC can be used for additional resiliency

Takeaways

©2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, Office, Azure, System Center, Dynamics and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.