Virtualization + Management & Automation = Private Cloud?

47
Virtualization + Management & Automation = Private Cloud? Barb Goldworm President & Chief Analyst, FOCUS Virtualization Chair, Interop Private Cloud Chair, ECS and Cloud Connect

Transcript of Virtualization + Management & Automation = Private Cloud?

Virtualization + Management &

Automation = Private Cloud?

Barb Goldworm President & Chief Analyst, FOCUS

Virtualization Chair, Interop

Private Cloud Chair, ECS and Cloud Connect

Technology Implementation

Priorities 2011/2012

© 2011 FOCUS - www.focusonsystems.com

2

Q: Which of the following technology initiatives are currently being implemented OR will begin implementation within your organization over the next 12 months.

0 50 100 150 200 250

None of the above

Middleware/Application Integration

Physical Security

Virtualization - Desktop

Unified Communications/VoIP

Video Conferencing

Collaboration (enterprise Web 2.0, social networking)

Energy conservation and cost savings

Storage

Data Center upgrades and optimization

Wireless and Mobility capabilities

Upgrading your Network Infrastructure

Virtualization - Server

Incorporating Cloud-based applications/services

IT Security

State of the Industry: Virtualization

• New VM created every 6 seconds, > than # live

births in US

• 5.5 vMotions per second, > than aircraft in flight

• Installed base of virtual OSs > physical as of 2011

• Up to 50% server workload virtualized (Gartner)

• Organizations not investing in management tools

beyond what comes with hypervisor

• Multi-hypervisor- 5% -1 hypervisor,50% -2,30% -3

State of the Industry:

Private Cloud

• 10x increase in private cloud deployments in

2012 (Gartner)

• Private cloud benefits – more agility than cost

• Hybrid – rare now but plans are affecting

architecture and vendor selection today

• Choices: Virt platforms, cloud mgmt vendors,

cloud stacks

• Hosted private clouds growing

State of the Industry:

Virtualization -> Cloud • Cloud fever/cloud washing

• Confusion

– Virtualization vs. cloud

– Between SaaS, IaaS, PaaS

• Virtualization success = economics of consolidation

• Optimization and agility increasingly important

• Cloud drivers = agility, optimization, & economics

Virtualization + optimization + agility = cloud

© 2012 FOCUS - www.focusonsystems.com 5

The Management Challenge • Virtualization not fulfilling promise – management becomes an

obstacle

– VM sprawl / VM stall

– Limited automation

– Lacking full stack monitoring/mgmt

– Limiting growth & value of virtualization & impeding path to ITaaS

• Virtualization increases pace of operations yet

– 39% lack monitoring and audit tools

– 65% plan on using multiple vendors hypervisors

– 34% have budgeted less than $10k for tools

– Most will have a mixed physical and virtual infrastructure for the foreseeable future

• Organizations historically lack proper policy and procedures

– Virtualization makes this a bigger problem

© 2012 FOCUS - www.focusonsystems.com 6

Source: InformationWeek survey of 391 IT organizations

Cloudify to Reach

the Next Level

The Road from Virtualization

to Private Cloud

2010 FOCUS,LLC - www.focusonsystems.com

8

From Virtualization to Private Cloud

Virtualized Infrastructure

Infrastructure optimized for virtualization

Automated, policy-based dynamic resource management

Usage based cost visibility – chargeback/showback

Self-service provisioning

Service Catalog Source: FOCUS, LLC

So What’s a Cloud?

© 2012 FOCUS, LLC. All rights reserved. 9

Hosted Private Cloud Operated and tailored solely for an organization, typically within the firewall, hosted by a CSP

Private Cloud Operated and solely for an organization, typically within the firewall

Public Cloud Accessible over the Internet for general consumption

Hybrid Cloud Composition of 2 or more interoperable clouds, enabling data and application portability

Cloud

Computing is a

way of doing

computing

Enterprise Cloud Service

Providers

(CSP)

Bridgin

g

NIST Definition of Cloud

© 2011 FOCUS - www.focusonsystems.com 10

Virtualization to Cloud

Phases & Challenges

© 2012 FOCUS - www.focusonsystems.com 11

1) Server virtualization /consolidation

4) IT as a Service/Private Cloud

3) Management and Automation

2) Infrastructure optimization

A

B

Stall Points

TIME

V

A

L

U

E C

New Delivery/ Business Model

Networking Storage

New Technology

Performance Tool Overload

Performance

The Roads to

Private Cloud

© 2012 FOCUS - www.focusonsystems.com 12

Private cloud: virtualized, optimized, and

automated – operates as self-

managing, virtual infrastructure with

self service portal and service

catalog

Public

Cloud

Virtual

Infrastructure

Virtualization=>

Cloud Management

• Virtualization management now morphed/merged into cloud

• Base requirements – visibility, discovery, mapping, monitoring, provisioning, automation/orchestration

• Orchestration may cross private/public/hybrid

• Workload/performance mgmt – required for agility, real-time responsiveness and availability, troubleshooting, root cause analysis

• Capacity planning & resource optimization required to achieve cloudlike efficiency and elasticity

• Configuration mgmt/automated provisioning – standardization, image management, and automation for efficiency and agility

• Infrastructure optimization – compute, network, & storage, scalability, converged infrastructure/virtual I/O – mobility must include fabric of networking and storage

• Cloudstacks, portals, catalogs, orchestration for true cloudification

© 2012 FOCUS - www.focusonsystems.com 13

Virtualization & Cloud

Management • Rapidly Changing Ecosystem

– Hypervisor Vendors

– Virt/cloud Mgmt Startups

– Traditional ESM Players

– Infrastructure vendors

– Cloud Orchestration stack vendors

– Cloud Service Providers/ Hosting providers/Managed Service providers

• Hypervisor specific vs. hypervisor agnostic

• Virtualization/cloud management lines are blurred

• Functionality lines are blurred

• Innovations from startups/ mergers and acquisitions

© 2012 FOCUS - www.focusonsystems.com 14

Virtualization &

Management Landscape • VMware – ESX/ESXi, Virtual Center (vCenter), HA, DRS, DPM, VMotion, Storage VMotion,

Site Recovery Manager, Workstation, Player, ACE, Fusion, View Manager, View Composer,

ThinApp, AppSpeed, RTO, vCenter Server Heartbeat, Chargeback, SpringSource, Hyperic,

vShield (BlueLane), TriCypher, vCloud Director, Request Manger, vCenter Operations (vCOPS)

Dashboard, Navigator, Chargeback, Configuration Manager (Integrien, ConfigureSoft,

FastScale, VMware vCloud Connector, Virtual Storage Appliance, App Performance Manager

(AppSpeed+ Hyperic), AppDirector, IT Busines Management Suite (Digital Fuel)

• Microsoft –Hyper-V - Windows Server 2008 R2 SP1, App-V Application Virtualization

(SoftGrid), Remote Desktop Services/Terminal Services, MED-V Enterprise Desktop

Virtualization (Kidaro), Systems Center 2012, VMM, Operations Manager, Configuration

Manager, System Center Orchestrator (Opalis), AppController (Concero Self-Service Portal),

Service Manager, Azure

• Citrix – XenServer, XenDesktop, XenApp hosted and streamed, Provisioning Server, Citrix

Delivery Center, Desktop Studio, Desktop Director, VMLogix, NetScaler, Branch Repeater,

CloudGateway, CloudBridge, CloudStack, CloudPortal, AppDNA Apptitude

• OpenSource (KVM/Xen) – Red Hat Enterprise Virtualization (RHEV-M and RHEV-H) RedHat

Enterprise Linux (RHEL), Novell SUSE, Oracle VM

© 2012 FOCUS - www.focusonsystems.com 15

VMware Cloud Products Private Cloud

Portability

Cloud Services vCloud

Operations and Management vCenter

Security and Compliance vShield

Virtual Resources vSphere

Public Cloud

Cross-Cloud Standards vCloud API

Open Virtualization Format

Cross-Cloud Management vCloud Connector

vCloud Solution

vCloud Powered Broad array of

VMware-compatible clouds

for any business need

vCloud Datacenter

Security & performance

for enterprises

vCloud Express

Rapid, credit card payment

for developers

Co-Branded vCloud Services

VMware Management

Architecture

© 2010 FOCUS - www.focusonsystems.com 17

MS Cloud View

© 2011 FOCUS - www.focusonsystems.com 18

Systems Center 2012

© 2012 FOCUS - www.focusonsystems.com 19

Citrix Cloud Management

© 2012 FOCUS - www.focusonsystems.com 20

Citrix CloudStack

• From Cloud.com acquisition in July 2011

• 60+ large-scale production clouds deployed

including GoDaddy, GreenCloud, KT, Nokia,

Tata Communications and Zynga

• Hypervisor-agnostic solution - KVM, Oracle VM

(October), vSphere, XenServer®, Hyper-V (Q4)

• Will also enable bare metal provisioning

• AWS API compatible

• Project Olympus – commercial distro of

OpenStack – officially dead © 2012 FOCUS - www.focusonsystems.com 21

© 2011 FOCUS - www.focusonsystems.com 22

0 50 100 150 200 250 300 350 400

Novell SUSE Xen

Open Source Xen

Red Hat Xen

Parallels

Red Hat KVM

Oracle VM

Microsoft Hyper-V

Citrix XenServer

VMware vSphere

Server Virtualization Platforms in Use 2011

Production-primary

production-non-primary

Evaluation

Source: FOCUS Interop Survey Sept 2011

Virtualization Expansion

Pain Points

© 2011 FOCUS - www.focusonsystems.com 23 0% 5% 10% 15% 20% 25% 30% 35% 40%

Other (please list):

Lack of vendor support

None

VM sprawl

Predicting storage requirements/growth

Troubleshooting performance problems

Security issues

Internal organizational issues

Storage challenges

Backup challenges

Networking challenges

Performance issues

Virtualization Implementation Pain Points 2011

Source: FOCUS Interop Survey Sept 2011

Monitoring the

Virtual /Cloud World

• Physical infrastructure monitoring has been a mature market

• Virtualization/cloud requires new monitoring components for hypervisors, multi-hypervisor and multi-environment clouds

• Parameters and thresholds are now different - CPU, memory, disk space

• Server workloads and desktop workloads

• Hardware to VMs to clouds to applications.

© 2012 FOCUS - www.focusonsystems.com 24

Real time performance mgmt

& Root Cause Analysis

• Performance & response times

• SLA management

• Address potential user

resistance barriers

• Understanding dependencies

• Locating bottlenecks

• Root cause analysis

© 2011 FOCUS - www.focusonsystems.com 25

Performance Monitoring &

Management Features

• Automated discovery of components and relationships (P + V +C)

• Visualization & Usability – customizable dashboard

• Monitoring

• DB - flexibility, import/export, reporting, ad hoc query/reporting

• Breadth and depth – cross vendor, tiers (apps, VMs, hypervisor, server, storage, networking, DT) + drill down with detailed metrics

• Thresholds and Alerting – granularity and flexibility of responses

• Policy-based responses/actions

• Recommendations – knowledge base

• One-click actions

• Real-time – monitoring and management

• Trending – historical analysis

• Integration with ESM tools

• Root cause analysis & correlation engine

• Scalability

© 2012 FOCUS - www.focusonsystems.com 26

Performance Tools Landscape • AccelOps – monitors status, events, trends, and configuration data about networks, network

devices, systems, applications and virtual environments

• Embotics–V-Commander–lifecycle,perf,capac,config. VMW &Hyper-V

• Hotlink – SuperVISOR for Vmware plug-in – VMW, Hyper-V, XenServer

• NetScout nGenius Virtual Agent - packet-flow monitoring & analysis

• Netuitive – storage, net,hosts, VMs; Best of VMworld 09

• Nimsoft (CA) - monitoring private clouds - servers, network devices, databases, and

applications, ESX, vSphere, Hyper-V, and Citrix XenServer

• Quest/Vkernel – vFoglight, Foglight, Vkernel – performance/capacity for VMware and Hyper-V

• Reflex – Monitoring, performance, capacity, configurations

• SolarWinds - network, storage, application, server and virtualization performance

management. Virtualization Manager/Storage Manager - VMware and Hyper-V

• VCOPS – performance, capacity, chargeback, configuration for VMware., ADM (nLayers)

• Veeam – monitoring, performance, capacity, reporting, VMware and Hyper-V

• Xangati – dashboard, analytics, DVR for servers and desktops

• Zenoss – open source physical, virtual device and app monitoring

• CA, BMC, EMC – enterprise systems mgmt and network analysis

• IBM, HP, Cisco – systems vendor physical mgmt

© 2012 FOCUS - www.focusonsystems.com 27

Capacity Management

• Planning (initial P2V placement)

• Management (basic what if, planning for

upgrades, stretching IT dollars, ongoing)

• Optimization (overprovisiong vs.

underprovisioning, additional variables and

more complex modeling, ongoing)

• Analytics (sophisticated modeling, planning

and real-time performance management

integration)

© 2012 FOCUS - www.focusonsystems.com 28

Capacity Management Features

• Application and infrastructure discovery & monitoring

• Profiling VM resources

• Understanding resource interdependencies

• Capacity Modeling (CPU, Mem, I/O) - what if analysis

• Capacity Management (CPU, Mem, I/O)

• Business Policy Overlay

• Point in time versus trending intelligence

• Candidacy analysis – Physical, virtual, Cloud

• Reporting

• Accounting/ chargeback /cost visibility tie-in

• Storage capacity

© 2012 FOCUS - www.focusonsystems.com 29

Capacity Management Landscape

• VCOPS - Capacity IQ, Chargeback

• CiRBA – Capacity, chargeback, candidacy

• Embotics – V-Commander capacity, chargeback

• Quest vFoglight & vKernel – Capacity Management Suite

• Veaam ONE- Monitor, Performance, Report,Capacity, Change Mgmt

• VMTubo – Economic Scheduling Engine

• Reflex VMC vWatch, vCapacity, vProfile © 2012 FOCUS - www.focusonsystems.com 30

Chargeback Considerations

• Chargeback vs cost visibility (showback)

• X86 chargeback was by Server, SW, MB, & ports

• Now need per application or per user

• Should include VM (% of HW, OS and app SW, power, backup/DR and mgmt SW), storage and networking

• Excel, capacity tools, simple chargeback model, high-end chargeback

• Service level tie-in

• Service providers and cloud vendors as models

• Path to consumption based pricing for cloud © 2012 FOCUS - www.focusonsystems.com 31

Life Cycle Management

• Plan, provision, police, put to bed

• Policies and products

• Provisioning management

• Optimization of resource usage

• Control for virtual sprawl

• Configuration and change control

• Automation of administrative tasks

• Workflow orchestration across systems

© 2011 FOCUS - www.focusonsystems.com 32

Life Cycle Management

Provisioning Features

• Migration P2V, V2V, V2P

• Templates, cloning

• OS and Application Streaming

• User Profile/Personalization/Virtualization

• Automated policy-based provisioning

• Workflow orchestration

• Lab management

• Service management

• Self- service provisioning

• Service Catalog

© 2011 FOCUS - www.focusonsystems.com 33

Self Service Provisioning &

Service Catalogs

• Menu of services available via self-service portal for IT service consumers

• Typically front-end Web-based listing of services, products and pricing delivered by back-end IT infrastructure

• Policy based back-end triggers orchestration/ automation of service provisioning steps

• Standardizes offerings and their implementations

• Enterprise App Store

• Integration with provisioning, change management, service desk, CMDBs

© 2012 FOCUS - www.focusonsystems.com 34

VMware vCloud Director

vCloud Director

Secure Private Cloud

Organization: Marketing Organization: Finance

Organization VDCs Catalogs Organization VDCs Catalogs

VMware vSphere

VMware vCenter Server

Resource Pools Datastores Port Groups

(Go

ld)

(Bro

nze)

Provider Virtual Datacenters

(Sil

ver)

Users & Policies Users & Policies

Systems Center 2012 features

• On prem and cloud VMs & move bw them

• VMs, cloud resources, fabric

• Self service and orchestration improvements

• Infrastructure and app performance awareness

• Private – Hyper-V, vSphere, XenServer

• Public – Azure

• Advisor – gathers and analyzes historical data

• Intune – deploys updates and reports

• SCCM – mobile devices through connector to ActiveSync (no agent for ipad, iphone, android)

Systems Center 2012

• Virtual Machine Manager (VMM) 2012 - services for creating and

managing clouds. deploy and update VMs and applications

• App Controller 2012 - self-service portal for requests to private cloud

created with VMM 2012. (also Windows Azure.)

• Service Manager 2012- automated IT service management, self-service

portal. process with human approvals

• Configuration Manager 2012 – user-centric app config, mgmt and

delivery (inventorying, updating, orchestrating, delivery), local, VDI, apps

(App-V or PS), mobile (Windows Phones, Symbian, iOS, Android),

update (MS, 3rd-party apps, HW drivers, BIOS), Windows and Linux

• Orchestrator 2012 - automate interactions among other management

tools such as VMM 2012 and Service Manager.

• Operations Manager 2012 - monitor VMs, applications, and other

aspects of private cloud, initiate actions to fix problems

Microsoft Private Cloud

Citrix Cloud.com

Cloud Management

Life Cycle Management

Configuration/Change Control

Features

• VM sprawl management

• Automatic infrastructure and VM Discovery

• VM Inventory

• Configuration Mgt

• Change Mgt and Compliance Auditing

• Application and OS image and patch management

• Retiring/ Decommissioning VMs

© 2012 FOCUS - www.focusonsystems.com

40

Automated Provisioning, Lifecycle

Management, Configuration Management,

Self Service & Service Catalogs

• BMC Cloud Lifecycle Management

• CA Automation Suite

• Cisco – Intelligent Autotmation for Cloud -CIAC- (NewScale, Tidal)

• Citrix CloudPortal, CloudGateway, CloudBridge, Delivery Center, Workflow Studio, Desktop Studio, Provisioning Server

• DynamicOps (Dell)

• Embotics - V-Commander

• MS Systems Center 2012 (VMM, App Controller, SCCM,SCOM, Service Manager, Orchestrator...)

• Novell Cloud Manager

• Quest Cloud Automation Platform (Surgient)

• Reflex VMC- vWatch, vProfile, vCapacity, vTrust

• Rightscale – manages AWS and Eucalyptus

• Veeam – inventory, config, visio export, biz view, cap planning, custom reporting

• VMware vCloud Director/Request Manager, vCenter Orchestrator, vCloud Director/Request Manager, vCenter Ops, Configuration Manager, View Composer

© 2012 FOCUS - www.focusonsystems.com 41

Cloud Stacks Cloud Orchestration and Provisioning

• OpenStack – 165+ supporters

– Rackspace/NASA 2010. Dell, Red Hat, IBM, HP, Cisco, ATT, Intel, SUSE

– Now OpenStandard Foundation

– Hyper-V, XenServer, KVM, ESX

– Essex –(v5) Dasboard (Horizon), Identity (Keystone)

• Eucalyptus – 25,000 cloud starts/yr

– AWS API compatible (EC2 and S3), blessed by & partnered with AWS

– VMware, KVM

• CloudStack – 57 supporters, but more mature, more in production

– Cloud.com 2008 / Citrix acq 2011. Juniper, Intel, NetApp, Brocade

– Support for AWS APIs

– Apache Software Foundation

– Zynga, Bechtel, GoDaddy

• Nimbula Director

– Enterprise focused

– Highly automated, scalable, reliable, easy to use

– Gartner Cool Vendor

– KVM, VMware ESXi, Cloud Foundry

Virtualization/Cloud Management

© 2012 FOCUS - www.focusonsystems.com

032112

Virtualization to Cloud

Road Map

• Capacity planning –Initial P2V - what goes where

• Server consolidation – low hanging fruit

• Basic mgmt - Live migration (PM), HA, basic DRS

• Security and Compliance

• Add policies and life cycle mgmt tools for managing VM sprawl (discovery, inventory, usage)

• Storage optimization and Image management

• Backup and DR – leveraging virt and addressing virt

• Real-time mgmt - troubleshooting tools - performance, root cause, fault mgmt, storage

© 2012 FOCUS - www.focusonsystems.com 44

Virtualization to Cloud

Road Map • Security and Compliance

• Integration with other mgmt tools

• Capacity management / planning

• Automated policy-based provisioning

• Usage based pricing/showback/chargeback

• Self service portals and service catalogs

• …. IT as a Service, Private Cloud, Hybrid Cloud

• * Business/mission critical apps added as comfort grows

© 2012 FOCUS - www.focusonsystems.com 45

Evaluation/Decision criteria

• Heterogeneous environs (servers,

storage, OS, hypervisors)

• Out of the box capabilities

• Lifecycle workflow

automation/integration

• Automated provisioning

• Back end templates, controls

• Self service portal usability

• Service catalog and admin tools

• Consumption based pricing/

reporting, chargeback/showback

• Sprawl, waste reclamation

• Change control/config mgmt

• Security and compliance reporting

• Real time end-to-end performance

monitoring of apps and systems

• Root cause analysis

• Ongoing resource optimization

• Resource capacity planning/mgmt

• Business view/overlay

• VM through storage

performance/capacity mgmt

• Recommendations, specificity and

granularity

• Ease of remediation

• Dashboard/reporting customization

• Standards

• Scalability

© 2012 FOCUS - www.focusonsystems.com 46

Company Name Virt

Backup Storage Optimiz

Storage Mgmt Monitoring Perform Mgmt

Capacity Mgmt

Config Mgmt

Charge-back

Provisioning Self Service Svc Catalog

Security & Compliance

Multi-hypervisor

Abiquo x x x x x x V, H, XS, K

Acronis x

Altor Networks (acq by juniper) x

Aptare x x

Atlantis X

BMC x x x x x x x x

CA (3tera,Hyperformix, Nimsoft) x x x x x x x x x H,V

Catbird x

CiRBA x x V,K,X,P

Cisco (NewScale, Tidal) x x

Citrix (Cloud.com, VMLogix, XenSource) X X X x x x X,H,V

Cloupia x

CommVault x

DataCore x x

Dell (Compel, Equal,DynOps,AppAssure) x x x x x x x x x x x x

DynamicOps x x x x x x x x x

eG Innovations x x

Embotics x x x x x x

EMC (Avamar, DD, Isilon, RSA) x x x x x x

Eucalyptus x x x x

FalconStor x x

Hotlink x x x x x V,X,K,H

HP (3PAR, LHN, Opsware, TipPoint) X x x x x x x x x

HyTrust x

IBM (Storwiz, Tivoli, XIV,Platform) x x x x x x x x x x x V,X,H,P

ManageIQ x x x x V,H,K

Microsoft (Opalis) x x x x x x x H,V,X

NetApp (Akorri) x x x

Netuitive x

Nimbula x x x K,V, CF

OpenStack x x x x

PhD Virtual x H plan

Quest (Surgient, Viz, VKernel) x x x x x x x x x x V,H

Red Hat x x x X,K

Reflex Systems x x x x x

Solarwinds (Hyper9, TekTools) x x x x x x

Symantec x x x x x x

TeamQuest x x

Tintri x x

Trend Mico x

Tripwire x x

Uptime Software x x x

Veeam Software x x x x x x V,H

Virsto x V,H

Vision (Double-Take) x

VMturbo x x x

VMware(AppSpeed,DigitalFuel,Hyperic,Integrien,Ionix,PacketMotion,Shavlik,TriCipher ) x x x x x x x x x x

Xangati x x

Zenoss x x x © 2012 FOCUS - www.focusonsystems.com