1

© 2006 IBM Corporation IBM / Oracle ICC

Using ESAMON to Monitor Oracle System Utilization and Overview of IBM Performance Toolkit

Brent A. HoweKathryn ArrellRichard Lewis

IBM / Oracle ICC2

Agenda

Overview of ESAMON

Samples of measuring systems at Oracle► Online► Monthly Summaries

Questions

Overview of IBM Performance Tool Kit

2

IBM / Oracle ICC3

Velocity Software Products

ESALPS provides for Linux and z/VM► Performance Analysis – to meet service levels

► Operational Alerts – to detect problems● Manage 100’s of servers● SNMP, 3270, browser

► Capacity Planning – to project requirements

► Accounting/Charge back – for utilized resources

zTUNE provides Health Check for Linux and z/VM► http://velocitysoftware.com/workshop.html

Performance Education► “http://velocitysoftware.com/workshop.html”

IBM / Oracle ICC4

Managing Linux on “z” With ESALPS

ESALPS – Linux Performance Suite► Analyze all z/VM Subsystems in detail, real time

● (DASD, Cache, Storage, Paging, Processor, TCPIP)► Analyze by Linux servers, applications, processes► Provide Historical view of same data

● Why are things worse today than yesterday?● Did adding new workload affect overall throughput?

► Support all releases (SLES7,8,9,10, RHEL 3,4, z/vm V3,4,5…)► All Standard interfaces► Low resource requirements

► Corrects CPU data► Can instrument hundreds of servers today

3

IBM / Oracle ICC5

Performance Resources

http://LinuxVM.com, http://VelocitySoftware.com•zLinux & z/VM Performance Workshops

•http://VelocitySoftware.com/workshop.html

IBM / Oracle ICC6

Oracle Mainframe Complex’s

IBM D32 2084► Hardware Configuration

● 32 Engines● Logical Configuration● 3 LPARS

– L1HQCMS1 ♦ 8 CP’s

– L1HQCMS3♦ 24 CP’s♦ Install, QA, Dev

Guests – L1HQCMS4

♦ 24 CP’s♦ Dev, Build, Install &

QA Guests

IBM B16 2084● Hardware Configuration

– 16 engines► Logical Configuration

● LP2MVS06 –● LP1VM1 (HQCMS2)

– OCFS Guests ● LP5VM2● LPAMVS05● LPBMVS06● LPCMVS07● LP1CF● LP2MVS01● LP3MVS02● LP4MVS09

4

IBM / Oracle ICC7

Screen: ESAMTOP Oracle Corporation ESAMON V3.6 04/06 15:12-15:

1 of 1 Top Users Management Report USER TOPUSERS 2084 2B

<---CPU time--> <-Main Storage> <Paging(s)> Expanded Stora

UserID <--(seconds)--> <---WSSize----> <---I/O---> <-----pages---

Time /Class Total Virt Total Actv Avg Read Write Read Write M

-------- -------- ------- ------- ----- ---- ---- ----- ----- ----- ----- --

15:27:00 System: 541.04 535.66 21M 21M 332K 165 0 112 0

STRKA28 119.36 119.24 91253 91K 91K 0 0 0 0

STRKA60 102.09 98.47 1048K 1M 1M 0 0 0 0

STRKA73 61.21 61.15 1048K 1M 1M 0 0 0 0

STRKA65 59.79 59.76 993K 993K 993K 0 0 0 0

STRKB25 59.78 59.75 1048K 1M 1M 0 0 0 0

STRKA59 59.74 59.69 943K 943K 943K 5 0 2 0

STRKA48 59.57 59.52 1048K 1M 1M 0 0 0 0

STRKA22 3.21 3.18 376K 376K 376K 0 0 0 0

STRKA23 3.18 3.16 370K 370K 370K 0 0 0 0

STRKA66 1.55 1.53 972K 972K 972K 0 0 0 0

Performance of VMCMS3

IBM / Oracle ICC8

Screen: ESAMTOP Oracle Corporation ESAMON V3.6 04/06 15:17-15:31 1 of 1 Top Users Management Report USER TOPUSERS 2084 3B4FA

<---CPU time--> <-Main Storage> <Paging(s)> Expanded Storage UserID <--(seconds)--> <---WSSize----> <---I/O---> <-----pages----->

Time /Class Total Virt Total Actv Avg Read Write Read Write Migr-------- -------- ------- ------- ----- ---- ---- ----- ----- ----- ----- -----15:31:00 STRKA77 59.95 59.87 1048K 1M 1M 4 0 118 422 0

STRKA37 59.83 59.79 315K 315K 315K 0 0 0 0 0STRKA76 59.73 59.66 1048K 1M 1M 6 0 2 212 0STRKA82 59.57 59.44 1048K 1M 1M 0 0 20 0 0STRKA39 11.75 11.50 858K 858K 858K 0 0 2 0 0STRKA40 10.41 10.16 977K 977K 977K 0 0 2 0 0STRKA64 4.53 4.41 1048K 1M 1M 33 0 23 0 0STRKA69 3.68 3.61 1018K 1M 1M 27 0 0 0 0STRKB16 2.83 2.76 270K 270K 270K 32 0 133 0 0STRKA63 1.92 1.87 1048K 1M 1M 0 0 1 0 0

15:30:00 STRKA82 67.01 66.88 1048K 1M 1M 0 0 0 0 0

Performance of VMCMS4

5

IBM / Oracle ICC9

Screen: ESAMTOP Oracle Corporation ESAMON V3.6 04/06 15:37-15:51 of 1 Top Users Management Report USER TOPUSERS 2084 553

<---CPU time--> <-Main Storage> <Paging(s)> Expanded StoragUserID <--(seconds)--> <---WSSize----> <---I/O---> <-----pages----

Time /Class Total Virt Total Actv Avg Read Write Read Write Mi-------- -------- ------- ------- ----- ---- ---- ----- ----- ----- ----- ---15:50:00 PAZXOB01 1.28 1.27 495K 495K 495K 0 0 0 0

PAZXOQ01 0.22 0.16 73424 73K 73K 0 0 0 0 PAZXOQ02 0.22 0.16 49028 49K 49K 0 0 0 0 PAZXXQ01 0.22 0.16 49328 49K 49K 0 0 0 0 PAZXXQ02 0.19 0.13 495K 495K 495K 0 0 0 0 STRKA88 0.19 0.12 111K 111K 111K 0 0 0 0 STRKA89 0.18 0.12 106K 106K 106K 0 0 0 0 PAZXXOI4 0.18 0.17 738K 738K 738K 0 0 0 0 STRKA86 0.08 0.06 178K 178K 178K 0 0 0 0 DTCVSW1 0.07 0.00 1684 1684 1684 0 0 0 0 ESATCP 0.04 0.03 527 527 527 0 0 0 0

Performance of VMCMS2

IBM / Oracle ICC10

Oracle System Use D32 August D32 by LPAR

0

10

20

30

40

50

60

70

80

90

100

8/1/

2006

8/2/

2006

8/3/

2006

8/4/

2006

8/5/

2006

8/6/

2006

8/7/

2006

8/8/

2006

8/9/

2006

8/10

/200

6

8/11

/200

6

8/12

/200

6

8/13

/200

6

8/14

/200

6

8/15

/200

6

8/16

/200

6

8/17

/200

6

8/18

/200

6

8/19

/200

6

8/20

/200

6

8/21

/200

6

8/22

/200

6

8/23

/200

6

8/24

/200

6

8/25

/200

6

8/26

/200

6

8/27

/200

6

8/28

/200

6

8/29

/200

6

8/30

/200

6

8/31

/200

6

L1HQCMS1 L2HQCMS3 L3HQCMS410.1.05 QA

AS10G QA

6

IBM / Oracle ICC11

August Oracle D32 LPAR Utilization by ShiftDay Chart

0

10

20

30

40

50

60

70

80

90

100

Day Chart

0

10

20

30

40

50

60

70

80

90

100

0

10

20

30

40

50

60

70

80

8/1/2006

8/2/2006

8/3/2006

8/4/2006

8/5/2006

8/6/2006

8/7/2006

8/8/2006

8/9/2006

8/10/2006

8/11/2006

8/12/2006

8/13/2006

8/14/2006

8/15/2006

8/16/2006

8/17/2006

8/18/2006

8/19/2006

8/20/2006

8/21/2006

8/22/2006

8/23/2006

8/24/2006

8/25/2006

8/26/2006

8/27/2006

8/28/2006

8/29/2006

8/30/2006

8/31/2006

L1HQCMS1 L2HQCMS3 L3HQCMS4

IBM / Oracle ICC12

Free command and VMstats

FREE total used free shared buffers cached

Mem: 32922444 18291512 14630932 0 410248 13123916

-/+ buffers/cache: 4757348 28165096

Swap: 2418964 0 2418964

us sy id

65 3 31

94 3 3

66 5 29

32 1 67

93 3 3

88 3 8

64 3 33

93 3 4

83 4 13

62 4 34

92 3 5

72 2 25

VMSTAT column n,o,p – for CPU

7

IBM / Oracle ICC13

Questions

Any questions on ESAMON

Now using IBMPerformance Tool Kit

IBM / Oracle ICC14

Performance Toolkit for VM

A real-time performance monitor based on FCON/ESA► Has replaced both VMPRF and RTM (in z/VM 5.1)► Priced optional feature of z/VM

Capabilities► Provides an immediate view of system performance► Post processes its own history files or CP Monitor data► Ability to monitor remote systems► Results can be viewed using

● VMCF and APPC/VM● Web browser

Processes Linux data provided by the RMF PM data collectorProcesses Linux data inserted into CP monitor stream as application data (APPLDATA)Provides performance information for Omegamon XE on z/VMMore info can be found at ► http://www.vm.ibm.com/related/perfkit/► SC24-6136-02, z/VM V5R2.0 Performance Toolkit► http://publib-b.boulder.ibm.com/Redbooks.nsf/RedpieceAbstracts/sg246059.html

8

IBM / Oracle ICC15

Performance Toolkit for VM

z/VM Control Program (CP)

PERFSVM Virtual

Machine

monitor

Reports

*MO

NIT

OR

Syst

em

Serv

ice

MonitorShared

Segment

HistoryFiles

Monitor Data

MONWRITE

Linux

IBM / Oracle ICC16

Performance Data Selection Screen

9

IBM / Oracle ICC17

Logon Screen - Web Interface

IBM / Oracle ICC18

System Selection Screen - Web Interface

10

IBM / Oracle ICC19

Display Selection Screen - Web Interface

IBM / Oracle ICC20

CPU Load Screen - Web Interface

11

IBM / Oracle ICC21

Getting Help - Web Interface

IBM / Oracle ICC22

Graphics Display – Web Interface

12

IBM / Oracle ICC23

Summary

The Performance Toolkit for VM is a priced optional feature of z/VM

Functions provided include: ► Operation of the system operator console in full-screen mode ► Management of multiple z/VM systems (local or remote) ► Post-processing of Performance Toolkit for VM history files and VM

monitor data captured by the MONWRITE utility ► Viewing of performance monitor data using either Web browsers or PC-

based 3270 emulator graphics► Viewing Linux data produced by rmfpm, or the Linux accounting facility

(APPLDATA) ► Supplies performance information for viewing with Omegamon XE for

z/VM