Oracle Real Application Clusters (RAC)


OracleRealApplicationClusters(RAC)–RoadmapforNewFeatures

MarkusMichalewicz,SeniorDirectorofProductManagementDaveHickson,DatabaseArchitect,BTTakWang,VicePresident,OracleRACDevelopmentOctober22,2018

Confidential–OracleInternal/Restricted/HighlyRestricted


SafeHarborStatement

Thefollowingisintendedtooutlineourgeneralproductdirection.Itisintendedforinformationpurposesonly,andmaynotbeincorporatedintoanycontract.Itisnotacommitmenttodeliveranymaterial,code,orfunctionality,andshouldnotberelieduponinmakingpurchasingdecisions.Thedevelopment,release,timing,andpricingofanyfeaturesorfunctionalitydescribedforOracle’sproductsmaychangeandremainsatthesolediscretionofOracleCorporation.

3


ProgramAgenda

Overview

BetterManagement

BetterAvailability

BetterScalability&Performance

TheRoadAhead

1

2

3

4

5

4


ProgramAgenda

Overview

BetterManagement

BetterAvailability


TheRoadAhead

1

2

3

4

5

5


ScalableSequences ContinuousApplicationAvailability OracleRACSharding ClusterDomains ClusterHealthAdvisor(CHA) RACReaderNodes

ApplicationContinuity(AC) OracleFlexASM&FlexClustersRapidHomeProvisioning(RHP) ClusterHealthMonitor(CHM)OracleQualityofServiceManagement(QoS)Policy-BasedClusterManagementOracleRACOneNode&RACcheckOracleASMClusterFileSystem(ACFS)OracleGridInfrastructure(GI)UCPandOCILoadBalancingSupportforRAC

ClusterVerificationUtility(CVU)Cluster-ManagedServices

OracleClusterwareOracleAutomaticStorageManagement(ASM)OracleRealApplicationClusters(RAC)

Oracle9i

OracleRAC’sJourneyintotheAutonomousDatabase20-yearsofcontinuousinnovation*

Oracle18c

*Documentedfeatureslistisselective;20yearsincludedevelopmenttime

6


OracleRACInnovationSpin-Off1OracleAutonomousHealthandtheAutonomousHealthFramework(AHF)

7

http://oracle.com/goto/ahf


OracleRACInnovationSpin-Off2OracleFleetPatching&Provisioning(FPP)andGoldImageManagementformerlyOracleRapidHomeProvisioning(RHP)

8

http://oracle.com/goto/fpp(http://oracle.com/goto/rhp)


OracleRACInnovationSpin-Off3ApplicationContinuity&ContinuousApplicationAvailability–thenewMAA*standard

*MAA=MaximumAvailabilityArchitecture

9

http://oracle.com/goto/ac


OracleAutonomousDatabaseHighlights

Self-DrivingAutomatesdatabaseand

infrastructuremanagement,monitoring,tuning

Self-ScalingScalesonlinefor

highestperformanceandlowestcost

Self-RepairingProtectsfromall

downtimeincludingplannedmaintenance

EnabledbyAppliedMachineLearning

10

1 2 3 4 5


OracleRACDevelopmentFocusAreas

Betterscalability&performance

Efficientmanagementfor

largescaledeploymentsBetteravailability

11


ProgramAgenda

Overview

BetterManagement

BetterAvailability


TheRoadAhead

1

2

3

4

5

12


WhatIf…YouhaveHundredsofEnvironmentsAndwhatif…

– SoftwareInstallation– Storageconfiguration– Diagnosticssetup…wouldhavetobeperformedonlyonceandcanthenbere-usedmultipletimes?…allowingyoutosavemanyhoursperformingthesetiringtasks?

13


ClusterDomain

ClusterDomain-BasedManagement

Facilitating…– FleetPatching&Provisioning(FPP)/formerlyRapidHomeProvisioning(RHP)

– AutonomousHealthFramework(AHF)– AutomaticStorageManagement(ASM)andhostedonadedicatedcluster–theDomainServicesCluster(DSC)–allthreemanagementtaskscanbecentralizedanddiagnosticscanbeoptimizedforMemberClustersinaClusterDomain.

14

DomainServicesCluster

FPP AHF

Simplificationandefficiencythroughcentralization

ClusterDomains@BTDavidHickson–DatabaseArchitect

BT

October22,2018

©BritishTelecommunicationsplc

AboutBT

•  TheUK’slargestbroadbandprovider•  TheUK’slargestlast-milenetworkprovider•  TheUK’slargestwideareanetworkprovider•  InEE,theUK’sbestlargestandbestmobilenetworkprovider•  Aglobalfootprintoperatingin180countries•  BTSportdeliveringPremiershipandUEFAfootball•  AllunderpinnedbyTechnologyDepartment


Context–ExistingRACandDatabaseServicesinBT

•  Largescale,on-premisesEnterpriseCloud•  OracleDatabaseandRACestatecontinuingtogrow•  OracleRACdatabasesmostlyon12.1or12.2•  12.2clustersonlysinceApril2018•  Lotsofautomationalreadybut…

•  Weneedsmarterwaysto–  DeliverRACclustersmorequickly–  Administratemoreefficiently

•  Goal:ReduceoverheadsofmanyRACclusters


ClusterDomains–Whyisthisarchitectureattractivetous?

•  I/OServer–  Replacehundredsofindependentpoolsofstoragewithcentralisedpools–  Increasestorageonmemberclusterswithoutinfrastructurechanges

•  RapidHomeProvisioning–  CentralisedmanagementofOraclesoftwareforinstallation,patching,upgrading

•  AutonomousHealthFramework–  Replacemanyindependentmanagementrepositorieswithone


ClusterDomains–FuturePlans

•  Whatwe’vedone–  TestingofClusterDomainsandMemberClustersusing12.2.0.1–  Onvirtualisedinfrastructure

•  Whatweplantodo–  ClusterDomainsareasignificantarchitecturalshift–  ProceedwithOracleDatabase19c(AKA12.2TerminalRelease)–  I/Oserver,RapidHomeProvisioningandAutonomousHealthFramework


What’sNextforClusterDomains?

1.   Transitions(*18c+)2.  DomainServices

ClusterAvailability3.  andPerformance

PlannedTransitions

20


gridSetupandzip-basedinstallforOracleGridInfrastructure

NEW:RPM-basedinstallsfortheOracleDatabaseandOracleClient

ASMManagementforNFS-basedClusterwarefilesforeasiermanagementandtherebybetteravailability.

SeparateDiskgroupforGridInfrastructureManagement

Repository(GIMR)allowsformoreflexibilityduringGridInfrastructureInstallation

BetterManagementThankstoYourFeedback

$ORACLE_HOME/gridSetup.sh

ConfigureASMonNFS

21


AdaptingtoYourFeedback•  DesupportofDirectFileSystemPlacementforOracleClusterwareFiles

–  IntroducedwithOracleClusterware12cRel.2(12.2.0.1)– EffectivewithOracleClusterware18c– DesupportrevokedeffectivewithOracleClusterware19c

•  OracleGridInfrastructureManagementRepository(GIMR)– AroundsinceOracleGridInfrastructure11gRelease2– AutomaticInstallationoftheGIMRintroducedwithGridInfrastructure12.1.0.2– SeparatediskgroupinstallationintroducedwithGridInfrastructure12cRelease2– AutomaticinstallrevisedforOracleGridInfrastructure19c

•  PlansforeseeaGIMRinstallationoutsideoftheOracleGridInfrastructurehomeforStandardClusters•  CentralizedGIMRhostingonaDomainServicesCluster(forMemberClusters)remainsunchanged

22


FlexCluster MassiveParallelQueryOracleRAC OracleRACReaderNodes

OracleFlexCluster– ABriefReview

23


FlexCluster

Leafnodesdeprecated

MassiveParallelQueryOracleRAC

deprecated

OracleRACReaderNodes

tobeimplementedonHubnodes

FlexCluster– ChangesDowntheRoad

24


Deprecation=RoomtoFocusonInnovation•  OracleFlexCluster

–  IntroducedwithOracleClusterware12cRelease1(12.1.0.1)•  Targetusecase:Managementofapplicationsanddatabaseinthesamecluster•  DatabasesaremeanttobehostedonHUBnodes,applicationsonLeafnodes

–  OracleClusterware12cRelease2enabledtwomoreusescases:1.  MassiveParallelQueryOracleRealApplicationClusters(OracleRAC)2.  OracleRACReaderNodes

–  EffectivewithOracleClusterware18c•  LeafnodesaspartoftheFlexClusterarchitecturehavebeendeprecated•  The“MassiveParallelQueryOracleRAC”usecasehasbeendeprecated•  The“OracleRACReaderNodes”usecaseremainsandwillbesupportedonHUBnodesinstead

–  HAcapabilitiesprovidedbyLeafnodeswillbemadeavailableonHubnodesasapplicable•  ThedesupportofLeafnodesandtheirrespectiveusescasesiscurrentlyplannedforOracleClusterware19c

25


ProgramAgenda

Overview

BetterManagement

BetterAvailability


TheRoadAhead

1

2

3

4

5

26


ApplicationContinuity&ContinuousApplication

Availability

ZeroBrownoutReconfiguration

ZeroDowntimeMaintenance

ThreeAvailabilityFocusAreas

27


InnovationUndertheHoodMultipleprojectsandfeaturescontributetoZeroBrownoutReconfiguration

MaximumAvailabilityArchitecture

4xfaster

1.5xfaster

•  OracleRACreconfigurationtimesreducedby–  4xbetweenOracleRAC11.2.0.4and12Rel.2–  1.5xbetweenOracleRAC12cRel.2&18c–  foratotalof6ximprovements

betweenOracleRAC11.2.0.4and18c

•  Selectionofcontributingfeatures:–  RemasteringSlaves(*12.1)–  Supportfor100LMS’s(*12.2)

–  MoreDynamicRemastering

28


ContributingFeatures•  RemasteringSlaves(1slaveperLMS)

–  StartingwithOracleRAC12.1,theLMSoffloadsheavyremasteringworktotheslave–  ThisimprovesLMS’sresponsivenessforCacheFusionrequestsduringremastering

•  Supportfor100LMS’s–changeindefaultvalue–  OracleRAC12.2supportsupto100LMS’s(names:LMS0-LM99)asopposedto35–  Onlargersystems(lotsofCPU,largeSGA),moreLMS’swillstartbydefault– MoreLMS’smeansbetterreconfigurationtimewithoutanyimpactduringruntime

• MoreDynamicRemastering(DRM)–  StartingwithOracleRAC19c,DRMisplannedtomoreadaptivelyconsidertheoverallsystemstate

29


InnovationontheWaytotheAutonomousDatabase

•  Aproactiveandautomaticmonitoringandcorrectionframework–  SomefunctionalityfirstintroducedinOracleRAC12c–  CurrentframeworkusedinOracleRAC18c;furtherenhancementsplannedforOracleDatabase19c

– Monitorsvarious(currently~50)metricsacrossdifferentlayerscontinuously

•  Sharesandconsidersinformationglobally,butactslocally–  Detectsproblemsbeforeanydisruptionofserviceoccurs

•  v$tablesprovidelogsshowingcurrentsystemstatusandhistoryofissuesdetected–  Identifiesrootcauseaccurately,basedoncurrentsystemsituation

•  Usesacombinationofmetricstopredictpotentialissuesandidentifiesrootcause(s)–  Resolvesproblemswithminimumdisruption,ideallybeforeithappens

•  Takespreventativeactionbasedonidentifiedrootcause–  Serializesactionsacrosstheclustertominimizeresolutionimpact

•  Correctiveactionsareperformedonperresourcebasis

IntroducingDatabaseReliabilityFramework(DRF)(WorkingName)

30


Patching Improvements• OJVMisOracleRACrollingpatchenabledwithOracleRAC18c(18.4)

– Non-Javaservicesareavailableatalltimes– Javaservicesareavailableallthetime,exceptfora~10secondsbrownout

•  Noerrorsarereportedduringthebrownout

•  Zero-DowntimeOracleGridInfrastructurePatching(*18.3)– PatchOracleGridInfrastructurewithoutinterruptingdatabaseoperations– Patchesareappliedout-of-placeandinarollingfashionwithonenodebeingpatchedatatimewhilethedatabaseinstance(s)onthatnoderemainupandrunning

– SupportedforOracleRACandRACOneNodeclusterswithtwoormorenodes

31


ProgramAgenda

Overview

BetterManagement

BetterAvailability


TheRoadAhead

1

2

3

4

5

32


InnovationUndertheHoodMultipleprojectsandfeaturescontributetoBetterScalability&Performance

5xfaster

•  OracleRACperformancehasimprovedupto–  5xbetweenOracleRAC11.2.0.4and18.1especiallyforhighcontentionworkloads

•  Selectionofcontributingfeatures:–  LeafBlockSplitOptimizations(*12.2)–  ScalableSequences(*18c)

•  Exadata-basedoptimizations:–  UndoRDMA-Read(*18c)–  “SmartFusionBlockTransfer”(*12.2)–  ExaFusionDirect-to-WireOLTPProtocol(*12.2)

33


OracleRACPerformanceFeatures

• AutomaticUndoManagement• CacheFusion• OracleRealApplicationClusters

• SessionAffinity• PDB&ServicesIsolation• Service-OrientedBufferCache• LeafBlockSplitOptimizations• SelfTuningLMS• MultithreadedCacheFusion• ExaFusionDirect-to-WireProtocol• SmartFusionBlockTransfer

• UniversalConnectionPool(UCP)SupportforOracleRAC• SupportforDistributedTransactions(XA)inOracleRAC• ParallelExecutionOptimizationsforOracleRAC• AffinityLockingandRead-MostlyObjects• ReaderBypass• FlashCache

• ConnectionLoadBalancing• LoadBalancingAdvisory• ClusterManagedServices• AutomaticStorageManagement

9i 10g11g

12c

18c

• ScalableSequences• UndoRDMA-Read• CommitCache• DatabaseReliabilityFramework

Overtwodecadesofinnovation


Contentioncanoccurinanymulti-usersystem(eveninSIdatabases)

Scalingout,contentioncanoccurbetweeninstances

(notonlywithinaninstance).

Fromacontentionperspective,thenumberofnodesisirrelevant.

Contention–TheBasicshttps://www.slideshare.net/MarkusMichalewicz/oracle-rac-internals-the-cache-fusion-edition

writewrite

writewrite

Note:forscalability,onlywrite/writecontentionneedstobeconsidered.

writewritewritewrite

35


Frequenttransactionalchangestothesamedatablocksmayresultin

“writehotspots”

Pendingredomustbewrittentologbeforetheblockcanbe

transferred

Contentioncanaffectrelateddataasmuchasitcanaffecttheuserdata.

Rightgrowingindexesandindexcontentionarecommon.In99%ofOLTPperformanceissues,writehotspotsoccuronindexes.

Contention–Considerationshttps://www.slideshare.net/MarkusMichalewicz/oracle-rac-internals-the-cache-fusion-edition

Sequence

REDO

36


ExaFusionDirect-to-WireOLTPProtocolallowsthedatabasetodirectlycallintotheInfiniBandHW.

SmartFusionBlockTransferImprovesCacheFusionlatencybyallowingLMStoservedirtyblocksassoonasaREDOflushisinitiated

3xfasterRight-GrowingIndexperformancedueto

LeafBlockSplitOptimizations,ScalableSequences,

CommitCache

Contention–TheSolutions

37


UndoRDMA-Read&CommitCache•  UndoRDMA-Read(*18c)

–  Insomeworkloads,morethanhalfoftheremotereadsareforUndoBlockstosatisfyreadconsistency

–  UndoBlockRDMA-readusesRDMAtodirectlyandrapidlyaccessUNDOblocksinremoteinstances•  AvoidshavingtoactivatearemoteLMStoperformtheoperation

•  CommitCache(*18c)–  TheCommitCachemaintainsanin-memory,simplehashtableofrecenttransactionsoneachinstance

–  RemoteLMSdirectlyreadsthecommitcacheandsendsbackcommittimesforrequestedtransactions•  Replaceshavingtosendentire8Ktransactiontableblock

•  Customertestresults:–  Upto57%ofthecache-fusionblocktrafficwaseliminated–  clusterwaittimedownby22%;DBCPUtimedownby7%

UNDOUNDO

RDMA RDMAInst1

Inst3

Inst2

38


ScalingtheWorld’sMostComplexEnterpriseWorkloads• DuetoitsmarketleadingCacheFusionalgorithm,OracleRACscales1.   anyfeature–e.g.PluggableDatabases,OracleIn-MemoryandOracleDataGuard

2.   mostenterpriseapplications–e.g.EbusinessSuite,SAP,OracleHospitality

3.   nearlyallcustomapplicationsasusedbymanyofOracle’s15000RACcustomers

• Withouttheneedforsignificantapplicationchanges•  EspeciallyonOracleExadataDatabaseMachines• DesignedtosupportOracleAutonomousDatabaseCloud

39


WhyOracleSharding?•  Someapplicationshugelybenefitfrom“datadependentrouting”

–  Datadependentroutingmeansthatusersareroutedtowherethedataresides–  RoutingcanbeperformedwithinanOracleRACdatabaseoracrossindependentdatabases–  OracleShardingisOracle’sfullyintegrateddatadependentroutingsolution

•  OracleRACSharding–  Affinitizestablepartitionstoinstances

•  forbettercacheutilizationandreducedblockpingsbetweeninstances–  TakesadvantageofdirectroutingAPIofSharding:

•  Requeststhataspecifyshardingkeyareroutedtotheinstancethatlogicallyholdsthecorrespondingpartition•  Requeststhatdonotprovideapartitionkeywillberoutedbasedonthedefaultloadbalancingpolicy

–  AddingashardingkeyimprovesOLTPperformancerequiresnochangestothedatabaseschema•  alter system enable affinity <TableName>;

40


AnotherInnovationforOracleRACOracleRACSharding

41

http://oracle.com/goto/sharding


ProgramAgenda

Overview

BetterManagement

BetterAvailability


TheRoadAhead

1

2

3

4

5

42


TheRoadAheadLeadsintotheAutonomousDatabaseCloud•  Futurescalability&performanceimprovements

– TailortoscalingwellwithinExadatadimensions(“scalelinearacross64nodes,not200”)– AredesignedtomeetADBperformancerequirementsandwillgrowasADBenhances– WillleverageRDMAtechnologyforserver-lesscommunication– PlantouseRoCEasthenext-generationnetworkforthecloud

•  DetailsinMOSnote“OracleRACInterconnectProtocols–SupportandRoadmap(ID2434852.1)”– Willsubstitutestorageaccesswithnetwork-basedaccesstodataonremotenodes– ArelikelytoutilizeNVMforstorageonindependentservers(eliminateshareddisk)

•  Futureavailabilityimprovements– Willfocusonreducingre-configurationtimes(brownouts)furthertocomecloserto“zero”– Willprovideevenmorewaystoperformmaintenance&admintaskswithnodowntime

43

Oracle Real Application Clusters (RAC)

Documents

Transcript of Oracle Real Application Clusters (RAC)