AboutGluent

We are long term Oracle Database & Data Warehousing guys – long history of performance & scaling

About 20 people in distributed teams in US & UK

The world is changing – we help customers to get the best out of both worlds!

we liberate enterprise data

Gluent Data Platform enables all applications to access all enterprise data, at anytime, on demand, and without any code migration or rewrites

Why“GettingStarted”

5

Manyconferencepresentationsgettootechnical,toofast

WhatisODI?

• E-LT(Extract,Load,Transform)vsETL• Heterogeneoussourcesandtargets• Builttointegratealldata

• Flexibility• Reusablecodetemplates(KnowledgeModules)

• OpenAPI

• ODIwilladapttoyourdatawarehouse-andnottheotherwayaround

• Flowbasedmappings

7

WhatisODI?

8

WheredidODIcomefrom?

Early2000s:Sunopsisformed

2006:OracleacquiresSunopsis.

2010:OracleDataIntegrator11greleased.Oracle’sfirstrealupdatetoODI.

Late2013:OracleDataIntegrator12creleased,combiningODIandOWBfeatures.

2012:ODIforBigDatafirstreleased

9

ODI12cArchitectureandComponents

*imagesource:https://docs.oracle.com/middleware/1221/odi/concepts/img/architecture.png

9

ODI12cArchitectureandComponents

*imagesource:https://docs.oracle.com/middleware/1221/odi/concepts/img/architecture.png

InstallationandConfiguration

• Knowthedifferenttypesofinstalls• Standard-usedforStandaloneAgentoronclientmachine(ODIStudioonly)

• Enterprise-JEEAgentorColocatedAgent,ODIConsole,FMCplugin

11

Chooseyourinstallationtypewisely

12

Configurationishalfthebattle

12

Configurationishalfthebattle

CONFIGURATION

• ODI_HOME/odi/studio/odi.sh|exe• Connecttoexistingrepository• Ifnoneexists,runRCUfirst

• Boom,you’rein!

13

ODIStudioConfiguration

• ODI_HOME/oracle_common/common/bin/config.sh|exe• RuntheWebLogicServerconfigurationwizard

• StandaloneAgent• CreatedomainoutsideofODIOracleHome

• JEEAgent• Addcredentialsmapping

• Create/configureadminserver,nodemanager,topology,etc.

14

StandaloneorJEEAgentConfiguration

15

ODIAgent-howitworks

ODIAgent

ODIrepository

Sourcedatabase

Targetdatabase

1.Executionrequestviahttp(s)

2.AgentcommunicateswithODIrepositorytogeneratecodeandgathersource/targetconnection

3.Agentpassescodetosource/targetdatabasesandupdatesrepositoryexecutionlogs

GettingStarted

• DataServer• Connectiontothedatasource

• PhysicalSchema• Databaseschema

• Workschema

• LogicalSchema• Abstractsthephysicalconnection/schemafromthelogical

• DevelopmentoccursagainsttheLogicalSchema

• Model• MetadataobjecttiedtoLogicalSchema

• Representsdatabaseschema,filedirectory,XMLdocument,etc

• Datastore• Logicalrepresentationoftable,file,XMLelement,etc.

17

Topology,Contexts,Models,andDatastores-Ohmy!

Alloftheseobjectsmustbecreatedandsetuppriortoanymappingdevelopmentcanoccur.

• There’sanotherwaytogetstarted-quickly!• NewModelandTopologyObjectswizard-ODI12.1.3• InODI11g,theODIQuickStartwasa10stepchecklist,whereeachstepledtoanothersectioninthedocumentation

18

Developer’sQuickstart

19

Topology,Contexts,Models,andDatastores

20

LogicalConstraintsonthemetadata

20

LogicalConstraintsonthemetadata

20

LogicalConstraintsonthemetadata

20

LogicalConstraintsonthemetadata

MappingsandKnowledgeModules

22

Mappings-LogicalDatastorecomponent

Joincomponent

Splitoutputtomultipletargettables

MappingsarebuiltfromdatastoreandcomponentstologicallyformtheETL

23

Mappings-Physical

Physicalimplementationsofthemappingsarerepresentedbasedonlocationofthedatastore.KnowledgeModulesareselectedtogeneratethecode.

23

Mappings-Physical

Physicalimplementationsofthemappingsarerepresentedbasedonlocationofthedatastore.KnowledgeModulesareselectedtogeneratethecode.

ODIwilladapttoyourdatawarehouse-andnottheotherwayaround

24

KnowledgeModules-thesecretsauce

*imagesource:FusionMiddlewareDevelopingKnowledgeModuleswithOracleDataIntegrator

24

KnowledgeModules-thesecretsauce

*imagesource:FusionMiddlewareDevelopingKnowledgeModuleswithOracleDataIntegrator

24

KnowledgeModules-thesecretsauce

*imagesource:FusionMiddlewareDevelopingKnowledgeModuleswithOracleDataIntegrator

OrchestrationPackagesandLoadPlans

• Grouplikeobjectstogether• Performspecializedtasks(looping,etc)

26

Packages

• ExecutesScenarios(executionobjectsthatareessentiallycompiledcode)• Stepscanberuninparallelorserially• If-then-elsestepcanevaluateavariabletodeterminepath• Exceptionstepscanbecustomizedandexecutedonfailure

27

LoadPlans-thetoplevelorchestrationobject

MoreflexibilityProcedures

• Reusablecomponentsforadmintasks• DDL,filearchivescripts,exceptionhandling,etc

• Movingortransformingdata,itprobablyshouldbeamapping• Creatingacomplex,recurringtaskfordatamanipulation,probablyaKnowledgeModule

29

Proceduresformaintenancetasksandone-offfunctions

Imagessource:http://ritt.md/9E

• IntegrationwithGoldenGate(changedatacapture)andEnterpriseDataQuality(for…dataquality)• ODIforBigData• ODICloudService

30

Othernotablefeatures

• OracleDataIntegratoris…• anE-LT/dataintegrationtool

• builttointegratealldata

• flexible.ODIwilladapttoyourdatawarehouse-andnottheotherwayaround

• Chooseyourinstallationwiselyandunderstandconfigurationismoreinvolved• ManyobjectsmustbecreatedpriortoMappingdevelopment• UsetheDeveloper’sQuickstart!

• Flowbasedmappingsseparatebusinesslogicfromphysicalimplementation• KnowledgeModulesarethe“secretsauce”ofODI• Moreinfo:mRainey.co/odi12c-getting-started

31

Recap

32

we liberate enterprise data

thank you!