Search icon CANCEL
Subscription
0
Cart icon
Your Cart (0 item)
Close icon
You have no products in your basket yet
Arrow left icon
Explore Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Free Learning
Arrow right icon
Arrow up icon
GO TO TOP
Oracle Data Integrator 11g Cookbook

You're reading from   Oracle Data Integrator 11g Cookbook This book is all you need to take your understanding of Oracle Data Integrator to the next level. From initial deployment right through to esoteric techniques, the task-based approach will enhance your expertise effortlessly

Arrow left icon
Product type Paperback
Published in May 2013
Publisher Packt
ISBN-13 9781849681742
Length 352 pages
Edition 1st Edition
Languages
Arrow right icon
Toc

Table of Contents (19) Chapters Close

Oracle Data Integrator 11g Cookbook
Credits
Foreword
About the Authors
About the Reviewers
www.PacktPub.com
Preface
1. Installation, Deployment, and Configuration 2. Defining the Oracle Data Integrator Security FREE CHAPTER 3. Advanced Topology 4. Using Variables 5. Knowledge Module Internals 6. Inside Knowledge Modules – SCD and CDC 7. Advanced Coding Techniques 8. Package Loops and File Processing 9. XML and Web Services 10. Advanced Coding Techniques Using the ODI SDK 11. More on ODI Index

Index

A

  • Action parameter / How to do it...
  • actions
    • modifying / Modifying actions to get more from your diagrams, How to do it...
  • API
    • about / Introduction
  • area location staging
    • changing, to impact data flow / Impacting the data flow by changing the staging area location, Getting ready, How to do it..., There's more...
  • artifacts
    • import automating, SDK used / Automating the import of artifacts using the SDK, How to do it..., How it works...
  • Authentication class / How it works...
  • AuthenticationConfiguration class / How it works...
  • Authentication object / How to do it..., How it works..., How to do it...

B

  • BATCH_ID attribute / How it works...
  • BATCH_ID variable / How to do it...
  • BLOB.DOC file / Getting ready
  • Boolean flags / Getting ready

C

  • C$ table / How it works...
  • callbacks
    • web services, invoking from ODI / Invoking asynchronous ODI web services with callbacks, How to do it...
  • case sensitivity
    • changing, for code generation / Changing the case sensitivity for code generation, How to do it..., There is more...
  • case_sens parameter / How it works...
  • CDC
    • using / Using Changed Data Capture (CDC) - simple, How to do it...
    / Defining packages and loops for near real-time execution using a hybrid loop
  • CLOB.TXT file / Getting ready
  • close() method / How it works..., How it works..., How to do it...
  • code generation
    • case sensitivity, changing for / Changing the case sensitivity for code generation, How to do it..., There is more...
  • commit() method / How it works..., How it works..., How it works..., How it works..., How it works...
  • COMPONENT_NAME / How it works...
  • computeSourceSets() method / How to do it..., How it works...
  • condition code generation
    • Java, using / Using Java for condition code generation, How it works...
  • CONNECT profile / How it works...
  • consistent set CDC
    • using / Using Changed Data Capture (CDC) - consistent set, Getting ready, How to do it..., How it works..., There's more...
  • container based authentication
    • configuring, with ODI web services / Configuring container-based authentication with ODI web services, How to do it..., How it works...
  • Copy of Oracle technology / How to do it...
  • createMasterRepository() method / How it works...
  • createWorkRepository() method / How it works...
  • Current Record Flag / Getting ready
  • custom profiles
    • creating, in security navigator / Creating new custom profiles in the Security navigator, How to do it..., How it works...

D

  • data
    • loading, from SQL query / Loading data from an SQL query, How to do it..., How it works...
    • pivoting / Performing a pivot, How to do it..., How it works..., There's more...
    • loading, partition exchange used / Loading data using partition exchange, How to do it..., How it works...
  • data flow
    • impacting, by changing staging area location / Impacting the data flow by changing the staging area location, Getting ready, How to do it..., There's more...
  • data models
    • DDL, generating from / Generating DDL from data models, How to do it..., How it works...
    • interfaces, generating from / Generating interfaces from data models or diagrams, How to do it..., How it works...
  • datastores
    • creating, SDK used / Creating models and datastores using the SDK, How to do it...
  • Data type option / How to do it...
  • datatypes
    • expanding / Modifying and expanding datatypes, How to do it...
    • modifying / Modifying and expanding datatypes, How to do it...
  • DDL
    • about / Generating DDL from data models
    • generating, from data models / Generating DDL from data models, How to do it..., How it works...
  • DEMO_SRC data model / Getting ready
  • DEMO_TRG data model / Getting ready
  • Developer Guide for Oracle Data Integrator
    • URL / Introduction
  • Developer Installation / Understanding the ODI Installation
  • diagrams
    • used, for maintaining models / Using diagrams to develop and maintain models, How to do it..., How it works..., There's more...
    • used, for developing models / Using diagrams to develop and maintain models, How to do it..., How it works..., There's more...
    • interfaces, generating from / Generating interfaces from data models or diagrams, How to do it..., How it works...
  • directory
    • files, processing / Processing all files in a directory, How to do it..., How it works...
  • Directory parameter / How to do it...
  • d parameter / How it works...

E

  • encode.bat(sh) / How to do it...
  • Ending Timestamp / Getting ready
  • Error if file not found parameter / How to do it...
  • Excel spreadsheet
    • accessing / Accessing an Excel spreadsheet, Getting ready…, How to do it...
  • ExecutionInfo / How it works...
  • exit() / How to do it...
  • external authentication
    • setting, with ODI / How to do it...
  • external program
    • with password requirement, invoking / Invoking an external program that requires a password, How to do it..., How it works...

F

  • Filename Mask option / How to do it...
  • FileName parameter / How to do it...
  • files
    • using, from parameter variable / Using a file from a parameter variable, How to do it..., There's more...
    • detecting, variable name used / Detecting files with a variable name, How to do it..., How it works...
    • in directory, processing / Processing all files in a directory, How to do it..., How it works...
    • processing, in parallel / Processing a large number of files in parallel, How to do it...
    • complex files, processing / Processing complex files with ODI, Getting ready, How to do it..., How it works...
  • findByName() method / How it works...
  • FLOW_CONTROL option / How to do it..., How it works...
  • f parameter / How it works...
  • Fusion Middleware Developers Guide
    • URL / Introduction
  • Fusion Middleware High Availability Guide
    • URL / There's more...

G

  • Generate DDL option / How it works...
  • generateScenario() method / How to do it..., How it works...
  • generic profiles
    • used, for creating users / Creating users using generic profiles, How to do it..., There's more...
  • get() method / How it works...
  • getObjectName
    • used for table names, running in contexts / Using table names that run in all contexts using getObjectName, How to do it..., How it works...
  • getTransactionalEntityManager() method / How it works...
  • Groovy
    • URL / Introduction
  • Groovy web site
    • URL / There's more...

H

  • Historize old rows / How it works...
  • hybrid loop / Defining packages and loops for near real-time execution using a hybrid loop

I

  • I$_ staging table / How it works...
  • If statement / Using Java for condition code generation
  • IImportService class / How it works...
  • IImportService constructor / How it works...
  • import/export
    • automating, with ODI SDK / Automating Smart Export/Smart Import with the ODI SDK, How to do it..., How it works...
  • importObjectFromXml() method / How to do it..., How it works...
  • Insert changing and new dimensions / How it works...
  • INSTANCE_HOME / How it works...
  • Integrated Development Environment (IDE) / Introduction
  • InteractiveInterfaceHelperWithActions / How it works...
  • InteractiveInterfaceHelperWithActions.prepareAction() method / How to do it...
  • interface
    • creating, SDK used / Creating an interface using the SDK, How to do it..., How it works..., There's more...
  • InterfaceActionAddSourceDataStore / How it works...
  • InterfaceActionOnTargetDataStoreComputeAutoMapping / How it works...
  • InterfaceActionSetTargetDataStore / How it works...
  • interfaces
    • generating, from diagrams / Generating interfaces from data models or diagrams, How to do it..., How it works...
    • generating, from data models / Generating interfaces from data models or diagrams, How to do it..., How it works...
  • Int_Variable_Filter interface / How to do it..., How to do it...
  • Int_Variable_Option interface / How to do it...
  • IOdiContextFinder class / How it works...
  • IOdiDataStoreFinder class / How it works...
  • IOdiEntityManager method / How it works...
  • IOdiLogicalSchemaFinder class / How it works...
  • IOdiProjectFinder class / How it works...
  • IOdiSessionFinder / How it works...
  • ITransactionManager class / How it works..., How it works...
  • ITransactionManager object / How to do it..., How it works..., How to do it...

J

  • Java
    • using, for condition code generation / Using Java for condition code generation, How it works...
    • invoking, from KMs / Invoking Java from the KMs, How to do it..., There's more...
    • substitution methods, using / Using substitution methods in Java, How to do it...
  • Java Development Kit (JDK) / Introduction
  • Java EE Installation / Understanding the ODI Installation
  • Java Management Extensions (JMX) / How it works...
  • Java Runtime Environment (JRE) / Introduction
  • Java variables
    • using, in KMs / Using Java variables in KMs, How to do it..., How it works...
  • JDBC driver
    • deploying, with JEE ODI Agent / Deploying JDBC drivers with a JEE ODI Agent, How to do it…
  • JDBC Driver option / How to do it...
  • JdbcProperties object / How it works...
  • JDBC protocol / How it works...
  • JDBC URL option / How to do it...
  • JEE agent / Understanding the ODI Installation
  • JEE components / Understanding the ODI Installation
  • JEE ODI agent
    • deploying / Deploying a JEE ODI Agent
    • deploying, steps for / How to do it...
  • JEE ODI Agent
    • JDBC drivers, deploying with / Deploying JDBC drivers with a JEE ODI Agent, How to do it…
  • JMX_PORTNO / How it works...
  • Journalizing Knowledge Module (JKM) / Getting ready
  • Jython code / How to do it...
  • Jython web site
    • URL / There's more...

K

  • Keep History option / How to do it...
  • KM
    • substitution methods, combining / Combining substitution methods in a KM, How to do it..., There's more...
  • KM options
    • variables, using / Using variables in KM options (and reusing the variables in an interface, package, and so on), How to do it..., How it works...
  • KMs
    • about / Introduction
    • Java variables, using / Using Java variables in KMs, How to do it..., How it works...
    • Java, invoking from / Invoking Java from the KMs, How to do it..., There's more...

L

  • LDAP security
    • setting up, for ODI / Setting up LDAP security for Oracle Data Integrator, How to do it...
  • LOB files
    • loading / Loading a file containing a LOB, How to do it...
  • loops
    • inside packages controlling, variables used / Using variables to control loops inside packages, How to do it..., How it works...

M

  • master repository
    • creating, SDK used / Creating the Master and Work repositories using the SDK, How to do it..., How it works...
  • MasterRepositoryDbInfo object / How it works...
  • MasterRepositorySetupImpl class / How it works...
  • Microsoft download center
    • URL / Getting ready…
  • Microsoft support website
    • URL / How it works...
  • models
    • maintaining, diagrams used / Using diagrams to develop and maintain models, How to do it..., How it works..., There's more...
    • developing, diagrams used / Using diagrams to develop and maintain models, How to do it..., How it works..., There's more...
    • creating, SDK used / Creating models and datastores using the SDK, How to do it...
  • Move Sub Directories parameter / How to do it...

N

  • Natural Key / Getting ready
  • non-generic profiles
    • used, for creating users / Creating users using non-generic profiles, How to do it..., How it works...
  • nXSD file / How to do it...

O

  • object-oriented programming (OOP) / How it works...
  • ODI
    • about / Introduction, How it works..., Introduction, Introduction
    • installation guide, URL / Introduction
    • components / Understanding the ODI Installation
    • LDAP security, setting up / Setting up LDAP security for Oracle Data Integrator, How to do it...
    • external authentication, setting with / How to do it...
    • used, for implementing SCD / Implementing Slowly Changing Dimensions (SCD) using ODI, Getting ready, How to do it..., How it works...
    • web services, invoking from / Invoking web services from ODI, How to do it..., There's more...
    • web services invoking from, with callbacks / Invoking asynchronous ODI web services with callbacks, How to do it...
  • OdiColumn class / How it works...
  • ODI Companion CD / Getting ready
  • ODI console / Understanding the ODI Installation
  • OdiContext class / How it works...
  • OdiDataStore class / How it works...
  • ODI Experts / There's more...
  • OdiFileWait tool / How to do it...
  • OdiFolder class / How it works...
  • ODI GUI
    • about / Introduction
  • ODI Installation
    • about / Understanding the ODI Installation
  • OdiInstance.createInstance() method / How it works...
  • OdiInstance class / How to do it..., How it works..., How it works..., How it works..., How it works...
  • odiInstance object / How it works...
  • OdiInstance object / How to do it..., How to do it..., How it works...
  • odiInstance variable / How to do it...
  • OdiInterface / How it works...
  • OdiInterface.getDataSets() method / How it works...
  • ODIInvokeWebService tool / How to do it...
  • ODI JEE Agent
    • about / There's more...
  • OdiKey class / How it works...
  • OdiLogicalSchema class / How it works...
  • OdiModel.setReverseContext() method / How it works...
  • OdiModel class / How it works...
  • ODI Oracle Universal Installer, installing options
    • Developer Installation / Understanding the ODI Installation
    • Standalone Installation / Understanding the ODI Installation
    • Java EE Installation / Understanding the ODI Installation
  • odiparams.sh or odiparams.bat file / How it works...
  • OdiProject class / How it works..., How it works...
  • OdiRefreshJournalCount / There's more...
  • ODI repositories / Understanding the ODI Installation
  • OdiRetrieveJournalData / There's more...
  • OdiScenarioGeneratorImpl / How it works...
  • OdiScenarioGeneratorImpl class constructor / How it works...
  • ODI SDK
    • import/export, automating with / Automating Smart Export/Smart Import with the ODI SDK, How to do it..., How it works...
  • ODI SDK documentation
    • URL / Introduction
  • ODI Security documentation
    • URL / How it works...
  • OdiSession / How it works...
  • ODI standalone agent / Understanding the ODI Installation
  • ODI Studio / Understanding the ODI Installation
  • odiSupervisorPassword variable / How to do it...
  • odiSupervisorUser variable / How to do it...
  • ODI Topology
    • about / Introduction
  • ODI versioning
    • using / Using ODI versioning, How to do it..., There's more...
  • OdiWaitForData / There's more...
  • OdiWaitForLogData / There's more...
  • ODI web services
    • container based authentication, configuring with / Configuring container-based authentication with ODI web services, How to do it..., How it works...
  • ODI XML JDBC driver / How it works...
  • ODI_INIT_HEAP / How to do it...
  • ODI_MASTER_DRIVER / How it works..., How it works...
  • ODI_MASTER_ENCODED_PASS / How it works..., How it works...
  • ODI_MASTER_URL / How it works..., How it works...
  • ODI_MASTER_USER / How it works..., How it works...
  • ODI_MAX_HEAP / How to do it...
  • ODI_OPMN_AGENT / How to do it...
  • ODI_SECU_WORK / How it works...
  • ODI_SUPERVISOR / How it works...
  • ODI_SUPERVISOR_ENCODED_PASS / How it works..., How it works...
  • open source encryption application
    • URL, for downloading / Getting ready
  • OPMN
    • standalone agent, configuring with / Configuring a standalone agent with OPMN, How to do it..., How it works..., There's more...
    • about / Configuring a standalone agent with OPMN
  • OPSS
    • URL / Setting up LDAP security for Oracle Data Integrator, Setting external authentication with Oracle Data Integrator
  • Oracle database SQL Language Reference
    • URL / How it works...
  • Oracle Fusion Middleware Developer's Guide for Oracle Data Integrator
    • URL / Introduction
  • Oracle Platform Security Services (OPSS) / Configuring container-based authentication with ODI web services, How it works...
  • Oracle Software Delivery Cloud / Getting ready
  • Oracle Technology Network
    • URL / How it works...
  • Oracle WebLogic Administration Console
    • URL / How to do it...
  • Oracle WebLogic Embedded LDAP Server
    • URL / Setting up LDAP security for Oracle Data Integrator
  • ORACLE_ODI_HOME / How it works...
  • Oracle® Fusion Middleware Developer's Guide for Oracle Data Integrator - Running Integration Processes
    • URL / Configuring container-based authentication with ODI web services
  • Oracle® Fusion Middleware User's Guide for Technology Adapters documentation
    • URL / There's more...
  • OS Command / How to do it...

P

  • packages
    • loops controlling, variables used / Using variables to control loops inside packages, How to do it..., How it works...
    • defining / Defining packages and loops for near real-time execution using a hybrid loop, Getting ready, How to do it..., How it works...
  • parallel
    • files, processing in / Processing a large number of files in parallel, How to do it...
  • parameter variable
    • file, using from / Using a file from a parameter variable, How to do it..., There's more...
  • partition exchange
    • used, for loading data / Loading data using partition exchange, How to do it..., How it works...
  • partition exchange loading (PEL) / Loading data using partition exchange
  • password requirement
    • of external program, invoking / Invoking an external program that requires a password, How to do it..., How it works...
  • persist() method / How it works...
  • Pkg_Variable_Loop package / How to do it...
  • Pkg_Variable_Option package / How to do it...
  • Pkg_Variable_Parameter / How to do it...
  • Pkg_Variable_Set package / How to do it...
  • Pkg_Variable_URL package / How to do it...
  • PORTNO / How it works...
  • prepareAction() method / How it works...
  • preparePersist() method / How it works...
  • print() method / How to do it...
  • println() method / How to do it...
  • project
    • creating, SDK used / Creating a project using the SDK, How to do it..., How it works...
  • PV_DATE_FILTER variable / How to do it..., How to do it...
  • PV_DB_URL variable / How to do it...

R

  • RDBMS
    • XML data, processing with / Processing XML data within an RDBMS not in memory, How to do it..., How it works...
  • re parameter / How it works...
  • replace() function / There's more...
  • Repository Creation Utility (RCU) / Getting ready, Getting ready
  • restore function / There's more...
  • ro parameter / How it works...
  • RuntimeAgent / How it works...
  • RuntimeAgent class constructor / How it works...

S

  • SCD
    • about / Introduction
    • implementing, ODI used / Implementing Slowly Changing Dimensions (SCD) using ODI, Getting ready, How to do it..., How it works...
  • SCD KM
    • modifying, to allow undefined column behavior / Modifying a Slowly Changing Dimension KM to allow undefined behaviors, How to do it..., How it works...
  • SCD method / Implementing Slowly Changing Dimensions (SCD) using ODI
  • SCD_END / Getting ready
  • SCD_FLAG / Getting ready
  • SCD_INS / Getting ready
  • SCD_NK / Getting ready
  • SCD_SK / Getting ready
  • SCD_START / Getting ready
  • SCD_UPD / Getting ready
  • scenario
    • start-up parameters passing, variables used / Passing start-up parameters to a scenario using variables, How to do it...
  • SDK / Introduction
    • used, for creating work repository / Creating the Master and Work repositories using the SDK, How to do it..., How it works...
    • used, for creating master repository / Creating the Master and Work repositories using the SDK, How to do it..., How it works...
    • used, for creating project / Creating a project using the SDK, How to do it..., How it works...
    • used, for automating artifacts import / Automating the import of artifacts using the SDK, How to do it..., How it works...
    • used, for creating models / Creating models and datastores using the SDK, How to do it...
    • used, for creating datastores / Creating models and datastores using the SDK, How to do it...
    • used, for creating interface / Creating an interface using the SDK, How to do it..., How it works..., There's more...
    • used, for invoking scenario / Invoking and monitoring a scenario using the SDK, How to do it..., How it works..., There's more...
    • used, for monitoring scenario / Invoking and monitoring a scenario using the SDK, How to do it..., How it works..., There's more...
  • security navigator
    • custom profiles, creating / Creating new custom profiles in the Security navigator, How to do it..., How it works...
  • Single Interface
    • using, to load changes / Using one single interface to load changes that occur in any dimensions, How to do it..., How it works...
  • Slowly Changing Attributes (trigger fields) / Getting ready
  • SmartExport
    • performing / Performing a Smart Export/Smart Import, How to do it..., How it works...
  • SmartImport
    • performing / Performing a Smart Export/Smart Import, How to do it..., How it works...
  • SOA
    • about / Introduction
  • s parameter / How it works...
  • SQL query
    • data, loading from / Loading data from an SQL query, How to do it..., How it works...
  • SRC_EMP table / Getting ready
  • staging area user
    • used, for accessing target scheme / Best practice – using the Staging Area User to access your target schema, How to do it..., How it works...
  • standalone agent, manual installation
    • about / Deploying and configuring a standalone agent manually, How to do it...
    • configuring, with OPMN / Configuring a standalone agent with OPMN, How to do it..., How it works..., There's more...
  • Standalone Installation option / Understanding the ODI Installation, There's more...
  • standalone ODI agent
    • tuning / Tuning a standalone ODI agent, Getting ready, How it works...
  • start-up parameters
    • passing to scenario, variables used / Passing start-up parameters to a scenario using variables, How to do it...
  • Starting Timestamp / Getting ready
  • startScenario() method / How to do it..., How it works...
  • Step name option / How to do it...
  • Step name parameter / How to do it...
  • substitution methods
    • using, in Java / Using substitution methods in Java, How to do it...
    • combining, in KM / Combining substitution methods in a KM, How to do it..., There's more...
  • substitution passes
    • using / Using the substitution passes, How to do it..., How it works...
  • Surrogate Key / Getting ready

T

  • table names
    • running in contexts, getObjectName used / Using table names that run in all contexts using getObjectName, How to do it..., How it works...
  • Target Directory parameter / How to do it...
  • target scheme
    • accessing, staging area user used / Best practice – using the Staging Area User to access your target schema, How to do it..., How it works...
  • technology
    • creating / Creating a new technology, How to do it..., How it works..., There's more...
  • temporary interface (subquery)
    • creating / Creating a temporary interface (subquery), How to do it..., How it works..., There's more...
  • Test Connection button / How to do it...
  • Timeout parameter / How to do it...
  • timestamp based data
    • filtering, variables used / Using variables to filter data based on a timestamp, How to do it..., How it works...
  • topology
    • variables, using / Using variables in topology, How to do it...
  • TRG_EMP table / Getting ready
  • Type-II SCD interface / Getting ready

U

  • undefined column behavior
    • allowing, by modifying SCD KM / Modifying a Slowly Changing Dimension KM to allow undefined behaviors, How to do it..., How it works...
  • Updatable attributes / Getting ready
  • Update existing rows / How it works...
  • users
    • creating, generic profiles used / Creating users using generic profiles, How to do it..., There's more...
    • creating, non-generic profiles used / Creating users using non-generic profiles, How to do it..., How it works...
  • Use Temporary Table as Derived Table (Sub-Query) box / How it works...

V

  • variable name
    • used, for detecting files / Detecting files with a variable name, How to do it..., How it works...
  • variables
    • used, for passing start-up parameters to scenario / Passing start-up parameters to a scenario using variables, How to do it...
    • using, to filter timestamp based data / Using variables to filter data based on a timestamp, How to do it..., How it works...
    • using, in KM options / Using variables in KM options (and reusing the variables in an interface, package, and so on), How to do it..., How it works...
    • using, in topology / Using variables in topology, How to do it...
    • using, to control loops inside packages / Using variables to control loops inside packages, How to do it..., How it works...

W

  • web services
    • invoking, from ODI / Invoking web services from ODI, How to do it..., There's more...
    • invoking from ODI, with callbacks / Invoking asynchronous ODI web services with callbacks, How to do it...
  • work repository
    • creating, SDK used / Creating the Master and Work repositories using the SDK, How to do it..., How it works...
  • WorkRepositorySetupImpl constructor / How it works...

X

  • XML Connection
    • defining / Defining a connection to XML within ODI, How to do it...
  • XML data
    • processing, with RDBMS / Processing XML data within an RDBMS not in memory, How to do it..., How it works...
  • XML JDBC URL parameter
    • ODI documentation, URL / How it works...
  • XML_GEO_DIM data server / How to do it...
  • XSD file / Defining a connection to XML within ODI
lock icon The rest of the chapter is locked
arrow left Previous Section
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at $19.99/month. Cancel anytime
Banner background image