Oracle Business Analytics Warehouse Architecture
The DAC provides a framework for the entire life cycle of data warehouse implementations. It enables you to create, configure, execute, and monitor modular data warehouse applications in a parallel, high-performing environment.
The DAC complements the Informatica ETL platform. It provides application-specific capabilities that are not prebuilt into ETL platforms. For example, ETL platforms are not aware of the semantics of the subject areas being populated in the data warehouse nor the method in which they are populated.
The DAC provides the following application capabilities at a layer of abstraction above the ETL execution platform:
- Dynamic generation of subject areas and execution plans
- Dynamic settings for parallelism and load balancing
- Intelligent task queue engine based on user- defined and computed scores
- Automatic full and incremental mode aware
- Index management for ETL and query performance
- Embedded high performance Siebel OLTP change capture techniques
- Ability to restart at any point of failure
- Phase-based analysis tools for isolating ETL bottlenecks
Data Warehouse Administration Console Components
The Data Warehouse Administration Console comprises the following components:
DAC Client:
- A command and control interface for the data warehouse to allow for schema management, and configuration, administration, and monitoring of data warehouse processes. It also allows you to design subject areas and build execution plans.
- Executes the instructions from the DAC client. The DAC server manages data warehouse processes, including loading of the ETL and scheduling execution plans. It dynamically adjusts its actions based on information in the DAC repository. Depending on your business needs, you might incrementally refresh the Oracle Business Analytics Warehouse once a day, once a week, once a month, or on another similar schedule.
- Stores the metadata (semantics of the Oracle Business Analytics Warehouse) that represents the data warehouse processes.
- The DAC repository stores application objects in a hierarchical framework that defines a data warehouse application. The DAC allows you to view the repository application objects based on the source system container you specify. The source system container holds the metadata that corresponds to the source system with which you are working.
- Subject area: A logical grouping of tables related to a particular subject or application context. It also includes the tasks that are associated with the tables, as well as the tasks required to load the tables. Subject areas are assigned to execution plans, which can be scheduled for full or incremental loads.
- Tables: Physical database tables defined in the database schema. Can be transactional database tables or data warehouse tables. Table types can be fact, dimension, hierarchy, aggregate, and so on, as well as flat files that can be sources or targets.
- Task: A unit of work for loading one or more tables. A task comprises the following: source and target tables, phase, execution type, truncate properties, and commands for full or incremental loads. When you assemble a subject area, the DAC automatically assigns tasks to it. Tasks that are automatically assigned to the subject area by the DAC are indicated by the Auto generated flag in the Tasks sub-tab of the Subject Areas tab.
- Task Groups: A group of tasks that you define because you want to impose a specific order of execution. A task group is considered to be a "special task."
- Execution plan: A data transformation plan defined on subject areas that needs to be transformed at certain frequencies of time. An execution plan is defined based on business requirements for when the data warehouse needs to be loaded. An execution plan comprises the following: ordered tasks, indexes, tags, parameters, source system folders, and phases.
- Schedule: A schedule specifies when and how often an execution plan runs. An execution plan can be scheduled for different frequencies or recurrences by defining multiple schedules.
The phases of the process and the actions associated with them are as follows:
Setup
- Set up database connections
- Set up ETL processes (Informatica)
- Set up email recipients
- Define application objects
- Design execution plans
- Define scheduling parameters to run execution plans
- Access runtime controls to restart or stop currently running schedules
- Monitor runtime execution of data warehouse applications
- Monitor users, DAC repository, and application maintenance jobs
DAC Interface
Main DAC Window
The DAC Server Monitor Icons
DAC Repository Command Line Options
This section describes the DAC repository command line parameters that are exposed by the AutomationUtils.bat file, which is located in the DAC installtion folder.
Import DAC Metadata by Application
- The IMPORT option imports DAC metadata into the DAC repository for specified source system containers. The import process truncates all imported tables. You cannot perform an incremental import with this command.
- Syntax : IMPORT [folderName] [contName1] [contName2] ...
- Where:
- folderName Full path to the root of the import file structure.
- contName (Optional) Name of the source system container for which you want to import DAC metadata. If no container is named, all containers that are found in the file structure will be imported.
- The EXPORT option exports DAC metadata into the DAC repository for specified source system containers.
- Syntax : EXPORT [folderName] [contName1] [contName2] ...
- Where:
- folderName Full path to the root of the export file structure.
- contName (Optional) Name of the source system container for which you want to export DAC metadata. If no container is named, all containers that are found in the file structure will be exported.
- The IMPORTCATEGORY option imports DAC metadata into the DAC repository based on the Logical, Run Time, or System categories. The import process truncates all imported tables. You cannot perform an incremental import with this command.
- Syntax : IMPORTCATEGORY [folderName] [logicalFlag] [runtimeFlag] [systemFlag]
- Where:
- folderName Full path to the root of the export file structure.
- logicalFlag If the value of this parameter is true, all data categorized as logical is imported (information contained in the DAC Design view). Otherwise, this parameter is ignored.
- runtimeFlag If the value of this parameter is true, all data categorized as run time is imported (information contained in the DAC Execute view). Otherwise, this parameter is ignored.
- systemFlag If the value of this parameter is true, all data categorized as run time is imported (information contained in the DAC Setup view). Otherwise, this parameter is ignored.
- The EXPORTCATEGORY option imports DAC metadata into the DAC repository based on the Logical, Run Time, or System categories. The import process truncates all exported tables. You cannot perform an incremental import with this command.
- Syntax : EXPORTCATEGORY [folderName] [logicalFlag] [runtimeFlag] [systemFlag]
- Where:
- folderName Full path to the root of the export file structure.
- logicalFlag If the value of this parameter is true, all data categorized as logical is exported (information contained in the DAC Design view). Otherwise, this parameter is ignored.
- runtimeFlag If the value of this parameter is true, all data categorized as run time is exported (information contained in the DAC Execute view). Otherwise, this parameter is ignored.
- systemFlag If the value of this parameter is true, all data categorized as run time is exported (information contained in the DAC Setup view). Otherwise, this parameter is ignored.
DAC Code Deployment using Command Line
This section describes the current existing process used for exporting, Importing and moving the logical container level code migration from one environment to another environment such as development, test, uat and production.
- Import_cmd.bat
- Export_cmd.bat
- Move_file.bat
- set CURR_DATE=%DATE%
- set MONTH=%CURR_DATE:~4,2%
- set DAY=%CURR_DATE:~7,2%
- set YEAR=%CURR_DATE:~12,2%
- set VERSION=%DAY%%YEAR%%MONTH%
- rename DAC_EXPORT DAC_EXPORT_%VERSION%
- automationUtils.bat importcategory :Dir\DAC_POC\DAC_EXPORT_%VERSION% "source_folder_name" logical
- automationUtils.bat exportcategory :Dir\DAC_POC\DAC_EXPORT Source_Folder_Name logical CC113B27D9316E5E968C2EBC263A678C
- xcopy D:\DAC_POC\DAC_EXPORT \\inf-fbi-uat2-a1\D$\DAC_POC\DAC_EXPORT /c /d /e /h /i /k /q /r /s /x /y