Oracle real time replica solution (Oracle GoldenGate) in Telco and FSI verticals

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.1
Oracle Real Time Replica
Solution :
Oracle GoldenGate
Milomir Vojvodic
EMEA Senior Business Development Manager
Oracle Data Integration Product Group
September 2012

The following is intended to outline our general product direction. It is
intended for information purposes only, and may not be incorporated
into any contract.
It is not a commitment to deliver any material, code, or functionality,
and should not be relied upon in making purchasing decisions. The
development, release, and timing of any features or functionality
described for Oracle’s products remains at the sole discretion of
Oracle.
Safe Harbor Statement

New DB/HW/OS/APP
Fully Active DB
Reporting Database and/or DR database
Data Warehouse
OGG
OGG
OGG ADG
OGG
Zero Downtime
Migrations & Upgrades
Active/Active High
Availability
Query Off-Loading
and Disaster Recovery
BI&DW
Synchronization and Loading
Migrations & Consolidations
ODI
ODI
Oracle Data Integration Solutions Together
EDQ
EDQ

Oracle Real Time
Replica Solution
(Oracle
GoldenGate)

Target DB
OGG
Source DB
What is OGG?

New DB/HW/OS/APP
Fully Active DB
Data Warehouse
OGG
OGG
OGG ADG
OGG
Zero Downtime
Active/Active High
Availability
Query Off-Loading
BI&DW
Use Cases Of OGG

Target DB
OGG
Source DB
First OGG Differentiator
Accessing directly transaction
logs
Second OGG Differentiator Moving
only committed transactions
Why Is OGG Different?

TIME REQUIRED FOR THE END OF DAY
PROCEDURE
Hours
NO OF CPUs REQUIRED FOR SAME
PERFORMANCE*
No Of Required CPUs
ESTIMATED COSTS FOR SERVER AND
LICENSE**
Estimated Cost of Purchase in USD
0
50
100
150
Year1 Year2 Year3 Year4 Year5
Currently during the End Of Day
utilizes the Server CPU by 40-50%
and the IO by 90%. Probably the IO
is the bottleneck.
0
20
40
60
80
100
120
Year1 Year2 Year3 Year4 Year5
Disaster Recovery Test
and Development
Primary Site
$-
$1
$1
$2
$2
$3
Millions
Oracle
License
Costs
Hardware
Costs
Daily load time can
reach 5 days with
the current HW
OR
Replacing Batch Window
First OGG Differentiator
Accessing directly
transaction logs

Physical Replication OGG
Like-to-like databases and platforms Heterogeneous databases and platforms
One-to-one topology with all-or-nothing
data replication
Many-to-many topology with selective and
optimized data movement
No transaction integrity Guaranteed transaction integrity
Data corruption propagated to target Data corruption is isolated at source
No rollback or point-in-time recovery Selective and dynamic rollback with advanced
point-in-time recovery
Target system unavailable for data
processing
Both source and target systems are available
No data transformation capability Data transformation and enrichment
Geographic distance limitation between
data source and target
No distance limitations
OR
Second OGG
Differentiator
Moving only
committed
transactions
Replacing Storage Replica
Begin,
TX 1
Insert,
TX 1
Begin,
TX 2
Update,
TX 1
Insert,
TX 2
Commit,
TX 2
Begin,
TX 3
Insert,
TX 3
Begin,
TX 4
Commit,
TX 3
Delete,
TX 4
Begin,
TX 2
Insert,
TX 2
Commit,
TX 2
Begin,
TX 3
Insert,
TX 3
Commit,
TX 3
Begin,
TX 2
Insert,
TX 2
Commit,
TX 2
Capture
Checkpoint
Pump
Checkpoint
Delivery
Checkpoint

Unidirectional
Query Offloading
Zero-Downtime Migration
Bi-Directional
Hot Standby or
Active-Active for HA
Peer-to-Peer
Load Balancing
Multi-Master
Broadcast
Data Distribution
Integration/Consolidation
Data Warehouse
BPM
BAM
CEP
Data Distribution
via Messaging
Directions

 Log-based change data capture
– High volume
– Low overhead
 Decoupled architecture
– Multiple capture processes may be used to scale, but generally not required
– Possible to split “hot” tables into a separate capture process
 Filtering and compression
– Unnecessary change data is discarded immediately
– Updates and deletes are “compressed” by default
– Before images are discarded by default
OGG Capture

New DB/HW/OS/APP
Fully Active DB
Data Warehouse
OGG
OGG
OGG ADG
OGG
Zero Downtime
Active/Active High
Availability
Query Off-Loading
BI&DW
Use Cases Of OGG

Reduce the workload on production
 Annual amortization of HW purchase 250 000 USD (1 000 000 USD per 4 years)
 Annual HW maintanence 100 000 USD
 Annual SW maintance 200 000 USD
 Energy, floor space 200 000 USD
 Overall 800 000 USD, as there are 36 CPUs, Annual cost 22 000 USD per CPU
 Overhead 8% with other solution, overhead 3% with GoldenGate
 Cost of overhead 64 000 USD vs 24 000 USD
 Savings 40 000 USD per year
Alternative option for target server
 DB software first option 100 000 USD, DB software second option 50 000 USD,
 Annual DB software support 22 000 USD vs 11 000 USD
OGG Offload Reporting Benefits

New DB/HW/OS/APP
Fully Active DB
Data Warehouse
OGG
OGG
OGG ADG
OGG
Zero Downtime
Active/Active High
Availability
Query Off-Loading
BI&DW
Use Cases Of OGG

APPS
APPS APPS
ONLY
REPORTINGAPPS
OGG Benefits For Dual Active DBs

New DB/HW/OS/APP
Fully Active DB
Data Warehouse
OGG
OGG
OGG ADG
OGG
Zero Downtime
Active/Active High
Availability
Query Off-Loading
BI&DW
Use Cases Of OGG

Analysis
and script
generation
using
PL/SQL
New SAP
implementation
Existing SAP
implementation
Capture
Source Trail
Delivery
Target Trail
Migration scripts are created to
create new DB, table-space and
implement GoldenGate and allow
verification
Installation and commencement of
real-time GoldenGate transactional
data capture does not require
system downtime and has limited
impact on production system
performance (“remote capture” can
be used if needed)
• Minimum Oracle database version for the production system is 9.2.0.8
• Oracle version on the target can be 10.2 or 11.2 and any UNIX, Linux or Windows platform is supported
• All SAP products and solutions where Oracle database is certified are supported (such as R/3, BW, CRM or XI)
• Supplemental Logging must be enabled on the source database prior to Oracle GoldenGate implementation
• The source Oracle database cannot contain any OLTP compressed tables
Oracle 9i or above
Existing Platform
Oracle 11g
New Platform
Migration scripts are executed
against the target/new
implementation and large tables
are transferred directly to new DB
GoldenGate delivery commences
into new database with
optimization to support migration
needs
Final switch over takes place –
SAP tasks are undertaken and
production users move to migrated
system
GoldenGate process can continue
running for as long as needed to
ensure that target system is
optimized for use – no time limits
SAP Note 1508271

Available – no issues
• Planned outage
• Upgrade
• Migration
• Maintenance
• Unplanned outage
• System failure
• Data failure
• Semi-available
• Performance
issues
Reusability Of OGG Licenses

• Planned Outage
• Upgrade
• Migration
• Maintenance
• Unplanned Outage
• System Failure
• Data Failure
• Need Additional Computing Resources
• Performance issues
• Growth

GoldenGate as a
platform for all use
cases
-70%
-80%
-70%• Reduce downtime (end user productivity and customer
satisfaction ) by 70%
• Reduce migration and recovery effort by 80%
• Reduce source system overhead (and costs for
stronger HW) by at least 70%
• Decrease TCO because of report server by 80%
• Communication Cost Savings by 10%
• Global optimization of resources as having real time
insight in regional capacities
• Avoiding data loss
• Consolidating and modernizing into more efficient
systems
Performance
Flexible &
Extendable
Reliable
OGG Value Proposition

 Avoids expensive network infrastructure upgrades:
– Moves only the committed changed data on a continuous basis
– Avoids moving the same data more than once
– Allows low overhead on the network
– No need for fibre channel upgrade or investment
– Reduce source system overhead (and costs for stronger HW)
– Reduce TCO for Reporting Server
 Requires minimal labour resources for deployment and management:
– Provides fast and easy deployment
– Requires minimal intervention once deployed
– Offers fast and complete recovery from any outages or interruptions
– Reducing downtime, increasing work force satisfaction and productivity
– Avoiding Data Loss, additional costs from inaccurate data man/days to recover from data loss
– Reduced recovery efforts in events of network or communication failure
Real Time Replica And OGG Value Proposition

Oracle GoldenGate Director:
Has basic configuration,
management, monitoring,
and alerting.
Based on legacy pull infrastructure.
Works on legacy
GoldenGate instances.
OGG Director

Oracle GoldenGate Monitor:
Has advanced monitoring,
alerting (SNMP support),
lag graphs,
and historical repository.
Based on new agent
infrastructure,
which will be the foundation for all future integration projects.
OGG Monitor

• A high-speed, low impact data
comparison solution
• Identifies and reports data discrepancies
between heterogeneous databases
without interrupting their availability
• Benefits:
• Reduce financial/legal risk exposure
• Speed and simplify IT work in comparing
data sources
• No disruption to business systems
• Improved failover to backup systems
• Confident decision-making and reporting
OGG Monitor

ODI OGG
OWB
=Gateways for non Oracle sources
=Declarative Design
=Integrating with other Oracle Products
INFA PowerCenter
=No such reusability already built best practice procedures
=Push Down
=Client Installation
Manual Coding
=Metadata Repository
=Designing DW schema
=Profile in advance source apps
Talend
=Metadata Level Limitations
=Datatype Conversion
=Separation between Physical and Logical resources
IBM DataStage
=Legacy Code
=Push Down
=Universe DB
INFA PowerExchange
=Disturb source CDC operation when scale
=Auto-restart feature, trapping apply side errors&exceptions
=DDL support
Streams
=Streams capture changes immediately in Redo.
=Advanced Queuing
=Multiple Stored Procedures
IBM InfoSphere CDC
=Check-pointing mechanism stored as database tables
Storage Level Replica
=Commit Transactions
=Transformation
=Corrupted Data
Competition
3 Key Functional Differences
Shareplex
=Data Transformations
=Pre-image check
=DDL and data types

References
Extract For Financial Services

References
Extract for Telco

Real Time Replica
(Oracle
GoldenGate) For
Financial Services

 Migration of Card Authorization System
 Migration of Core Banking Systems + Migration of Payment Processing System
 DR+AA for Payment Processing System
 DR+AA for Payment Processing System + unidirectional to DW
 Feeds from Payment Processing System to Fraud Detection System
 Feeds from Payment Processing System to Device Monitoring System
 Feeds from Core Banking Systems to other Back Office Applications (Risk Management, Clearing and
Settlement, Reporting to Member Banks)
 Offload Reporting from Core Banking Systems in order to improve performance
 Bi-directional synchronization between Payment Processing and Card Management System
Real Time Replica In Financial Services

Credit
Cards
Loans,
Mortgages
Funds,
Assets
Business Unit
A Marketing
System
Business Unit
B Accounting
System
Group Risk
Management
Group Risk
Management
CRM
Regulatory
reporting
Statutory
reporting
Management
Information
Systems
Customers
Accounts
…
ODI
EDQ
Core Banking
(Payment
Processing,
Accounts)
ODI
R
Fraud
Detection
OGG OGG OGG
OGG
OGG
OGG
OGG
OGG
OGG
Real Time Replica In Financial Services

Core Banking
Loans,
Mortgages
Credit
Cards
Funds,
Assets
Business Unit
A Marketing
System
Business Unit
B Accounting
System
Group Risk
Management
Group Risk
Management
CRM
Regulatory
reporting
Statutory
reporting
Management
Information
Systems
Banking Architecture

Customer
Place
Order
Telephone
Network
Bill
Customer
Customer
Care
Billing
Collect
Usage
Self Care CRM
Call
Center
Customers
ODI
EDQ
Billing
R
R
SR ODS
ODI
OGG
OGG OGG OGG
R
Real Time Replica In Telco

Telephone
Network
Service
Fulfillment
Service
Assurance
Configure
Network
Monitor
Network
Order
Fulfillment
R
Network
ODI
Intentory and Workorder
Management System
Network Alarms
Monitoring System
Network Performance
Monitoring System
Network Managament
System
ODI
OGG
Real Time Replica In Telco

The preceding is intended to outline our general product direction. It
is intended for information purposes only, and may not be
incorporated into any contract.
It is not a commitment to deliver any material, code, or functionality,
and should not be relied upon in making purchasing decisions. The
development, release, and timing of any features or functionality
described for Oracle’s products remains at the sole discretion of
Oracle.
Safe Harbor Statement

Oracle real time replica solution (Oracle GoldenGate) in Telco and FSI verticals

Related slideshows

More Related Content

Oracle real time replica solution (Oracle GoldenGate) in Telco and FSI verticals