MODULE 11 LOCAL REPLICATION

EMC Proven Professional

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

Module 11: Local Replication

Upon completion of this module, you should be able to: Describe various uses of local replica Describe how consistency is ensured in file system and database replication Describe host-based, array-based, and network-based local replication technologies Explain restore and restart considerations Describe local replication in a virtualized environment
EMC Proven Professional

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

Module 11: Local Replication

Lesson 1: Local Replication Overview

During this lesson the following topics are covered: Uses of local replica File system and database consistency

EMC Proven Professional

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

What is Replication?
Replication

It is a process of creating an exact copy (replica) of data.

Replication can be classified as

Local replication Replicating data within the same array or data center

Remote replication Replicating data at remote site

REPLICATION
EMC Proven Professional Source Replica (Target)

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

Uses of Local Replica

Alternate source for backup Fast recovery Decision support activities Testing platform Data Migration

EMC Proven Professional

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

Replica Characteristics

Recoverability/Restartability
Replica should be able to restore data on the source device Restart business operation from replica

Consistency
Replica must be consistent with the source

Choice of replica type ties back theto RPO

Point-in-Time (PIT) Non-zero RPO
Continuous Near-zero RPO
EMC Proven Professional

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

Understanding Consistency

Consistency ensures the usability of replica Consistency can be achieved in various ways for file system and
database
Offline Online

File System

Unmount file system

Flushing host buffers a) Using dependent write I/O principle Holding I/Os to source before creating replica

Database

Shutdown database

EMC Proven Professional

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

File System Consistency: Flushing Host Buffer

Application File System Data

Flush Buffer

Memory Buffers Logical Volume Manager Physical Disk Driver

EMC Proven Professional

Source

Replica

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

Database Consistency: Dependent Write I/O Principle

Source Replica Source Replica 1 1 1

EMC Proven Professional

C C

Consistent

Inconsistent

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

10

Module 11: Local Replication

Lesson 2: Local Replication Technologies

During this lesson the following topics are covered: Local replication technologies Restore and restart considerations

EMC Proven Professional

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

11

Host-based Replication: LVM-based Mirroring

Logical Volume

Physical Volume 1

Volume group
Physical Volume 2

Host

EMC Proven Professional

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

12

Host-based Replication: File System Snapshot

Pointer-based replication Uses Copy on First Write

FS Snapshot Metadata Production FS Metadata 1 Data a 2 Data b Bit 1-0 2-0 3-1 4-1 BLK 1-0 2-0 3-2 4-1

(CoFW) principle Uses bitmap and block map Requires a fraction of the space used by the production FS

3 Data C
4 Data D 1 Data d 2 Data c 3 no data
EMC Proven Professional

N Data N

4 no data

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

13

Storage Array-based Local Replication

Replication performed by the array operating environment Source and replica are on the same array Types of array-based replication
Full-volume mirroring Pointer-based full-volume replication Pointer-based virtual replication

Source EMC Proven Professional Production Host

Replica Storage Array BC Host

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

14

Full-Volume Mirroring
Attached
Read/Write Not Ready

Source Production Host

Target BC Host

Storage Array

Detached - PIT
Read/Write Read/Write

Source Mirroring ceases Production Host EMC Proven Professional Storage Array

Target BC Host

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

15

Pointer-based Full-Volume Replication

Provides full copy of source data on the target Target device is immediately accessible by the BC host after the

replication session is activated PIT is determined by time of session activation Target device is at least as large as the source device Two modes
Full copy mode After session starts, all the data from source is copied to the target in the background
Copy on First Access (deferred)

EMC Proven Professional

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

16

Copy on First Access: Write to the Source

Write to Source C
A B C C

C Target BC Host

Source Production Host

When a write is issued to the source for the first time after replication
session activation:
Original data at that address is copied to the target Then the new data is updated on the source This ensures that original data at the point-in-time of activation is
EMC Proven Professional

preserved on the target

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

17

Copy on First Access: Write to the Target

Write to Target
A B C

B
B C

B Target Data Warehouse Host

Source Production Host

When a write is issued to the target for the first time after replication
session activation:
The original data is copied from the source to the target Then the new data is updated on the target
EMC Proven Professional

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

18

Copy on First Access: Read from Target

Read request for data A
A B C

A B C

Source Production Host

Target BC Host

When a read is issued to the target for the first time after replication
session activation:
The original data is copied from the source to the target and is made

available to the BC host

EMC Proven Professional

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

19

Pointer-based Virtual Replication

Targets do not hold data, but hold pointers to where the data is
located
At the start of the session the target device holds pointers to data

on source device Target requires a small fraction of the size of the source volumes

Target devices are accessible immediately when the session is

started Uses CoFW principle This method is recommended, if the changes to the source are typically less than 30%

EMC Proven Professional

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

20

Pointer-based Virtual Replication (CoFW): Write to Source

Save Location

Source Target Virtual Device A C Write to Source B C C C

When a write is issued to the source for the first time after replication
session activation:
Original data at that address is copied to save location The pointer in the target is updated to point to this data in the save

location EMC Proven Professional

Finally, the new write is updated on the source

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

21

Pointer-based Virtual Replication (CoFW): Write to Target

A Write to Target Save Location

Source Target Virtual Device A B C A A A

When a write is issued to the target for the first time after replication
session activation:
Original data from the source device is copied to the save location The pointer is updated to the data in save location

Another copy EMC Proven Professional

of the original data is created in the save location before the new write is updated on the save location

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

22

Tracking Changes to Source and Target

Source At PIT Target

0 0

0 0

0 0

0 0

0 0

0 0

0 0

0 0

After PIT

Source Target

1 0

0 0

0 1

1 1

0 0

1 0

0 0

0 1

For resynchronization/restore Logical OR

Resynchronization changes to replica are overwritten

1
0

0
1

EMC Proven Professional

unchanged

changed

Restore changes to source are overwritten

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

23

Restore and Restart Considerations

Source has a failure

Logical corruption or physical failure of source devices

Solution
Restore data from target to source (Logical corruption) Restore would typically be done incrementally Applications can be restarted even before synchronization is complete

-----OR----- Start production on target (Physical failure)

Create a Gold copy of target device before restarting on target Resolve issues with source while continuing operations on target
EMC Proven Professional

After resolving the issue, restore latest data on target to source

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

24

Comparison of Local Replication Technologies

Factor Performance impact on source due to replica Size of target Availability of source for restoration
EMC Proven Professional

Full-Volume Mirroring

Pointer-based FullVolume Replication Full copy mode no impact CoFA mode some impact

Pointerbased Virtual Replication High impact

No impact

At least the same as the source

Not required Only after synchronization and detachment from the source

At least the same as the source

Full copy mode not required CoFA mode required Immediately accessible

Small fraction of the source

Required

Accessibility to target

Immediately accessible

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

25

Network-based Local Replication: Continuous Data Protection Replication occurs at the network layer between the hosts and
storage arrays
Ideal for highly heterogeneous environment

Typically provides the ability to restore data to any previous

point-in-time replicly
RPOs are random and do not need to be defined in advance

Data changes are continuously captured and stored in a separate

location from the production data CDP is implemented by using

Journal volume

CDP appliance
EMC Proven Professional Write splitter

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

26

CDP Local Replication Operation

Host Write Splitter

SAN
CDP Appliance

Storage Array EMC Proven Professional Production Volume Replica CDP Journal

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

27

Module 11: Local Replication

Lesson 3: Local Replication in Virtualized Environment

During this lesson the following topics are covered: Mirroring of a virtual volume Replication of virtual machines

EMC Proven Professional

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

28

Local Replication in Virtualized Environment

Local replication (mirroring) of a virtual volume assigned to a

host
Mirroring is performed by a virtualization appliance

Replication of virtual machines

VM snapshot VM clone

EMC Proven Professional

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

29

Local Replication of Virtual Volume

Data Center
Host

I/Os

Virtualization Appliance

Mirrored Virtual Volume

Storage Pool

SAN

LUN

LUN

EMC Proven Professional

Storage Array Mirror Legs Storage Array

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

30

VM Snapshot

Captures the state and data of a running VM at a specific PIT Uses a separate delta file to record all the changes to the virtual

disk since the snapshot session is activated Restores all settings configured in a guest OS to the PIT

EMC Proven Professional

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

31

VM Clone

An identical copy of an existing VM

Clones are created for different use such as testing Changes made to a clone VM do not affect the parent VM and vice

versa

Clone VM is assigned a separate network identity

Clone has its own separate MAC address

Useful when multiple identical VMs need to deploy

EMC Proven Professional

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

32

Module 11: Local Replication

Concept in Practice

EMC SnapView EMC TimeFinder EMC RecoverPoint

EMC Proven Professional

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

33

EMC SnapView

SnapView Snapshot
Logical view of the production volume Uses CoFW principle

Full image copy

SnapView Clone
Full volume copies that require same disk

Clone
Clone

space as the source Becomes a PIT copy once the clone is fractured from the source

Source LUN
Snap

Snap

EMC Proven Professional

Logical pointin-time view

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

34

EMC TimeFinder

TimeFinder/Snap
Creates space-saving, logical PIT (snapshots) Allows creating multiple snapshots from a single source

TimeFinder/Clone
Creates PIT copy of the source volume Uses pointer-based full-volume replication technology Allows creating multiple clones from a single source device

EMC Proven Professional

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

35

EMC RecoverPoint

Provides continuous data protection and recovery to any PIT Uses splitting technology at server, fabric, or array to mirror a

write to a RecoverPoint appliance Provides automatic RecoverPoint appliance failover Family of product includes
RecoverPoint/CL

RecoverPoint/EX
RecoverPoint/SE

EMC Proven Professional

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

36

Module 11: Summary

Key points covered in this module: Uses of local replicas Consistency in file system and database replication Host-based, storage array-based, and network-based replication Restore and restart considerations Local replication of a virtual volume VM snapshot and VM clone

EMC Proven Professional

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

37

Check Your Knowledge 1

What is an advantage of pointer-based virtual replication?

A. Source device need not be healthy for restore

Save location is not required to activate session C. Less storage space is required for creating replica D. No performance impact on source due to replication
B.

Which is true about pointer-based full-volume replication?

A. Size of the target is a small fraction of the source

Size of the target is at least the same as the source C. Target can be accessed only after synchronization and detachment from source EMC D. Proven Professional Target contains only pointers to save location at all time
B.

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

38

Check Your Knowledge 2

In continuous data protection technology, which factor

determines how far back the recovery points can go?
A. B. C. D.

Amount of space that is configured for the replica Type of write splitter used in replication Amount of space that is configured for the journal Rate of changes happening to the replica

When is the data copied from source to target in CoFA mode of

replication?
source C. A read or write occurs for the first time to a location on the target All writes issued to a location on the target EMC D. Proven Professional
A. A read occurs for the first time from a location on the source B. A read or write occurs for the first time to a location on the

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

39

Check Your Knowledge 3

What occurs to the guest OS configuration when a VM is

reverted from its snapshot?
A. Guest OS configurations are reverted to the PIT of snapshot

creation B. Current guest OS configurations are preserved C. Guest OS configurations are duplicated to a new VM D. Guest OS settings are lost and need manual configuration

EMC Proven Professional

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

40

Exercise: Local Replication

Scenario
Organizations mission critical data is stored on RAID 1 volumes Database application uses 1TB storage Average data that changes in 24 hours is 60 GB

Requirements

Task

Need solution to address logical corruption of database Maximum RPO of 1 hour Solution should support restore request for up to 8 hours old data Minimize the amount of storage used for data protection

Suggest an appropriate local replication solution to meet RPO

requirement with minimum amount of storage EMC Proven Professional Estimate the physical storage required by this solution

EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.

Module 11: Local Replication

41