CSE423

VIRTUALIZATION AND CLOUD COMPUTING

Working with Cloud-based Storage

1
Lecture Outline
 Measuring the digital universe
 Provisioning cloud storage
 Creating cloud storage systems
 Cloud backup solutions
 Cloud storage interoperability

2
Introduction
 The world is creating massive amounts of data.

 A large percentage of that data either is already stored in the

cloud, will be stored in the cloud, or will pass through the cloud
during the data's lifecycle.

 Cloud storage systems are among the most successful cloud

computing applications in use today.

 This chapter surveys the area of cloud storage systems,

categorizes the different cloud storage system types, discusses
file-sharing and backup software and systems

3
Data usage on cloud based platforms

4
Some cloud related facts
1. The average enterprise uses 1,427 distinct cloud services.
2. The average employee actively uses 36 cloud services at work.
3. The average enterprise uses 210 distinct collaboration cloud
services.
4. The average enterprise uses 76 distinct file sharing cloud services.
5. 18.1 percent of files uploaded to cloud-based file-sharing and
collaboration services contain sensitive data.
6. 2.7 percent of files shared in the cloud have access permissions that
make them publicly accessible.
7. 71.3 percent of all cloud services at use are enterprise-focused and
28.7 percent are consumer ones.

5
 Measuring the Digital Universe
 Estimates for storage
 The storage industry will ship 42ZB of capacity over the next
seven years.
 90ZB of data will be created on IoT devices by 2025.
 By 2025, 49 percent of data will be stored in public cloud
environments.
 Nearly 30 percent of the data generated will be consumed in
real-time by 2025.

6
 Measuring the Digital Universe
 Facts of hunger for storage
 More than 50% of the data created everyday is the data that
is automatically generated, (called shadow data/digital shadow
) especially from video cameras and surveillance photos,
financial transaction event logs, performance data and so on.

 However lots of shadow data does get retained having never

been touched by human bieng

 Much of the data produced is temporal, stored briefly and get

deleted.

7
8
Cloud Storage Definition
 Cloud storage is a cloud computing model that stores data on
the Internet through a cloud computing provider who manages
and operates data storage as a service. It's delivered on demand
with just-in-time capacity and costs, and eliminates buying and
managing your own data storage infrastructure.
 IaaS model
 Storage accessed by Web service API
 Cloudy characteristics
 Network access most often through browser
 On-demand provisioning
 User control
 SaaS model
 Software package on top of cloud storage for backup,
synchronization, archiving, etc.
9
 Storage Devices
 Block storage device
 Raw storage that can be partitioned to create volumes
 Data is transferred in blocks
 Example, hard disk, flash drives
 Faster data transfers/ additional overhead on clients
 File storage device
 Expose its storage to client in a form of files
 Example, file server, most often in the form of Network
Attached Storage (NAS) devise
 Slower transfers/ less overhead from clients

10
Provisioning Cloud Storage
 Cloud storage may be broadly
categorized into two major classes of
storage:

 Unmanaged Storage
 Managed Storage

11
 Cloud Storage Types
 Unmanaged storage
 Unmanaged storage is presented to a user as if it is a ready-
to-use disk drive. The user has little control over the nature of
how the disk is used.

 Preconfigured storage (limited level of mgt)

 Cannot (1) format as your like, (2) install your own file
system (FAT, NTFS), and (3) change drive properties
(compression, encryption)
 Reliable, relatively cheap, easy to work with

 Ex-Application using this storage are SaaS web services

12
 Cloud Storage Types
 Managed storage
 Managed storage involves the provisioning of raw virtualized disk
and the use of that disk to support applications that use cloud-
based storage

 Provided as a raw disk

 Can (1) format and partition the disk, (2) attach or mount the
disk, and (3) make storage assets available to applications and
other users
 Support applications built using Web services

 Ex-Application using this storage are IaaS web services

13
 Unmanaged Cloud Storage
 With the development of high capacity disks in mid to late 1990
a new class of Storage provider known as Storage Service
Provider (SSP) appeared with intent of doing online storage

 IDrive, FreeDrive, MyVirtualDrive, OmniDrive, Xdrive offered file

hosting services in unmanaged storage form.

 Volumes were accessible using FTP then Utility then within

browsers. DropBox example of file transfer utility.

 In unmanaged cloud, disk space provided to user as a sized

partition.

14
Managed Cloud Storage
 User provisions storage on demand and pays using pay-as-you-
go model

 System appears to user as a raw disk that user must partition

and format

 Amazon Simple Storage Service (S3)

 http://aws.amazon.com/s3/
 Rackspace Cloud
 http://www.rackspace.com/index.php
 Google Storage for Developers
 https://cloud.google.com/storage/

15
16
Creating Cloud Storage Systems
 Concepts
 Multiple copies of data are stored on multiple
servers and in multiple locations
 Storage virtualization software
 Failover - > changing the pointers to the stored
object’s location
 Example
 Amazon Web Service (EC2, S3) supports
“failover” / load balancing ->but you must
purchase these features
17
Evaluating Cloud Storage
 Important considerations
 Client self-service
 Strong management capabilities
 Scale up – more disks
 Scale out – additional storage systems
 Performance characteristics such as
throughput
 Block-based or file-based protocol support
 Seamless maintenance and upgrades

18
 Cloud Backup Solutions
 Last line of defense in a strong backup routine
 Backup types
 Full system or image backups
 Point-in-time (PIT) backups or snapshots
 Incremental backups
 3-2-1 Backup rule
 3 copies (1 primary and 2 backups)
 2 different media
 1 copy should be stored offside

19
Backup Types
 Full System/ Image Backups
 Creates a complete copy of volume
including all system files, the boot record
and any other data contained in the disks.

 For create image backup of active system

we need to stop all applications.

20
Backup Types
 Point in Time (PIT) or Snapshots
 Referred to as incremental backup, created
so often.

 Lets you restore your data to a point in

time and save multiple copies of any files
that have been changed.

21
Cloud Backup Features
 Logon authentication
 High encryption of data transfers
 Automated and scheduled backup
 Fast backup (snapshots) after full online
backup, with 10-30 historical versions of
a file retained
 Ability to retrieve historical versions of
file

22
Cloud Backup Features (2)
 Multiplatform support (Win/ Mac / Linux)
 Web-based management console with ease to
use features such as drag and drop.
 24x7 technical support
 Logging and reporting of operations
 Multisite storage or replication, enabling data
failover

23
24
Cloud Attached Backup

25
Data management in cloud

26
27