This session will cover private and public cloud storage options, including flash, disk and tape, to address the different types of cloud storage requirements. It will also explain the use of Active File Management for local space management and global access to files, and support for file-and-sync.
1 of 24
More Related Content
Inter connect2016 yss1841-cloud-storage-options-v4
2. Please Note:
1
• IBM’s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM’s sole
discretion.
• Information regarding potential future products is intended to outline our general product direction and it should not be relied on in
making a purchasing decision.
• The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any
material, code or functionality. Information about potential future products may not be incorporated into any contract.
• The development, release, and timing of any future features or functionality described for our products remains at our sole discretion.
• Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual
throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the
amount of multiprogramming in the user’s job stream, the I/O configuration, the storage configuration, and the workload processed.
Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.
3. Cloud Storage Taxonomy
Reference Storage
• Archives
• Images/Video
• WORM/NENR
Ephemeral Storage
• Typically boot volumes,
page files and temporary data
• Goes away when VM
is shutdown
Persistent Storage
• Persists across
VM reboots
• Can be shared
between VMs
• Transactional
• High Performance
Storage as the Storage CloudStorage for Compute Cloud
Hosted Storage
• File and Object access
• File Sync & Share
• Backup/Disaster Recovery
2
4. Cloud Storage Overview
Block
File
Object
Archival
Online
Ephemeral
Persistent
• Block storage offerings are differentiated by speed/throughput (as measured in
IOPS) and segmented by lifecycle of the disk. Device location does not matter.
• Ephemeral storage is tied to the lifecycle of a single VM (i.e. it is provisioned
when the VM is provisioned and destroyed when the VM is destroyed)
• Persistent storage has a lifecycle independent of any single VM and can be
provisioned/destroyed at any time and attached/detached to many VMs during it’s life
• File-based offerings are uncommon among providers, especially among those
targeting cloud native applications
• Primarily targeted at cloud enabled workloads
• Usage is being replaced in new application development with online object
storage
• Object storage offerings are differentiated by the durability of the data (i.e. odds of
irrecoverable loss) and segmented by the availability of the data (i.e. time
required to retrieve)
• An object in online storage is immediately accessible
• An object in archival storage may require minutes to hours to be accessible
3
6. VM
2
IBM Spectrum Accelerate for Block-Level Hyperconvergence
Enables the IT administrator to
single-handedly manage the
entire data center stack
Allows hardware standardization
of network, compute, storage,
power and environmentals
Leverages existing Data Center
services and maintenance
contracts
Simplifies the architecture when
lacking specialized, domain-
specific skill sets
Ethernet
Interconnect
Hypervisor
Spectrum
Accelerate
Spectrum
Accelerate
Spectrum
Accelerate
Hypervisor
iSCSI
Hypervisor
VM
1
VM
4
VM
6
iSCS
I
iSC
SI
VM
3
VM
5
iSCSI
8
7. IBM Spectrum Accelerate --- as a Service!
• Single order for Accelerate on IBM SoftLayer
• Operating Expense (OPEX) - no capital required
• Ordered:
– Base of 50TiB
– Increments of 20 TiB
• Two configurations are offered:
– Capacity oriented (for archive type of applications)
– Performance oriented (for real time processing applications)
– Each package includes all features and unlimited traffic
Capacity oriented servers
Dual CPU 6 cores
32 GB RAM
11 x 4TB SATA drives
10GbE dual private links
Performance oriented servers
Dual CPU 8 cores
64 GB RAM
11 x 4TB SATA drives
800GB SSD
10GbE dual private links
…
9
8. Virtualize Your Storage with IBM Spectrum Virtualize
Virtual Server
Infrastructure
Storwize V7000
V7000 Unified, V5000
FlashSystem V9000
San Volume Controller
10
Virtual Storage
Infrastructure
9. Real-time Compression implementation on Spectrum Virtualize
IBM Random Access Compression Engine™
Benefits
• Hardware-assisted real-time
compression
• Compressed data in cache to
increase hit ratios
• More capacity savings than data
deduplication for active data
• Compress existing data without
downtime
• Compress before Encryption to
optimize benefits of both
Upper cache
Lower cache
• Stretch Cluster forwarding
• Metro Mirror, HyperSwap
• Compression
offloaded to
Intel® QuickAssist
FPGA
• FlashCopy
• Global Mirroring
• Thin Provisioning
5x
effective
capacity!
• Encryption
33
10. IBM Spectrum Scale – Flexible File and Object Storage
FS1 FS256. . .
Exabyte-Scale,
Global
Namespace
One big file system or divide
into as many as 256 smaller
file/object systems
Each file system
can be further
divided into fileset
containers
Metadata can be
separated to its own Pool
or intermixed with data
Files and objects can
be migrated to tape to
reduce costsROBO
Other
Datacenters
36
11. IBM Spectrum Archive™ Overview
IBM Spectrum Archive enables IBM tape libraries to read and write LTFS-format
tapes as part of a Spectrum Scale™ global namespace
– Based on the integration of Spectrum Scale™
and LTFS technology
– Supports Spectrum-enabled devices
•TS1140 (or higher) Enterprise Drive
•LTO5 (or higher) Ultrium drive
•IBM Libraries TS4500, TS3500, TS3310, etc.
– Integrated functionality with
Spectrum Scale
•Supports Policy based migrations
•Seamless DMAPI usage
•Data replication to multiple pools
– Supports scale-out for capacity and I/O
•Seamless cache controls between
Spectrum Archive Nodes
•Tape drive performance balancing
•Multiple node performance balancing
Tokyo Las Vegas London
Clients
Wide Area Network (WAN)
Global Namespace
LTFS LTFS LTFS LTFS
46
12. IBM Spectrum Scale™ for File Sync-and-Share
SAN
Internal,
Direct-Attach
No IT Control:
• Servers and storage
• Security
• Access control
• User provisioning
• Sensitive data
TCP/IP or RDMA network
Twin-tailed
57
13. Storage Efficiency with Cleversafe
How to build a highly reliable storage system
for 1 Petabyte of usable data?
RAID 6 + Replication
1 PB
3.6 PB
900
3.6x
3.6x
3 FTE
Replication/backup
Usable Data
Raw Storage
4TB Disks
Racks Required
Floor Space
Ops Staffing
Extra Software
$$
70% +
TCO Savings
Cleversafe®
Original
1.20 PB Raw
Onsite mirror
1.20 PB
Raw
Remote
copy
1.20 PB
Raw
1 PB
1.7 PB
432
1.7x
1.7x
.5 FTE
None
567 TB Raw 567 TB Raw567 TB Raw
Information Dispersal
Algorithm (IDA)
Erasure coding is used to
transform encrypted pieces of
data into a customizable
number of slices (7 pieces into
12 slices, in this example)
Highly Scalable and Reliable
Only a subset of disks needed
to retrieve data (any 7 disks out
of 12, in this example)
58
14. Original Data
Encrypted, Erasure
Coded Slices
12
11
10
9
8
7
6
5
4
3
1
2
SITE 1 SITE 2 SITE 3
Slicestor®
Appliances
Accesser® Appliance, Application,
VM, Docker Container or Embedded
Accesser®
$ 7
6
5
4
3
1
2
Original object is encrypted
then cut into pieces
Each slice is written to a
separate storage node. In
this example, the storage
nodes are geographically
dispersed across 3 sites.
Information Dispersal
Algorithm (IDA)
Erasure coding is used to
transform the data into a
customizable number of slices
(7/12 in this example)
Writing Data to Cleversafe
61
15. SITE 1 SITE 2 SITE 3
StorageNodes
7
6
5
4
3
1
2
1
3 7
2
5
6
4
$
With erasure coding “k” pieces are turned into “n” slices:
Reads can be performed using any k of the n slices
• This example is a “7 of 12” Information Dispersal Algorithm (IDA) means only 7
slices are needed to reconstruct the original object
With this IDA, a read can
still be executed with any
five storage nodes being
unavailable out of 12.
With 3 sites, even an
entire site outage (plus
one additional storage
node outage) can be
tolerated.
Reading Data from Cleversafe
62
16. Cloud Storage Positioning
66
Unified file and object storage.
Optimized for high performance,
across flash, disk and object store
Flash Tape
Object
StoreDisk
Object storage on disk
File, backup and archive interfaces
available through variety of options
IBM SoftLayer
OpenStack Swift
Amazon Web Services S3
Swift S3 emulation
Unified file and object
storage on tape
Transparent Cloud Storage Tiering (beta)
Information Lifecycle Management across tiers
HighPerformance
Lower cost
17. Object storage pools for IBM Spectrum Protect
On-premises server
and object storage pool
Object storage
On-premises server,
off-premises object storage
pool
Server
Object storage
Object storage
On-premises server replicating to server in cloud
Server
Object storage
Replication
Server
TCP/IPClients
Off-premises server and
object storage pool
Clients
Clients
Server
Clients
Server
“Cloud” storage pools will exploit object-storage APIs provided by cloud, without need for gateway
Native cloud storage support based on container pools (not enabled for use as copy pool or database
backup media)
Initial support
– OpenStack Swift, including IBM SoftLayer, IBM Cleversafe and IBM Spectrum Scale
– Client backup/restore, archive/retrieve directly to/from object-storage pool
Storage hierarchy
Clients
80
18. Cloud Storage Taxonomy
Storage as the Storage CloudStorage for the Compute Cloud
Persistent
Storage
• Persists across
VM reboots
• Can be shared
between VMs
• Transactional
• High
Performance
Reference
Storage
• Archives
• Images
Video
• NENR and
WORM
Ephemeral
Storage
• Typically boot
volumes,
page files and
temporary
• Goes away when
VM is shutdown
Hosted Storage
• File Storage
• Object Storage
• Backup
• Disaster
Recovery
IBM XIV / SVC / DS8000 / FlashSystem Cleversafe, Spectrum Archive
Spectrum Scale, Elastic Storage ServerTransactional
Performance
Universal Access
Lowest
TCO
81
20. Notices and Disclaimers Con’t.
83
Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not
tested those products in connection with this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products.
Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. IBM does not warrant the quality of any third-party products, or the
ability of any such third-party products to interoperate with IBM’s products. IBM EXPRESSLY DISCLAIMS ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING BUT
NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE.
The provision of the information contained h erein is not intended to, and does not, grant any right or license under any IBM patents, copyrights, trademarks or other intellectual
property right.
IBM, the IBM logo, ibm.com, Aspera®, Bluemix, Blueworks Live, CICS, Clearcase, Cognos®, DOORS®, Emptoris®, Enterprise Document Management System™, FASP®,
FileNet®, Global Business Services ®, Global Technology Services ®, IBM ExperienceOne™, IBM SmartCloud®, IBM Social Business®, Information on Demand, ILOG,
Maximo®, MQIntegrator®, MQSeries®, Netcool®, OMEGAMON, OpenPower, PureAnalytics™, PureApplication®, pureCluster™, PureCoverage®, PureData®,
PureExperience®, PureFlex®, pureQuery®, pureScale®, PureSystems®, QRadar®, Rational®, Rhapsody®, Smarter Commerce®, SoDA, SPSS, Sterling Commerce®,
StoredIQ, Tealeaf®, Tivoli®, Trusteer®, Unica®, urban{code}®, Watson, WebSphere®, Worklight®, X-Force® and System z® Z/OS, are trademarks of International Business
Machines Corporation, registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM
trademarks is available on the Web at "Copyright and trademark information" at: www.ibm.com/legal/copytrade.shtml.
21. Thank You
Your Feedback is Important!
Access the InterConnect 2016 Conference Attendee
Portal to complete your session surveys from your
smartphone,
laptop or conference kiosk.
22. IBM Tucson Executive Briefing Center
• Tucson, Arizona is home for
storage hardware and software
design and development
• IBM Tucson Executive
Briefing Center offers:
– Technology briefings
– Product demonstrations
– Solution workshops
• Take a video tour!
– http://youtu.be/CXrpoCZAazg
85
23. 86
About the Speaker
Tony Pearson is a Master Inventor and Senior Software Engineer for the IBM Storage product line. Tony joined IBM Corporation in
1986 in Tucson, Arizona, USA. In his current role, Tony presents briefings on storage topics covering the entire IBM Storage product
line, Software Defined Storage, Analytics, Watson, and Cloud Computing. He interacts with clients, speaks at conferences and events,
and leads client workshops to help clients with strategic planning for IBM’s integrated set of storage management software, hardware,
and virtualization products.
Tony writes the “Inside System Storage” blog, which is read by thousands of clients, IBM sales reps and IBM Business Partners every
week. This blog was rated one of the top 10 blogs for the IT storage industry by “Networking World” magazine, and #1 most read IBM
blog on IBM’s developerWorks. The blog has been published in series of books, Inside System Storage: Volume I through V.
Over the past years, Tony has worked in development, marketing and customer care positions for various storage hardware and
software products. Tony has a Bachelor of Science degree in Software Engineering, and a Master of Science degree in Electrical
Engineering, both from the University of Arizona. Tony has 19 patents for inventions on storage hardware and software products.
9000 S. Rita Road
Bldg 9032 Floor 1
Tucson, AZ 85744
+1 520-799-4309 (Office)
tpearson@us.ibm.com
Tony Pearson
Master Inventor
Senior Software
Engineer
IBM Storage