Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                

03. Dell ECS

Download as pdf or txt
Download as pdf or txt
You are on page 1of 33

Dell ECS

Enterprise object storage

Huy Nguyen
Solution Architect
Challenges navigating the data era

DATASPHERE RAPID DATA APP DESIGN


COMPOSITION GROWTH REVOLUTION

>90% 3x 70%
of the world’s data growth of file and of all new apps will be
is unstructured1 object data capacity by 20252 production-grade,
cloud-native apps
1. IDC White Paper: High Data Growth and Modern Applications Drive New Storage Requirements in Digitally Transformed Enterprises, July 2022,.
IDC #US493597222
by 20243
2. IDC Market Forecast:: Worldwide File- and Object-Based Storage Forecast, 2021-2025: New Enterprise Workloads Driving Strong Growth, Eric
Burgener, Carol Sliwa and Natalya Yezhkova, Dec. 2021, IDC #US48403021
3. IDC MarketScape: Worldwide Distributed Scale-Out File System 2022 Vendor Assessment, Eric Burgener, April 2022, IDC #US49015322

© Copyright 2022 Dell Inc.


What is object storage?
A critical element of an enterprise storage strategy

TRANSACTION UNITS PROTOCOLS METADATA SUPPORT


Objects – files with REST and SOAP Supports custom
custom metadata over HTTP metadata

WELL SUITED FOR BIGGEST STRENGTH LIMITATIONS


Relatively static file data Scalability and Not well suited for frequently
and as cloud storage distributed access changing transactional data

© Copyright 2022 Dell Inc.


Dell ECS
Enterprise-class object storage

EX-Series | HDD & all-flash appliances

Cost-effective at scale Fast S3 for modern apps Enterprise proven


Build an object storage private cloud Support modern workloads with high Deploy with confidence using best-in-
with up to 76% lower TCO* performance, S3-compatible storage class technology and services

* ESG Economic Validation sponsored by Dell Technologies, “Analyzing the Economic Benefits
of Dell ECS: Economic Benefit Analysis of On-premises Object Storage versus Public Cloud,”
Tony Palmer, July 2022. Cost savings based on ESG comparison of ECS to a leading public
cloud in active storage scenarios. Actual results may vary.

© Copyright 2022 Dell Inc.


Keep pace with any data demands

• Limitless scale

• Global accessibility

• Secondary storage

• Simplified management

• Lower TCO

Global Namespace

© Copyright 2022 Dell Inc.


Empowering
modern workloads
Cloud-native
apps
IoT, AI,
Dev / test machine learning

Data
• All-flash S3
Containers
monetization
• Modern data lake
Safety &
security ECS Analytics
• Splunk analytics

Backup CloudPools • Streaming data


& CloudTier
platform storage
Sync &
Compliance
shares
Archive / tape
replace

© Copyright 2022 Dell Inc.


Technology you can trust

• Built-in data protection

• Meets compliance
standards

• Services and support

• Future-Proof Program

• Legacy of leadership

1 Gartner, Inc. “Magic Quadrant™ for Distributed File Systems and Object Storage” by Julia Palmer, Jerry Rozeman, Chandra Mukhyala, Jeff Vogel, October 19, 2022.​
Gartner does not endorse any vendor, product or service depicted in its research publications, and does not advise technology users to select only those vendors with the highest ratings or other designation. Gartner research publications consist of the opinions of
Gartner’s research organization and should not be construed as statements of fact. Gartner disclaims all warranties, express or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose. This graphic was
published by Gartner, Inc. as part of a larger research document and should be evaluated in the context of the entire document. The Gartner document is available upon request from Dell Technologies.
.

© Copyright 2022 Dell Inc.


The EX-Series portfolio

EXF900

230 TB min. EX5000


Performance

Up to 5,898 TB/rack EX500

480 TB min.
Up to 6,144 TB/rack 2,000 TB min.
Up to 11,200 TB/rack

Capacity

© Copyright 2022 Dell Inc.


Dell ECS
Enterprise-grade object storage
Cloud-native
apps EXF900
IoT, AI,
Dev / test Machine Learning

Data
Containers
monetization EX500

Safety &
security ECS Analytics

CloudPools EX5000
Backup
& CloudTier

Sync &
Compliance
shares
Archive / tape
replace

Scale-out | Geo-distributed | Multiprotocol | Custom metadata | Turnkey appliances

© Copyright 2022 Dell Inc.


ECS EX-Series | EX500
• Scale-out nodes
EX500 | PowerEdge R740xd2 • Improved performance via dual, 10 core processors
• Identical performance characteristics with every node
• Optional SSD for metadata cache
2U
• Introducing with ECS release 3.8:
• 25% higher available capacity/density
• 3X higher available memory

CPU/PE
Model Memory Disk per node Rack capacity Networking connections
Server
EX500 48TB 64GB / 192GB 2 x 10 core 12, 24 x 2TB / 4TB 120TB – 768TB 25GbE FrontEnd | 25GbE BackEnd

EX500 96TB 64GB / 192GB 2 x 10 core 12, 24 x 2TB / 4TB 240TB – 1536TB 25GbE FrontEnd | 25GbE BackEnd

EX500 192TB 64GB / 192GB 2 x 10 core 12, 24 x 8TB 480TB – 3072TB 25GbE FrontEnd | 25GbE BackEnd

EX500 288TB 64GB / 192GB 2 x 10 core 12, 24 x 12TB 720TB – 4608TB 25GbE FrontEnd | 25GbE BackEnd

EX500 384TB 64GB / 192GB 2 x 10 core 12, 24 x 16TB 960TB – 6144TB 25GbE FrontEnd | 25GbE BackEnd

EX500 480TB 64GB / 192GB 2 x 10 core 12, 24 x 20TB 1200TB – 7680TB 25GbE FrontEnd | 25GbE BackEnd

© Copyright 2022 Dell Inc.


ECS EX-Series | EX5000
EX5000 | PowerEdge XE7100
• Single and dual node configurations
• Drawer accessible and hot-pluggable drives
5U • 16TB disk drives per node
• Optional SSD for metadata cache

Model Memory CPU/PE Server Disk per node Rack capacity Networking connections

EX5000(S) 16TB 25, 50, 75, 100


192GB 2 x 28 core 2,000TB – 11,200TB 25GbE FrontEnd | 25GbE BackEnd
Single node x 16TB
EX5000(D) 16TB
192GB 2 x 28 core 25, 50 x 16TB 4,800TB – 11,200TB 25GbE FrontEnd | 25GbE BackEnd
Dual node

© Copyright 2022 Dell Inc.


ECS EX-Series | EXF900
EXF900 | PowerEdge R740xd • Scale-out nodes
• High performance NVMe SSDs with dual
24-core processors
2U
• Identical performance characteristics with every node
• Powers AI, machine learning, IoT and real-time
analytics apps

Model Memory CPU/PE Server Disk per node Rack capacity Networking connections

EXF900 46TB 192GB 2 x 24 core 12, 24 x 3.84TB 230TB – 1474TB 25GbE FrontEnd | 25GbE BackEnd

EXF900 92TB 192GB 2 x 24 core 12, 24 x 7.68TB 460TB – 2949TB 25GbE FrontEnd | 25GbE BackEnd

EXF900 184TB 192GB 2 x 24 core 12, 24 x 15.36TB 920TB – 5898TB 25GbE FrontEnd | 25GbE BackEnd

© Copyright 2022 Dell Inc.


ECS core features and capabilities

Limitless scale Globally connected Multi-tenancy / access


• Scale-out architecture • VDC federation (8 sites) • Namespaces & role-based access
• No limits on capacity, number of • Replication groups controls
objects, file size, or nodes • Active/active architecture with XOR • Identity & access management
reduction (IAM) controls

Multiprotocol support Protection & compliance Advanced features


• Cloud-native via HTTP and S3 • FIPS 140-2, D@RE, erasure • NVMe SSD options
(S3a) RESTful APIs coding, triple mirroring, etc. • SSD metadata cache
• NFS, SMB, CIFS, Swift, CAS, • Retention, indexing, replication and • Custom metadata
ATMOS, HDFS logging • Object cloning

© Copyright 2022
2021 Dell Inc.
ECS Scale-Out Architecture

Clients

Multi-protocol S3 S3a HDFS NFS CIFS Swift

Load Balancer

Front-end Network

ECS Nodes and


Back-end Network
ECS Nodes Intra-cluster
Same roles for all nodes communication
Erasure Coding Protection Level
Erasure coding Number of chunk
# Nodes in VDC Erasure coded data protected against
scheme fragments per node

5 or less nodes 4 • Loss of up to four disks or


• Loss of one node

6 or 7 nodes 3 • Loss of up to four disks or


• Loss of one node and one disk from a second node

Default 8 or more nodes 2 • Loss of up to four disks or


• Loss of two nodes or
(12 + 4) • Loss of one node and two disks

16 or more nodes 1 • Loss of four nodes or


• Loss of three nodes and disks from one additional node or
• Loss of two nodes and disks from up to two different nodes or
• Loss of one node and disks from up to three different nodes or
• Loss of four disks from four different nodes

• Loss of up to two disks or


11 or less nodes 2
Cold storage • Loss of one node

(10 + 2) 12 or more nodes 1 • Loss of any number of disks from two different nodes or
• Loss of two nodes
Note: This table reflects protection levels possible with full distribution of chunk fragments. There may be scenarios where more fragments exist on a node such as if a node has
insufficient space available. In this case the protection levels may vary.
Deployment Models
Typical Single Deployment

HTTP Load AD
Balancer DNS
NTP

Namespace 1

Storage Pool 1 Bucket Bucket


01 02
Deployment – Geo Replication
Geo – Federated

Replication Group 1
Namespace 1

Bucket Bucket
01 02

Storage Pool 1 Storage Pool 2


Namespace 2
Replication Group 2

Bucket
03
Dell Technologies & Kemp Partnership

Joint
Solutions

Reference
Architecture

& Customer
Validation

Streamlined
Procurement
& Support
ECS Connection Manager (Kemp LoadMaster)
Customer Provided Load Balancer (F5)
Key Use Cases
Consolidated Cloud-native Big data &
archive applications analytics

© Copyright 2022 Dell Inc.


PowerMax + ECS
Unisphere Customer
UI Client Network

5am
Snapshots
10am 3pm 8pm
80%
Cost reduction1

Cloud Mobility

Tier database snapshots Free up capacity and Integrate snapshot data into
onto ECS improve TCO modern apps via the ECS
Storage Broker for k8s

1Based on Dell Technologies analysis, April 2021. Savings calculated comparing the cost of storing 6
months of Snaps (on avg. 55% capacity consumed) over 3 years on PowerMax 8000 for 1246TB vs. using
Cloud Mobility to store snaps in Dell ECS Cloud object storage. Costs in US dollars. Actual savings will vary.
© Copyright 2022 Dell Inc.
© Copyright 2021 Dell Inc.
PowerProtect DD + ECS

Access methods
NFS ▪ CIFS ▪ VTL ▪ NDMP ▪ DD Boost

Cloud tier

Tier cold data from Free up capacity and Extend the value
PowerProtect DD to ECS improve TCO of data

© Copyright 2022
2021 Dell Inc.
PowerScale + ECS
Extended OneFS Namespace

ECS private cloud


Apps Seattle
PowerScale OneFS

CloudPools Tokyo
Clients London

Cost-effective Automated
NFS | SMB | S3 | HDFS | Swift Eliminates data Single vendor
cold storage data tiering residency issues solution

© Copyright 2022 Dell Inc.


© Copyright 2021 Dell Inc.
GeoDrive: Object storage access from Windows
VDC 2
Windows Clients

GeoDrive ECS VDC 1

S3
CIFS | SMB
Windows Servers
Geo-federation

VDC 3

Extends the Windows file Install, configure, and use No complex shares,
system interface to ECS with ease—at no cost mounts, or API
developments

© Copyright
© Copyright 2021 2022 Dell Inc.
Dell Inc.
ECS, the ultimate backup target

And more!

Backup and archive Validated target by Up to 76% lower TCO Keeps data under your
at any scale multiple ISVs than public cloud1 organization’s control

1ESG Economic Validation, Economic Benefit Analysis of On-premises Object Storage versus Public Cloud, by Tony Palmer, June 2022.

© Copyright 2022
2021 Dell Inc.
ECS Kubernetes Storage Broker
Master Node Node 1 ECS Storage Cluster

Scheduler
ECS S3 API: Catalog Namespace
Application Namespace Data Access
Controller
API Bucket
Kubelet Secret Pod
Server Bucket Application

Catalog Namespace ENV


Variable
Pod
Kubelet

Service Catalog
Pod
ECS Broker
Controller

Service ECS Management API


Catalog API Developer

Support modern apps Utilize Kubernetes Meet growing data


with cloud-native storage methodologies and requirements with
concepts limitless scalability

© Copyright 2022
2021 Dell Inc.
Modernization with object storage

3
1 2 Global Namespace

Seattle
4

HTTP Tokyo
5 London

1 2 3 4 5

ECS multi-tenancy Apps can access Geo-replication S3 RESTful APIs allow Faster provisioning with
eliminates the need for massive amounts of eliminates the need for direct access to data via self-service options for
multiple file system silos data through a single disaster recovery HTTP developers
namespace

© Copyright 2022
2021 Dell Inc.
ECS + Splunk SmartStore
Event / Streaming Data ECS Warm Tier
Site 1

Splunk Indexers Move buckets between Replication


Site 2
ECS and local storage

Cache
Management

Reduces storage Improves availability Scales compute and Simple to use


costs and and resiliency storage resources and flexible
improves TCO separately

© Copyright 2022
2021 Dell Inc.
ECS for AI, deep learning & analytics
INDUSTRY VERTICALS

M&E Healthcare EDU


AI ML Models

FinServ ADAS Sciences

INPUT OUTPUT ANALYZE

ECS DATA LAKE

Turnkey Appliances

© Copyright 2022
2021 Dell Inc.
IoT data lake
Persistent storage
Data source Ingest / process Ingest / process Data source
Discover Analyze

Dell DataIQ
Act

Global, unified Hadoop S3a Multiprotocol Persistent, batch


storage compatibility interoperability repository

© Copyright 2022
2021 Dell Inc.

You might also like