Hitachi G1k Technical Presentation - 2016
Hitachi G1k Technical Presentation - 2016
Hitachi G1k Technical Presentation - 2016
Redefining Mission-Critical
Storage Virtualization
New Uses Now Possible
Backup-less
Global virtualization
infrastructure
Customer-driven
Zero RPO infrastructure
nondisruptive migration
Active-Active server
cluster support
Hitachi Storage Virtualization
Operating System (SVOS)
Hitachi Storage Virtualization Operating System
Introducing Global Storage Virtualization
Virtual Virtual
Hardware Hardware Virtual Hardware Virtual Hardware
Hardware Hardware
Server OS and VM File System Virtual Storage Software
DATA DEMANDS
File
Simplifies migration of
systems and paired
Nondisruptively maintains devices
the relationships between (HDS source and target)
Automated Data
Automated page-based data movement for Most Accessed
Relocation
performance and cost efficiency
Less Accessed
Frees users from hands-on tier
management and data layout Least or Never
Accessed
Hitachi Advantages
Reduce costs with self-managed and self-
optimized storage tiers
Most efficient use of flash ensures that
investments are fully utilized
Hitachi Storage Virtualization Operating
System Security
SECURE Secure Information Assets for Multiple Tenants
Secure Management
RESOURCE RESOURCE
PARTITION 1 PARTITION 2
Multi-Tenancy PORT PORT PORT PORT
HOST HOST
Authentication and GROUP
HOST
GROUP
HOST
Authorization GROUP GROUP
Virtualization
Add up to 8 Hitachi NAS Controller
Platform file modules for
high-performance
iSCSI, NFS, CIFS, file sharing and deduplication.
Flash-Only
Block-Only Configurations Configuration
Up to 2 controller
chassis/racks
Up to 6 racks total
Same upgrade Mainframe-Only
flexibility options as Configuration
with Hitachi Virtual
Storage Platform
Hitachi Virtual Storage Platform G1000:
Architecture vs. Commodity
Specialized Commodity
Separate application data and control path Common application data and control path
Enterprise-wide
Write consolidation
mirrored global memory; Application
Mirrored withmemory;
global distributed linear growth
Critical,
Variable bandwidthvolatile workload Fixed
of bandwidth
capacity and performance
Switching interconnects with messaging latency Switching interconnects with messaging
(nanoseconds) latency (microseconds)
Global virtualization with complete integration with Local virtualization with partial integration with
storage features storage features
Hitachi Virtual Storage Platform G1000 vs.
Commodity Design
8 ports 8 ports
FC, 10GbE Control FC, 10GbE Front-end
Bandwidth Bandwidth
Front-end Virtual Storage Virtual Storage Front-end
Director 1 Director 1 Director 16 Director 24
128 256
Commodity
GB/s
Scale-out GB/s
8Cores 8Cores
Controller 0 Controller 1
Data
Bandwidth
480
384 Cache-Switch
Virtual Storage1
Director 1
6 Cores 768
Cache-Switch
Virtual Storage8
Director 16
6 Cores
cores
cores GB/s
8Cores 8Cores
128 Back-end
Bandwidth
Back-end
cores Director 1
128
8 Engines
Director 8
GB/s
Reads Writes
4,500,000 1,400,000
4,000,000 1,200,000
3,500,000
1,000,000
3,000,000
3.9x VSP 4.4x VSP
2,500,000 800,000
G1000 G1000
2,000,000 600,000
1,500,000
400,000
1,000,000
200,000
500,000 VSP VSP
0 0
System System
Preliminary results
Hitachi Virtual Storage Platform G1000 (VSP G1000)
Performance Comparison: Sequential 256kB [MB/sec]
Reads Writes
60,000 30,000
50,000 25,000
40,000
3.7x VSP 20,000 3.8x VSP
30,000 G1000 15,000 G1000
20,000 10,000
10,000 5,000
VSP VSP
0 0
System System
Preliminary results
Hitachi Virtual Storage Platform G1000 (VSP G1000)
Performance Comparison: Sequential 256kB [MB/sec]
Reads Writes
60,000 30,000
Sequential 256kB [MB/sec]
0 0
System System
I Cache per Node: 46GB (HNAS* 4060 or 4080), 108GB (HNAS 4100)
Protocols: NFS/SMB/FTP/iSCSI and HTTP to the cloud
L
Fibre Channel Ports: 4 x 8Gb/sec ports per node
E Ethernet Ports (File Sharing): 4 x 10Gb Ethernet per node
Example of Hitachi
Virtual Storage
Platform G1000
granular scaling of Drive Drive Drive Drive Drive
Chassis
Drive
Chassis
Chassis Chassis Chassis Chassis
Hitachi Accelerated
Flash modules and
drives
Flash Module Flash Module
combinations Drive
Chassis
Drive
Chassis
Drive
Chassis
Drive
Chassis
available
Separate
Today: Storage
VSP G1000 Controllers
Flexible
5M, 30M,
Deployment 100M Options
Coming Soon:
Ultimate Deployment
Flexibility
Separate Controller Racks
and Disks Racks
Hitachi Virtual Storage Platform G1000
Hardware Features
All of the controller boards within a system are connected via the Hitachi
HiStar-E network of paths
Views of Controller Chassis (CBX)
VSDs Fans
Fans
This is the SBX DKU, This is the UBX DKU, This is the FBX DKU, which
which holds 8 HDUs with which holds 8 HDUs with holds 8 HDUs with 12 FMD
24 SFF drives each. 12 LFF drives each. drives each.
On Hitachi Virtual Storage Platform G1000, each HDU is self contained with drive trays,
SAS switches, power supplies, and fans. This is very different from the Virtual Storage
Platform, in which the DKUs contained the active components and the HDUs were more
logical than physical.
The SFF SBX DKU chassis contains 8 DBS HDUs (24 slots wide) that hold up to 192x
2.5” SAS and SSD drives.
The LFF UBX DKU chassis contains 8 DBW HDUs (4x3 slot matrix) that hold up to 96x
3.5” SAS drives.
The FBX DKU chassis contains 4 split DBF trays (4x3 slot matrix, with 6 drives per upper
and lower HDU section) that hold up to 48x FMD drives.
Hitachi Virtual Storage Platform G1000:
Media Options
Hitachi Flash SSD SFF (2.5- HDD SFF HDD LFF (3.5-
Module Drive inch) (2.5-inch) inch)
900GB 10K
1.2TB 10K
*Note: All specifications may change without prior notice
Hitachi Accelerated Flash (HAF) Advantage
FMD Internal Architecture
SAS
SAS Target Mode
SAS Host Interface Interface
Controller
Flash Array
Hitachi Storage Virtualization Operating
System and Hitachi Virtual Storage Platform
G1000 In Detail
Hitachi Storage Virtualization Operating System
and Hitachi Virtual Storage Platform G1000 In Detail
Storage Virtualization
Throughout the Unified System
Versatile, Scalable Storage System
LUN
LUN
Hitachi Storage Virtualization Operating System
Controller Intelligence
VDEV VDEV VDEV
Devices
Internal
LDEV
LDEV
Mapped Mapped
1:1 External Port N:1
Target Port
Internal
Disks
Target Port
HDD
External
Storage
LUN LUN LUN
RAID group
LUN LUN LUN
External Storage Virtualization
SVOS* Universal Volume Manager Platform Support
Resource Resource
Group 1 Group 2
Write to
Multiple Copies LDEVs: LDEVs: Read Locally
10:00 20:00
10:01 20:01
Simultaneous 10:02 20:02 Simultaneous
from Multiple from Multiple
Applications Applications
Zero Recovery-Point-Objective Infrastructure
GAD* + Hitachi Universal Replicator (HUR) with Delta-Resync
Plus…
HUR Active HUR Standby
HUR SVOL
* GAD = global-active device
Global-Active Device Supported Configurations
QRM
2 Sites
Primary site
Quorum
DKC Alternate site
Reserve and quorum DKC is located on the primary site
Provides moderate level of business continuity for any
MDKC HA mirroring RDKC type of DKC failures, or alternate site failure
(Healthy)
Single data center
All the DKCs are located on the same site
QRM
Primary site
Quorum Provides business continuity for DKC failures, but
DKC
cannot maintain the business for a site failure
Global-Active Device with Cross Site Paths
Hitachi Dynamic Link Manager required at any distance Hitachi Dynamic Link Manager not required at Campus distances
SCSI2, SCSI3 (PGR) and ATS are all supported and are replicated in
Only SCSI2 and ATS is supported, SCSI3 (PGR) is not supported
either Pair or PSUS states
No Hitachi High Availability Manager consistency groups Global-active device consistency groups in V02
Only SI supported on the remote site SI and TI supported on either or both sides
Quorum failure stops replication Quorum failure stops replication, will be changed in V03
Quorum is single point of failure for HA Quorum is single point of failure for HA, will be enhanced in V03
Management
Throughout the Unified System
Hitachi Storage Virtualization Operating System
Provisioning Overview
Warning
Storage Navigator
Hitachi
Command Function Emergency MF Maintenance
restricted mode mode mode mode
Suite Management
Server Service Processor
SVOS* Hitachi Dynamic Provisioning and Hitachi
Dynamic Tiering (Block): Details
Hitachi Virtual Hitachi Virtual
Hitachi Unified Hitachi Unified
FEATURE Storage Storage
Storage 150 Storage VM
Platform Platform G1000
Number of pools 64 128 128 128
Max. DPRG 200
Max. number of pool-VOLs 1,024 per pool 1,024/pool 1,024/pool
per pool
Capacity per pool-VOL 128TB 8GB to 4TB 8GB to 4TB 8GB to 4TB
Number of virtual volumes 4K 16K 64K 64K
46.87MB to 46.87MB to 46.87MB to
DP-VOL capacity 128TB
59.9TB* 59.9TB* 59.9TB*
Max. total pool capacity 2.6PB 2.1PB 5PB 12.3PB
1GB chunk
Data allocation unit (page) allocated in 42MB 42MB 42MB
32MB segments
Support Capacity Expand (max Pool Capacity from 5PB to 12.3 PB) V01
HDP
Fully-Allocated DPVOL V02
Capabilities
Simple, centralized, and integrated storage SAN path management
Complete multipath failover and failback, and I/O load balancing
Enables global storage virtualization over metro distance
Optimized application performance by controlling path bandwidth
Centralized path management, listing path information for all paths or for
each host, HBA port, storage subsystem and storage port
Migrations
Throughout the Unified System
Timelines for Nondisruptive Migration and
Global-Active Device
Global-Active Device
‒ CYQ3, 2014
Nondisruptive Migration
Through Global Storage Virtualization
Simplifies migration of
systems and paired
Always maintain devices
the relationships (HDS source and target)
Hitachi
between your Virtual
applications Storage Reduces migration
Platform
and their data G1000 exposure
Block Migrations: Hitachi Storage Virtualization
Operating System Nondisruptive Migration
SN=3
• Complete volume migrations
RSG
Data
Data (new) Disk
Remote P
Remote (new) Chassis P P
DKC P
DKC Data Copy Data Copy
SN=4
SN=3 Supported Pair
Create Pair Create
D/R server can switch (SAN)
RDKC S S
to new D/R copy after all
initial copies for the CTG S S
D/R Server (JG) are complete
Nondisruptive Migration with Active Hitachi
TrueCopy/Hitachi Universal Replicator (HUR)
Hitachi TrueCopy/Hitachi Universal Replicator
Item GA Release Notes
Case #1 Case #2
Maintaining DR Pair/Suspend
Migration Migration
configuration
Hitachi Case 1 Supported
Hitachi
TrueCopy/Hitachi
Hitachi Case 2 Supported
TrueCopy/HUR TrueCopy/HUR Hitachi
Universal Replicator
TrueCopy/HUR (Pair/Create)
TrueCopy/HUR Case 3 Not
(Pair/Create)
Supported
Case #3
Migration
1: Hitachi TrueCopy/Hitachi Universal Replicator Initial copy happens
before volume migration starts.
Hitachi
TrueCopy/HUR 2: Extra bandwidth will be required during migration due to initial copy to
Hitachi
TrueCopy/HUR
the new target as well as update copies to the old target.
NAS Migrations
Introduction to Universal Migrator
What is it?
Virtualize data from one or more 3rd-party filers to
Hitachi NAS Platform with minimal downtime
Data appears as if it’s on Hitachi NAS Platform
local file systems, when in reality it’s still on external
NAS (e.g., NTAP)
Data migrated transparently from legacy NAS to
Hitachi NAS Platform without interruption to front-
end clients
NAS Virtualization/Migration
Virtualization Stage
NFS NFS
Permanent objective:
Keep third party
Ingested files
virtualized behind HNAS*
Migration Stage
NFS NFS
Temporary objective:
Remove third party after
migration is completed
* HNAS = Hitachi NAS Platform
Universal Migrator: Example
Data In Place Virtualization
\\Server01
IP: 17.4.21.9
\\Tier2
192.168.0.3 IP: 192.168.0.3
Metadata Metadata
Manually Create: Configuration:
Data Data
1 EVS 1 vfiler
1 export 1 export
Universal Migrator: Example
Data-In-Place Virtualization
\\Server01 \\Tier2
IP: 17.4.21.9 IP: 192.168.0.3
192.168.0.3
Fx hus
Metadata Metadata
Manually Create: Configuration:
Data Data
1 EVS 1 vfiler
1 export 1 export
Hitachi Storage Virtualization Operating System
and Hitachi Virtual Storage Platform G1000 In Detail
Security
Throughout the Unified System
Hitachi Storage Virtualization Operating System and Hitachi
Virtual Storage Platform G1000 Security Overview
Secure Management
Multi-Tenancy
Audit Logging
Sanitization
Virtual Resource Partitions with Hitachi
Resource Partition Manager
Resource Partition 1 Resource Partition 2
Port Port Port Port
Hitachi
Virtual
Parity Group Parity Group Storage
Platform
G1000
Directory Authorization
‒ Role-based access controls
‒ Leverage existing authentication and
authorization data
‒ Microsoft Active Directory®
‒ LDAP
‒ Kerberos
‒ Radius
‒ Multifactor authentication
Audit Logging
Ease audit and compliance reporting
Hitachi Virtual Storage Platform G1000
Data-at-Rest Encryption
Optional back-end director
Third generation of controller based
encryption
Encryption is performed in hardware with
no degradation in throughput
Unique encryption key per piece of media.
Associated key is deleted when media is
removed
Full KMIP support
Controller-Based Encryption
Key Management
Interoperability Protocol
OASIS Interoperability
Protocol
Block-level Protection:
Hitachi Data Retention Utility
logical volumes
‒ Customers can write, protect and define
data retention periods
Rd. Protect Protect
‒ Locks disk volumes as “read-only” for Only 3 years Forever
a prescribed retention period 3 years
In process:
FIPS 140-2
Hitachi Storage Virtualization Operating System
and Hitachi Virtual Storage Platform G1000 In Detail
Operational Recovery
Throughout the Unified System
Hitachi Data Protection Trident
Critical Applications,
Large Data Sets
RPO / RTO in Minutes
HDS offers a tiered approach to data
Hardware-Based protection, retention and recovery
Snapshots / Clones
Fast Data Hitachi Thin Hitachi
Restore Image ShadowImage®
Application-Consistent
Standard Data Sets
Snap Management
Fast App Hitachi Data Protection Suite
24 Hour RPO / RTO
Restore IntelliSnap
Standard Backup
Long-Term Standard
Retention
Hitachi Data Protection Suite (HDPS)
Restore
Hitachi ShadowImage Clones
environments
Hitachi Thin Image Snapshots
Virtual Volumes
P-VOL S-VOL P-VOL
Snapshot
It then calls the HDS HW-based
8AM 12PM 4 PM 8PM
snapshot (Thin Image) or clone
(ShadowImage) feature
Hitachi Thin Image Primary
After the snap/clone is completed, the Hitachi ShadowImage Storage
application is released to continue
operations Backup
Hitachi Data
Protection Suite
The snap/clone copy can then be Cloud
ContentStore
Primary
‒ Revert, Clone + Mount, File copy Storage
Disaster Recovery
Throughout the Unified System
Hitachi Universal Replicator Remote Replication
Primary Remote
Select Hitachi
TrueCopy or Hitachi
Universal Replicator
based on
RPO, bandwidth and
distance objectives
Copy data at remote
Hitachi TrueCopy (synchronous) or
site with Hitachi
Hitachi Universal Replicator ShadowImage or
(asynchronous)
Hitachi Thin Image
< 300km S-VOL
P-VOL
Hitachi Test and
ShadowImage or
Hitachi Thin Image Dev
3 Data-Center Cascade Configuration
S-VOL
P-VOL S-VOL
Hitachi Universal Replicator (asynchronous)
Hitachi Replication Manager
V2I Snap/Clone/Backup
Backup-less
Global virtualization
infrastructure
Customer-driven
Zero RPO infrastructure
nondisruptive migration
Unlimited growth
Inter system mobility
(scale-out)
Active-Active server
cluster support
Thank You