Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
SlideShare a Scribd company logo
DATA CENTER
                                TECHNOLOGIES
                                 Sagar Patil
                                 EMC Proven Professional




                                                                                  @sagarkotekar
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.               1
Agenda
     • Information storage and management
     • Core elements of a data center
     • Intelligent storage systems
     • Storage networking technologies
     • Business continuity solutions




EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.
Why Information Storage and Management?
     • Information is the knowledge derived from data
     • Growth of digital information has resulted in information
         explosion
     •   We live in an on-command, on-demand world
            We need information when and where required
     • Increasing dependency on fast and reliable access to information
     • Businesses seek to store, protect, optimize, and leverage the
         information
            To gain competitive advantage
            To derive new business opportunity




EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.   3
Data Center
            Data Center

         It is a facility that contains storage, compute, network, and other IT
         resources to provide centralized data-processing capabilities.


     • Core elements of a data center
            Application
            Database management system (DBMS)
            Host or Compute
            Network
            Storage
     • These core elements work together to address data-processing
         requirements


EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.   4
Data Center: Online Order Transaction System
     Example


                                                                    Host/                   Storage Array
                                                                   Compute

          Client

                                                                                  Storage
                                    LAN/WAN                                       Network


          User
        Interface                                              OS and DBMS




EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.                             5
Host (Compute)
     • Resource that runs applications with the
         help of underlying computing
         components
            Example: Servers, mainframes, laptop,
                  desktops, tablets, server clusters, etc.
     • Consists of hardware and software
         components
     •   Hardware components
            Include CPU, memory, and input/output                                IP
                  (I/O) devices
     • Software components
            Include OS, device driver, file system,
                  volume manager, and so on


EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.        6
Storage
     • Stores data created by individuals and organizations
            Provides access to data for further processing
     • Examples of storage devices are:
            Media card in a cell phone or digital camera
            DVDs, CD-ROMs
            Disk drives
            Disk arrays
            Tapes




EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.   7
Evolution of Storage Architecture

                                                                                  Department 1    Department 2     Department 3
                                                                                     Server          Server           Server




     Department 1             Department 2              Department 3
        Server                   Server                    Server




                                                                                                     Storage
                                                                                                     Network



               Server-centric Storage Architecture




                                                                                                  Storage Device
                                                                                     Information-centric Storage Architecture




EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.                                                   8
Intelligent Storage System (ISS)
                 Intelligent Storage System

          It is a feature-rich RAID array that provides highly optimized I/O processing
          capabilities.

     • Provides large amount of cache and multiple
         I/O paths that enhances the performance
     •   Has an operating environment that provides
            Intelligent cache management
            Array resource management
            Connectivity to heterogeneous hosts
     • Supports flash drive, virtual provisioning, and
         automated storage tiering
                                                                                  Intelligent Storage Array



EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.                           9
Key Components of an ISS


                                                                                  Intelligent Storage System
     Host
                                                           Front End                           Back End        Physical Disks

                                                                                    Cache
                    Connectivity
                         Storage
                         Network




EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.                                                 10
Storage Area Network
             SAN

         It is a high-speed, dedicated network of servers and shared storage devices.

     • Centralizes storage and management
     • Enables sharing of storage resources across multiple servers at
         block level
     •   Meets increasing storage demands efficiently with better
         economies of scale
     •   Common SAN deployments are:
            Fibre Channel (FC) SAN: uses FC protocol for communication
            IP SAN: uses IP-based protocols for communication




EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.         11
Understanding Fibre Channel
     • High-speed network technology
            Latest FC implementation supports speed up to 16 Gb/s
     • Highly scalable
            Theoretically, accommodate approximately 15 million devices




                                          IP
                                       Network                                    FC SAN




                   Clients                          Application Servers                    Storage Arrays




EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.                             12
Fibre Channel over IP (FCIP)
                                          Servers                                                                      Servers



            Server                                                                                Server




                                                 FCIP Gateway                          FCIP Gateway

                         FC SAN                                                                             FC SAN

                                                                                  IP




                      Storage Array                                                                        Storage Array




EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.                                                  13
Fibre Channel over Ethernet (FCoE)

                                                                                              CNA
                                                                                                    LAN Ethernet
                                                       FC HBA                                        SAN (FCoE)



                                                                  SAN (FC)




                                                                  LAN
                                                                  (Ethernet)



                                                         NIC



                                                                                              CNA



                          Without FCoE                                            With FCoE




EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.                                    14
Network Attached Storage
             NAS

         It is an IP-based, dedicated, high-performance file sharing and storage device.

     • Enables NAS clients to share files over IP network
     • Uses specialized operating system that is optimized for file I/O
     • Enables both UNIX and Windows users to share data
                                  Clients


                                                                                          LAN
               Application
                Servers

                                                                                    NAS Device



                                                                     Print Server



EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.                  15
NAS Use Case – Server and Storage Consolidation
     with NAS
               Traditional File Server Environment                                                  NAS Environment
                                Internal Users                                                              Internal Users




          Business Clients                       Surfers, Shoppers                       Business Clients                    Surfers, Shoppers




                                      IP                                                                          IP


                                                                                  NAS
                                                                                  Head
                                   Web and                                                                      Web and
                                   Database                                                                     Database
                                    Servers                                                                      Servers

       Windows                                                   UNIX
       File Server                 FC SAN                     File Server
                                                                                                                FC SAN

                         Storage                                                                      Storage




EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.                                                                  16
Business Continuity
     • Information is an organization’s most important asset
     • Continuous access to information ensures smooth functioning of
         business operations
     •   Cost of unavailability of information to an organization is greater
         than ever




EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.   17
Causes of Information Unavailability

                                                                                  Disaster (<1% of Occurrences)
                                                                                  Natural or man made
                                                                                       • Flood
                                                                                       • Fire
                                                                                       • Earthquake



                                                                                  Unplanned Outages (20%)
                                                                                  Failure
                                                                                       • Database corruption
                                                                                       • Component (physical and/or virtual) failure
                                                                                       • Human error


                                                                                  Planned Outages (80%)
                                                                                  Competing workloads
                                                                                       • Backup, reporting
                                                                                       • Data warehouse extracts
                                                                                       • Application and data restore




EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.                                                        18
Impact of Downtime
    Lost Productivity                                   Know the downtime costs (per       Lost Revenue
    • Number of employees                               hour, day, two days, and so on.)   •   Direct loss
        impacted x hours out x                                                             •   Compensatory payments
        hourly rate                                                                        •   Lost future revenue
                                                                                           •   Billing losses
                                                                                           •   Investment losses


    Damaged Reputation                                                                     Financial Performance
    •   Customers                                                                          •   Revenue recognition
    •   Suppliers                                                                          •   Cash flow
    •   Financial markets                                                                  •   Lost discounts (A/P)
    •   Banks                                                                              •   Payment guarantees
    •   Business partners                                                                  •   Credit rating
                                                                                           •   Stock price
                                        Other Expenses
                                        • Temporary employees, equipment rental, overtime
                                          costs, extra shipping costs, travel expenses, and so on.



EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.
Single Points of Failure
                Single Points of Failure

            It refers to the failure of a component of a system that can
            terminate the availability of the entire system or IT service.



                                                                                              Array port




         Client                    IP Switch                                      FC Switch
                                                                  Server                                   Storage Array




EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.                                            20
Resolving Single Points of Failure

                                                                                                                    Redundant
           Client                                                                 Redundant Ports                     Arrays
                                                        Redundant Paths



                                  NIC      HBA
                                  NIC
                                           HBA



               IP
       Redundant
        Network
                                                                        Redundant FC
                                  NIC
                                                                          Switches
                                           HBA                                                       Production              Remote
      NIC Teaming                 NIC                                                               Storage Array         Storage Array
                                           HBA


                            Clustered Servers




EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.                                                           21
Backup
               Backup

            It is an additional copy of production data that is created and retained
            for the sole purpose of recovering lost or corrupted data.


     • Organization also takes backup to comply with regulatory
         requirements
     •   Backups are performed to serve three purposes:
            Disaster recovery
            Operational recovery
            Archive




EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.        22
Replication
             Replication

            It is a process of creating an exact copy (replica) of data.


     • Replication can be classified as
            Local replication
               Replicating data within the same array
            Remote replication
               Replicating data at remote site



                                                                   REPLICATION

                                       Source                                     Replica (Target)




EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.                      23
Archive – Fixed Content
     • Fixed content is growing at more than 90% annually
             Significant amount of newly created information falls into this
              category
             New regulations require retention and data protection

                                                       Examples of Fixed Content

      Electronic Documents                                Digital Records                     Rich Media
        •   Contracts and claims                            • Documents                       • Medical
        •   Email attachments                                     • Checks, securities           • X-rays, MRIs, CT Scan
                                                                    trades
        •   Financial spread sheets
                                                                  • Historical preservation
                                                                                              • Video
        •   CAD/CAM designs                                                                      • News/media, movies
                                                            • Photographs                        • Security surveillance
        •   Presentations                                         • Personal/professional
                                                                                              • Audio
                                                            • Surveys                            • Voicemail
                                                                  • Seismic, astronomic,         • Radio
                                                                    geographic



EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.                                            24
Summary
     • Information storage and management
     • Core elements of data centers
     • Intelligent storage systems
     • Storage networking technologies
     • Business continuity solutions




EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.   25
Q&A

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.   26
Get Social @EMCAcademics




EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.
Next Session:
                Webinar : Technology
                Lecture Series : Big Data &
                Analytics
                MapReduce/Hadoop – A
                programmer’s perspective
                on
                23 Aug 2012


EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.

More Related Content

Data center Technologies

  • 1. DATA CENTER TECHNOLOGIES Sagar Patil EMC Proven Professional @sagarkotekar EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. 1
  • 2. Agenda • Information storage and management • Core elements of a data center • Intelligent storage systems • Storage networking technologies • Business continuity solutions EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.
  • 3. Why Information Storage and Management? • Information is the knowledge derived from data • Growth of digital information has resulted in information explosion • We live in an on-command, on-demand world  We need information when and where required • Increasing dependency on fast and reliable access to information • Businesses seek to store, protect, optimize, and leverage the information  To gain competitive advantage  To derive new business opportunity EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. 3
  • 4. Data Center Data Center It is a facility that contains storage, compute, network, and other IT resources to provide centralized data-processing capabilities. • Core elements of a data center  Application  Database management system (DBMS)  Host or Compute  Network  Storage • These core elements work together to address data-processing requirements EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. 4
  • 5. Data Center: Online Order Transaction System Example Host/ Storage Array Compute Client Storage LAN/WAN Network User Interface OS and DBMS EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. 5
  • 6. Host (Compute) • Resource that runs applications with the help of underlying computing components  Example: Servers, mainframes, laptop, desktops, tablets, server clusters, etc. • Consists of hardware and software components • Hardware components  Include CPU, memory, and input/output IP (I/O) devices • Software components  Include OS, device driver, file system, volume manager, and so on EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. 6
  • 7. Storage • Stores data created by individuals and organizations  Provides access to data for further processing • Examples of storage devices are:  Media card in a cell phone or digital camera  DVDs, CD-ROMs  Disk drives  Disk arrays  Tapes EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. 7
  • 8. Evolution of Storage Architecture Department 1 Department 2 Department 3 Server Server Server Department 1 Department 2 Department 3 Server Server Server Storage Network Server-centric Storage Architecture Storage Device Information-centric Storage Architecture EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. 8
  • 9. Intelligent Storage System (ISS) Intelligent Storage System It is a feature-rich RAID array that provides highly optimized I/O processing capabilities. • Provides large amount of cache and multiple I/O paths that enhances the performance • Has an operating environment that provides  Intelligent cache management  Array resource management  Connectivity to heterogeneous hosts • Supports flash drive, virtual provisioning, and automated storage tiering Intelligent Storage Array EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. 9
  • 10. Key Components of an ISS Intelligent Storage System Host Front End Back End Physical Disks Cache Connectivity Storage Network EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. 10
  • 11. Storage Area Network SAN It is a high-speed, dedicated network of servers and shared storage devices. • Centralizes storage and management • Enables sharing of storage resources across multiple servers at block level • Meets increasing storage demands efficiently with better economies of scale • Common SAN deployments are:  Fibre Channel (FC) SAN: uses FC protocol for communication  IP SAN: uses IP-based protocols for communication EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. 11
  • 12. Understanding Fibre Channel • High-speed network technology  Latest FC implementation supports speed up to 16 Gb/s • Highly scalable  Theoretically, accommodate approximately 15 million devices IP Network FC SAN Clients Application Servers Storage Arrays EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. 12
  • 13. Fibre Channel over IP (FCIP) Servers Servers Server Server FCIP Gateway FCIP Gateway FC SAN FC SAN IP Storage Array Storage Array EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. 13
  • 14. Fibre Channel over Ethernet (FCoE) CNA LAN Ethernet FC HBA SAN (FCoE) SAN (FC) LAN (Ethernet) NIC CNA Without FCoE With FCoE EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. 14
  • 15. Network Attached Storage NAS It is an IP-based, dedicated, high-performance file sharing and storage device. • Enables NAS clients to share files over IP network • Uses specialized operating system that is optimized for file I/O • Enables both UNIX and Windows users to share data Clients LAN Application Servers NAS Device Print Server EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. 15
  • 16. NAS Use Case – Server and Storage Consolidation with NAS Traditional File Server Environment NAS Environment Internal Users Internal Users Business Clients Surfers, Shoppers Business Clients Surfers, Shoppers IP IP NAS Head Web and Web and Database Database Servers Servers Windows UNIX File Server FC SAN File Server FC SAN Storage Storage EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. 16
  • 17. Business Continuity • Information is an organization’s most important asset • Continuous access to information ensures smooth functioning of business operations • Cost of unavailability of information to an organization is greater than ever EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. 17
  • 18. Causes of Information Unavailability Disaster (<1% of Occurrences) Natural or man made • Flood • Fire • Earthquake Unplanned Outages (20%) Failure • Database corruption • Component (physical and/or virtual) failure • Human error Planned Outages (80%) Competing workloads • Backup, reporting • Data warehouse extracts • Application and data restore EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. 18
  • 19. Impact of Downtime Lost Productivity Know the downtime costs (per Lost Revenue • Number of employees hour, day, two days, and so on.) • Direct loss impacted x hours out x • Compensatory payments hourly rate • Lost future revenue • Billing losses • Investment losses Damaged Reputation Financial Performance • Customers • Revenue recognition • Suppliers • Cash flow • Financial markets • Lost discounts (A/P) • Banks • Payment guarantees • Business partners • Credit rating • Stock price Other Expenses • Temporary employees, equipment rental, overtime costs, extra shipping costs, travel expenses, and so on. EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.
  • 20. Single Points of Failure Single Points of Failure It refers to the failure of a component of a system that can terminate the availability of the entire system or IT service. Array port Client IP Switch FC Switch Server Storage Array EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. 20
  • 21. Resolving Single Points of Failure Redundant Client Redundant Ports Arrays Redundant Paths NIC HBA NIC HBA IP Redundant Network Redundant FC NIC Switches HBA Production Remote NIC Teaming NIC Storage Array Storage Array HBA Clustered Servers EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. 21
  • 22. Backup Backup It is an additional copy of production data that is created and retained for the sole purpose of recovering lost or corrupted data. • Organization also takes backup to comply with regulatory requirements • Backups are performed to serve three purposes:  Disaster recovery  Operational recovery  Archive EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. 22
  • 23. Replication Replication It is a process of creating an exact copy (replica) of data. • Replication can be classified as  Local replication  Replicating data within the same array  Remote replication  Replicating data at remote site REPLICATION Source Replica (Target) EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. 23
  • 24. Archive – Fixed Content • Fixed content is growing at more than 90% annually  Significant amount of newly created information falls into this category  New regulations require retention and data protection Examples of Fixed Content Electronic Documents Digital Records Rich Media • Contracts and claims • Documents • Medical • Email attachments • Checks, securities • X-rays, MRIs, CT Scan trades • Financial spread sheets • Historical preservation • Video • CAD/CAM designs • News/media, movies • Photographs • Security surveillance • Presentations • Personal/professional • Audio • Surveys • Voicemail • Seismic, astronomic, • Radio geographic EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. 24
  • 25. Summary • Information storage and management • Core elements of data centers • Intelligent storage systems • Storage networking technologies • Business continuity solutions EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. 25
  • 26. Q&A EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. 26
  • 27. Get Social @EMCAcademics EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.
  • 28. Next Session: Webinar : Technology Lecture Series : Big Data & Analytics MapReduce/Hadoop – A programmer’s perspective on 23 Aug 2012 EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved.