Lesson 01 5day
Lesson 01 5day
Lesson 01 5day
Objectives
After completing this lesson, you should be able to: Explain the principles and purposes of clusters Describe Cluster hardware best practices Describe the Oracle Clusterware architecture Describe how Grid Plug and Play affects Clusterware Describe the Automatic Storage Management (ASM) architecture Describe the components of ASM
1-2
ASM and Oracle Clusterware are installed into a single home directory called Oracle Grid Infrastructure 11g Release 2. This directory is referred to as the Grid Infrastructure home.
1-3
1-4
What Is a Cluster?
A group of independent, but interconnected, computers that act as a single system Usually deployed to Network increase availability and Interconnect performance or Users to balance a dynamically changing workload
Storage Network
1-5
What Is Clusterware?
Software that provides various interfaces and services for a cluster. Typically, this includes capabilities that: Allow the cluster to be managed as a whole Protect the integrity of the cluster Maintain a registry of resources across the cluster Deal with changes to the cluster Provide a common view of resources
1-6
Oracle Clusterware
Oracle Clusterware is: A key part of Oracle Grid Infrastructure Integrated with Oracle Automatic Storage Management (ASM) The basis for ASM Cluster File System (ACFS) A foundation for Oracle Real Application Clusters (RAC) A generalized cluster infrastructure for all kinds of applications
1-7
1-8
1-9
Interconnect
Each node
bond0 eth2
Each node
bond0 eth2
Active
Standby
Active
Active
1 - 12
eth1
eth1
bond0 eth2
Active
Standby
1 - 14
1 - 15
Jumbo frames: Are not an Institute of Electrical and Electronics Engineers (IEEE) standard Are useful for Network-Attached Storage (NAS)/iSCSI storage Have network device interoperability concerns Need to be configured with care and tested rigorously
1 - 16
Quiz
Each cluster nodes public Ethernet adapter must support UDP or RDS. 1. True 2. False
1 - 17
1 - 18
/etc/init.d/init.ohasd
Oracle Clusterware installation modifies the /etc/inittab file to restart ohasd in the event of a crash.
Processes
crsd ocssd,cssdmonitor, cssdagent evmd, evmlogger octssd ons, eons oraagent
Owner
root grid owner, root, root grid owner root grid owner grid owner
Event Manager (EVM) Cluster Time Synchronization Service (CTSS) Oracle Notification Service (ONS) Oracle Agent
orarootagent
gnsd gpnpd mdnsd
root
root grid owner grid owner
In previous releases, adding or removing servers in a cluster required extensive manual preparation. In Oracle Database 11g Release 2, GPnP allows each node to perform the following tasks dynamically:
Negotiating appropriate network identities for itself Acquiring additional information from a configuration profile Configuring or reconfiguring itself using profile data, making host names and addresses resolvable on the network
To add a node, simply connect the server to the cluster and allow the cluster to configure the node.
1 - 22
GPnP Domain
The GPnP domain is a collection of nodes belonging to a single cluster served by the GPnP service:
Cluster name: cluster01 Network domain: example.com GPnP domain: cluster01.example.com
1 - 23
GPnP Components
Software image A software image is a read-only collection of software to be run on nodes of the same type. At a minimum, the image must contain:
An operating system The GPnP software A security certificate from the provisioning authority Other software required to configure the node when it starts up
1 - 24
GPnP Profile
The profile.xml file:
$ cat GRID_HOME/gpnp/profiles/peer/profile.xml <?xml version="1.0" encoding="UTF-8"?><gpnp:GPnP-Profile Version="1.0" xmlns="http://www.grid-pnp.org/2005/11/gpnp-profile" ... xsi:schemaLocation="http://www.grid-pnp.org/2005/11/gpnp-profile gpnp-profile.xsd" ProfileSequence="4" ClusterUId="2deb88730e0b5f1bffc9682556bd548e" ClusterName="cluster01" PALocation=""><gpnp:Network-Profile><gpnp:HostNetwork id="gen" HostName="*"><gpnp:Network id="net1" IP="192.0.2.0" Adapter="eth0" Use="public"/><gpnp:Network id="net2" IP="192.168.1.0" Adapter="eth1" Use="cluster_interconnect"/></gpnp:HostNetwork></gpnp:Network-Profile><orcl:CSS-Profile id="css" DiscoveryString="+asm" LeaseDuration="400"/><orcl:ASM-Profile id="asm" DiscoveryString="/dev/sd*" SPFile="+data/spfile.ora"/><ds:Signature <ds:SignedInfo> <ds:CanonicalizationMethod Algorithm="http://www.w3.org/2001/10/xml-exc-c14n#"/> <ds:SignatureMethod Algorithm="http://www.w3.org/2000/09/xmldsig#rsa-sha1"/> <ds:Reference URI=""> <ds:Transforms> <ds:Transform Algorithm="http://www.w3.org/2000/09/xmldsig#enveloped-signature"/> <ds:Transform Algorithm="http://www.w3.org/2001/10/xml-exc-c14n#"> <InclusiveNamespaces xmlns="http://www.w3.org/2001/10/xml-exc-c14n#" PrefixList="gpnp orcl xsi"/> ... <ds:DigestMethod Algorithm="http://www.w3.org/2000/09/xmldsig#sha1"/> <ds:DigestValue>gIBakmtUNi9EVW/XQoE1mym3Bnw=</ds:DigestValue> ... <ds:SignatureValue>cgw3yhP/2oEm5DJzdachtfDMbEr2RSfFFUlZujLemnOgsM...=</ds:SignatureValue>
1 - 25
[root@my-dns-server ~]# cat /etc/named.conf // Default initial "Caching Only" name server configuration ... # Delegate to gns on cluster01 cluster01.example.com #cluster sub-domain# NS cluster01-gns.example.com # Let the world know to go to the GNS vip cluster01-gns.example.com 192.0.2.155 # cluster GNS Address
A request to resolve cluster01-scan.cluster01.example.com would be forwarded to the GNS on 192.0.2.155. Each node in the cluster runs a multicast DNS (mDNS) process.
Copyright 2010, Oracle and/or its affiliates. All rights reserved.
1 - 26
The SCAN provides a stable, highly available name for clients to use, independent of the nodes that make up the cluster.
Copyright 2010, Oracle and/or its affiliates. All rights reserved.
1 - 27
DNS
Use 1 SCAN VIP
GNS
Register node VIP & SCAN VIP One name that resolves to three VIPs
SL LL
Node1
profile.xml
SL LL
Node2
Least loaded node for service
SL LL
Node4
Node & SCAN VIP agents orarootagent
remote_listener
LL
Node3
LL
local_listener
Client
Scan+port+service
Noden
DHCP
GPnPd discovery
GPnP mDNS
GPnP mDNS
GPnP mDNS
GPnP mDNS
mDNS
1 - 29
2. A GPnP agent is started from the nodes Clusterware home. 3. The GPnP agent either gets its profile locally or from one of the peer GPnP agents that responds. 4. Shared storage is configured to match profile requirements. 5. Service startup is specified in the profile, which includes:
Grid Naming Service for external names resolution Single client access name (SCAN) listener
1 - 31
Database client
Listener1
Listener2
Listener3
1 - 32
Quiz
The init.ohasd entry in the /etc/inittab file is responsible for: 1. Starting Oracle Clusterware when the node boots 2. Mounting shared volumes as required by Oracle Clusterware 3. Managing node evictions 4. Restarting ohasd in the event of a crash
1 - 33
Quiz
Which of the following statements regarding Grid Naming Service is not true? 1. GNS is an integral component of Grid Plug and Play. 2. Each node in the cluster runs a multicast DNS (mDNS) process. 3. The GNS virtual IP address must be assigned by DHCP. 4. The cluster subdomain is defined as a delegated domain.
1 - 34
1 - 35
Application
File system
Application
ASM
Logical Volume Manager
1 - 36
Application
Database
ACFS ASM/ADVM
Operating System
3rd Party FS
1 - 37
1 - 39
ASM instance
ASM instance 1
ASM instance 2
ASM instance 3
ASM instance 4
ASM instance 1
ASM instance 2
ASM instance 3
Database servers
SYSDBA
Access to data stored on ASM Create and delete files Grant and revoke file access
SYSOPER
OSOPER for ASM Limited privileges to start and stop the ASM instance along with a set of nondestructive ALTER DISKGROUP commands
The SYS user on ASM is automatically created with the SYSASM privilege.
Copyright 2010, Oracle and/or its affiliates. All rights reserved.
1 - 43
For
ASM
ASM ASM Both DB DB
Example OS Group
asmadmin
asmdba asmoper oinstall dba oper
Privilege
SYSASM
SYSDBA SYSOPER
SYSDBA SYSOPER
1 - 44
REMOTE_LOGIN_PASSWORDFILE must be set to a value other than NONE to enable remote password-based authentication.
1 - 46
1 - 47
Role/Software
Oracle ASM administrator/Oracle Grid Infrastructure home Database administrator 1/Database home 1 Database administrator 2/Database home 2 Operating system disk device owner
Software Owner
oracle oracle oracle oracle
Groups/Privileges
dba/SYSASM, SYSDBA, SYSOPER dba/SYSASM, SYSDBA, SYSOPER dba/SYSASM, SYSDBA, SYSOPER dba
1 - 48
Oracle ASM administrator grid Oracle Grid Infrastructure home Database administrator 1 Database home 1 Database administrator 2 Database home 2 Operating system disk device owner oracle1
oracle2
grid
1 - 49
1 - 50
Use a common ORACLE_BASE for all Oracle products owned by the same user. Use an isolated ORACLE_HOME location from other Oracle products even if they are the same version. Do not place Grid ORACLE_HOME below ORACLE_BASE. ORACLE_HOME requires 3 GB to 5 GB of disk space.
Copyright 2010, Oracle and/or its affiliates. All rights reserved.
Shared pool
Large pool
ASM cache
Free memory
1 - 51
1 - 53
1 - 54
1 - 55
1 - 56
1 - 57
1 - 59
Are named when added to a disk group using a different name than the operating system device name May use different operating system device names on different nodes in a cluster for the same ASM disk Are divided into allocation units (AU) with sizes 1, 2, 4, 8, 16, 32, or 64 MB allowed
Copyright 2010, Oracle and/or its affiliates. All rights reserved.
Are stored as a set or collection of data extents Are striped across all disks in a disk group Use names that begin with a plus sign (+), which are automatically generated or from user-defined aliases
Copyright 2010, Oracle and/or its affiliates. All rights reserved.
1 - 60
ASM stripes files using extents with a coarse method for load balancing or a fine method to reduce latency. Coarse-grained striping is always equal to the effective AU size. Fine-grained striping is always equal to 128 KB.
1 - 61
High redundancy
Three-way
1 - 62
Oracle DB C instance
OCR
ADVM
Mounted ACFS
1 - 63
1 - 64
ASM Scalability
ASM imposes the following limits: 63 disk groups in a storage system 10,000 ASM disks in a storage system Two-terabyte maximum storage for each ASM disk (nonExadata) Four-petabyte maximum storage for each ASM disk (Exadata) 40-exabyte maximum storage for each storage system 1 million files for each disk group ASM file size limits (database limit is 128 TB):
External redundancy maximum file size is 140 PB. Normal redundancy maximum file size is 42 PB. High redundancy maximum file size is 15 PB.
1 - 65
Summary
In this lesson, you should have learned how to: Explain the principles and purposes of clusters Describe Cluster hardware best practices Describe the Oracle Clusterware architecture Describe how Grid Plug and Play affects Clusterware Describe the ASM architecture Describe the components of ASM
1 - 66