installation-and-configuration-guide-exadata-database-machine-dbmin
installation-and-configuration-guide-exadata-database-machine-dbmin
25.1
F29249-36
January 2025
Oracle Exadata Database Machine Installation and Configuration Guide for Exadata Database Machine, 25.1
F29249-36
Contributors: Doug Archambault, Leo Agranonik, Andrew Babb, Nilesh Choudhury, Henry Chow, Ravindra Dani, Boris
Erlikhman, Jaime Figueroa, Roger Hansen, Leslie Keller, Frank Kobylanski, René Kundersma, Holger Leister, Yang Liu,
Juan Loaiza, Barb Lundhild, Catherine Luu, Philip Newlan, Dan Norris, Michael Nowak, Gavin Parish, Hector Pujol,
Dmitry Potapov, Darryl Presley, Ashish Ray, Richard Scales, Oliver Sharwood, Jia Shi, Kesavan Srinivasan, Krishnadev
Telikicherla, Cliff Thomas, Alex Tsukerman, Kothanda Umamageswaran, Doug Utzig, Zheren Zhang, Alex Blyth,
Gautam Bhatt
This software and related documentation are provided under a license agreement containing restrictions on use and
disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or
allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit,
perform, publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation
of this software, unless required by law for interoperability, is prohibited.
The information contained herein is subject to change without notice and is not warranted to be error-free. If you find
any errors, please report them to us in writing.
If this is software, software documentation, data (as defined in the Federal Acquisition Regulation), or related
documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, then
the following notice is applicable:
U.S. GOVERNMENT END USERS: Oracle programs (including any operating system, integrated software, any
programs embedded, installed, or activated on delivered hardware, and modifications of such programs) and Oracle
computer documentation or other Oracle data delivered to or accessed by U.S. Government end users are "commercial
computer software," "commercial computer software documentation," or "limited rights data" pursuant to the applicable
Federal Acquisition Regulation and agency-specific supplemental regulations. As such, the use, reproduction,
duplication, release, display, disclosure, modification, preparation of derivative works, and/or adaptation of i) Oracle
programs (including any operating system, integrated software, any programs embedded, installed, or activated on
delivered hardware, and modifications of such programs), ii) Oracle computer documentation and/or iii) other Oracle
data, is subject to the rights and limitations specified in the license contained in the applicable contract. The terms
governing the U.S. Government's use of Oracle cloud services are defined by the applicable contract for such services.
No other rights are granted to the U.S. Government.
This software or hardware is developed for general use in a variety of information management applications. It is not
developed or intended for use in any inherently dangerous applications, including applications that may create a risk of
personal injury. If you use this software or hardware in dangerous applications, then you shall be responsible to take all
appropriate fail-safe, backup, redundancy, and other measures to ensure its safe use. Oracle Corporation and its
affiliates disclaim any liability for any damages caused by use of this software or hardware in dangerous applications.
Oracle®, Java, MySQL, and NetSuite are registered trademarks of Oracle and/or its affiliates. Other names may be
trademarks of their respective owners.
Intel and Intel Inside are trademarks or registered trademarks of Intel Corporation. All SPARC trademarks are used
under license and are trademarks or registered trademarks of SPARC International, Inc. AMD, Epyc, and the AMD logo
are trademarks or registered trademarks of Advanced Micro Devices. UNIX is a registered trademark of The Open
Group.
This software or hardware and documentation may provide access to or information about content, products, and
services from third parties. Oracle Corporation and its affiliates are not responsible for and expressly disclaim all
warranties of any kind with respect to third-party content, products, and services unless otherwise set forth in an
applicable agreement between you and Oracle. Oracle Corporation and its affiliates will not be responsible for any loss,
costs, or damages incurred due to your access to or use of third-party content, products, or services, except as set forth
in an applicable agreement between you and Oracle.
Contents
Preface
Audience xii
Documentation Accessibility xii
Diversity and Inclusion xii
Related Documentation xii
Conventions xiv
iii
1.2.14 General Environmental Requirements for Oracle Exadata Storage Expansion
Rack X3-2 1-21
1.2.15 General Environmental Requirements for Oracle Exadata Storage Expansion
Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers 1-22
1.2.16 General Environmental Requirements for Single Servers 1-23
1.3 Space Requirements 1-29
1.3.1 Space Requirements for Racks up to Oracle Exadata X6 1-30
1.4 Receiving, Unpacking, and Access Route Requirements 1-30
1.4.1 Rack Weights for Oracle Exadata 1-31
1.4.2 Rack Weights for Oracle Exadata Storage Expansion Rack 1-32
1.5 Maintenance Access Requirements 1-33
1.6 Flooring Requirements 1-34
1.7 Electrical Power Requirements 1-34
1.7.1 PDU Power Requirements 1-35
1.7.1.1 Low-Voltage 15 kVA Single Phase PDU for North America, South America,
Japan and Taiwan 1-36
1.7.1.2 Low-Voltage 22 kVA Single Phase PDU for North America, South America,
Japan and Taiwan 1-36
1.7.1.3 Low-Voltage 15 kVA Three Phase PDU for North America, South America,
Japan and Taiwan 1-37
1.7.1.4 Low-Voltage 24 kVA Three Phase PDU for North America, South America,
Japan and Taiwan 1-37
1.7.1.5 High-Voltage 15 kVA Single Phase PDU for Europe, the Middle East and
Africa (EMEA), and Asia Pacific (APAC), except for Japan and Taiwan 1-38
1.7.1.6 High-Voltage 22 kVA Single Phase PDU for Europe, the Middle East and
Africa (EMEA), and Asia Pacific (APAC), except for Japan and Taiwan 1-39
1.7.1.7 High-Voltage 15 kVA Three Phase PDU for Europe, the Middle East and
Africa (EMEA), and Asia Pacific (APAC), except for Japan and Taiwan 1-39
1.7.1.8 High-Voltage 24 kVA Three Phase PDU for Europe, the Middle East and
Africa (EMEA), and Asia Pacific (APAC), except for Japan and Taiwan 1-40
1.7.2 Facility Power Requirements 1-41
1.7.3 Circuit Breaker Requirements 1-41
1.7.4 Electrical Grounding Guidelines 1-41
1.8 Temperature and Humidity Requirements 1-42
1.9 Ventilation and Cooling Requirements 1-43
1.10 Network Connection and IP Address Requirements for Oracle Exadata Rack 1-44
1.10.1 Network Connection Requirements for Oracle Exadata Rack 1-44
1.10.2 DNS Configuration for Oracle Exadata Rack 1-45
1.10.3 IP Address Requirements for Oracle Exadata Rack 1-46
1.10.4 Secure Fabric Requirements for Oracle Exadata 1-48
iv
2.3 Network Partitioning on Oracle Exadata 2-4
2.3.1 VLAN Support on Customer-Facing Networks 2-4
2.3.2 Access VLAN Support with RoCE Network Fabric 2-5
2.3.3 Using Exadata Secure RDMA Fabric Isolation 2-6
2.3.4 Using InfiniBand Partitioning for Network Isolation with InfiniBand Network Fabric 2-8
2.4 Configuring a Separate Network for ILOM 2-9
2.5 Default IP Addresses 2-10
2.6 Default Port Assignments 2-10
v
4.3.5 CLUSTER 4-19
4.3.5.1 ALTER CLUSTER 4-19
4.3.5.2 CREATE CLUSTER 4-22
4.3.5.3 DESTROY CLUSTER 4-23
4.3.5.4 DOWNGRADE CLUSTER 4-24
4.3.5.5 LIST CLUSTER 4-25
4.3.5.6 LIST CLUSTERS 4-26
4.3.5.7 UPGRADE CLUSTER 4-26
4.3.6 COMPUTE 4-29
4.3.6.1 CLONE COMPUTE 4-29
4.3.6.2 DELETE COMPUTE 4-32
4.3.7 CURRENTACTION 4-33
4.3.7.1 CLEAR CURRENTACTION 4-34
4.3.7.2 LIST CURRENTACTION 4-34
4.3.8 DATABASE 4-34
4.3.8.1 ADD DATABASE 4-34
4.3.8.2 ALTER DATABASE 4-37
4.3.8.3 DELETE DATABASE 4-39
4.3.8.4 LIST DATABASES 4-40
4.3.9 DATABASEHOME 4-41
4.3.9.1 ADD DATABASEHOME 4-41
4.3.9.2 ALTER DATABASEHOME 4-44
4.3.9.3 DELETE DATABASEHOME 4-45
4.3.9.4 LIST DATABASEHOMES 4-46
4.3.10 DISKGROUP 4-47
4.3.10.1 ADD DISKGROUP 4-47
4.3.10.2 ALTER DISKGROUP 4-49
4.3.10.3 ALTER DISKGROUPS 4-52
4.3.10.4 DELETE DISKGROUP 4-53
4.3.10.5 LIST DISKGROUPS 4-54
4.3.11 DOM0 4-54
4.3.11.1 LIST DOM0S 4-54
4.3.12 DOMAIN 4-55
4.3.12.1 GET DOMAIN 4-55
4.3.13 ES 4-56
4.3.13.1 ALTER ES 4-56
4.3.13.2 DISCOVER ES 4-56
4.3.13.3 VALIDATE ES 4-57
4.3.14 EXASCALE 4-57
4.3.14.1 DEPLOY EXASCALE 4-57
4.3.15 EXASCALECLUSTER 4-58
4.3.15.1 ADD EXASCALECLUSTER 4-58
vi
4.3.15.2 ALTER EXASCALECLUSTER 4-59
4.3.15.3 DELETE EXASCALECLUSTER 4-60
4.3.15.4 LIST EXASCALECLUSTER 4-60
4.3.15.5 LIST EXASCALECLUSTERS 4-60
4.3.16 EXITONERROR 4-60
4.3.16.1 SET EXITONERROR 4-61
4.3.17 FILE 4-61
4.3.17.1 LOAD FILE 4-61
4.3.17.2 MERGE FILES 4-61
4.3.17.3 SAVE FILE 4-62
4.3.17.4 SAVE FILES 4-62
4.3.18 GUEST 4-62
4.3.18.1 CLONE GUEST 4-63
4.3.18.2 DELETE GUEST 4-66
4.3.19 ILOM 4-67
4.3.19.1 ALTER ILOM 4-67
4.3.19.2 LIST ILOMS 4-68
4.3.20 LOGIN 4-68
4.3.20.1 CHECK LOGIN 4-68
4.3.21 MACHINE 4-69
4.3.21.1 ALTER MACHINE 4-69
4.3.21.2 ALTER MACHINES 4-72
4.3.21.3 LIST MACHINES 4-73
4.3.22 NETWORK 4-74
4.3.22.1 ADD NETWORK 4-74
4.3.22.2 ALTER NETWORK 4-76
4.3.22.3 ALTER NETWORKS 4-77
4.3.22.4 DELETE NETWORK 4-78
4.3.22.5 LIST NETWORKS 4-79
4.3.23 PASSWORD 4-79
4.3.23.1 ALTER PASSWORD 4-79
4.3.24 PROPERTY 4-80
4.3.24.1 ALTER PROPERTY 4-80
4.3.24.2 LIST PROPERTIES 4-81
4.3.25 RACK 4-81
4.3.25.1 ADD RACK 4-81
4.3.25.2 ALTER RACK 4-82
4.3.25.3 LIST RACKS 4-83
4.3.25.4 LIST RACKDESCRIPTION 4-83
4.3.26 REQUIREDFILES 4-83
4.3.26.1 LIST REQUIREDFILES 4-83
4.3.27 REMOTE 4-84
vii
4.3.27.1 EXEC REMOTE 4-84
4.3.28 SCAN 4-84
4.3.28.1 ADD SCAN 4-85
4.3.28.2 ALTER SCAN 4-85
4.3.28.3 DELETE SCAN 4-86
4.3.28.4 LIST SCANS 4-86
4.3.29 SECURITY 4-87
4.3.29.1 SET SECURITY 4-87
4.3.30 SOFTWAREVERSIONS 4-87
4.3.30.1 LIST SOFTWAREVERSIONS 4-88
4.3.31 SSHKEYS 4-88
4.3.31.1 DEPLOY SSHKEYS 4-88
4.3.31.2 GENERATE SSHKEYS 4-89
4.3.31.3 SET SSHKEYS 4-90
4.3.32 STEPS 4-90
4.3.32.1 LIST STEPS 4-90
4.3.33 STORAGEPOOL 4-92
4.3.33.1 ADD STORAGEPOOL 4-92
4.3.33.2 ALTER STORAGEPOOL 4-93
4.3.33.3 DELETE STORAGEPOOL 4-94
4.3.33.4 LIST STORAGEPOOL 4-94
4.3.33.5 LIST STORAGEPOOLS 4-95
4.3.34 STORAGETEMPLATES 4-95
4.3.34.1 LIST STORAGETEMPLATES 4-95
4.3.35 SWITCH 4-95
4.3.35.1 ADD SWITCH 4-96
4.3.35.2 ALTER SWITCH 4-96
4.3.35.3 LIST SWITCHES 4-97
4.3.36 SU 4-97
4.3.36.1 SET SU 4-98
4.3.37 ULOC 4-98
4.3.37.1 LIST ULOC 4-98
4.3.38 VAULT 4-98
4.3.38.1 ADD VAULT 4-99
4.3.38.2 ALTER VAULT 4-99
4.3.38.3 DELETE VAULT 4-100
4.3.38.4 LIST VAULT 4-101
4.3.38.5 LIST VAULTS 4-101
4.3.39 VIP 4-101
4.3.39.1 ADD VIP 4-102
4.3.39.2 ALTER VIP 4-102
4.3.39.3 DELETE VIP 4-103
viii
4.3.39.4 LIST VIPS 4-103
4.3.40 VOLUME 4-104
4.3.40.1 ADD VOLUME 4-104
4.3.40.2 DELETE VOLUME 4-105
4.3.40.3 LIST VOLUMES 4-105
4.3.41 XMLACTION 4-105
4.3.41.1 ALTER XMLACTION 4-106
4.3.41.2 DELETE XMLACTION 4-106
4.3.41.3 LIST XMLACTION 4-106
4.3.41.4 LIST XMLACTIONS 4-106
ix
6.6.2.2 PDU Thresholds for Oracle Exadata Database Machine X4-2 Half Rack 6-31
6.6.2.3 PDU Thresholds for Oracle Exadata Database Machine X4-2 Quarter
Rack 6-32
6.6.3 PDU Thresholds for Oracle Exadata Database Machine X3-2 6-34
6.6.3.1 PDU Thresholds for Oracle Exadata Database Machine X3-2 Full Rack 6-34
6.6.3.2 PDU Thresholds for Oracle Exadata Database Machine X3-2 Half Rack 6-36
6.6.3.3 PDU Thresholds for Oracle Exadata Database Machine X3-2 Quarter
Rack 6-37
6.6.4 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 M2
and X4270 M2 servers) 6-39
6.6.4.1 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170
M2 and X4270 M2 servers) Full Rack 6-39
6.6.4.2 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170
M2 and X4270 M2 servers) Half Rack 6-41
6.6.4.3 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170
M2 and X4270 M2 servers) Quarter Rack 6-42
6.6.5 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 and
X4275 servers) 6-44
6.6.5.1 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170
and X4275 servers) Full Rack 6-44
6.6.5.2 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170
and X4275 servers) Half Rack 6-46
6.6.5.3 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170
and X4275 servers) Quarter Rack 6-47
6.6.6 PDU Thresholds for Oracle Exadata Database Machine X4-8 and Later 6-49
6.6.7 PDU Thresholds for Oracle Exadata Database Machine X3-8 Full Rack 6-49
6.6.8 PDU Thresholds for Oracle Exadata Database Machine X2-8 Full Rack 6-51
6.6.9 PDU Thresholds for Oracle Exadata Storage Expansion Rack with Exadata
Storage Server with Sun Fire X4270 M2 Servers 6-53
6.6.9.1 PDU Thresholds for Oracle Exadata Storage Expansion Full Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers 6-53
6.6.9.2 PDU Thresholds for Oracle Exadata Storage Expansion Half Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers 6-55
6.6.9.3 PDU Thresholds for Oracle Exadata Storage Expansion Quarter Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers 6-56
6.7 Checking Exadata Storage Servers 6-58
6.8 Checking Oracle Exadata Database Servers 6-61
6.9 Performing Additional Checks and Configuration 6-65
6.10 Verifying the RoCE Network Fabric Configuration 6-66
6.11 Verifying the InfiniBand Network Fabric Network 6-67
6.12 Imaging a New System 6-68
6.12.1 Using ISO Images to Image a New System 6-69
6.12.2 Using Elastic Configuration to Image a New System 6-71
6.12.3 Using ISO to Image a New System 6-73
6.12.4 Using PXE to Image a New System 6-79
x
6.12.4.1 Using PXE to Image a New System Using Release 12.1.2.2.0 or Later 6-79
6.12.4.2 Using PXE to Image a New System for Releases Earlier than 12.1.2.2.0 6-84
6.12.5 Updates to Imaging Parameters 6-87
6.13 Performing Initial Elastic Configuration of Oracle Exadata 6-88
6.14 Adding Additional Elastic Nodes to an Existing Rack 6-94
6.15 Using the OEDA setuprootssh Utility 6-95
6.16 Loading the Configuration Information and Installing the Software 6-96
6.16.1 Configuring Oracle Exadata Database Machine Using OEDA 6-96
6.16.2 Using Oracle Exadata Deployment Assistant in Conjunction with Key-Based
Authentication 6-99
6.16.3 Using Oracle Exadata Deployment Assistant on Systems with Non-Default root
Passwords 6-100
6.17 Using the OEDA changePassword Utility 6-101
6.18 Installing Oracle Enterprise Manager Cloud Control 6-101
6.19 Adding a VM Cluster to Oracle Exadata Database Machine Using OEDA 6-102
A Site Checklists
A.1 System Components Checklist A-2
A.2 Data Center Room Checklist A-3
A.3 Data Center Environment Checklist A-4
A.4 Access Route Checklist A-6
A.5 Facility Power Checklist A-8
A.6 Safety Checklist A-9
A.7 Logistics Checklist A-10
A.8 Network Configuration Checklist A-13
A.9 Auto Service Request Checklist A-14
A.10 Re-racking Checklists A-15
A.11 PDU Checklist for Re-racking A-18
A.12 Recycling the Racks A-19
xi
Preface
Preface
This guide describes Oracle Exadata Database Machine for online transaction processing
(OLTP) and enterprise data warehousing. It includes information about site planning and
configuration, as well as physical, electrical, and environmental specifications.
• Audience
• Documentation Accessibility
• Diversity and Inclusion
• Related Documentation
• Conventions
Audience
This guide is intended for Oracle Exadata Database Machine customers and those responsible
for data center site planning, configuration, and maintenance of Oracle Exadata Database
Machine.
Documentation Accessibility
For information about Oracle's commitment to accessibility, visit the Oracle Accessibility
Program website at http://www.oracle.com/pls/topic/lookup?ctx=acc&id=docacc.
Related Documentation
The following guides contain additional information for Oracle Exadata:
Oracle Exadata System Guides
xii
Preface
xiii
Preface
• Sun Server X2-8 (formerly Sun Fire X4800 M2) Service Manual at http://
docs.oracle.com/cd/E20815_01/html/E20819/index.html
• Sun Fire X4800 Server Service Manual at http://docs.oracle.com/cd/E19140-01/html/
821-0282/index.html
• Sun Fire X4270 M2 Server Service Manual at http://docs.oracle.com/cd/E19245-01/
E21671/index.html
• Sun Fire X4170 M2 Server Service Manual at http://docs.oracle.com/cd/E19762-01/
E22369-02/index.html
• Sun Fire X4170, X4270, and X4275 Servers Service Manual at http://
docs.oracle.com/cd/E19477-01/820-5830-13/index.html
• Sun Datacenter InfiniBand Switch 36 Firmware Version 2.1 Documentation at http://
docs.oracle.com/cd/E36265_01/index.html
• Sun Datacenter InfiniBand Switch 36 Firmware Version 2.2 Documentation at http://
docs.oracle.com/cd/E76424_01/index.html
• Sun Flash Accelerator F20 PCIe Card User's Guide at http://docs.oracle.com/cd/
E19682-01/E21358/index.html
• Sun Flash Accelerator F40 PCIe Card User's Guide at http://docs.oracle.com/cd/
E29748_01/html/E29741/index.html
• Sun Flash Accelerator F80 PCIe Card User's Guide at http://docs.oracle.com/cd/
E41278_01/html/E41251/index.html
• Oracle Flash Accelerator F160 PCIe Card User Guide at http://docs.oracle.com/cd/
E54943_01/html/E54947/index.html
• Oracle Flash Accelerator F320 PCIe Card User Guide at http://docs.oracle.com/cd/
E65386_01/html/E65387/index.html
• Oracle Flash Accelerator F640 PCIe Card User Guide at https://docs.oracle.com/cd/
E87231_01/html/E87233/index.html
• Sun Storage 6 Gb SAS PCIe RAID HBA Documentation at http://docs.oracle.com/cd/
E19221-01/
• Oracle Storage 12 Gb/s SAS PCIe RAID HBA, Internal Documentation Library at http://
docs.oracle.com/cd/E52363_01/index.html
• Oracle Integrated Lights Out Manager (ILOM) Documentation at http://www.oracle.com/
goto/ilom/docs
• "Cisco Catalyst 4948E and 4948E-F Ethernet Switches Data Sheet" at https://
www.cisco.com/c/en/us/products/collateral/switches/catalyst-4948e-ethernet-
switch/data_sheet_c78-598933.html
• "Cisco Nexus 9300-EX and 9300-FX Platform Switches Data Sheet at https://
www.cisco.com/c/en/us/products/collateral/switches/nexus-9000-series-switches/
datasheet-c78-736651.html"
Conventions
The following text conventions are used in this document:
xiv
Preface
Convention Meaning
boldface Boldface type indicates graphical user interface
elements associated with an action, or terms
defined in text or the glossary.
italic Italic type indicates book titles, emphasis, or
placeholder variables for which you supply
particular values.
monospace Monospace type indicates commands within a
paragraph, URLs, code in examples, text that
appears on the screen, or text that you enter.
$ prompt The dollar sign ($) prompt indicates a command
run as the oracle user.
# prompt The pound (#) prompt indicates a command that is
run as the root user.
xv
1
Site Requirements for Oracle Exadata and
Oracle Exadata Storage Expansion Rack
This chapter describes the site requirements for Oracle Exadata and Oracle Exadata Storage
Expansion Rack.
Note:
For ease of reading, the name "Oracle Exadata Rack" is used when information
refers to both Oracle Exadata and Oracle Exadata Storage Expansion Rack.
1-1
Chapter 1
General Environmental Requirements
1-2
Chapter 1
General Environmental Requirements
1-3
Chapter 1
General Environmental Requirements
1-4
Chapter 1
General Environmental Requirements
Table 1-2 Environmental Requirements for Oracle Exadata Database Machine X5-8
1-5
Chapter 1
General Environmental Requirements
Table 1-2 (Cont.) Environmental Requirements for Oracle Exadata Database Machine
X5-8
Table 1-3 Environmental Requirements for Oracle Exadata Database Machine X4-2
1-6
Chapter 1
General Environmental Requirements
Table 1-3 (Cont.) Environmental Requirements for Oracle Exadata Database Machine
X4-2
1-7
Chapter 1
General Environmental Requirements
Table 1-3 (Cont.) Environmental Requirements for Oracle Exadata Database Machine
X4-2
1-8
Chapter 1
General Environmental Requirements
Table 1-4 Environmental Requirements for Oracle Exadata Database Machine X4-8
Racks with Exadata Storage Server X5-2 Servers
1-9
Chapter 1
General Environmental Requirements
Table 1-4 (Cont.) Environmental Requirements for Oracle Exadata Database Machine
X4-8 Racks with Exadata Storage Server X5-2 Servers
Table 1-5 Environmental Requirements for Oracle Exadata Database Machine X4-8 Full
Rack
1-10
Chapter 1
General Environmental Requirements
Table 1-5 (Cont.) Environmental Requirements for Oracle Exadata Database Machine
X4-8 Full Rack
Table 1-6 Environmental Requirements for Oracle Exadata Database Machine X3-2
1-11
Chapter 1
General Environmental Requirements
Table 1-6 (Cont.) Environmental Requirements for Oracle Exadata Database Machine
X3-2
1-12
Chapter 1
General Environmental Requirements
Table 1-6 (Cont.) Environmental Requirements for Oracle Exadata Database Machine
X3-2
1-13
Chapter 1
General Environmental Requirements
Table 1-7 Environmental Requirements for Oracle Exadata Database Machine X3-8 Full
Rack with Exadata Storage Server X4-2L Servers
1-14
Chapter 1
General Environmental Requirements
Table 1-8 Environmental Requirements for Oracle Exadata Database Machine X3-8 Full
Rack with Exadata Storage Server X3-2 Servers
1-15
Chapter 1
General Environmental Requirements
Table 1-9 Environmental Requirements for Oracle Exadata Database Machine X2-2
1-16
Chapter 1
General Environmental Requirements
Table 1-9 (Cont.) Environmental Requirements for Oracle Exadata Database Machine
X2-2
Table 1-10 Environmental Requirements for Oracle Exadata Database Machine X2-8
Full Rack
1-17
Chapter 1
General Environmental Requirements
Table 1-10 (Cont.) Environmental Requirements for Oracle Exadata Database Machine
X2-8 Full Rack
Table 1-11 Environmental Requirements for Oracle Exadata Storage Expansion Rack
X5-2
1-18
Chapter 1
General Environmental Requirements
Table 1-11 (Cont.) Environmental Requirements for Oracle Exadata Storage Expansion
Rack X5-2
1-19
Chapter 1
General Environmental Requirements
Table 1-12 Environmental Requirements for Oracle Exadata Storage Expansion Rack
X4-2
1-20
Chapter 1
General Environmental Requirements
Table 1-12 (Cont.) Environmental Requirements for Oracle Exadata Storage Expansion
Rack X4-2
Table 1-13 Environmental Requirements for Oracle Exadata Storage Expansion Rack
X3-2
1-21
Chapter 1
General Environmental Requirements
Table 1-13 (Cont.) Environmental Requirements for Oracle Exadata Storage Expansion
Rack X3-2
Table 1-14 Environmental Requirements for Oracle Exadata Storage Expansion Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers
1-22
Chapter 1
General Environmental Requirements
Table 1-14 (Cont.) Environmental Requirements for Oracle Exadata Storage Expansion
Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers
Table 1-15 Environmental Requirements for Oracle Exadata X11M Single Servers
1-23
Chapter 1
General Environmental Requirements
Table 1-15 (Cont.) Environmental Requirements for Oracle Exadata X11M Single
Servers
Table 1-16 Environmental Requirements for Oracle Exadata X10M Single Servers
1-24
Chapter 1
General Environmental Requirements
Table 1-16 (Cont.) Environmental Requirements for Oracle Exadata X10M Single
Servers
1-25
Chapter 1
General Environmental Requirements
1-26
Chapter 1
General Environmental Requirements
1-27
Chapter 1
General Environmental Requirements
1-28
Chapter 1
Space Requirements
Table 1-23 Environmental Requirements for 8-Socket Servers, Model X4-8 and Later
1-29
Chapter 1
Receiving, Unpacking, and Access Route Requirements
The space surrounding the cabinet must not restrict the movement of cool air between the air
conditioner and the front of the systems within the cabinet, or the movement of hot air coming
out of the rear of the cabinet.
• Space Requirements for Racks up to Oracle Exadata X6
All racks up to Oracle Exadata X6-2 and X6-8 use the same hardware rack, and have the
same space requirements.
Related Topics
• Oracle Exadata Configuration Assistant (OECA) Downloads
1-30
Chapter 1
Receiving, Unpacking, and Access Route Requirements
Caution:
Prior to moving the rack, always make sure that all four leveling and stabilizing feet
are raised and out of the way.
1-31
Chapter 1
Receiving, Unpacking, and Access Route Requirements
Related Topics
• Oracle Exadata Configuration Assistant (OECA) Downloads
1-32
Chapter 1
Maintenance Access Requirements
Related Topics
• Oracle Exadata Configuration Assistant (OECA) Downloads
1-33
Chapter 1
Flooring Requirements
Table 1-25 Maintenance Access Requirements for Oracle Exadata Rack (All Models)
Note:
• In raised floor data centers, an adjacent tile at the rear of the rack must be able
to be opened to access any cabling going under the floor.
• Oracle Exadata Racks can be placed side-by-side when interconnecting the
racks.
Description Requirement
Maximum allowable weight of installed rack 952.5 kg (2100 lbs)
equipment
Maximum allowable weight of installed power 52.16 kg (115 lbs)
distribution units
Maximum dynamic load (maximum allowable 1004.66 kg (2215 lbs)
weight of installed equipment including PDUs)
Note:
If you want to route data or power cables through the bottom of the rack, you can cut
out a rectangular hole in the floor below the rear portion of the rack. However, avoid
creating a hole that impacts the rack casters or leveling feet. For details, see Floor
Cutout Dimensions in Oracle Rack Cabinet 1242 User's Guide.
1-34
Chapter 1
Electrical Power Requirements
Damage may occur if the ranges are exceeded. Electrical disturbances such as the following
may damage Oracle Exadata Rack:
• Fluctuations caused by brownouts
• Wide and rapid variations in input voltage levels or in input power frequency
• Electrical storms
• Faults in the distribution system, such as defective wiring
To protect Oracle Exadata Rack from such disturbances, you should have a dedicated power
distribution system, power-conditioning equipment, as well as lightning arresters or power
cables to protect from electrical storms.
• PDU Power Requirements
Each Oracle Exadata Rack configuration contains two power distribution units (PDUs).
Various PDUs are available to cater for different circumstances. Select the correct PDU for
your data center and Oracle Exadata Rack configuration.
• Facility Power Requirements
To prevent catastrophic failures, design the input power sources to ensure adequate power
is provided to the PDUs.
• Circuit Breaker Requirements
If computer equipment is subjected to repeated power interruptions and fluctuations, then it
is susceptible to a higher rate of component failure.
• Electrical Grounding Guidelines
The cabinets for Oracle Exadata Rack are shipped with grounding-type power cords.
1-35
Chapter 1
Electrical Power Requirements
1.7.1.1 Low-Voltage 15 kVA Single Phase PDU for North America, South America,
Japan and Taiwan
Note:
The following specifications are for a single PDU. Every Oracle Exadata Rack
configuration contains two PDUs.
Table 1-27 Specifications for each Low-Voltage 15 kVA Single Phase PDU for North
America, South America, Japan and Taiwan
Specification Value
Number of Inputs 3
Source Voltage 200-240V
Frequency 50/60 Hz
Max Line Current 24A
Phase Current N/A
Nominal Power Rating 15kVA
Recommended Circuit Breaker 30A
Outlets 42 x C13, 6 x C19
Outlet Groups 6
Max Group Current 20A
Output Voltage 200-240V
Data Center Receptacle 1ph 2W + ground 30A NEMA L6-30
1.7.1.2 Low-Voltage 22 kVA Single Phase PDU for North America, South America,
Japan and Taiwan
Note:
The following specifications are for a single PDU. Every Oracle Exadata Rack
configuration contains two PDUs.
Table 1-28 Specifications for each Low-Voltage 22 kVA Single Phase PDU for North
America, South America, Japan and Taiwan
Specification Value
Number of Inputs 3
Source Voltage 200-240V
Frequency 50/60 Hz
Max Line Current 36.8A
Phase Current N/A
Nominal Power Rating 22kVA
Recommended Circuit Breaker 50A
1-36
Chapter 1
Electrical Power Requirements
Table 1-28 (Cont.) Specifications for each Low-Voltage 22 kVA Single Phase PDU for
North America, South America, Japan and Taiwan
Specification Value
Outlets 42 x C13, 6 x C19
Outlet Groups 6
Max Group Current 20A
Output Voltage 200-240V
Data Center Receptacle 1ph 2W + ground 30A NEMA L6-30
1.7.1.3 Low-Voltage 15 kVA Three Phase PDU for North America, South America,
Japan and Taiwan
Note:
The following specifications are for a single PDU. Every Oracle Exadata Rack
configuration contains two PDUs.
Table 1-29 Specifications for each Low-Voltage 15 kVA Three Phase PDU for North
America, South America, Japan and Taiwan
Specification Value
Number of Inputs 1
Source Voltage 200-220V
Frequency 50/60 Hz
Max Line Current 40A
Phase Current 23A
Nominal Power Rating 15kVA
Recommended Circuit Breaker 50A
Outlets 42 x C13, 6 x C19
Outlet Groups 6
Max Group Current 20A
Output Voltage 200-240V
Data Center Receptacle 3ph 3W + ground 60A IEC60309
1.7.1.4 Low-Voltage 24 kVA Three Phase PDU for North America, South America,
Japan and Taiwan
Note:
The following specifications are for a single PDU. Every Oracle Exadata Rack
configuration contains two PDUs.
1-37
Chapter 1
Electrical Power Requirements
Table 1-30 Specifications for each Low-Voltage 24 kVA Three Phase PDU for North
America, South America, Japan and Taiwan
Specification Value
Number of Inputs 2
Source Voltage 200-220V
Frequency 50/60 Hz
Max Line Current 34.6A
Phase Current 20A
Nominal Power Rating 24kVA
Recommended Circuit Breaker 50A
Outlets 42 x C13, 6 x C19
Outlet Groups 6
Max Group Current 20A
Output Voltage 200-240V
Data Center Receptacle 3ph 3W + ground 60A IEC60309
1.7.1.5 High-Voltage 15 kVA Single Phase PDU for Europe, the Middle East and
Africa (EMEA), and Asia Pacific (APAC), except for Japan and Taiwan
Note:
The following specifications are for a single PDU. Every Oracle Exadata Rack
configuration contains two PDUs.
Table 1-31 Specifications for each High-Voltage 15 kVA Single Phase PDU for Europe,
the Middle East and Africa (EMEA), and Asia Pacific (APAC), except for Japan and
Taiwan
Specification Value
Number of Inputs 3 x 25A 1ph
Voltage 220 - 240 VAC
Frequency 50/60 Hz
Current 25A maximum (per input)
Power Rating 15 kVA
Output Current 72A (3 x 24A)
Outlets 42 x C13, 6 x C19
Outlet Groups 6
Group Protection (UL489 1-pole circuit breaker) 20A
Data Center Receptacle IEC309 32A 3 PIN 250 VAC IP44
1-38
Chapter 1
Electrical Power Requirements
Note:
The high-voltage 15 kVA single phase PDU is no longer available. The high-voltage
22kVA single phase PDU is the recommended replacement.
1.7.1.6 High-Voltage 22 kVA Single Phase PDU for Europe, the Middle East and
Africa (EMEA), and Asia Pacific (APAC), except for Japan and Taiwan
Note:
The following specifications are for a single PDU. Every Oracle Exadata Rack
configuration contains two PDUs.
Table 1-32 Specifications for each High-Voltage 22 kVA Single Phase PDUs for Europe,
the Middle East and Africa (EMEA), and Asia Pacific (APAC), except for Japan and
Taiwan
Specification Value
Number of Inputs 3
Source Voltage 200-240V
Frequency 50/60 Hz
Max Line Current 32A
Phase Current N/A
Nominal Power Rating 22kVA
Recommended Circuit Breaker 30A
Outlets 42 x C13, 6 x C19
Outlet Groups 6
Max Group Current 20A
Output Voltage 200-240V
Data Center Receptacle 1ph 2W + ground 32A IEC60309 3P 6H 230V
1.7.1.7 High-Voltage 15 kVA Three Phase PDU for Europe, the Middle East and
Africa (EMEA), and Asia Pacific (APAC), except for Japan and Taiwan
Note:
The following specifications are for a single PDU. Every Oracle Exadata Rack
configuration contains two PDUs.
1-39
Chapter 1
Electrical Power Requirements
Table 1-33 Specifications for each High-Voltage 15 kVA Three Phase PDU for Europe,
the Middle East and Africa (EMEA), and Asia Pacific (APAC), except for Japan and
Taiwan
Specification Value
Number of Inputs 1
Source Voltage 220/380 - 240/415VAC 3Ø
Frequency 50/60 Hz
Max Line Current 21A
Phase Current 21A
Nominal Power Rating 15kVA
Recommended Circuit Breaker 25A
Outlets 42 x C13, 6 x C19
Outlet Groups 6
Max Group Current 20A
Output Voltage 220-240V
Data Center Receptacle 3ph 4W + ground 32A IEC60309 5P 6h 400V
1.7.1.8 High-Voltage 24 kVA Three Phase PDU for Europe, the Middle East and
Africa (EMEA), and Asia Pacific (APAC), except for Japan and Taiwan
Note:
The following specifications are for a single PDU. Every Oracle Exadata Rack
configuration contains two PDUs.
Table 1-34 Specifications for each High-Voltage 24 kVA Three Phase PDU for Europe,
the Middle East and Africa (EMEA), and Asia Pacific (APAC), except for Japan and
Taiwan
Specification Value
Number of Inputs 2
Source Voltage 220/380 - 240/415VAC 3Ø
Frequency 50/60 Hz
Max Line Current 16A
Phase Current 16A
Nominal Power Rating 24kVA
Recommended Circuit Breaker 25A
Outlets 42 x C13, 6 x C19
Outlet Groups 6
Max Group Current 18A
Output Voltage 220-240V
Data Center Receptacle 3ph 4W + ground 32A IEC60309 5P 6h 400V
1-40
Chapter 1
Electrical Power Requirements
Note:
Electrical work and installations must comply with applicable local, state, or national
electrical codes. Contact your facilities manager or qualified electrician to determine
what type of power is supplied to the building.
PDU power cords are 4 meters (13.12 feet) long, and 1 to 1.5 meters (3.3 to 4.9 feet) of the
cord is routed within the rack cabinet. The installation site AC power receptacle must be within
2 meters (6.6 feet) of the rack.
Note:
Electrical work and installations must comply with applicable local, state, or national
electrical codes.
1-41
Chapter 1
Temperature and Humidity Requirements
Note:
Studies have shown that temperature increases of 10 degrees Celsius (15 degrees
Fahrenheit) above 20 degrees Celsius (70 degrees Fahrenheit) reduce long-term
electronics reliability by 50 percent.
The following table lists the temperature, humidity and altitude requirements for operating and
non-operating machines.
Set conditions to the optimal temperature and humidity ranges to minimize the chance of
downtime due to component failure. Operating Oracle Exadata Rack for extended periods at or
near the operating range limits, or installing it in an environment where it remains at or near
non-operating range limits could significantly increase hardware component failure.
The ambient temperature range of 21 to 23 degrees Celsius (70 to 74 degrees Fahrenheit) is
optimal for server reliability and operator comfort. Most computer equipment can operate in a
wide temperature range, but near 22 degrees Celsius (72 degrees Fahrenheit) is desirable
because it is easier to maintain safe humidity levels. Operating in this temperature range
provides a safety buffer in the event that the air conditioning system goes down for a period of
time.
The ambient relative humidity range of 45 to 50 percent is suitable for safe data processing
operations. Most computer equipment can operate in a wide range (20 to 80 percent), but the
range of 45 to 50 percent is recommended for the following reasons:
• Optimal range helps protect computer systems from corrosion problems associated with
high humidity levels.
1-42
Chapter 1
Ventilation and Cooling Requirements
• Optimal range provides the greatest operating time buffer in the event of air conditioner
control failure.
• This range helps avoid failures or temporary malfunctions caused by intermittent
interference from static discharges that may occur when relative humidity is too low.
Electrostatic discharge (ESD) is easily generated, and hard to dissipate in areas of low relative
humidity, such as below 35 percent. ESD becomes critical when humidity drops below 30
percent. It is not difficult to maintain humidity in a data center because of the high-efficiency
vapor barrier and low rate of air changes normally present.
1-43
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Rack
Figure 1-1 shows a typical installation of the floor tiles for Oracle Exadata Database Machine
Full Rack in a typical data center.
Figure 1-1 Typical Data Center Configuration for Perforated Floor Tiles
1-44
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Rack
The same requirements apply to Oracle Exadata Storage Expansion Rack. However, since
Oracle Exadata Storage Expansion Rack contains no database servers, there are no
corresponding database server uplink requirements.
Related Topics
• Understanding the Network Requirements for Oracle Exadata
Review the network requirements for Oracle Exadata before installing or configuring the
hardware.
1-45
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Rack
All addresses registered in DNS must be configured for both forward resolution and reverse
resolution. Reverse resolution must be forward confirmed (forward-confirmed reverse DNS)
such that both the forward and reverse DNS entries match each other.
Note:
During configuration using OEDA, Grid Naming Service (GNS) is not configured on
Oracle Exadata Database Machine.
See Also:
1-46
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Rack
1-47
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Rack
Related Topics
• Single Client Access Name (SCAN)
• Using Oracle Exadata Deployment Assistant
1-48
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Rack
Commencing with the October 2024 Oracle Exadata System Software release updates
(24.1.5, 23.1.19, and 22.1.28), the option to enable Secure Fabric is selected by default for
all new configurations using VM clusters.
See Using the Browser-based Version of Oracle Exadata Deployment Assistant.
Related Topics
• Using Exadata Secure RDMA Fabric Isolation
1-49
2
Understanding the Network Requirements for
Oracle Exadata
Review the network requirements for Oracle Exadata before installing or configuring the
hardware.
Note:
For ease of reading, the name "Oracle Exadata Rack" is used when information
refers to both Oracle Exadata and Oracle Exadata Storage Expansion Rack.
2-1
Chapter 2
Overview of Network Requirements
Manager (ILOM) interfaces, and RDMA Network Fabric switches to the Management
Network Switch in the rack. One uplink is required from the Management Network Switch
to your management network.
Each database server and storage server has two network interfaces for administration.
One interface provides management access to the operating system through a dedicated
Ethernet port. The other network interface is dedicated to ILOM. By default, Oracle
Exadata is delivered with both interfaces connected to the Management Network Switch.
Cabling or configuration changes to these interfaces is not permitted, except that starting
with Oracle Exadata System Software release 19.1.0, the ILOM interfaces can be
connected to a dedicated ILOM network, which is separate from the administration
network. The administration network interfaces on the database servers should not be
used for client or application network traffic.
Notes:
• Client Network: This required network connects the database servers to your existing
client network and is used for client access to the database servers. Applications access
databases through this network using Single Client Access Name (SCAN) and Oracle RAC
Virtual IP (VIP) addresses. Database servers support channel bonding to provide higher
bandwidth or availability for client connections to the database. Non-bonded network
configurations are not supported on Oracle Exadata X7 and later systems.
• Private Network: Also known as the RDMA Network Fabric, storage network, or
interconnect. This network connects the database servers and storage servers. Oracle
Database uses this network for Oracle RAC cluster interconnect traffic and for accessing
data on the Oracle Exadata Storage Servers. The private network is automatically
configured during installation. It is non-routable, fully contained in Oracle Exadata, and
does not connect to your existing networks.
Starting with Oracle Exadata X8M, the private network uses RDMA over Converged
Ethernet (RoCE).
Previously, the private network was built using InfiniBand technology. RoCE Network
Fabric uses different switches and cables from those used by InfiniBand Network Fabric.
• Additional Networks: Database servers can optionally connect to additional networks
using the available open ports not used by the administration network and the client
network.
By using the OEDA Web user interface, you can create up to two additional networks. In
OEDA, the first additional network is known as the Backup Network, and the second
additional network is known as the Other Network. You can create more additional
networks by using the OEDA command-line interface (OEDACLI).
Like the client network, the additional networks support channel bonding to maximize
bandwidth and availability. Non-bonded network configurations are not supported on
Oracle Exadata X7 and later systems.
2-2
Chapter 2
Network Channel Bonding Support
The following diagram displays how the various Oracle Exadata components connect to the
different networks.
Additional Network(s)
Client Network
Administration Network
RDMA Network
Fabric Switch
RDMA Network
Fabric Switch
Related Topics
• Using Oracle Exadata Deployment Assistant
• Hardware Components of Oracle Exadata Database Machine
2-3
Chapter 2
Network Partitioning on Oracle Exadata
bonded interface name for the second additional network, also known in OEDA as the
Other Network, is bondeth2, and so on.
• The XML configuration file generated by OEDA includes detailed information that maps the
bonded network interfaces to the underlying Ethernet ports.
• During the initial configuration using OEDA, the Linux bonding module is configured to use
active-backup mode (mode=active-backup) by default. Additional configuration of other
bonding parameters is allowed but is outside the scope of installation services and must be
performed by customer network engineers. Reconfiguration to enable a different bonding
policy is permitted but is discouraged.
For further details, refer to the "Linux Ethernet Bonding Driver HOWTO" at https://
www.kernel.org/doc/Documentation/networking/bonding.txt.
• You must provide network infrastructure (switches) capable of supporting the chosen
bonding mode. For example, if Link Aggregation Control Protocol (LACP) is enabled
(mode=802.3ad), then you must supply and configure the network switches accordingly.
Requirements for specific bonding policies are documented in the "Linux Ethernet Bonding
Driver HOWTO" at https://www.kernel.org/doc/Documentation/networking/bonding.txt
2-4
Chapter 2
Network Partitioning on Oracle Exadata
Notes:
• Oracle Exadata Deployment Assistant (OEDA) supports VLAN tagging for both
physical and VM deployments.
• Network VLAN tagging is supported for Oracle Real Application Clusters (Oracle
RAC) on the public network.
• Client and backup VLAN networks must be bonded. The administration network
is never bonded.
• If the backup network is on a tagged VLAN network, the client network must also
be on a separate tagged VLAN network.
• The backup and client networks can share the same network cables.
• VLAN tagging on the client and backup networks is supported with IPv4 and IPv6
on all hardware models. For IPv6 support on Oracle Database version 12.1.0.2,
and later, patch 22289350 is also required.
• VM deployments do not support IPv6 VLANs.
• VLAN tagging on the administration network is only supported with IPv4
addresses on X3-2 and above for two-socket servers, and X4-8 and above for
eight-socket servers.
• If the client network uses VLAN tagging and your system uses more than 10
Oracle Clusterware virtual IP (VIP) addresses, then you must use 3-digit VLAN
IDs. Do not use 4-digit VLAN IDs because the VLAN name can exceed the
operating system interface name limit, which is the 15 characters.
Related Topics
• Implementing InfiniBand Partitioning across Oracle VM Oracle RAC Clusters on Oracle
Exadata
• Enabling 802.1Q VLAN Tagging in Exadata Database Machine over client networks (My
Oracle Support Doc ID 1423676.1)
• Implementing Tagged VLAN Interfaces in Oracle VM Environments on Exadata (My Oracle
Support Doc ID 2018550.1)
• Implementing Tagged VLAN Interfaces in KVM based Oracle VM Environments on
Exadata (My Oracle Support Doc ID 2710712.1)
2-5
Chapter 2
Network Partitioning on Oracle Exadata
• Database servers 1 and 2, and storage servers 1, 2, and 3 using VLAN ID 3888
• Database servers 3 and 4, and storage servers 4, 5, 6, and 7 using VLAN ID 3889
Switch
2-6
Chapter 2
Network Partitioning on Oracle Exadata
Exadata Secure RDMA Fabric Isolation uses RoCE VLANs to ensure that a VM cluster cannot
see network packets from another VM cluster. Secure Fabric uses a double VLAN tagging
system, where one tag identifies the network partition and the other tag specifies the
membership level of the server in the partition. Within each network partition, a partition
member with full membership can communicate with all other partition members, including
other full and limited members. Partition members with limited membership cannot
communicate with other limited membership partition members. However, a partition member
with limited membership can communicate with other full membership partition members.
With Secure Fabric, each database cluster uses a dedicated network partition and VLAN ID for
cluster networking between the database servers, which supports Oracle Real Application
Clusters (Oracle RAC) inter-node messaging. In this partition, all of the database servers are
full members. They can communicate freely within the partition but cannot communicate with
database servers in other partitions.
Another partition, with a separate VLAN ID, supports the storage network partition. The storage
servers are full members in the storage network partition, and every database server VM is
also a limited member. By using the storage network partition:
• Each database server can communicate with all of the storage servers.
• Each storage server can communicate with all of the database servers that they support.
• Storage servers can communicate directly with each other to perform cell-to-cell
operations.
The following diagram illustrates the network partitions that support Exadata Secure RDMA
Fabric Isolation. In the diagram, the line connecting the Sales VMs illustrates the Sales cluster
network. The Sales cluster network is the dedicated network partition that supports cluster
communication between the Sales VMs. The line connecting the HR VMs illustrates the HR
cluster network. The HR cluster network is another dedicated network partition that supports
cluster communication between the HR VMs. The lines connecting the database server VMs
(Sales and HR) to the storage servers illustrate the storage network. The storage network is
the shared network partition that supports communications between the database server VMs
and the storage servers. But, it does not allow communication between the Sales and HR
clusters.
2-7
Chapter 2
Network Partitioning on Oracle Exadata
As illustrated in the diagram, each database server (KVM host) can support multiple VMs in
separate database clusters. However, Secure Fabric does not support configurations where
one database server contains multiple VMs belonging to the same database cluster. In other
words, using the preceding example, one database server cannot support multiple Sales VMs
or multiple HR VMs.
To support the cluster network partition and the storage network partition, each database
server VM is plumbed with 4 virtual interfaces:
• clre0 and clre1 support the cluster network partition.
• stre0 and stre1 support the storage network partition.
Corresponding stre0 and stre1 interfaces are also plumbed on each storage server.
On each server, the RoCE network interface card acts like a switch on the hypervisor, which
performs VLAN tag enforcement. Since this is done at the KVM host level, cluster isolation
cannot be bypassed by any software exploits or misconfiguration on the database server VMs.
You can only enable Secure Fabric as part of the initial system deployment using Oracle
Exadata Deployment Assistant (OEDA). You cannot enable Secure Fabric on an existing
system without wiping the system and re-deploying it using OEDA. When enabled, Secure
Fabric applies to all servers and clusters that share the same RoCE Network Fabric.
To use Secure Fabric you must:
1. Configure the RoCE Network Fabric switch hardware to enable Secure Fabric. After you
complete the switch configuration, the leaf switch ports become trunk ports, which can
carry network traffic with multiple VLAN IDs.
The switch configuration must occur before initial system deployment using OEDA. See
Configuring the RoCE Network Fabric Switches to Enable Exadata Secure RDMA Fabric
Isolation.
2. As part of initial system deployment using OEDA, select the option to enable Secure Fabric
and specify VLAN IDs for the cluster and storage network partitions associated with each
VM cluster.
In the OEDA Web user interface, the option to enable Secure Fabric is one of the
advanced options associated with the Cluster Networks page. When the option to enable
Secure Fabric is selected, the Cluster Networks page automatically displays additional
fields to specify the VLAN IDs required to configure Secure Fabric.
Commencing with the October 2024 Oracle Exadata System Software release updates
(24.1.5, 23.1.19, and 22.1.28), the option to enable Secure Fabric is selected by default for
all new configurations using VM clusters.
See Using the Browser-based Version of Oracle Exadata Deployment Assistant.
2-8
Chapter 2
Configuring a Separate Network for ILOM
With Oracle Exadata, each database cluster uses a dedicated network partition for cluster
networking between the database servers. All of the database servers can communicate freely
within the partition, other but cannot communicate with database servers in other partitions.
Another partition enables communication between each database cluster and the storage
servers. By using this partition, database servers can communicate with all of the storage
servers, storage servers can communicate with all of the database servers that they support,
and storage servers can communicate directly with each other to perform cell-to-cell
operations.
You can use InfiniBand partitioning on physical or virtual machine (VM) deployments.
For details see Configuring InfiniBand Partitioning.
A new section appears on the page, with the heading of ILOM. In this area you specify the
information required to configure the ILOM network.
3. Provide the required values for the ILOM network:
• Gateway
• Start IP Address
• Subnet Mask
• Domain Name
4. Optional: If you do not want to use the default names and values for the ILOM network,
click the Modify Masks button and customize the network settings.
2-9
Chapter 2
Default IP Addresses
Note:
Prior to connecting Oracle Exadata to the network, ensure these IP addresses do not
conflict with other addresses on the network. Use the checkip.sh script generated by
Oracle Exadata Deployment Assistant (OEDA) to check for conflicts. You run the
checkip.sh script on the network after the DNS entries for the Oracle Exadata have
been created, but before the Oracle Exadata is configured or connected to the
network. Oracle recommends running the script to avoid configuration delays, even if
a check was performed as part of planning process before the machine was
delivered. See Verifying the Network Configuration Prior to Configuring the Rack.
If you run OEDA on a Microsoft Windows system, then the generated script is
checkip.bat.
2-10
Chapter 2
Default Port Assignments
2-11
Chapter 2
Default Port Assignments
2-12
Chapter 2
Default Port Assignments
2-13
Chapter 2
Default Port Assignments
2-14
Chapter 2
Default Port Assignments
See Also:
Managing Oracle Database Port Numbers in Oracle Real Application Clusters
Installation Guide for Linux and UNIX.
2-15
3
Using Oracle Exadata Deployment Assistant
This chapter describes how to use the Oracle Exadata Deployment Assistant, which is not only
used for Exadata but also Zero Data Loss Recovery Appliance and other Oracle Engineered
Systems. The information that you enter in it is used to create the Recovery Appliance
configuration files. These files work with installation utility to automate the installation process.
• Overview of Oracle Exadata Deployment Assistant
Use Oracle Exadata Deployment Assistant (OEDA) to specify the system configuration
details and drive the system configuration processes.
• Getting Started with the OEDA Browser-based User Interface
The OEDA application server is available for Linux, OSX and Windows.
• Using the Browser-based Version of Oracle Exadata Deployment Assistant
Note:
For ease of reading, Oracle Exadata Rack is used when information refers to both
Oracle Exadata and Oracle Exadata Storage Expansion Rack.
You can also use the OEDA command-line interface (OEDACLI) to perform Oracle Exadata
Rack life-cycle management tasks.
You can download the latest version of OEDA from Exadata Database Machine and Exadata
Storage Server Supported Versions (Doc ID 888828.1). OEDA is also available on Oracle
Technology Network.
In addition to Oracle Exadata Rack, OEDA is also used for Oracle Zero Data Loss Recovery
Appliance and Oracle SuperCluster.
Oracle Exadata System Software release 19.1.0 introduced the Web-based interface for
OEDA, which replaces the previous Java-based user interface as the graphical user interface
for configuring Oracle Exadata Rack.
The following outlines how OEDA is used during the implementation of Oracle Exadata Rack:
• Before your engineered system arrives, do the following:
1. Work with your network and database administrators to evaluate the current network
settings, such as current IP address use and network configuration. OEDA supports
IPv6 addresses.
3-1
Chapter 3
Overview of Oracle Exadata Deployment Assistant
2. Define the settings for the rack, such as network configuration and backup method.
3. Download the latest version of OEDA from Oracle Technology Network.
4. Unzip and run the configuration script on a supported platform, and select the type of
system to configure.
5. Go through every page in OEDA and supply values for all required fields. You cannot
advance to the next page if you do not supply all of the required values. You must
provide naming details and DNS, NTP, and networking details.
6. At the end of the dialogue with OEDA, configuration files are generated on the client.
The files are also listed at the bottom of the InstallationTemplate.html file that is
generated by OEDA. Depending on your engineered system and configuration, OEDA
generates all or some of the following files:
– databasemachine.xml
– CustomerName-rackname.xml
– CustomerName-rackname-preconf_GUID.csv
– CustomerName-rackname-InstallationTemplate.html
– CustomerName-rackname-platinum.csv
– CustomerName-rackname-checkip.sh
– CustomerName-rackname.zip
– pkey_GUID.csv and pkey_racknamehostname_GUID.csv — if you enabled
InfiniBand partitioning for your virtual environments
The CustomerName-hostname.zip file contains all the generated files.
7. Review the InstallationTemplate.html file to check the entire configuration and
verify all information was entered correctly.
• Shortly before your engineered system arrives, or is scheduled to be configured, validate
the network configuration, as directed by Oracle. See Verifying the Network Configuration
Prior to Configuring the Rack.
• After your engineered system arrives, the configuration files are copied to a database
server, and the validation and installation is completed. See Configuring Oracle Exadata
Database Machine Using OEDA.
• Considerations and Requirement for Using OEDA
Review this information before using Oracle Exadata Deployment Assistant (OEDA).
3-2
Chapter 3
Overview of Oracle Exadata Deployment Assistant
Note:
The rack prefix can contain a maximum of 20 letters and numbers. Spaces and
symbols are not permitted; for example, exclamation (!), hyphen (-), and so on.
In you have multiple racks, then, each rack prefix should be a unique value that identifies
the rack. Oracle recommends using dbm01 for the first rack, dbm02 for the second, dbm03 for
the third, and so on.
• If you configure Oracle Exadata with storage management using Oracle Automatic Storage
Management (Oracle ASM), the backup method and redundancy protection levels you use
determine how to size the Oracle ASM disk groups that are created during installation.
– If you configure internal backups, then the database backups are created on disk in
the Fast Recovery Area in the RECO disk group for the database. The Fast Recovery
Area also contains Archived Redo Logs and Flashback Log Files. The division of disk
space between the DATA disk group and the RECO disk group is 40% and 60%,
respectively.
– If you configure external backups, then database backups are created on disk or tape
media that is external to currently deployed Oracle Exadata. The Fast Recovery Area
contains only objects such as Archived Redo Logs and Flashback Log Files.
Because you do not need to reserve additional space in the RECO disk group for
backups, the division of disk space between the DATA disk group and the RECO disk
group is now 80% and 20%, respectively.
• If you configure Oracle Exadata with storage management using Oracle Automatic Storage
Management (Oracle ASM), Oracle recommends the use of high redundancy disk groups
for mission critical applications. Use the following guidelines to assist in sizing the disk
groups based on the redundancy levels for the disk groups:
3-3
Chapter 3
Getting Started with the OEDA Browser-based User Interface
• A valid time zone name is required when installing Oracle Exadata. Time zone values
provided for Oracle Exadata and Oracle Linux comes from the Time Zone Database. You
must specify a valid time zone name for each server using the TZ environment variable.
The variable value is of the form Area/Location. For example, America/New_York is a valid
TZ value; EST, EDT, and UTC-4 are invalid values.
• OEDA configures all Exadata components, including the database servers (with or without
virtualization), storage servers, and the RDMA Network Fabric. For successful
configuration, OEDA requires access to:
– The client and administration network interfaces on the database servers, including the
VM server host and the VM guests where applicable.
– The administration network interfaces on the storage servers.
– The administration network interfaces on the RDMA Network Fabric switches.
Ensure that you run the OEDA deployment phase on a host with access to all of the
required network interfaces.
Related Topics
• iana Time Zone Database
• Maximum Availability with Oracle ASM
Note:
The OEDA Web-based interface is supported only on Chrome and Firefox browsers.
To set up the OEDA application server and start the Web-based user interface, perform the
following steps.
1. Download the latest OEDA release from My Oracle Support note 888828.1 and copy the
archive to the system where you want to run the OEDA application server.
2. On the system where you want to run the OEDA application server, extract the contents of
the downloaded compressed file. The extracted contents is written to a directory based on
the operating system, such as linux-x64, macosx-x64, or windows-i586. This is referred to
as the OEDA_HOME directory.
3. Launch the OEDA application server (located in the OEDA_HOME directory).
• On Linux, OSX, and UNIX run:
3-4
Chapter 3
Using the Browser-based Version of Oracle Exadata Deployment Assistant
In the command:
• -p port-number — optionally specifies the port number for the OEDA application
server.
If not specified, the default port number is 7072. However, you can specify any unused
port number. It is not recommended to use port numbers less than 1024.
• -g — optionally specifies that the OEDA application server accepts connections on all
available network interfaces.
If not specified, the OEDA application server only listens on the localhost interface
(127.0.0.1).
You can run the installOedaServer program using a non-privileged OS user account. You
do not need to be logged in as an OS administrator.
When you run the installOedaServer program, previous OEDA application server
instances are stopped and removed before starting the latest OEDA application server
version.
4. Access the OEDA Web-based user interface.
After you start the OEDA application server, you can access the Web-based interface by
opening a browser and entering the following URL:
http://host-name:port-number/oeda
In the URL:
• host-name is the application server host name.
• port-number is the network port number that you specified when starting the
installOedaServer program. For example, 7072.
If you did not specify the -g option when starting the OEDA application server, then you
must run the browser on the same host as the OEDA application server and specify
localhost as the application server host name.
3-5
Chapter 3
Using the Browser-based Version of Oracle Exadata Deployment Assistant
Note:
In a virtualized configuration, each Exadata database server may only contain a
limited number of VMs up to the supported maximum.
For Exadata X8M-2 and later systems, see Oracle Linux KVM Deployment
Specifications and Limits. Otherwise, see Oracle VM Deployment Specifications
and Limits.
3. Enter the administration network and private network information on the Rack Networks
page.
4. Specify the configuration of database server operating system users and groups on the
Users page.
You can choose between a Default, Role Separated, or Custom configuration.
5. Configure the Exascale cluster and storage pool on the Exascale page.
6. Define the Oracle Grid Infrastructure (GI) clusters on the Clusters page.
Each cluster definition specifies the database and storage servers that are associated with
the cluster.
In a virtualized configuration, each cluster definition also specifies the CPU and memory
resources allocated to each VM. You can also customize the configuration of the guest
user filesystem (/u01) and optionally add others (/u02, and so on).
7. Define the Oracle ASM disk group layout on the Diskgroups page.
8. Specify the Oracle Database home information for each Oracle home on the Database
Home page.
9. Specify databases and their attributes on the Database page.
3-6
Chapter 3
Using the Browser-based Version of Oracle Exadata Deployment Assistant
Note:
To create databases on Exadata, Oracle recommends using Oracle Exadata
Deployment Assistant (OEDA) or the OEDA Command Line Utility (OEDACLI),
as both utilities implement the latest Exadata best-practice configuration settings
for your Exadata system configuration. The Oracle Database Configuration
Assistant (DBCA) is also available in the Oracle Database software bundle.
However, DBCA is not recommended for new database creation on Exadata
because it does not integrate with the OEDA XML configuration file and may not
implement the recommended Exadata-specific configuration settings.
Note:
Commencing with the October 2024 Oracle Exadata System Software release
updates (24.1.5, 23.1.19, and 22.1.28), the option to enable Secure Fabric is
selected by default for all new configurations using VM clusters. To configure
Secure Fabric, you must also specify VLAN IDs for the private network partitions
on the Cluster Networks page.
11. Configure the email alerts, SNMP alerts, Auto Service Request, Oracle Config Manager,
and Enterprise Manager alerting on the Alerting page.
12. Answer the configuration questionnaire and provide additional information about the
deployment in the text field on the Comments page. Information entered in this field
appears at the bottom of the InstallationTemplate.html file.
13. Click Save and Download to create the configuration files. You are prompted to choose a
location in which to save a ZIP file to your local computer.
14. Copy the ZIP file to a directory on the first database server in Oracle Exadata Rack. Use a
subdirectory of /u01, such as the /u01/oeda directory. These files are used by the field
engineer to configure the Oracle Exadata Rack.
3-7
4
OEDA Command Line Interface
When you run the oedacli program, it starts the OEDA command line interface.
Note:
To create databases on Exadata, Oracle recommends using Oracle Exadata
Deployment Assistant (OEDA) or the OEDA Command Line Utility (OEDACLI),
as both utilities implement the latest Exadata best-practice configuration settings
for your Exadata system configuration. The Oracle Database Configuration
Assistant (DBCA) is also available in the Oracle Database software bundle.
However, DBCA is not recommended for new database creation on Exadata
because it does not integrate with the OEDA XML configuration file (es.xml)
and may not implement the recommended Exadata-specific configuration
settings.
See ADD DATABASE.
OEDACLI supports life cycle management tasks for Oracle Exadata systems only. OEDACLI
does not support life cycle management operations on Oracle SuperCluster and Oracle Zero
Data Loss Recovery Appliance (ZDLRA).
OEDACLI allows you to update an existing Exadata configuration file (es.xml). The updates
are called Actions. An Action is a single atomic task.
An Action can have many sub commands, however most actions are single commands.
Examples of multi-command steps are - CLONE GUEST and CLONE CELL
4-1
Chapter 4
About the OEDA Command Line Interface
2. Modify an in-memory version of the es.xml. Specify the additional actions to perform
during deployment. For example, to clone an Oracle VM guest to a new guest:
3. After you have provided all the commands for an action, save the action to a list of actions
to be processed within the command line interface. At this point, the data in the es.xml
file is not yet updated.
SAVE ACTION
4. Merge the actions into the main body of the in-memory copy of the es.xml using the
FORCE keyword.
5. Save the memory copy of the es.xml, overwriting the input file or writing to a new file that
you specify.
4-2
Chapter 4
Starting the OEDACLI Utility
SAVE ACTION
4. Merge the actions into the main body of the in-memory copy of the es.xml.
MERGE ACTIONS
5. Deploy the actions into the main body of the es.xml file. This step will perform the
specified actions such as creating the new Oracle VM guest.
DEPLOY ACTIONS
6. Save the memory copy of the es.xml, overwriting the input file or writing to a new file that
you specify.
Prerequisites
To use oedacli, you must meet the following requirements:
• Download the August 2017 release or later of OEDA. The August 2017 release of OEDA is
only supported on Oracle Linux.
• Have the original OEDA configuration XML file used for deployment
• Use the default password on the nodes in the cluster (for the root, oracle and grid users)
Note:
If your environment does not use the default passwords for the specified users, then
refer to My Oracle Support Doc ID 2163751.1.
4-3
Chapter 4
Starting the OEDACLI Utility
File Path
The directory that contains the unzipped files from the OEDA download. For
example /u01/joc/linux-x64.
Syntax
./oedacli
Usage Notes
To display the help output, use one of the following:
• HELP
• HELP command name
oedacli> HELP
HELP [topic]
Available Objects:
ACFSVOLUME
LIST ACFSVOLUMES
CELL
LIST CELLS
CLUSTER
LIST CLUSTERS
DISKGROUP
LIST DISKGROUPS
DATABASE
LIST DATABASES
DATABASEHOME
LIST DATABASEHOMES
DOM0
LIST DOM0S
GUEST
CLONE GUEST
DELETE GUEST
4-4
Chapter 4
Starting the OEDACLI Utility
LIST GUESTS
ILOM
LIST ILOMS
MACHINE
LIST MACHINES
NETWORK
LIST NETWORKS
SCAN
LIST SCANS
SWITCH
LIST SWITCHES
VIP
LIST VIPS
CLI COMMANDS
LOAD FILE
SAVE FILE
SAVE FILES
LIST XMLACTIONS
SAVE ACTION
MERGE ACTIONS
DEPLOY ACTIONS
Example 4-2 Help Output for the OEDACLI ALTER DATABASE command
This example shows how to display the syntax for the ALTER DATABASE command of
OEDACLI. The help output is shown for the 18c (18.1.0) release.
Purpose:
Alters an existing database
Arguments:
<blocksize> : Default: 8192, not required for PDB
<characterset> : Default: AL32UTF8, not required for PDB
<datadg> : *The DATA diskgroup, not required for PDB
<dblang> : Default: all_langs, not required for PDB
4-5
Chapter 4
OEDACLI Command Reference
4-6
Chapter 4
OEDACLI Command Reference
• FILE
You can manage the Engineered System XML file (es.xml).
• GUEST
You can clone or delete an Oracle VM guest.
• ILOM
You can alter or list the ILOMS in the loaded es.xml file.
• LOGIN
You can check remote login to a machine or cluster.
• MACHINE
You can alter or list the machines in the es.xml file.
• NETWORK
You can add, alter, delete, or list the networks defined in the XML configuration file.
• PASSWORD
You can specify the default passwords.
• PROPERTY
You can set OEDA properties.
• RACK
You can manage an Engineered System rack.
• REQUIREDFILES
You can display information about required files.
• REMOTE
You can run a command on a remote host.
• SCAN
You can add, alter, delete, or list the SCANs for a cluster.
• SECURITY
You can manage security settings.
• SOFTWAREVERSIONS
You can check supported software versions.
• SSHKEYS
You can generate and deploy SSH keys for root user authentication on Oracle Exadata
Rack.
• STEPS
You can display the steps for a virtual CREATE CLUSTER deployment.
• STORAGEPOOL
• STORAGETEMPLATES
• SWITCH
You can display and manage the switches.
• SU
Controls use of the su command.
• ULOC
You can display the location of rack items.
• VAULT
• VIP
You can add, alter, delete, or list the Oracle Clusterware VIPs.
4-7
Chapter 4
OEDACLI Command Reference
• VOLUME
You can display and manage storage volumes.
• XMLACTION
You can manage actions relating to the Engineered System XML file.
4.3.1 ACFSVOLUME
You can add, alter, delete, or list Oracle ACFS volumes.
• ADD ACFSVOLUME
• ALTER ACFSVOLUME
• DELETE ACFSVOLUME
• LIST ACFSVOLUMES
Syntax
ADD ACFSVOLUME
VOLUMENAME=volume_name
VOLUMESIZE=volume_size
MOUNTPATH=mount_path
WHERE
{ DISKGROUPID=diskgroup_id |
CLUSTERNUMBER=cluster_number DISKGROUPNAME=diskgroup_name |
CLUSTERNAME=cluster_name DISKGROUPNAME=diskgroup_name |
CLUSTERID=cluster_id DISKGROUPNAME=diskgroup_name }
Arguments
Specify the following attributes for the new Oracle ACFS volume:
• VOLUMENAME : Specifies a unique name for the new volume
• VOLUMESIZE : A number that specifies the size of the new volume in GB
• MOUNTPATH : Specifies the file system mount path for the new volume
The following arguments are available in the WHERE clause:
4-8
Chapter 4
OEDACLI Command Reference
Syntax
ALTER ACFSVOLUME
{ VOLUMENAME=volume_name |
VOLUMESIZE=volume_size |
MOUNTPATH=mountpath } ...
WHERE
{ ID=acfs_volume_id |
DISKGROUPID=diskgroup_id VOLUMENAME=volume_name |
CLUSTERNUMBER=cluster_number DISKGROUPNAME=diskgroup_name
VOLUMENAME=volume_name |
CLUSTERNAME=cluster_name DISKGROUPNAME diskgroup_name
VOLUMENAME=volume_name |
CLUSTERID=cluster_id DISKGROUPNAME=diskgroup_name
VOLUMENAME=volume_name }
Arguments
You can modify the following attributes of the Oracle ACFS volume:
• VOLUMENAME : Specifies a new, unique volume name
• VOLUMESIZE : A number that specifies the new size of the volume in GB
• MOUNTPATH : Specifies the new file system mount path for the volume
The following arguments are available in the WHERE clause:
Syntax
DELETE ACFSVOLUME
WHERE
{ ID=acfs_volume_id |
DISKGROUPID=diskgroup_id VOLUMENAME=volume_name |
CLUSTERNUMBER=cluster_number DISKGROUPNAME=diskgroup_name
VOLUMENAME=volume_name |
CLUSTERNAME=cluster_name DISKGROUPNAME=diskgroup_name
VOLUMENAME=volume_name |
4-9
Chapter 4
OEDACLI Command Reference
CLUSTERID=cluster_id DISKGROUPNAME=diskgroup_name
VOLUMENAME=volume_name }
Arguments
The following arguments are available in the WHERE clause:
• ID : Specifies the es.xml ID for the Oracle ACFS volume
• DISKGROUPID : Specifies the es.xml ID for the container disk group
• CLUSTERNUMBER : Specifies the cluster number in the es.xml, starting at 1
• CLUSTERNAME : Specifies the name of the cluster
• CLUSTERID : Specifies the es.xml ID of the cluster
• DISKGROUPNAME : Specifies the name of the container disk group
• VOLUMENAME : Specifies the name of the existing Oracle ACFS volume
Syntax
LIST ACFSVOLUMES
[ WHERE
{ ID=acfs_volume_id |
DISKGROUPID=diskgroup_id |
CLUSTERNUMBER=cluster_number [ DISKGROUPNAME=diskgroup_name ] |
CLUSTERNAME=cluster_name [ DISKGROUPNAME=diskgroup_name ] |
CLUSTERID=cluster_id [ DISKGROUPNAME=diskgroup_name ] }
Arguments
The following arguments are available in the WHERE clause:
• ID : Specifies the es.xml ID for the Oracle ACFS volume
• DISKGROUPID : Specifies the es.xml ID for the container disk group
• CLUSTERNUMBER : Specifies the cluster number in the es.xml, starting at 1
• CLUSTERNAME : Specifies the name of the cluster
• CLUSTERID : Specifies the es.xml ID of the cluster
• DISKGROUPNAME : Specifies the name of the container disk group
4.3.2 ACTION
You can save, merge, and deploy OEDACLI actions.
• SAVE ACTION
• MERGE ACTIONS
• DEPLOY ACTIONS
4-10
Chapter 4
OEDACLI Command Reference
Syntax
Arguments
Specify FORCE to auto-merged the action into the Engineered System model.
Note:
The Engineered System configuration should be saved as a file using a subsequent
SAVE FILE command.
Syntax
Arguments
Specify FORCE if you do not want this action to be processed by a DEPLOY ACTIONS command.
Note:
The Engineered System configuration should be saved as a file using a subsequent
SAVE FILE command.
Syntax
DEPLOY ACTIONS
4-11
Chapter 4
OEDACLI Command Reference
4.3.3 ALERT
You can create, alter, delete, or list Oracle alerts.
• ALTER ALERT
• DELETE ALERT
• LIST ALERTS
Syntax
ALTER ALERT
{ RECIPIENTS='recipients'
FROMNAME='from_name'
FROMEMAIL=from_email
SMTPHOST=smtp_host
[ SSL=uses_ssl ]
[ PORT=smtp_port ]
| SNMPHOST=snmp_host
[ PORT=snmp_port ]
[ COMMUNITY=snmp_community ]
| ASRHOST=asr_host
CONTACT=asr_contact
EMAIL=asr_email
MOSACCOUNT=asr_mos_account
[ PROXYHOST=asr_proxy_host ]
[ PROXYPORT=asr_proxy_port ]
[ PROXYUSER=asr_proxy_user ]
| [ EMAIL=ocm_email ]
[ HUBHOST=ocm_hub_host ]
[ HUBUSER=ocm_hub_user ]
[ PROXYHOST=ocm_proxy_host ]
[ PROXYPORT=ocm_proxy_port ]
[ PROXYUSER=ocm_proxy_user ]
| EMBASE=em_base
[ OMSHOST=oms_host ]
PORT=oms_port }
WHERE
{ ID=alert_id |
TYPE=alert_type |
HOSTNAME=host_name TYPE=alert_type |
CLUSTERNUMBER=cluster_number TYPE=alert_type |
CLUSTERNAME=cluster_name TYPE=alert_type |
CLUSTERID=cluster_id TYPE=alert_type }
4-12
Chapter 4
OEDACLI Command Reference
Arguments
You can specify various attributes according to the alert type.
• For SMTP alerts:
– RECIPIENTS : Specifies a list of email addresses. The list entries are separated by a
space or a comma and the list is surrounded by single quotation marks
– FROMNAME : Specifies the name of the email sending user, surrounded by single
quotation marks
– FROMEMAIL : Specifies the email address of the email sending user
– SMTPHOST : Specifies the hostname of the SMTP email server
– SSL : Optionally, set to true to use SSL. Default value is false.
– PORT : Optionally, specifies the SMTP email server port. Default value is 25.
• For SNMP alerts:
– SNMPHOST : Specifies the hostname of the SNMP server
– PORT : Optionally, specifies the SNMP server port. Default value is 162.
– COMMUNITY : Optionally, specifies the SNMP community value. Default value is public.
• For Oracle Auto Service Request (ASR) alerts:
– ASRHOST : Specifies the hostname of the ASR server
– CONTACT : Specifies the ASR contact name
– EMAIL : Specifies the ASR email address
– MOSACCOUNT : Specifies the ASR My Oracle Support (MOS) email address
– PROXYHOST : Optionally, specifies the proxy hostname for connectivity to the ASR
server
– PROXYPORT : Optionally, specifies the proxy port for connectivity to the ASR server
– PROXYUSER : Optionally, specifies the proxy username for connectivity to the ASR
server
• For Oracle Configuration Manager (OCM) alerts:
– EMAIL : Specifies the OCM email address
– HUBHOST : Specifies the hostname of the OCM hub
– HUBUSER : Specifies the OCM hub user name
– PROXYHOST : Optionally, specifies the proxy hostname for connectivity to the OCM hub
– PROXYPORT : Optionally, specifies the proxy port for connectivity to the OCM hub
– PROXYUSER : Optionally, specifies the proxy username for connectivity to the OCM hub
• For Oracle Enterprise Manager (EM) alerts:
– EMBASE : Optionally, specifies the EM base directory. Default value is /u01/app/
oracle/product/EMbase.
– OMSHOST : Specifies the hostname of the Oracle Management Server (OMS)
– PORT : Optionally, specifies the OMS server port. Default value is 4900.
4-13
Chapter 4
OEDACLI Command Reference
Syntax
DELETE ALERT
WHERE
{ ID=alert_id |
HOSTNAME=host_name [ TYPE=alert_type ] |
CLUSTERNUMBER=cluster_number [ TYPE=alert_type ] |
CLUSTERNAME=cluster_name [ TYPE=alert_type ] |
CLUSTERID=cluster_id [ TYPE=alert_type ] }
Arguments
The following arguments are available in the WHERE clause:
Syntax
LIST ALERTS
[ WHERE
{ ID=alert_id |
TYPE=alert_type |
HOSTNAME=host_name [ TYPE=alert_type ] } ]
Arguments
The following arguments are available in the WHERE clause:
4-14
Chapter 4
OEDACLI Command Reference
4.3.4 CELL
You can clone, delete, or list Oracle Exadata storage cells.
• CLONE CELL
• CLONE NEWCELL
• DELETE CELL
• DELETE NEWCELL
• LIST CELLS
Note:
This command is deprecated and replaced by CLONE NEWCELL.
Syntax
CLONE CELL
SRCNAME=source_cell
[ TGTNAME=new_cell_name ]
[ WAIT=wait ]
[ POWER=power ]
[ WHERE STEPNAME=step ]
Arguments
• SRCNAME: Specifies the name of an existing cell from which the new cell is derived.
• TGTNAME: Specifies the name of the new cell being added.
• WAIT: Default is true, in which case the command waits for completion of the ASM
rebalance operation prior to completion. Optionally, set to false to return control without
waiting for the ASM rebalance operation.
• POWER : Optionally, specifies the ASM rebalance power limit. The range of valid values is 1 -
1024.
4-15
Chapter 4
OEDACLI Command Reference
• STEPNAME: Specifies the deployment step to perform, which is one of the following:
– CONFIG_CELL
– CREATE_GRIDDISKS
– ADD_DISKS_TO_ASM
– REBALANCE
You can set the following options for a cloned cell:
• ADMINNET : Specifies the DNS name and IP address to use for the administration network.
The DNS name may optionally include the domain name. You can also optionally specify
the netmask and gateway for the administration network.
• PRIVNET : Specifies the names and IP addresses to use for the first and second private
networks. The names may optionally include the domain name.
• ILOMNET : Specifies the DNS name and IP address to use for the ILOM network. The DNS
name may optionally include the domain name. You can also optionally specify the
netmask and gateway for the ILOM network.
• RACK : Specifies the rack number in a multi-rack configuration, where 1 is the first rack, and
the physical location (slot number) of the cell in the rack.
The following example shows the command sequence for adding cell dbm01celadm14 by
cloning dbm01celadm09.
# Clone
CLONE CELL SRCNAME=dbm01celadm09 TGTNAME=dbm01celadm14 where
STEPNAME=CONFIG_CELL
SET ADMINNET NAME=dbm01celadm14 IP=203.0.161.160
SET PRIVNET NAME1=dbm01celadm14-priv1 IP1=192.168.160.19 NAME2=dbm01celadm14-
priv2 IP2=192.168.160.20
SET ILOMNET NAME=dbm01celadm14-ilom IP=203.0.161.182
SET RACK NUM=1, ULOC=12
SAVE ACTION
MERGE ACTIONS
DEPLOY ACTIONS
# Create Griddisks
CLONE CELL SRCNAME=dbm01celadm09 TGTNAME=dbm01celadm14 where
STEPNAME=CREATE_GRIDDISKS
SAVE ACTION
MERGE ACTIONS
DEPLOY ACTIONS
SAVE ACTION
MERGE ACTIONS
DEPLOY ACTIONS
4-16
Chapter 4
OEDACLI Command Reference
STEPNAME=REBALANCE
SAVE ACTION
MERGE ACTIONS
DEPLOY ACTIONS
Syntax
CLONE NEWCELL
SRCNAME=source_cell
TGTNAME=new_cell_name
[ TYPE=cell_type ]
Arguments
• SRCNAME: Specifies the name of an existing cell from which the new cell is derived.
• TGTNAME: Specifies the name of the new cell being added.
• TYPE: Optionally specifies the cell type. Use this option only for situations where the clone
source is a high capacity (HC) storage server, and the target is an extended (XT) storage
server. The following values are allowed:
– X8XT: Specifies that the target is an XT storage server with InfiniBand Network Fabric.
– X8MXT: Specifies that the target is an XT storage server with RoCE Network Fabric.
You can set the following options for a cloned cell:
• ADMINNET : Specifies the DNS name and IP address to use for the administration network.
The DNS name may optionally include the domain name. You can also optionally specify
the netmask and gateway for the administration network.
• PRIVNET : Specifies the names and IP addresses to use for the first and second private
networks. The names may optionally include the domain name.
• ILOMNET : Specifies the DNS name and IP address to use for the ILOM network. The DNS
name may optionally include the domain name. You can also optionally specify the
netmask and gateway for the ILOM network.
• RACK : Specifies the rack number in a multi-rack configuration, where 1 is the first rack, and
the physical location (slot number) of the cell in the rack.
4-17
Chapter 4
OEDACLI Command Reference
The following example shows the command sequence for adding cell dbm02celadm06 by
cloning dbm02celadm01.
# Clone
CLONE NEWCELL SRCNAME=dbm02celadm01 TGTNAME=dbm02celadm06
SET ADMINNET NAME=dbm02celadm06 IP=203.0.96.17
SET PRIVNET NAME1=dbm02cell06vm1str-priv1 IP1=192.168.3.47
NAME2=dbm02cell06vm1str-priv2 IP2=192.168.3.48
SET ILOMNET NAME=dbm02celadm06-ilom IP=203.0.10.103
SET RACK NUM=1 ULOC=12
SAVE ACTION
SAVE ACTION
MERGE ACTIONS
DEPLOY ACTIONS
Syntax
DELETE CELL
WHERE
SRCNAME=cell_hostname
Arguments
• SRCNAME : Specifies the hostname of the cell being deleted.
Usage Notes
• The command performs no deployment actions, and no deployed cells are affected.
• Use SAVE ACTION FORCE to save changes to the XML configuration file.
• To remove a deployed cell, use the ALTER CLUSTER command instead of DELETE CELL.
Syntax
DELETE NEWCELL
WHERE
{ SRCNAME=cell_host_name |
SRCNAMES=cell_host_names }
4-18
Chapter 4
OEDACLI Command Reference
Arguments
WHERE clause arguments:
• SRCNAME : Specifies the host name of the cell being deleted from es.xml.
• SRCNAMES : Specifies a comma-separated list of host names for the cells being deleted from
es.xml.
Usage Notes
Use SAVE ACTION FORCE to save changes only to es.xml. No deployment actions are
performed.
Syntax
LIST CELLS
Usage Notes
This command is deprecated. Instead, use:
4.3.5 CLUSTER
You can alter or list the Oracle RAC Clusters on the Oracle Exadata Database Machine.
• ALTER CLUSTER
• CREATE CLUSTER
Use this command to create virtual guests for a virtual machine (VM) cluster, including the
steps to configure and deploy an Oracle RAC database.
• DESTROY CLUSTER
This command is used to cleanly remove a running virtual machine (VM) cluster in one
operation.
• DOWNGRADE CLUSTER
Use this command downgrade a previously upgraded cluster.
• LIST CLUSTER
This command lists a specific Exadata cluster.
• LIST CLUSTERS
This command lists the existing Exadata clusters.
• UPGRADE CLUSTER
Use this command upgrade an Oracle Grid Infrastructure cluster.
4-19
Chapter 4
OEDACLI Command Reference
Syntax
ALTER CLUSTER
{ CLUSTERNAME=cluster_name |
GIVERSION=grid_version |
GIHOMELOC=grid_home_location |
INVLOC=inventory_location |
BASEDIR=oracle_base_dir |
PATCHLIST=patch_list |
VCPU=vcpu |
VMEM=vmem |
ASMSCOPEDSECURITY=asm_scoped_security |
HOMESIZE=home_size |
INSTALLTYPE={ CLONE | ZIP }
} ...
WHERE
{ CLUSTERNUMBER=cluster_number |
CLUSTERNAME=cluster_name |
ID=cluster_id }
ALTER CLUSTER
{ ADDCELLS='add_cells' | DROPCELLS='drop_cells' }
[ DISKGROUPS='asm_diskgroups' ] [ POWER=power ] [ WAIT={ TRUE |
FALSE }]
WHERE
{ CLUSTERNUMBER=cluster_number |
CLUSTERNAME=cluster_name |
ID=cluster_id }
[ STEPNAME=step_name ]
Arguments
You can modify the following attributes of the GI cluster:
• CLUSTERNAME: Specifies a new, unique name for the cluster
• GIVERSION: Specifies the clusterware version, including the release update (RU). For
example: 12.1.0.2.170418
• GIHOMELOC: Specifies a new path for the Grid home location
• INVLOC: Specifies a new path for the software inventory
• BASEDIR: Specifies a new path for the Oracle base directory
• PATCHLIST: Specifies a comma-separated list of patches. The list must be enclosed in
single quotes. By default, the patch list is derived from the RU included in the GIVERSION.
• VCPU: Specifies the number of virtual CPUs for each virtual machine (VM) in a VM cluster.
This option only applies to a cluster in a VM deployment.
• VMEM: Specifies the amount of memory (in GB) for each virtual machine (VM) in a VM
cluster. This option only applies to a cluster in a VM deployment.
• ASMSCOPEDSECURITY: Specify true to enable ASM scoped security. The default value is
false.
• HOMESIZE: Specifies the cluster home size (in GB).
4-20
Chapter 4
OEDACLI Command Reference
• INSTALLTYPE: Specifies the software installation method to use. The options are:
– CLONE: Uses image files to clone a software installation. The image files include the
base software release, and may also include additional patches and updates. By
including updates in the image files, this method reduces deployment time and
improves deployment consistency.
The CLONE software installation method is the only supported method for a cluster in a
virtual machine (VM) deployment. This option is also available for clusters in a physical
(bare metal) deployment.
– ZIP: Performs a fresh software installation by using compressed (zip) files that contain
the software release. This method does not include additional patches or updates.
The ZIP software installation method is the default method for clusters in a physical
(bare metal) deployment. This option is not available for clusters in a virtual machine
(VM) deployment.
• ADDCELLS: Specifies a comma-separated list of cells to add to the disk groups. The list must
be enclosed in single quotes. If multiple cells are specified, they are all added in one
operation, and the data is rebalanced once at the end of the process.
• DROPCELLS: Specifies a comma-separated list of cells to drop from the disk groups. The list
must be enclosed in single quotes. If multiple cells are specified, they are all dropped in
one operation, and the data is rebalanced once at the end of the process.
• DISKGROUPS: Specifies a comma-separated list of disk groups from which you want to add
or remove cells specified in ADDCELLS or DROPCELLS. The list must be enclosed in single
quotes. If not specified, then the specified cells are added to or removed from all of the
disk groups.
• POWER: Specifies the ASM rebalance power limit. The range of valid values is 1 - 1024.
• WAIT: Specifies whether or not to wait for the completion of the ASM rebalance operation
that occurs during the ADD_DISKS_TO_ASM step of an ADDCELLS or DROPCELLS operation. This
option is only applicable when the WHERE clause contains STEPNAME=ADD_DISKS_TO_ASM.
Specify false to proceed without waiting for the ASM rebalance operation to complete.
Specify true to wait for the ASM rebalance operation to complete. The default value is
true.
The following arguments are available in the WHERE clause:
4-21
Chapter 4
OEDACLI Command Reference
3. ADD_DISKS_TO_ASM: Adds the newly created grid disks to the ASM disk groups
associated with the specified cluster.
For a DROPCELLS operation, the steps are performed in reverse order:
1. ADD_DISKS_TO_ASM: Removes the grid disks from the ASM disk groups associated with
the specified cluster.
2. CREATE_GRIDDISKS: Deletes grid disks associated with the specified cluster.
3. CONFIG_CELL: Deletes the cell configuration on the storage server.
Example 4-4 Deploying a Cluster Change
The following example shows an OEDACLI session that uses the ALTER CLUSTER command
along with typical output at each step.
Syntax
CREATE CLUSTER
[ STEPS='step_short_names' [ DELETEDB={ true | false } ] |
SKIPSTEPS='step_short_names' [ DELETEDB={ true | false } ] |
DELETEDB={ true | false } ]
[ WHERE
{ CLUSTERNAME=cluster_name |
CLUSTERNUMBER=cluster_number |
ID=cluster_id } ]
Arguments
• STEPS : Optionally, specifies the steps to run.
The list consists of space-separated step short names and the entire list is enclosed in
single quotes.
Use the LIST STEPS command to view the available steps.
4-22
Chapter 4
OEDACLI Command Reference
Usage Notes
• The command can only create a cluster in a VM deployment. You cannot use this
command to create the cluster in a physical (bare-metal) deployment.
• The simplest form of this command does not require any arguments. However, if the XML
configuration file (es.xml) contains more than one cluster, then the WHERE clause is
mandatory.
Example 4-5 Using the STEPS Parameter with CREATE CLUSTER
Use the following command to only create the guest domains for the Cluster-c1 cluster:
Example 4-6 Using the SKIPSTEPS and DELETEDB Parameters with CREATE
CLUSTER
Use the following command to create the Cluster-c1 cluster, skipping the specified SKIPSTEPS
and deleting the default database.
Syntax
DESTROY CLUSTER
[ WHERE
{ CLUSTERNUMBER=cluster_number |
CLUSTERNAME=cluster_name |
CLUSTERID=cluster_id } ]
Arguments
The following arguments are available in the WHERE clause:
4-23
Chapter 4
OEDACLI Command Reference
Usage Notes
• No WHERE clause is required if the XML file contains one cluster only.
• The MERGE step indicates the machines that will be destroyed and the affected cells.
Example 4-7 Using the DESTROY CLUSTER Command
The following example shows the simplest case, where there is only a single cluster in the XML
file.
Syntax
DOWNGRADE CLUSTER
WHERE
{ CLUSTERNAME=cluster_name [ STEPNAME=step_name ] |
CLUSTERNUMBER=cluster_number [ STEPNAME=step_name ] |
ID=cluster_id [ STEPNAME=step_name ] }
Arguments
The following arguments are available in the WHERE clause:
Usage Notes
• To use the command, you must use the es.xml that contains the upgraded cluster.
• The command can only downgrade a cluster in a VM deployment. You cannot use this
command to downgrade the cluster in a physical (bare-metal) deployment.
• The command can only run if the DELETE_OLDHOME step has not been run on the upgraded
cluster.
4-24
Chapter 4
OEDACLI Command Reference
Syntax
LIST CLUSTER
WHERE
{ NAME=cluster_name |
ID=cluster_id }
4-25
Chapter 4
OEDACLI Command Reference
Arguments
The following arguments are available in the WHERE clause:
Syntax
LIST CLUSTERS
[ WHERE
{ CLUSTERNUMBER=cluster_number |
CLUSTERNAME=cluster_name |
ID=cluster_id } ]
Arguments
The following arguments are available in the WHERE clause:
Usage Notes
The WHERE clause is optional.
Syntax
UPGRADE CLUSTER
GIVERSION=Grid_relnum
GIHOMELOC=Grid_home_dir
4-26
Chapter 4
OEDACLI Command Reference
WHERE
{ CLUSTERNAME=cluster_name [ STEPNAME=step_name ] |
CLUSTERNUMBER=cluster_number [ STEPNAME=step_name ] |
ID=cluster_id [ STEPNAME=step_name ] }
Arguments
• GIVERSION: The version of the Oracle Grid Infrastructure software you are upgrading to,
including the release update (RU). For example: 12.1.0.2.170418
• GIHOMELOC: The target location of the Oracle Grid Infrastructure home directory
The following arguments are available in the WHERE clause:
Usage Notes
• The command can only upgrade a cluster in a VM deployment. You cannot use this
command to upgrade the cluster in a physical (bare-metal) deployment.
• If STEPNAME is not specified, then the ADD_HOME and CONFIG_HOME steps are performed.
• The RUN_ROOTSCRIPT step runs the rootupgrade.sh script sequentially in a rolling mode on
all nodes. This step also restarts the database instances on each of the nodes.
• After you run the DELETE_OLDHOME step in conjunction with the UPGRADE CLUSTER command,
you cannot later use the DOWNGRADE CLUSTER command to roll back the upgrade.
Example 4-10 Using the UPGRADE CLUSTER Command
This example shows the first three steps (ADD_HOME, CONFIG_HOME, and RUN_ROOTSCRIPT) in a
step-by-step cluster upgrade. At the end of this example, the cluster is upgraded, but
downgrade is still possible because the DELETE_OLDHOME step has not been run.
4-27
Chapter 4
OEDACLI Command Reference
4-28
Chapter 4
OEDACLI Command Reference
4.3.6 COMPUTE
Use these commands to add or delete a physical compute node as a cluster member.
• CLONE COMPUTE
Use this command to clone an existing physical compute cluster node.
• DELETE COMPUTE
This command deletes an existing compute node, removes the instance, home and
clusterware from the cluster.
4-29
Chapter 4
OEDACLI Command Reference
Syntax
CLONE COMPUTE
{ SRCNAME=source_compute_node TGTNAME=target_compute_node |
TGTNAMES=target_compute_nodes }
[ WHERE
STEPNAME=stepname ]
Arguments
• SRCNAME: Specifies the name of an existing compute server from which the compute server
is derived.
• TGTNAME: Specifies the name of the new compute server to add.
• TGTNAMES: Specifies a comma-separated list of new compute servers to add.
• STEPNAME: Optionally specifies the deployment step to perform, which is one of the
following:
– CREATE_USERS
– CELL_CONNECTIVITY
– ADD_NODE
– EXTEND_DBHOME
– ADD_INSTANCE
If STEPNAME is not specified, then all steps are performed.
You can set the following options for a cloned compute node:
• ADMINNET : Specifies the DNS name and IP address to use for the administration network.
The DNS name may optionally include the domain name.
• PRIVNET : Specifies the names and IP addresses to use for the first and second private
networks. The names may optionally include the domain name.
• INTERCONNECT: Only required if the compute nodes are configured with Exadata Secure
RDMA Fabric Isolation or InfiniBand security (PKEYS). Specifies the names and IP
addresses to use for the first and second private networks. The names may optionally
include the domain name.
• CLIENTNET : Specifies the DNS name and IP address to use for the client network. The
DNS name may optionally include the domain name. Not required on virtual machine (VM)
hosts (Oracle Linux KVM or Oracle VM).
4-30
Chapter 4
OEDACLI Command Reference
• VIPNET : Specifies the DNS name and IP address to use for the virtual IP (VIP) network.
The DNS name may optionally include the domain name. Not required on virtual machine
(VM) hosts (Oracle Linux KVM or Oracle VM).
• BACKUP : Specifies the DNS name and IP address to use for the backup network. The DNS
name may optionally include the domain name. Not required on servers without a backup
network.
• ILOMNET: Specifies the DNS name and IP address to use for the ILOM network. The DNS
name may optionally include the domain name.
• RACK : Specifies the rack number in a multi-rack configuration, where 1 is the first rack, and
the physical location (slot number) of the server in the rack.
Usage Notes
• For configurations with Exadata Secure RDMA Fabric Isolation or InfiniBand security
(PKEYS), INTERCONNECT defines the private network that connects the database nodes and
PRIVNET defines the private storage network.
• Use TGTNAMES to clone multiple compute servers simultaneously in the DEPLOY ACTIONS.
Use TGTNAMES without additional SET statements. Use SAVE ACTION FORCE prior to using
this argument. See the example below.
Example 4-11 Cloning a Compute Node
This example clones the dbadm13 compute server to a new server, dbadm14.
SAVE ACTION
MERGE ACTIONS
DEPLOY ACTIONS
4-31
Chapter 4
OEDACLI Command Reference
SAVE ACTION
MERGE ACTIONS
DEPLOY ACTIONS
SAVE ACTION
MERGE ACTIONS
DEPLOY ACTIONS
SAVE ACTION
MERGE ACTIONS
DEPLOY ACTIONS
SAVE ACTION
MERGE ACTIONS
DEPLOY ACTIONS
...
Syntax
DELETE COMPUTE
WHERE
{ SRCNAME=host_name [ STEPNAME=step_name ] |
SRCNAMES=host_names [ STEPNAME=step_name ] }
4-32
Chapter 4
OEDACLI Command Reference
Arguments
SRCNAME specifies the host name of the guest that you want to remove.
SRCNAMES specifies a comma-separated list host names of the guests that you want to remove.
STEPNAME is used to clean up steps from a failed CREATE COMPUTE command. Specify the name
of the individual creation step to be reverted. The values for step_name are:
• ADD_INSTANCE
• EXTEND_DBHOME
• ADD_NODE
• CELL_CONNECTIVITY
• CREATE_USERS
Example 4-14 Deleting a Compute Node - Simple Case
This example removes the dbadm04 compute node from the cluster.
4.3.7 CURRENTACTION
You can clear or list the current action in OEDACLI.
• CLEAR CURRENTACTION
4-33
Chapter 4
OEDACLI Command Reference
• LIST CURRENTACTION
Syntax
CLEAR CURRENTACTION
Syntax
LIST CURRENTACTION
4.3.8 DATABASE
You can add, alter, delete, or list the Oracle databases.
• ADD DATABASE
• ALTER DATABASE
• DELETE DATABASE
• LIST DATABASES
Syntax
ADD DATABASE
DBNAME=database_name
[ BLOCKSIZE=blocksize ]
[ CHARSET=database_character_set ]
[ DBLANG=database_language ]
[ UNIQUENAME=database_unique_name ]
[ DBTEMPLATE=database_template ]
[ DBTYPE=database_type ]
[ HOSTNAMES='host_names' ]
[ DATADG=data_diskgroup RECODG=reco_diskgroup ]
[ VAULTLIST=exascale_vault_list EXASCALECLUSTER=exascale_cluster_name
[ STORAGETEMPLATE = exascale_storage_template_name ]]
WHERE
{ DBHOMEID=database_home_id |
CLUSTERNUMBER=cluster_number DBHOMELOC=database_home_location |
CLUSTERNAME=cluster_name DBHOMELOC=database_home_location |
CLUSTERID=cluster_id DBHOMELOC=database_home_location |
CLUSTERNUMBER=cluster_number CDBNAME=container_database_name |
4-34
Chapter 4
OEDACLI Command Reference
CLUSTERNAME=cluster_name CDBNAME=container_database_name |
CLUSTERID=cluster_id CDBNAME=container_database_name }
Arguments
You can specify the following attributes for the new Oracle database:
• DBNAME : Specifies the name of the new database.
• BLOCKSIZE : Optionally, specifies the block size for the new database. The default value is
8192. This argument is not required for pluggable databases.
• CHARSET : Optionally, specifies the character set to use for the new database. The default
value is AL32UTF8. This argument is not required for pluggable databases.
• DBLANG : Optionally, specifies the language to use for the new database. The default value
is all_langs. This argument is not required for pluggable databases.
• UNIQUENAME : Specifies the unique name of the new database. The default value is dbname.
• DBTEMPLATE : Specifies the template to use when creating the new database, ADMIN or DW.
The default value is ADMIN. This argument is not required for pluggable databases.
• DBTYPE : Optionally, specifies the type of database to create:
– normal DB : Adds a non-container database (non-CDB). This is the default value.
– CDB : Adds a container database.
– PDB : Adds a pluggable database to an existing CDB.
• HOSTNAMES : Optionally, specifies a comma-separated list of host names on which the
database should run. The default value is the list of nodes registered with the database
home.
• DATADG : Specifies the name of the DATA disk group for the new database.
This argument is required when adding a database using Oracle ASM storage. It does not
apply to pluggable databases (PDBs) or databases using Exascale storage.
• RECODG : Specifies the name of the RECO disk group for the new database.
This argument is required when adding a database using Oracle ASM storage. It does not
apply to pluggable databases (PDBs) or databases using Exascale storage.
• VAULTLIST : Specifies a comma-separated list of Exascale vaults used to store the
database.
This argument is required when adding a database using Exascale storage. It does not
apply to pluggable databases (PDBs) or databases using Oracle ASM storage.
• EXASCALECLUSTER : Specifies the name of the Exascale cluster that contains the Exascale
vaults used to store the database.
This argument is required when adding a database using Exascale storage. It does not
apply to pluggable databases (PDBs) or databases using Oracle ASM storage.
• STORAGETEMPLATE : Optionally, specifes the Exascale storage template applied to the
Oracle Database data files.
You can use the OEDACLI LIST STORAGETEMPLATES command to view the list of available
templates. If not specified, the default template (DATAFILE) applies.
4-35
Chapter 4
OEDACLI Command Reference
For example, you can specify DATA_EF_HIGHREDUNDANCY to use the built-in Exascale
template that places data files on Extreme Flash (EF) storage media (if available) using
high redundancy (triple mirroring).
The following arguments are available in the WHERE clause:
2. Use the command LIST DATABASEHOMES to identify the databasehome_id associated with
the target database home. This database home will be used to create the new database.
3. Create an action for creating the new database. You must provide a name for the new
database, and the names of the DATA and RECO disk groups that the new database
should use. Also, use the ID retrieved in the previous step to specify the Oracle Home in
which to create this database.
4-36
Chapter 4
OEDACLI Command Reference
Syntax
ALTER DATABASE
{ { BLOCKSIZE=blocksize |
CHARSET=database_character_set |
DATADG=data_diskgroup |
VAULT='vaultlist' [ EXASCALECLUSTER=exascaleclustername ] |
DBLANG=database_language |
DBNAME=database_name |
UNIQUENAME=database_unique_name |
DBTEMPLATE=database_template |
DBTYPE=database_type |
HOSTNAMES='host_names' |
RECODG=reco_diskgroup } ... |
{ DBHOMELOC=new_dbhome_loc | DBHOMEID=new_dbhome_id } }
WHERE
{ ID=database_id |
CLUSTERNUMBER=cluster_number DATABASENAME=database_name |
4-37
Chapter 4
OEDACLI Command Reference
CLUSTERNAME=cluster_name DATABASENAME=database_name |
CLUSTERID=cluster_id DATABASENAME=database_name }
Arguments
You can modify the following attributes:
• BLOCKSIZE: The block size for the new database. The default value is 8192. This argument
is not required for pluggable databases.
• CHARSET: The character set to use for the new database. The default value is AL32UTF8.
This argument is not required for pluggable databases.
• DATADG: The name of the DATA disk group for the new database. This argument is not
required for pluggable databases.
• VAULT: If using Exascale, specify a vault or space-seperated list of two vaults for the
database. Note that the value is also surrounded by single quotes (as displayed in the
command syntax).
• EXASCALECLUSTER: Specifies the Exascale cluster that contains the specified vault or vaults.
This option is required only if the vault specification cannot uniquely identify the Exascale
cluster.
• DBLANG: The language to use for the new database. The default value is all_langs. This
argument is not required for pluggable databases.
• DBNAME: The name of the new database.
• UNIQUENAME: The unique name of the new database. The default value is dbname.
• DBTEMPLATE : The template to use when creating the new database, ADMIN or DW. The
default value is ADMIN. This argument is not required for pluggable databases.
• DBTYPE: The type of database to create:
– normal DB: Specifies a non-container database (non-CDB). This is the default value.
– CDB: Specifies a container database.
– PDB: Specifies a pluggable database to an existing CDB.
• HOSTNAMES: A comma-separated list of host names on which the database should run. The
default value is the list of nodes registered with the database home.
• RECODG: The name of the RECO disk group for the new database. This argument is not
required for pluggable databases.
• DBHOMELOC : The location of the database home that you want to move the database to.
This argument is not required for pluggable databases.
• DBHOMEID: The es.xml ID of the database home that you want to move the database to.
This argument is not required for pluggable databases.
The following arguments are available in the WHERE clause:
4-38
Chapter 4
OEDACLI Command Reference
Usage Notes
For moving the database to use a different database home, specify only the new home location
(DBHOMELOC) or the ID of the new database home (DBHOMEID).
Syntax
DELETE DATABASE
WHERE
{ ID=database_id |
CLUSTERNUMBER=cluster_number DATABASENAME=database_name |
CLUSTERNAME=cluster_name DATABASENAME=database_name |
CLUSTERID=cluster_id DATABASENAME=database_name }
Arguments
The following arguments are available in the WHERE clause:
2. List the databases contained in the XML configuration file, so that you can identify the
database ID associated with the database you want to delete.
4-39
Chapter 4
OEDACLI Command Reference
diskGroup :
id : "c0_datadg"
id : "c0_recodg"
id : "c0_dbm01"
.....
.....
databaseHome :
id : "c0_databaseHome3"
machines :
machine :
....
....
databaseTemplate : "OLTP"
databaseStyle : "ADMIN"
language : "all_langs"
diskGroups :
diskGroup :
id : "c0_datadg"
id : "c0_recodg"
id : "c0_testdb01"
3. Create an action to delete the target database. Use the database id identified in the
previous step
4-40
Chapter 4
OEDACLI Command Reference
Syntax
LIST DATABASES
[ WHERE
{ ID=database_id |
CLUSTERNUMBER=cluster_number |
CLUSTERNAME=cluster_name |
CLUSTERID=cluster_id } ]
Arguments
The following arguments are available in the WHERE clause:
4.3.9 DATABASEHOME
You can add, alter, delete, or list the Oracle Database homes.
• ADD DATABASEHOME
• ALTER DATABASEHOME
• DELETE DATABASEHOME
• LIST DATABASEHOMES
Syntax
ADD DATABASEHOME
OWNER=owner
DBVERSION=version
DBHOMELOC=database_home_path
[ DBHOMENAME=database_home_name ]
[ INVLOC=inventory_location ]
[ DBLANG=database_language ]
[ MACHINELIST='machine_list' ]
[ PATCHLIST='patch_list' ]
[ BASEDIR=base_directory ]
[ VOLUMESIZE=volume_size ]
[ INSTALLTYPE={ CLONE | ZIP } ]
WHERE
{ CLUSTERNUMBER=cluster_number |
CLUSTERNAME=cluster_name |
CLUSTERID=cluster_id }
4-41
Chapter 4
OEDACLI Command Reference
Arguments
You can specify the following attributes for the new Oracle database home:
• OWNER : (Mandatory) Specifies the operating system user that owns the Oracle home.
• DBVERSION : (Mandatory) Specifies the version of the software in the database home,
including the release update (RU), for example 12.1.0.2.170418.
• DBHOMELOC : (Mandatory) Specifies the file system path for the new Oracle database home
directory.
• DBHOMENAME : Specifies the name of the new database home. The default value is the
standard template name, for example, dbhome_1.
• INVLOC : Specifies the location of the Oracle inventory directory. The default value is
derived from the cluster home.
• DBLANG : Specifies the language to use with the Oracle home. The default value is
all_langs.
• MACHINELIST : Specifies a list of nodes to create the Oracle home on. The default value is
list of nodes registered with the Grid home.
• PATCHLIST : Specifies a comma-separated list of patches for the database home. The
default value is derived from DBVERSION.
• BASEDIR : Specifies the location of the Oracle Base directory. The default value is derived
from OWNER.
• VOLUMESIZE : Specifies the size of the home directory volume. The default value is 50 GB.
This argument is applicable only for database homes for Oracle VM clusters.
• INSTALLTYPE: Specifies the software installation method to use. The options are:
– CLONE: Uses image files to clone a software installation. The image files include the
base software release, and may also include additional patches and updates. By
including updates in the image files, this method reduces deployment time and
improves deployment consistency.
The CLONE software installation method is the only supported method for database
homes in a virtual machine (VM) deployment. This option is also available for database
homes in a physical (bare metal) deployment.
– ZIP: Performs a fresh software installation by using compressed (zip) files that contain
the software release. This method does not include additional patches or updates.
This option is not available for database homes in a virtual machine (VM) deployment.
If you do not specify the INSTALLTYPE setting, then the default setting matches the
INSTALLTYPE setting in the containing cluster.
The following arguments are available in the WHERE clause:
4-42
Chapter 4
OEDACLI Command Reference
database home with 12.1.0.2.170418. The software will be installed under /u01/app/
oracle/product/12.1.0.2/dbhome_2.
./oedacli
4-43
Chapter 4
OEDACLI Command Reference
node1adm01.example.com
Copying file: p26022196_121020_Linux-x86-64.zip to node
node1adm02.example.com
Copying file: p26027162_121020_Linux-x86-64.zip to node
node1adm02.example.com
Completed copying files...
Extracting files...
Completed extracting files...
Validating nodes for database readiness...
Installing database software ...
Running database installer on node node1adm01.example.com ... Please wait...
After running database installer...
Patching...
Done...
Done
Syntax
ALTER DATABASEHOME
{ OWNER=owner |
DBVERSION=version |
DBHOMELOC=database_home_path |
DBHOMENAME=database_home_name |
INVLOC=inventory_location |
DBLANG=language |
MACHINELIST='machine_list' |
PATCHLIST='patch_list' |
BASEDIR=base_directory |
INSTALLTYPE={ CLONE | ZIP } } ...
WHERE
{ ID=database_home_id |
CLUSTERNUMBER=cluster_number DBHOMELOC=database_home_path |
CLUSTERNAME=cluster_name DBHOMELOC=database_home_path |
CLUSTERID=cluster_id DBHOMELOC=database_home_path }
Arguments
You can modify the following attributes for the Oracle database home:
• OWNER : Specifies the operating system user that owns the Oracle home.
• DBVERSION : Specifies the version of the software in the database home, including the
release update (RU), for example 12.1.0.2.170418.
• DBHOMELOC : Specifies the file system path for the new Oracle database home directory.
• DBHOMENAME : Specifies the new name of the database home. The database home name
must be unique within a cluster.
• INVLOC : Specifies the location of the Oracle inventory directory.
• DBLANG : Specifies the supported languages for the Oracle home.
• MACHINELIST : Specifies a list of nodes. The nodes must exist within the cluster.
4-44
Chapter 4
OEDACLI Command Reference
• PATCHLIST : Specifies a comma-separated, custom list of patches for the database home.
• BASEDIR : Specifies the location of the Oracle Base directory.
• INSTALLTYPE: Specifies the software installation method to use. The options are:
– CLONE: Uses image files to clone a software installation. The image files include the
base software release, and may also include additional patches and updates. By
including updates in the image files, this method reduces deployment time and
improves deployment consistency.
The CLONE software installation method is the only supported method for database
homes in a virtual machine (VM) deployment. This option is also available for database
homes in a physical (bare metal) deployment.
– ZIP: Performs a fresh software installation by using compressed (zip) files that contain
the software release. This method does not include additional patches or updates.
This option is not available for database homes in a virtual machine (VM) deployment.
The following arguments are available in the WHERE clause:
Syntax
DELETE DATABASEHOME
WHERE
{ ID=database_home_id |
CLUSTERNUMBER=cluster_number DBHOMELOC=database_home_path |
CLUSTERNAME=cluster_name DBHOMELOC=database_home_path |
CLUSTERID=cluster_id DBHOMELOC=database_home_path }
Arguments
The following arguments are available in the WHERE clause:
Usage Notes
The database home you are deleting must not contain any dependent databases.
4-45
Chapter 4
OEDACLI Command Reference
Syntax
LIST DATABASEHOMES
[ WHERE
{ ID=database_home_id |
CLUSTERNUMBER=cluster_number [ NAME=database_home_name ] |
CLUSTERNAME=cluster_name [ NAME=database_home_name ] |
CLUSTERID=cluster_id [ NAME=database_home_name ] } ]
Arguments
The following arguments are available in the WHERE clause:
4-46
Chapter 4
OEDACLI Command Reference
4.3.10 DISKGROUP
You can add, alter, delete, or list the Oracle ASM disk groups.
• ADD DISKGROUP
• ALTER DISKGROUP
• ALTER DISKGROUPS
• DELETE DISKGROUP
• LIST DISKGROUPS
Syntax
ADD DISKGROUP
[ ACFSNAME=acfs_name ]
[ ACFSPATH=acfs_path ]
[ ACFSSIZE=acfs_size ]
[ CELLLIST='cell_list' ]
DISKGROUPNAME=diskgroup_name
[ DISKGROUPLOCATION=diskgroup_location ]
DISKGROUPSIZE=diskgroup_size
[ OCRVOTE=ocr_voting_disks_included ]
[ QUORUMDISK=quorum_disks_included ]
REDUNDANCY=redundancy_level
SLICESIZE=slice_size
[ SPARSE=sparse ]
[ TYPE=diskgroup_type [ DATABASENAME=database_name ]]
WHERE
{ CLUSTERNUMBER=cluster_number |
CLUSTERNAME=cluster_name |
CLUSTERID=cluster_id }
Arguments
You can specify the following attributes for the new Oracle ASM disk group:
• ACFSNAME : Specifies the name for the Oracle ACFS volume on this disk group
• ACFSPATH : Specifies the path for the Oracle ACFS file system
• ACFSSIZE : Specifies the size for the Oracle ACFS volume on this diskgroup
• CELLLIST : A comma separated list of cells for this disk group, enclosed in single quotes
• DISKGROUPNAME : (Mandatory) Specifies the name of the disk group
• DISKGROUPLOCATION : Specifies the media type where the disk group is located. The valid
values are FLASHDISK or HARDDISK. The default value is HARDDISK.
The same disk group location is recommended for all non-RECO disk groups across all
clusters in the Exadata configuration file (es.xml). If the RECO disk group location is
FLASHDISK, then FLASHDISK is the recommended location for all disk groups.
4-47
Chapter 4
OEDACLI Command Reference
4-48
Chapter 4
OEDACLI Command Reference
Syntax
ALTER DISKGROUP
{ ACFSNAME=acfs_name |
ACFSPATH=acfs_path |
ACFSSIZE=acfs_size |
CELLLIST='cell_list' |
DISKGROUPNAME=diskgroup_name |
DISKGROUPLOCATION=diskgroup_location |
DISKGROUPSIZE=diskgroup_size |
OCRVOTE=ocr_voting_disks_included |
QUORUMDISK=quorum_disks_included |
REDUNDANCY=redundancy_level |
SLICESIZE=slice_size |
SPARSE=sparse } ...
WHERE
{ ID=diskgroup_id |
CLUSTERNUMBER=cluster_number DISKGROUPNAME=diskgroup_name |
CLUSTERNAME=cluster_name DISKGROUPNAME=diskgroup_name |
CLUSTERID=cluster_id DISKGROUPNAME=diskgroup_name }
Arguments
You can modify the following attributes of an Oracle ASM disk group:
• ACFSNAME : Specifies a new name for the Oracle ACFS volume on this disk group
• ACFSPATH : Specifies the new path for the Oracle ACFS file system
• ACFSSIZE : Specifies a new size for the Oracle ACFS volume on this disk group
• CELLLIST : A comma separated list of cells for this disk group, enclosed in single quotes
• DISKGROUPNAME : Specifies a new name for the disk group
• DISKGROUPLOCATION : Specifies the media type where the disk group is located. The valid
values are FLASHDISK or HARDDISK. The default value is HARDDISK.
The same disk group location is recommended for all non-RECO disk groups across all
clusters in the Exadata configuration file (es.xml). If the RECO disk group location is
FLASHDISK, then FLASHDISK is the recommended location for all disk groups.
• DISKGROUPSIZE : Specifies a new size for the disk group
• OCRVOTE : A boolean variable, where TRUE indicates the disk group should store the OCR
and voting disks for the cluster.
• QUORUMDISK : A boolean variable, where TRUE indicates the disk group requires a quorum
4-49
Chapter 4
OEDACLI Command Reference
• REDUNDANCY : Specifies the redundancy level for the disk group. The valid values are
NORMAL or HIGH.
• SLICESIZE : Specifies the slice size on disk for each grid disk for this disk group.
• SPARSE : A boolean variable, where TRUE indicates this should be sparse disk group.
The following arguments are available in the WHERE clause:
Usage Notes
• With the ALTER DISKGROUP command, you can only deploy the following modifications to an
existing disk group:
– You can alter the size of an existing disk group by setting the DISKGROUPSIZE attribute.
– You can change the storage servers that contain the disk group by setting the
CELLLIST attribute. However, if you remove a storage server from a disk group, you
must ensure that the remaining storage servers have enough space to accommodate
the existing data.
Changes to all other disk group attributes may only be saved to the OEDA XML
configuration file (es.xml). Consequently, you cannot use the ALTER DISKGROUP command
in conjunction with the DEPLOY ACTIONS command to change the name of an existing disk
group, for example.
• If you modify the redundancy, the volume size will be maintained, however the slice size
will be recalculated.
Example 4-21 Resizing an Oracle ASM Disk Group Using OEDACLI
This example shows how to resize an existing Oracle ASM disk group using OEDACLI.
1. Load the OEDA XML configuration file.
2. Use the command LIST DISKGROUPS to view the disk group details.
4-50
Chapter 4
OEDACLI Command Reference
ocrVote : "true"
quorumDisk : "false"
id : "c0_dbfsdg"
version : "PhysicalLayoutLegacy"
diskGroupName : "DATAC1"
redundancy : "NORMAL"
sliceSize : "2953G"
machines :
..
..
cellDisks : "ALL"
diskGroupSize : "53154G"
ocrVote : "false"
quorumDisk : "false"
id : "c0_datadg"
version : "PhysicalLayoutLegacy"
diskGroupName : "RECOC1"
redundancy : "NORMAL"
sliceSize : "ALL"
machines :
..
..
cellDisks : "ALL"
diskGroupSize : "13284G"
ocrVote : "false"
quorumDisk : "false"
id : "c0_recodg"
4-51
Chapter 4
OEDACLI Command Reference
Syntax
ALTER DISKGROUPS
DATASPLIT=data_split_percent
RECOSPLIT=reco_split_percent
DATAREDUNDANCY=data_redundancy_level
RECOREDUNDANCY=reco_redundancy_level
SPLITDISK=percent_of_cell_disk
WHERE
DATADG=data_diskgroup
RECODG=reco_diskgroup
{ CLUSTERNAME=cluster_name |
CLUSTERNUMBER=cluster_number |
CLUSTERID=cluster_id }
Arguments
You can modify the following sizing attributes of the DATA and RECO Oracle ASM disk groups:
• DATASPLIT : Specifies a percentage of the Oracle ASM volume allocated to the DATA disk
group. The sum of DATASPLIT and RECOSPLIT cannot exceed 100.
• RECOSPLIT : Specifies a percentage of the Oracle ASM volume allocated to the RECO disk
group. The sum of DATASPLIT and RECOSPLIT cannot exceed 100.
• DATAREDUNDANCY : Specifies the redundancy level for the DATA disk group. The accepted
values are NORMAL or HIGH.
• RECOREDUNDANCY : Specifies the redundancy level for the RECO disk group. The accepted
values are NORMAL or HIGH.
4-52
Chapter 4
OEDACLI Command Reference
• SPLITDISK : Specifies the percentage of the cell disk to allocate to the DATA and RECO
disk groups. The specified value must be an integer between 1 and 100.
The following arguments are available in the WHERE clause:
• DATADG : Specifies the name of the DATA disk group in the cluster
• RECODG : Specifies the name of the RECO disk group in the cluster
• CLUSTERNUMBER : Specifies the cluster number in the es.xml, starting at 1
• CLUSTERNAME : Specifies the name of the cluster
• CLUSTERID : Specifies the es.xml ID of the cluster
Syntax
DELETE DISKGROUP
WHERE
{ ID=diskgroup_id |
CLUSTERNUMBER=cluster_number DISKGROUPNAME=diskgroup_name |
CLUSTERNAME=cluster_name DISKGROUPNAME=diskgroup_name |
CLUSTERID=cluster_id DISKGROUPNAME=diskgroup_name }
Arguments
The following arguments are available in the WHERE clause:
4-53
Chapter 4
OEDACLI Command Reference
Syntax
LIST DISKGROUPS
[ WHERE
{ ID=diskgroup_id |
CLUSTERNUMBER=cluster_number |
CLUSTERNAME=cluster_name |
CLUSTERID=cluster_id } ]
Arguments
The following arguments are available in the WHERE clause:
4.3.11 DOM0
You can list Oracle VM management domains (dom0s).
• LIST DOM0S
Syntax
LIST DOM0S
4-54
Chapter 4
OEDACLI Command Reference
Usage Notes
This command is deprecated. Instead, use:
4.3.12 DOMAIN
You can get live information from a domain.
• GET DOMAIN
Syntax
GET DOMAIN
ACTION=action
WHERE
{ ID=id |
HOSTNAME=hostname |
CLUSTERNUMBER=cluster_number { COMPUTENUMBER=compute_number |
STORAGENUMBER=storage_number } |
CLUSTERNAME=cluster_name { COMPUTENUMBER=compute_number |
STORAGENUMBER=storage_number } |
CLUSTERID=cluster_id { COMPUTENUMBER=compute_number |
STORAGENUMBER=storage_number } }
Arguments
ACTION : Specifies the information that the command returns.
If the action is applied to a guest, then the command displays specific information for the guest.
If the action is applied to the host, then the command displays information for the hypervisor.
• LISTIMAGES: Displays image file details.
• LISTDOMAIN: Displays domain details.
• LISTMEMORY: Displays memory details.
• LISTVCPU: Displays CPU details.
The following arguments are available in the WHERE clause:
4-55
Chapter 4
OEDACLI Command Reference
• STORAGENUMBER : Specifies the es.xml storage server number in the cluster, starting at 1
4.3.13 ES
You can discover an engineered system or alter a limited number of attributes of an engineered
system.
• ALTER ES
This command alters the attributes of an engineered system.
• DISCOVER ES
This command discovers an existing configuration of an engineered system.
• VALIDATE ES
4.3.13.1 ALTER ES
This command alters the attributes of an engineered system.
Syntax
ALTER ES
PAAS = 'pass_mode' |
CUSTOMERNAME = customer_name |
CUSTOMERDEPT = customer_dept
Arguments
You can modify the following attributes for the engineered system:
• PAAS : A boolean value, TRUE or FALSE, which specifies whether to enable PaaS mode.
• CUSTOMERNAME : Specifies the customer name.
• CUSTOMERDEPT : Specifies the customer department.
4.3.13.2 DISCOVER ES
This command discovers an existing configuration of an engineered system.
Syntax
DISCOVER ES
HOSTNAMES = host_names
LOCATION = directory_name
Arguments
You can use the following arguments when discovering an engineered system configuration:
• HOSTNAMES: Specifies the list of nodes to be discovered, with each host name separated by
a ',' or a space. The list must be enclosed in quotation marks, for example, 'node1,node2'
or 'node1 node2'. For virtual environments with user domains, you need to provide a list
of only management domain (dom0) host names and storage servers.
• LOCATION: Specifies the target directory for file creation.
4-56
Chapter 4
OEDACLI Command Reference
Usage Notes
The following are requirements and limitations of the DISCOVER ES command:
4.3.13.3 VALIDATE ES
Validates certain aspects of an OEDA XML configuration file (es.xml).
Syntax
VALIDATE ES
4.3.14 EXASCALE
• DEPLOY EXASCALE
This command performs Exascale deployment actions.
Syntax
DEPLOY EXASCALE
ACTION = action
WHERE
{ CLUSTERNUMBER = clusternumber [ DATABASENAME = databasename ] |
CLUSTERNAME = clustername [ DATABASENAME = databasename ] |
CLUSTERID = clusterid [ DATABASENAME = databasename ] |
DATABASENAME = databasename }
Arguments
• ACTION: Specifies the Exascale deployment action, which is one of the following:
CONFIGURECELLS, CONFIGURECOMPUTES, CREATEDBWALLET, CREATEGIVAULT, CREATEDBVAULT,
4-57
Chapter 4
OEDACLI Command Reference
• CLUSTERNUMBER : Specifies the cluster number in the OEDA configuration file (es.xml),
starting at 1.
• CLUSTERNAME : Specifies the name of the cluster.
• CLUSTERID : Specifies the OEDA configuration file (es.xml) ID of the cluster.
• DATABASENAME : Specifies the name of the database.
Usage Notes
• The CONFIGURECELLS action must be performed before the CONFIGURECOMPUTES action.
• The CONFIGURECELLS and CONFIGURECOMPUTES actions must be performed before any wallet
or vault actions.
• The CONFIGURECOMPUTES action creates an Exascale wallet for the Oracle Grid
Infrastructure operating system (OS) owner. This wallet also supports Oracle Database in
a non-role-separated Exadata configuration, where the Oracle Grid Infrastructure OS
owner is the same as the Oracle Database OS owner.
• The CREATEDBWALLET action only creates an Exascale wallet for an Oracle Database OS
owner in a role-separated Exadata configuration, where the Oracle Database OS owner is
not the same as the Oracle Grid Infrastructure OS owner.
• Undo actions must be performed in the following order: UNDOCREATEDBVAULT,
UNDOCREATEGIVAULT, UNDOCREATEDBWALLET, UNDOCONFIGURECOMPUTES and
UNDOCONFIGURECELLS.
4.3.15 EXASCALECLUSTER
• ADD EXASCALECLUSTER
This command adds a new Exascale cluster.
• ALTER EXASCALECLUSTER
This command alters an existing Exascale cluster.
• DELETE EXASCALECLUSTER
This command deletes an existing Exascale cluster.
• LIST EXASCALECLUSTER
This command displays details for an existing Exascale cluster.
• LIST EXASCALECLUSTERS
This command displays details for all Exascale clusters.
Syntax
ADD EXASCALECLUSTER
NAME = exascaleclustername
4-58
Chapter 4
OEDACLI Command Reference
[ VIP = ersvip
IP = ersip ]
Arguments
• NAME: Specifies the name of the Exascale cluster.
• VIP: Specifies the DNS name for the virtual IP (VIP) interface that provides access to
Exascale control services (also known as Exascale RESTful Services or ERS).
• IP: Specifies the IP address for the ERS VIP.
Usage Notes
• The network interface specified by VIP and IP is associated with a highly-available virtual
IP (VIP) network interface, which provides a consistent network end point for Exascale
control services. The VIP is hosted by one of the Exadata storage servers, which also runs
a front-end ERS instance. If the storage server or ERS instance becomes unavailable,
then the VIP moves to another server hosting a front-end ERS instance.
You should define the ERS VIP if possible. The option to define an Exascale cluster
without an ERS VIP primarily exists to support Exascale configurations on existing Exadata
systems that have no spare IP addresses to support the ERS VIP.
Syntax
ALTER EXASCALECLUSTER
[ NAME = newexascaleclustername ]
[ VIP = newersvip ]
[ IP = newersip ]
WHERE
NAME = exascaleclustername
Arguments
• NAME: Changes the name of the Exascale cluster.
• VIP: Specifies the DNS name for the virtual IP (VIP) interface that provides access to
Exascale control services (also known as Exascale RESTful Services or ERS).
• IP: Specifies the IP address for the ERS VIP.
The following argument is available in the WHERE clause:
• NAME: Specifies the name for the Exascale cluster that you want to alter.
Usage Notes
• The network interface specified by VIP and IP is associated with a highly-available virtual
IP (VIP) network interface, which provides a consistent network end point for Exascale
control services. The VIP is hosted by one of the Exadata storage servers, which also runs
a front-end ERS instance. If the storage server or ERS instance becomes unavailable,
then the VIP moves to another server hosting a front-end ERS instance.
4-59
Chapter 4
OEDACLI Command Reference
Syntax
DELETE EXASCALECLUSTER
WHERE
NAME = exascaleclustername
Arguments
The following argument is available in the WHERE clause:
• NAME: Specifies the name for the Exascale cluster that you want to delete.
Usage Notes
• You cannot delete an Exascale cluster while it provides resources to Oracle Grid
Infrastructure or an Oracle database.
Syntax
LIST EXASCALECLUSTER
WHERE
NAME = exascaleclustername
Arguments
The following argument is available in the WHERE clause:
• NAME: Specifies the name for the Exascale cluster that you want to display.
Syntax
LIST EXASCALECLUSTERS
4.3.16 EXITONERROR
You can set the exit status for OEDACLI.
• SET EXITONERROR
This command controls the exit status for OEDACLI when an error in encountered.
4-60
Chapter 4
OEDACLI Command Reference
Syntax
Arguments
• ENABLE: When ENABLE=true, a run-time error causes OEDACLI to terminate with exit code
1. This option may be useful when OEDACLI is used inside a script.
4.3.17 FILE
You can manage the Engineered System XML file (es.xml).
• LOAD FILE
• MERGE FILES
• SAVE FILE
• SAVE FILES
Syntax
Arguments
• NAME : Specifies the name of an existing Engineered System XML file
Example 4-23 Loading a File into OEDACLI for Editing
Syntax
MERGE FILES
INPUT='input_files'
OUTPUT=output_file
4-61
Chapter 4
OEDACLI Command Reference
Arguments
• INPUT: Specifies a space-separated list of Engineered System XML files to merge. The list
of input files is surrounded by single quotes (').
• OUTPUT: Specifies the new target Engineered System XML file. The file is overwritten if it
already exists.
Syntax
SAVE FILE
[ NAME=file_name ]
[ MAC={ true | false } ]
Arguments
• NAME: Optionally specifies the name of a new Engineered System XML file. If you do not
specify the NAME argument, then the command overwrites the source file.
• MAC: When MAC=true, OEDACLI updates the Engineered System XML file with MAC
addresses for the system components. The ILOM interfaces must be available for this
operation.
Syntax
SAVE FILES
LOCATION=dir_name
[ MAC={ true | false } ]
Arguments
• LOCATION: Specifies the name of a target directory for file creation.
• MAC: When MAC=true, OEDACLI updates the Engineered System XML file with MAC
addresses for the system components. The ILOM interfaces must be available for this
operation.
Usage Notes
The specified LOCATION directory is created if it does not already exist.
4.3.18 GUEST
You can clone or delete an Oracle VM guest.
4-62
Chapter 4
OEDACLI Command Reference
• CLONE GUEST
This command clones an existing VM guest and creates a new fully functional guest with
storage, users, and Oracle RAC instances.
• DELETE GUEST
This command deletes an existing Oracle VM guest, and removes all of its configuration:
instances, software installations, storage, and users from the cluster.
Prerequisites
Before you can clone an virtual machine (VM) guest, you must download the appropriate
software images from My Oracle Support and extract the files. Place the extracted "klone.zip"
files for Oracle Grid Infrastructure and Oracle Database in the /EXAVMIMAGES/onecommand/
<platform>/WorkDir directory in the VM host where the new guest clone will be created.
Syntax
CLONE GUEST
{ SRCNAME=source_guest TGTNAME=target_guest |
TGTNAMES=target_guests }
[ WHERE
STEPNAME=stepname ]
Arguments
• SRCNAME: Specifies the name of an existing guest VM from which the new guest VM is
derived.
• TGTNAME: Specifies the host name of the new guest VM that you are creating with the clone
operation.
• TGTNAMES: Specifies a comma-separated list of new guest VMs to add.
• STEPNAME: Specifies the deployment step to perform, which is one of the following:
– CREATE_GUEST
– CREATE_USERS
– CELL_CONNECTIVITY
4-63
Chapter 4
OEDACLI Command Reference
– CONFIG_CLUSTERWARE
– RUN_ROOTSCRIPT
– EXTEND_DBHOME
– ADD_INSTANCE
You can specify the following additional settings when specifying CLONE GUEST with the WHERE
STEPNAME=CREATE_GUEST clause or when specifying CLONE GUEST without using any WHERE
STEPNAME clause:
• PARENT: Specifies the name of the virtual machine (VM) host (Oracle Linux KVM or Oracle
VM) that hosts the new guest.
• ADMINNET : Specifies the DNS name and IP address to use for the administration network.
Also, optionally specifies the gateway and netmask for the administration network.
• BACKUPNET : Specifies the DNS name and IP address to use for the backup network. The
DNS name may optionally include the domain name. Not required on guests without a
backup network.
• PRIVNET : Specifies the names and IP addresses to use for the first and second private
networks.
• INTERCONNECT: Only required if the compute nodes are configured with Exadata Secure
RDMA Fabric Isolation or InfiniBand security (PKEYS). Specifies the names and IP
addresses to use for the first and second private networks.
• CLIENTNET : Specifies the DNS name and IP address to use for the client network. May
optionally include host name, IP address, domain name, and netmask details to support
Network Address Translation (NAT).
• VIPNET : Specifies the DNS name and IP address to use for the virtual IP (VIP) network.
Usage Notes
• For configurations with Exadata Secure RDMA Fabric Isolation or InfiniBand security
(PKEYS), INTERCONNECT defines the private network that connects the database nodes and
PRIVNET defines the private storage network.
• When you load the XML configuration file to use when cloning a guest domain, the XML
file should have the management domain (dom0) node of the source VM defined but not
allocated to the cluster that is being extended into the guest domain.
• You should save the modified XML file after the actions are merged so that you have a
new XML file that reflects the addition of the new guest domain.
• You can use the CLONE GUEST command to add a VM to a server that already contains a
VM in the same cluster. Consequently, you can create a configuration where one VM host
contains multiple VMs that are members of the same cluster. However, this capability is
only available on systems not configured with Exadata Secure RDMA Fabric Isolation.
• During deployment, the cloned guest inherits various configuration attributes from the
source guest, including the client network configuration and the backup network
configurations (if present).
If all of the KVM hosts have the same network configuration, then the inherited attributes
work as expected.
However, if the new KVM host uses a different physical network configuration, deployment
of the cloned guest will fail. This situation is most likely when an Exadata system contains
different versions of compute node hardware. For example, when adding an X10M server
to an X8M-2 rack.
4-64
Chapter 4
OEDACLI Command Reference
In this case, you must manually adjust the relevant network definition by using the ALTER
NETWORK command before deployment. Contact Oracle Support for details.
Example 4-24 Cloning a Guest VM
This example shows how to clone a new guest from an existing node in the cluster. In this
example, the source node name is exa01adm01vm01.example.com and the new node is
exa01adm03vm01.example.com. A series of SET commands are used to specify the configuration
for the new guest VM.
The XML file loaded at the beginning of this example has the dom0 node
(host01adm01.example.com) defined but not allocated to the cluster that is being extended
into the guest.
SAVE ACTION
MERGE ACTIONS
DEPLOY ACTIONS
Related Topics
• Expanding an Oracle VM RAC Cluster on Exadata Using OEDACLI
• Expanding an Oracle RAC Cluster in Oracle Linux KVM Using OEDACLI
4-65
Chapter 4
OEDACLI Command Reference
Syntax
DELETE GUEST
WHERE
{ SRCNAME=node_name [ STEPNAME=stepname ] |
SRCNAMES='node_names' [ STEPNAME=stepname ] }
Arguments
• SRCNAME specifies the host name of an existing DomU that you want to delete.
• SRCNAMES specifies a comma-separated list of host names for existing guests that you want
to delete. The specified list of host names must be surrounded by quotation marks.
• STEPNAME allows you to undo individual steps of the clone operation.
The value of stepname can be one of the following:
– ADD_INSTANCE
– EXTEND_DBHOME
– RUN_ROOTSCRIPT
– CONFIG_CLUSTERWARE
– CELL_CONNECTIVITY
– CREATE_USERS
– CREATE_GUEST
When used with DELETE GUEST, the STEPNAME clauses should be used in the reverse order
of CLONE GUEST steps, and you should not skip any steps. For example, if you want to undo
the ADD_NODE and ADD_INSTANCE steps, you would use the following commands:
4-66
Chapter 4
OEDACLI Command Reference
4.3.19 ILOM
You can alter or list the ILOMS in the loaded es.xml file.
• ALTER ILOM
• LIST ILOMS
Syntax
ALTER ILOM
{ DNSSERVERS='dns_servers' |
NTPSERVERS='ntp_servers' |
TIMEZONE=timezone } ...
WHERE
{ ID=ilom_id |
HOSTNAME=host_name |
ILOMNAME=ilom_host_name }
Arguments
You can specify the following attributes for the ILOM:
• DNSSERVERS : Specifies a comma-separated list of DNS servers that is enclosed in single
quotes.
• NTPSERVERS : Specifies a comma-separated list of NTP servers that is enclosed in single
quotes.
• TIMEZONE : Specifies a valid time zone for the ILOM.
The following arguments are available in the WHERE clause:
4-67
Chapter 4
OEDACLI Command Reference
Syntax
LIST ILOMS
[ WHERE
{ ID = ilom_id |
HOSTNAME = hostname |
ILOMNAME = ilom_hostname } ]
Arguments
The following arguments are available in the WHERE clause:
Usage Notes
If you do not specify a WHERE clause, then this command lists all the ILOMs in the es.xml file.
4.3.20 LOGIN
You can check remote login to a machine or cluster.
• CHECK LOGIN
Syntax
CHECK LOGIN
WHERE
{ CLUSTERNUMBER=cluster_number |
CLUSTERNAME=cluster_name |
CLUSTERID=cluster_id |
HOSTNAME=host_name }
Arguments
The following arguments are available in the WHERE clause:
4-68
Chapter 4
OEDACLI Command Reference
4.3.21 MACHINE
You can alter or list the machines in the es.xml file.
• ALTER MACHINE
• ALTER MACHINES
• LIST MACHINES
Syntax
ALTER MACHINE
{ { DNSSERVERS='dnsservers' |
GATEWAYADAPTER=gatewayadapter |
HOSTNAMEADAPTER=hostnameadapter |
NTPSERVERS='ntpservers' |
TIMEZONE=timezone |
VSWITCH={ true | false } |
TYPE=newmachinetype |
ORADISKSIZE=oradisksize |
ORADISKPATH=oradiskpath }...
| ACTION={ START [ WAIT={ true | false } ] |
STOP [ WAIT={ true | false } ] |
RESTART [ WAIT={ true | false } ] |
CREATEIMAGE IMAGEFILE=imagefile SIZE=size
[ FILESYSTEM=filesystem ] [ ZIPFILE=zipfile ] |
ATTACHDISK IMAGEFILE=imagefile MOUNTPATH=mountpath
[ FILESYSTEM=filesystem ] |
DETACHDISK IMAGEFILE=imagefile [ DELETE=delete ] |
SETVCPU [ VCPU=vcpu ] [ MAXVCPU=maxvcpu ] [ REBOOT={ true |
false } ] |
SETVMEM VMEM=vmem [ REBOOT={ true | false } ] } }
WHERE
{ ID=id |
HOSTNAME=hostname |
CLUSTERNUMBER=clusternumber { COMPUTENUMBER=computenumber |
STORAGENUMBER=storagenumber } |
CLUSTERNAME=clustername { COMPUTENUMBER=computenumber |
STORAGENUMBER=storagenumber } |
CLUSTERID=clusterid { COMPUTENUMBER=computenumber |
STORAGENUMBER=storagenumber } }
Arguments
You can specify the following arguments for the machine:
4-69
Chapter 4
OEDACLI Command Reference
• DNSSERVERS: Comma-separated list of DNS servers for the machine. Enclose the list in
single quotes (').
• GATEWAYADAPTER: Network adapter to use for the machine gateway: ADMIN or CLIENT
• HOSTNAMEADAPTER: Network adapter to use for the machine hostname: ADMIN or CLIENT
• NTPSERVERS: Comma-separated list of NTP servers for the machine. Enclose the list in
single quotes (').
• TIMEZONE: Timezone specification for the machine
• VSWITCH: Specifies if the machine is connected to a vswitch. Default is false.
• TYPE: Sets a machine as new type. For example: X8XT
• ORADISKSIZE: Size (in GB) of the Oracle software volume (typically /u01). Default is 20,
minimum is 10.
• ORADISKPATH: Mount point of the Oracle software volume. Default is /u01. For non-default
values, take great care to ensure other paths are compatible with the setting.
• ACTION: Action to perform against the specified VM guest machine. One of the following:
– START: Starts the specified guest. The action completes when the machine is ready for
SSH connections. There is no error if the machine is already started.
– STOP: Stops the specified guest. The action completes when the machine is shut down.
There is no error if the machine is already stopped.
– RESTART: Stops and then starts the specified guest. The action completes when the
machine is ready for SSH connections. There is no error if the machine is already
stopped.
– CREATEIMAGE: Creates a disk image in the hypervisor for subsequent ATTACHDISK
commands.
– ATTACHDISK: Attaches a disk image from the hypervisor to a running guest and mounts
the file system in the guest. FILESYSTEM must be specified if the default (xfs) is not
used.
– DETACHDISK: Unmount the file system and detach a disk image from a guest, and
optionally delete the disk image.
– SETVCPU: Changes the CPU resource allocation for a guest. The action allows
allocation increases and reductions within the limit specified by the maxcpu value in the
vm.cfg file. The action can operate on a running guest. A reboot is not required to
enable changes.
– SETVMEM: Changes the RAM resource allocation for a guest. A reboot is required to
enable a change.
The following ACTION arguments are available:
– WAIT: Optionally specifies whether to wait for the associated action to complete.
Default is true. With WAIT=false, the action starts asynchronously, and the command
returns immediately with no indication or guarantee of success.
– IMAGEFILE: Name of the disk image file
– SIZE: Size (in GB) of the disk image file
– FILESYSTEM: File system type used in the disk image. Default is xfs. Alternative is
ext4.
– ZIPFILE: Zip file used to optionally populate a new disk image
4-70
Chapter 4
OEDACLI Command Reference
• ID: Specifies the identifier for the target machine in the OEDA XML file (es.xml)
• HOSTNAME: Specifies the current host name of the target machine
• CLUSTERNUMBER: Cluster number associated with target machine in the OEDA XML file
(es.xml), starting at 1
• CLUSTERNAME: Name of the cluster associated with target machine in the OEDA XML file
(es.xml)
• CLUSTERID: ID of the cluster associated with target machine in the OEDA XML file (es.xml)
• COMPUTENUMBER: The compute node number associated with target machine in the OEDA
XML file (es.xml). The numbering of compute nodes starts at 1 for each cluster.
• STORAGENUMBER: The storage server number associated with target machine in the OEDA
XML file (es.xml). The numbering of storage servers starts at 1 for each cluster.
Example 4-27 ACTION Examples
The following examples show commands that use the ACTION argument:
• Start a guest:
• Stop a guest:
• Restart a guest:
4-71
Chapter 4
OEDACLI Command Reference
Syntax
ALTER MACHINES
{ ORADISKSIZE=oradisksize |
ORADISKPATH=oradiskpath |
IMAGEVERSION=imageversion }...
4-72
Chapter 4
OEDACLI Command Reference
WHERE
{ CLUSTERNUMBER=clusternumber |
CLUSTERNAME=clustername |
CLUSTERID=clusterid |
TYPE=GUESTS }
Arguments
You can specify the following arguments for the machine:
• ORADISKSIZE: Size (in GB) of the Oracle software volume (typically /u01). Default is 20,
minimum is 10.
• ORADISKPATH: Mount point of the Oracle software volume. Default is /u01. For non-default
values, take great care to ensure other paths are compatible with the setting.
• IMAGEVERSION: The version of the image to deploy on guest machines. This argument is
only applicable to guest machines (WHERE TYPE=GUEST).
The following arguments are available in the WHERE clause:
• CLUSTERNUMBER: Cluster number associated with target machine in the OEDA XML file
(es.xml), starting at 1
• CLUSTERNAME: Name of the cluster associated with target machine in the OEDA XML file
(es.xml)
• CLUSTERID: ID of the cluster associated with target machine in the OEDA XML file (es.xml)
• TYPE=GUEST: Applies the change to all guest machines. This option is only applicable when
setting the IMAGEVERSION.
Syntax
LIST MACHINES
[ WHERE
{ TYPE=type |
ID=machine_id |
CLUSTERNUMBER=cluster_number [ TYPE=type ] |
CLUSTERNAME=cluster_name [ TYPE=type ] |
CLUSTERID=cluster_id [ TYPE=type ] } ]
Arguments
The following arguments are available in the WHERE clause:
• TYPE : Specifies the machine type. The valid values are COMPUTE, CELL, STORAGE, DOM0,
GUEST, DOMU, KVM, or KVMGUEST.
• ID : Specifies the es.xml ID for an individual machine
• CLUSTERNUMBER : Specifies the cluster number in the es.xml, starting at 1
• CLUSTERNAME : Specifies the name of the cluster
• CLUSTERID : Specifies the es.xml ID of the cluster
4-73
Chapter 4
OEDACLI Command Reference
Usage Notes
If you do not specify a WHERE clause, then this command lists all the machines defined in the
es.xml file.
4.3.22 NETWORK
You can add, alter, delete, or list the networks defined in the XML configuration file.
• ADD NETWORK
• ALTER NETWORK
• ALTER NETWORKS
• DELETE NETWORK
• LIST NETWORKS
Syntax
ADD NETWORK
NETWORKTYPE=network_type
HOSTNAME=hostname
IP=ip_addr
NETMASK=netmask
DOMAINNAME=domain_name
MASTER=master
[ MTU=mtu ]
[ GATEWAY=gateway ]
[ SSHENABLED={ true | false } ]
[ MAC=mac_addr ]
[ LINKSPEED=nic_speed ]
[ SLAVE='slave' ]
[ PKEY=pkey ]
[ PKEYNAME=pkey_name ]
[ STATUS = status ]
[ LACP={ true | false } ]
[ VLANID=vlan_id ]
[ INTERFACENAME=interface_name ]
[ DESCRIPTION='network_description' ]
[ VSWITCHNETWORKPARAMS='vswitchnetwork_parameters' ]
[ NATHOSTNAME=nat_host_name ]
[ NATIP=nat_ip_addr ]
[ NATDOMAINNAME=nat_domain_name ]
[ NATNETMASK=nat_mask ]
WHERE
{ HOSTNAME=hostname |
CLUSTERNAME=cluster_name { COMPUTENUMBER=compute_number |
STORAGENUMBER=storage_number } |
CLUSTERNUMBER=cluster_name { COMPUTENUMBER=compute_number |
STORAGENUMBER=storage_number } }
4-74
Chapter 4
OEDACLI Command Reference
Arguments
You can specify the following attributes when adding a network:
• NETWORKTYPE: Specifies the type of network, which can be ADMIN, CLIENT, BACKUP, PRIVATE,
OTHER, INGESTVIP, REPLICATIONVIP, or ILOM.
• HOSTNAME: Specifies the short host name for the network
• IP: Specifies the IP address of the network
• NETMASK: Specifies the network netmask
• DOMAINNAME: Specifies the domain name of the network
• MASTER: Specifies the primary adapter name
• MTU: Specifies the network MTU (maximum transmission unit). Not applicable for PRIVATE
or ILOM networks.
• GATEWAY: Specifies the network subnet gateway
• SSHENABLED: TRUE indicates that SSH should be enabled for this adapter
• MAC: Specifies the MAC address
• LINKSPEED: Either 10000 or 25000. Only for X7-2 or later 2-socket compute nodes.
• SLAVE: Specifies a space-separated list of secondary devices for a bonded network,
enclosed in single quotes
• PKEY: Specifies the pkey, for PRIVATE networks only
• PKEYNAME: Specifies the pkey name, for PRIVATE networks only
• STATUS: Specifies the status of the network
• LACP: TRUE indicates that LACP should be enabled
• VLANID: Specifies the VLAN identifier. Applicable if the network is a non-private VLAN
network, or a VLAN network on a KVM guest.
• INTERFACENAME: The name for the private network on the VLAN for a KVM guest and cell,
clre[0-1] or stre[0-1].
• DESCRIPTION: The text description for this network, surrounded by single quotes.
• VSWITCHNETWORKPARAMS: Parameters required for vswitches, surrounded by single quotes.
• NATHOSTNAME: Specifies the NAT host name
• NATIP: Specifies the NAT IP address
• NATDOMAINNAME: Specifies the NAT domain name
• NATNETMASK: Specifies the NAT netmask
The following arguments are available in the WHERE clause:
4-75
Chapter 4
OEDACLI Command Reference
• STORAGENUMBER: Specifies the umber of an existing storage cell in the cluster, starting at 1
Syntax
ALTER NETWORK
{ HOSTNAME=hostname |
IP=ip_addr |
NETMASK=netmask |
DOMAINNAME=domain_name |
MASTER=master |
GATEWAY=gateway |
SSHENABLED={ true | false } |
MAC=mac_addr |
MTU=mtu |
LINKSPEED=nic_speed |
SLAVE='slave' |
PKEY=pkey |
PKEYNAME=pkey_name |
STATUS=status |
LACP={ true | false } |
VLANID=vlan_id |
INTERFACENAME=interface_name |
DESCRIPTION='network_description' |
VSWITCHNETWORKPARAMS='vswitchnetwork_parameters' |
NATHOSTNAME=nat_host_name |
NATIP=nat_ip_addr |
NATDOMAINNAME=nat_domain_name |
NATNETMASK=nat_mask } ...
WHERE
{ ID=network_id |
NETWORKHOSTNAME=network_hostname |
NATHOSTNAME=nat_hostname |
HOSTNAME=hostname NETWORKTYPE=network_type [ PRIVATEID=private_id ] |
CLUSTERNAME=cluster_name { COMPUTENUMBER=compute_number |
STORAGENUMBER=storage_number } NETWORKTYPE=network_type
[ PRIVATEID=private_id ] |
CLUSTERNUMBER=cluster_number { COMPUTENUMBER=compute_number |
STORAGENUMBER=storage_number } NETWORKTYPE=network_type
[ PRIVATEID=private_id ] }
Arguments
You can specify the following attributes when altering a network:
• HOSTNAME: Specifies the short host name for the network
• IP: Specifies the IP address of the network
• NETMASK: Specifies the netmask of the network
• DOMAINNAME: Specifies the domain name of the network
• MASTER: Specifies the primary adapter name
4-76
Chapter 4
OEDACLI Command Reference
• ID: Specifies the ID for the target network in the XML configuration file.
• NETWORKHOSTNAME: Specifies the host name for an network object, not the machine host
name
• NATHOSTNAME: Specifies the NAT host name for an existing compute node
• HOSTNAME: Specifies the host name for an existing compute node
• NETWORKTYPE: Specifies the type of network, which can be ADMIN, CLIENT, BACKUP, PRIVATE,
OTHER, INGESTVIP, REPLICATIONVIP, or ILOM.
• PRIVATEID: Specifies the ID of the private network
• CLUSTERNUMBER: Specifies the cluster number in the XML configuration file, starting at 1
• CLUSTERNAME: Specifies the name of an existing cluster
• COMPUTENUMBER: Specifies the number of an existing compute node in the cluster, starting
at 1
• STORAGENUMBER: Specifies the number of an existing storage cell in the cluster, starting at 1
4-77
Chapter 4
OEDACLI Command Reference
Syntax
ALTER NETWORKS
VLANID=vlan_id
WHERE
HOSTNAMES=hostnames
NETWORKTYPE=network_type
Arguments
• VLANID: Specifies the VLAN identifier.
• HOSTNAMES: Specifies a comma-separated list of host names
• NETWORKTYPE: Specifies the type of network, which can be ADMIN, CLIENT, BACKUP, PRIVATE
(storage private network), or CLUSTERPRIVATE.
Usage Notes
• During corresponding MERGE ACTIONS processing, the VLAN identifier is set even if the
specified host does not have an existing VLAN.
• During corresponding DEPLOY ACTIONS processing, the storage cells reboot in parallel to
enable the new VLAN identifier.
Syntax
DELETE NETWORK
WHERE
{ ID=network_id |
HOSTNAME=network_hostname [ NETWORKTYPE=network_type ] |
CLUSTERNAME=cluster_name { COMPUTENUMBER=compute_number |
STORAGENUMBER=storage_number } [ NETWORKTYPE=network_type ] |
CLUSTERNUMBER=cluster_number { COMPUTENUMBER=compute_number |
STORAGENUMBER=storage_number } [ NETWORKTYPE=network_type ] |
CLUSTERID=cluster_id { COMPUTENUMBER=compute_number |
STORAGENUMBER=storage_number } [ NETWORKTYPE=network_type ] }
Arguments
The following arguments are available in the WHERE clause:
• ID : Specifies the ID for the network object in the XML configuration file.
• HOSTNAME : Specifies the host name for an existing compute node
• NETWORKTYPE : Specifies the type of network, which can be ADMIN, CLIENT, BACKUP,
PRIVATE, OTHER, INGESTVIP, REPLICATIONVIP, or ILOM.
• CLUSTERNAME : Specifies the name of an existing cluster
• CLUSTERNUMBER : Specifies the cluster number in the XML configuration file, starting at 1
• CLUSTERID : Specifies the cluster ID in the XML configuration file
4-78
Chapter 4
OEDACLI Command Reference
• COMPUTENUMBER : Specifies the number of an existing compute node in the cluster, starting
at 1
• STORAGENUMBER : Specifies the number of an existing storage cell in the cluster, starting at 1
Syntax
LIST NETWORKS
[ WHERE
{ ID=network_id |
HOSTNAMES=ALL [ NETWORKTYPE=network_type ] |
HOSTID=host_id [ NETWORKTYPE=network_type ] |
HOSTNAME=network_hostname [ NETWORKTYPE=network_type ] |
CLUSTERNAME=cluster_name { COMPUTENUMBER=compute_number |
STORAGENUMBER=storage_number } [ NETWORKTYPE=network_type ] |
CLUSTERNUMBER=cluster_number { COMPUTENUMBER=compute_number |
STORAGENUMBER=storage_number } [ NETWORKTYPE=network_type ] } ]
Arguments
The following arguments are available in the WHERE clause:
• ID : Specifies the ID for the network object in the XML configuration file
• HOSTNAMES=ALL : Specifies all hosts
• NETWORKTYPE : Specifies the type of network, which can be ADMIN, CLIENT, BACKUP,
PRIVATE, or ILOM.
• HOSTID : Specifies the host ID in the XML configuration file
• HOSTNAME : Specifies the host name for an existing compute node
• CLUSTERNAME : Specifies the name of an existing cluster
• CLUSTERNUMBER : Specifies the cluster number in the XML configuration file, starting at 1
• CLUSTERID : Specifies the cluster ID in the XML configuration file
• COMPUTENUMBER : Specifies the number of an existing compute node in the cluster, starting
at 1
• STORAGENUMBER : Specifies the number of an existing storage cell in the cluster, starting at 1
4.3.23 PASSWORD
You can specify the default passwords.
• ALTER PASSWORD
Modifies the OEDA properties that specifies the default passwords.
4-79
Chapter 4
OEDACLI Command Reference
Syntax
ALTER PASSWORD
[ PASSWORD=new_password ]
WHERE
USER={ ROOT | NONROOT }
Arguments
• PASSWORD: Specifies the new password.
• USER: Specifies the user type; either ROOT or NONROOT.
Usage Notes
If the PASSWORD argument is not specified, then the user is prompted to specify and verify the
password interactively.
4.3.24 PROPERTY
You can set OEDA properties.
• ALTER PROPERTY
Modifies an OEDA properties parameter.
• LIST PROPERTIES
Displays information about OEDA properties.
Syntax
ALTER PROPERTY
NAME=property_name
VALUE=value
WHERE
[ OS=os_name ]
Arguments
• NAME: Specifies the name of the property to alter. See LIST PROPERTIES to display the
available properties.
• VALUE: Specifies the new property value
• OS: Optionally specifies the operating system that is associated with the property. Permitted
values are: LINUX, SPARC, WINDOWS, MAC, OVM, or WEB.
Usage Notes
If the OS argument is not specified, then the property is updated in the main es.properties file
is updated.
4-80
Chapter 4
OEDACLI Command Reference
Syntax
LIST PROPERTIES
[ WHERE
OS=os_name ]
Arguments
• OS: Optionally specifies the operating system that is associated with the properties.
Permitted values are: LINUX, SPARC, WINDOWS, MAC, OVM, or WEB.
Usage Notes
If the OS argument is not specified, then the properties in the main es.properties are
displayed.
4.3.25 RACK
You can manage an Engineered System rack.
• ADD RACK
Add a new rack to the Engineered System XML file.
• ALTER RACK
Modify a rack in the Engineered System XML file.
• LIST RACKS
Displays information about racks in the Engineered System XML file.
• LIST RACKDESCRIPTION
Displays information about rack types supported by OEDA.
Syntax
ADD RACK
TYPE=ELASTIC
MODEL={ X7 | X8 | X8M }
SRCRACK=srcrack
4-81
Chapter 4
OEDACLI Command Reference
Arguments
• TYPE: Specifies the ELASTIC rack type.
• MODEL: Specifies the rack model. Permitted values are: X7, X8, or X8M.
• SRCRACK: Specifies the es.xml identifier of the existing rack, which is used as the template
for the new rack.
You can set the following options for the new rack:
• ADMIN : Specifies the DNS name and IP address to use for the administration network
switch. The DNS name may optionally include the domain name.
• LEAF1 : Specifies the DNS name and IP address to use for the first leaf switch. The DNS
name may optionally include the domain name.
• LEAF2 : Specifies the DNS name and IP address to use for the second leaf switch. The
DNS name may optionally include the domain name.
• SPINE : Optionally specifies the DNS name and IP address to use for the spine switch. The
DNS name may optionally include the domain name.
• PDU1 : Optionally specifies the DNS name and IP address to use for the first PDU. The
DNS name may optionally include the domain name.
• PDU2 : Optionally specifies the DNS name and IP address to use for the second PDU. The
DNS name may optionally include the domain name.
Syntax
ALTER RACK
ULOC={ ulocation | 0 | GENERATE }
WHERE
RACKNUMBER=rack_number
[ HOSTNAME=host_name ]
ALTER RACK
{ DESCRIPTION=description |
RACKID=rack_type } ...
WHERE
RACKNUMBER=rack_number
Arguments
You can modify the following attributes:
• ULOC: Sets the rack location (uloc) as follows:
– ULOC=ulocation: Specifies a rack location for a specific host or switch
– ULOC=0: Sets the rack location to 0 (zero) for all hosts and switches in the specified
rack.
4-82
Chapter 4
OEDACLI Command Reference
– ULOC=GENERATE: Assigns valid rack locations to all hosts and switches in the specified
rack.
• DESCRIPTION: Sets the rack description
• RACKID: Sets the rack type
The following arguments are available in the WHERE clause:
• RACKNUMBER: Specifies the number of the rack in the Engineered System XML file, starting
at 1
• HOSTNAME: Specifies the host name for a specific host or switch
Usage Notes
If you use the ULOC argument and supply a specific rack location (ULOC=ulocation), then you
must specify HOSTNAME=host_name in the WHERE clause.
Syntax
LIST RACKS
Syntax
LIST RACKDESCRIPTION
[ WHERE
TYPE=rack ]
Arguments
TYPE: Optionally specifies the rack model that you want to use to limit the command output.
Usage Notes
If the WHERE clause is omitted, all rack types are displayed.
4.3.26 REQUIREDFILES
You can display information about required files.
• LIST REQUIREDFILES
Displays information about required installation files for Oracle Grid Infrastructure or Oracle
Database.
4-83
Chapter 4
OEDACLI Command Reference
Syntax
LIST REQUIREDFILES
{ GRID |
DATABASE |
GIVERSION='<giversion>' |
DBVERSION='<dbversion>' }
Arguments
• GRID: Displays information about required files for Oracle Grid Infrastructure
• DATABASE: Displays information about required files for Oracle Database
• GIVERSION: Specifies the Oracle Grid Infrastructure version including the release update
(RU). For example: 12.1.0.2.170418.
• DBVERSION: Specifies the Oracle Database version including the release update (RU). For
example: 12.1.0.2.170418.
Usage Notes
• Use GIVERSION or DBVERSION when no es.xml file is loaded.
• Use LIST SOFTWAREVERSIONS { GRID | DATABASE } to display information about software
versions.
4.3.27 REMOTE
You can run a command on a remote host.
• EXEC REMOTE
Runs a command on remote hosts.
Syntax
EXEC REMOTE
COMMAND='command'
WHERE
HOSTNAMES='host_names'
Section Title
• COMMAND: Specifies the command to run on the specified hosts.
• HOSTNAMES: Specifies the comma-separated list of remote hosts.
4.3.28 SCAN
You can add, alter, delete, or list the SCANs for a cluster.
• ADD SCAN
4-84
Chapter 4
OEDACLI Command Reference
• ALTER SCAN
• DELETE SCAN
• LIST SCANS
Syntax
ADD SCAN
SCANNAME=scan_name
[ SCANPORT=scan_port ]
SCANIPS='scan_ip_addrs'
WHERE
{ CLUSTERNAME=cluster_name |
CLUSTERNUMBER=cluster_number |
CLUSTERID=cluster_id }
Arguments
You can specify the following attributes for the new SCAN:
• SCANNAME : Specifies the DNS name for the SCAN
• SCANPORT : Optionally specifies the port for the SCAN. The default value is 1521.
• SCANIPS : A comma-separated list of IP addresses for the SCAN, enclosed in single quotes
The following arguments are available in the WHERE clause:
Syntax
ALTER SCAN
{ SCANNAME=scan_name |
SCANPORT=scan_port |
SCANIPS='scan_ip_addrs' } ...
WHERE
{ CLUSTERNAME=cluster_name |
CLUSTERNUMBER=cluster_number |
CLUSTERID=cluster_id }
Arguments
You can modify the following attributes for the SCAN:
• SCANNAME : Specifies the DNS name for the SCAN
4-85
Chapter 4
OEDACLI Command Reference
Syntax
DELETE SCAN
WHERE
{ CLUSTERNAME=cluster_name |
CLUSTERNUMBER=cluster_number |
CLUSTERID=cluster_id }
Arguments
The following arguments are available in the WHERE clause:
Syntax
LIST SCANS
[ WHERE
{ ID=scan_id |
CLUSTERNAME=cluster_name |
CLUSTERNUMBER=cluster_number |
CLUSTERID=cluster_id } ]
Arguments
The following arguments are available in the WHERE clause:
4-86
Chapter 4
OEDACLI Command Reference
Usage Notes
If you do not specify a WHERE clause, then this command lists details about all the SCANS for
all the clusters in the XML configuration file.
4.3.29 SECURITY
You can manage security settings.
• SET SECURITY
This command performs security-related actions, like setting the non-default root password
for the OEDACLI session or controlling password-based authentication.
Prerequisites
Before you can use this command with the ENABLEPASSWORDLOGIN option, you must configure
SSH key-based authentication on the target system. See DEPLOY SSHKEYS.
Syntax
SET SECURITY
PASSWORD=root_password
SET SECURITY
ENABLEPASSWORDLOGIN={ true | false }
[ HOSTNAMES="host1[,host2[,host3 ...]]" ]
Arguments
• PASSWORD: Specifies the non-default root password for the OEDACLI session
• ENABLEPASSWORDLOGIN: Specifies whether to enable or disable password-based
authentication for the root user
• HOSTNAMES: Optionally specifies the list of host names on which to act
Usage Notes
If the HOSTNAMES argument is not specified, then the command acts on the currently loaded
Engineered System XML file.
4.3.30 SOFTWAREVERSIONS
You can check supported software versions.
• LIST SOFTWAREVERSIONS
Displays information about supported versions of Oracle Grid Infrastructure and Oracle
Database.
4-87
Chapter 4
OEDACLI Command Reference
Syntax
Arguments
• GRID: Displays information about supported versions of Oracle Grid Infrastructure
• DATABASE: Displays information about supported versions of Oracle Database
Usage Notes
• If neither argument (GRID or DATABASE) is specified, then LIST SOFTWAREVERSIONS displays
information about supported software versions for Oracle Grid Infrastructure and Oracle
Database.
4.3.31 SSHKEYS
You can generate and deploy SSH keys for root user authentication on Oracle Exadata Rack.
• DEPLOY SSHKEYS
This command configures SSH key-based authentication on all hosts in the Engineered
System XML file (es.xml), or the host names specified in the command.
• GENERATE SSHKEYS
This command generates SSH key pairs for all hosts in the Engineered System XML file
(es.xml), or the host names specified in the command. The keys are saved in the OEDA
WorkDir .
• SET SSHKEYS
This command enables and disables SSH key-based authentication for remote commands
run by OEDACLI.
Syntax
DEPLOY SSHKEYS
[ PASSWORD=root_password ]
[ ENABLEPASSWORDLOGIN={ true | false } ]
[ HOSTNAMES="host1[,host2[,host3 ...]]" ]
Arguments
• PASSWORD: Optionally specifies the non-default root password for connecting to the hosts to
set up SSH key access
4-88
Chapter 4
OEDACLI Command Reference
Usage Notes
• If the SSH key pairs are not located in the OEDA WorkDir, then the command also
generates them.
• If the HOSTNAMES argument is not specified, then the command acts on the currently loaded
Engineered System XML file.
Example 4-28 Deploy SSH keys for all hosts of an XML file
Syntax
Arguments
• HOSTNAMES optionally specifies the list of host names for which to generate SSH keys.
Usage Notes
• If the HOSTNAMES argument is not specified, then the command acts on the currently loaded
Engineered System XML file.
Example 4-30 Generate SSH keys for all hosts of an XML file
4-89
Chapter 4
OEDACLI Command Reference
Prerequisites
Before you can use this command, you must configure SSH key-based authentication on the
target system. See DEPLOY SSHKEYS.
Syntax
Arguments
• ENABLE specifies whether or not to enable SSH key-based authentication for remote
commands run by OEDACLI.
4.3.32 STEPS
You can display the steps for a virtual CREATE CLUSTER deployment.
• LIST STEPS
This command lists the steps for a virtual CREATE CLUSTER deployment.
Each step is named, for example Create Virtual Machine. Each step also has a one word
identifier, for example, CREATEVM. The short name identifier is used when specifying STEPS or
SKIPSTEPS in other commands, such as the CREATE CLUSTER command.
The list of valid steps for a cluster depends on the features selected for the cluster. The steps
listed are valid for the identified cluster. If the XML file contains only 1 cluster, then there is no
need to identify the cluster explicitly.
The step numbers listed may change depending on features implemented for the cluster, but
the short name identifier is always the same for a given step.
Syntax
LIST STEPS
[ WHERE
{ CLUSTERNUMBER=cluster_number |
4-90
Chapter 4
OEDACLI Command Reference
CLUSTERNAME=cluster_name |
ID=cluster_id } ]
Arguments
The following arguments are available in the WHERE clause:
4-91
Chapter 4
OEDACLI Command Reference
}, {
"stepName" : "Relink Database with RDS",
"shortName" : "RELINK",
"id" : "11"
}, {
"stepName" : "Create ASM Diskgroups",
"shortName" : "ASMDG",
"id" : "12"
}, {
"stepName" : "Create Databases",
"shortName" : "DATABASE",
"id" : "13"
}, {
"stepName" : "Apply Security Fixes",
"shortName" : "APPLYFIXES",
"id" : "14"
}, {
"stepName" : "Install Exachk",
"shortName" : "EXACHK",
"id" : "15"
}, {
"stepName" : "Create Installation Summary",
"shortName" : "INSTALLSUMMARY",
"id" : "16"
}, {
"stepName" : "Resecure Machine",
"shortName" : "RESECURE",
"id" : "17"
} ]
}
4.3.33 STORAGEPOOL
• ADD STORAGEPOOL
This command adds a new Exascale storage pool.
• ALTER STORAGEPOOL
This command alters an existing Exascale storage pool.
• DELETE STORAGEPOOL
This command deletes an existing Exascale storage pool.
• LIST STORAGEPOOL
This command displays details for an existing Exascale storage pool.
• LIST STORAGEPOOLS
This command displays details for existing Exascale storage pools.
Syntax
ADD STORAGEPOOL
NAME = storagepoolname
4-92
Chapter 4
OEDACLI Command Reference
[ SIZE = size ]
[ TYPE = storagetype ]
CELLLIST = 'celllist'
[ WHERE
EXASCALECLUSTER = exascaleclustername ]
Arguments
• NAME: Specifies the name of the Exascale storage pool.
• SIZE: Optionally, specifies the size of the storage pool in GB. If not specified, then the
storage pool receives all of the available space in the specified cells.
• TYPE: Specify EF to create a flash-based storage pool using High Capacity Exadata storage
servers. Otherwise, the storage pool media type is derived from the Exadata storage
server type.
• CELLLIST: Specifies the list of Exadata storage servers to use for the storage pool. The
value is a space-seperated list of cell names, or use ALL to specify all available cells in the
OEDA configuration file (es.xml). Note that the value is also surrounded by single quotes
(as displayed in the command syntax).
The following argument is available in the WHERE clause:
• EXASCALECLUSTER: Specifies the name for the Exascale cluster that contains the new
storage pool.
Usage Notes
• When you use the ADD STORAGEPOOL command, there is no immediate check to validate the
specified storage pool size. However, deployment fails with an error if there is insufficient
space.
• The WHERE clause is optional if the OEDA configuration file (es.xml) contains only one
Exascale cluster. Otherwise, the WHERE clause is mandatory.
Syntax
ALTER STORAGEPOOL
[ NAME = storagepoolname ]
[ SIZE = size ]
[ TYPE = storagetype ]
[ ADDCELLS = 'addcelllist' ]
[ DROPCELLS = 'dropcelllist' ]
WHERE
[ EXASCALECLUSTER = exascaleclustername ]
NAME = storagepoolname
Arguments
• NAME: Changes the name of the Exascale storage pool.
• SIZE: Changes the size (in GB) of the storage pool.
4-93
Chapter 4
OEDACLI Command Reference
• TYPE: Specify EF to create a flash-based storage pool using High Capacity Exadata storage
servers. Otherwise, the storage pool media type is derived from the Exadata storage
server type.
• ADDCELLS: Specifies the list of Exadata storage servers to add to the storage pool. The
value is a space-seperated list of cell names. Note that the value is also surrounded by
single quotes (as displayed in the command syntax).
• DROPCELLS: Specifies the list of Exadata storage servers to remove from the storage pool.
The value is a space-seperated list of cell names. Note that the value is also surrounded
by single quotes (as displayed in the command syntax).
The following arguments are available in the WHERE clause:
• EXASCALECLUSTER: Specifies the name of the Exascale cluster that contains the storage
pool. This argument is optional if the OEDA configuration file (es.xml) contains only one
Exascale cluster.
• NAME: Specifies the name for the Exascale storage pool that you want to alter.
Usage Notes
• When you use the ALTER STORAGEPOOL command, there is no immediate check to validate
the specified storage pool size. However, deployment fails with an error if there is
insufficient space.
Syntax
DELETE STORAGEPOOL
WHERE
[ EXASCALECLUSTER = exascaleclustername ]
NAME = storagepoolname
Arguments
The following arguments are available in the WHERE clause:
• EXASCALECLUSTER: Specifies the name of the Exascale cluster that contains the storage
pool. This argument is optional if the OEDA configuration file (es.xml) contains only one
Exascale cluster.
• NAME: Specifies the name for the Exascale storage pool that you want to delete.
Usage Notes
• You cannot delete an Exascale storage pool while it provides resources to Oracle Grid
Infrastructure or an Oracle database.
4-94
Chapter 4
OEDACLI Command Reference
Syntax
LIST STORAGEPOOL
WHERE
[ EXASCALECLUSTER = exascaleclustername ]
NAME = storagepoolname
Arguments
The following arguments are available in the WHERE clause:
• EXASCALECLUSTER: Specifies the name of the Exascale cluster that contains the storage
pool. This argument is optional if the OEDA configuration file (es.xml) contains only one
Exascale cluster.
• NAME: Specifies the name for the Exascale storage pool that you want to display.
Syntax
LIST STORAGEPOOLS
[ WHERE
EXASCALECLUSTER = exascaleclustername ]
Arguments
The following arguments are available in the WHERE clause:
4.3.34 STORAGETEMPLATES
• LIST STORAGETEMPLATES
This command displays details for the Exascale storage templates.
Syntax
LIST STORAGEPOOLTEMPLATES
4.3.35 SWITCH
You can display and manage the switches.
• ADD SWITCH
Add a new switch to a rack in the Engineered System XML file.
4-95
Chapter 4
OEDACLI Command Reference
• ALTER SWITCH
• LIST SWITCHES
Syntax
ADD SWITCH
WHERE
{ RACKID=rack_id |
RACKNUMBER=rack_number }
Arguments
The following arguments are available in the WHERE clause:
Syntax
ALTER SWITCH
{ DNSSERVERS='dns_servers' |
NTPSERVERS='ntp_servers' |
TIMEZONE=time_zone |
DESCRIPTION=description |
4-96
Chapter 4
OEDACLI Command Reference
ULOC=ulocation |
IBPARTITIONMEMBERSHIP=pkey_membership } ...
WHERE
{ ID=switch_id |
HOSTNAME=switch_name }
Arguments
You can modify the following attributes for a switch:
• DNSSERVERS: Specifies a comma-separated list of DNS servers that is enclosed in single
quotes
• NTPSERVERS: Specifies a comma-separated list of NTP servers that is enclosed in single
quotes
• TIMEZONE: Specifies a valid time zone for the switch
• DESCRIPTION: Specifies a description for the switch
• ULOC: Specifies physical rack location for the switch
• IBPARTITIONMEMBERSHIP: Specifies the switch pkey membership
The following arguments are available in the WHERE clause:
Syntax
LIST SWITCHES
[ WHERE
{ ID=switch_id |
HOSTNAME=switch_name } ]
Arguments
The following arguments are available in the WHERE clause:
Usage Notes
If you do not specify a WHERE clause, then the command displays the details for all switches.
4.3.36 SU
Controls use of the su command.
• SET SU
This command enables and disables using su from the root user to run remote non-root
commands from OEDACLI.
4-97
Chapter 4
OEDACLI Command Reference
4.3.36.1 SET SU
This command enables and disables using su from the root user to run remote non-root
commands from OEDACLI.
Syntax
Arguments
• ENABLE: Specifies whether or not OEDACLI uses su from the root user to run remote non-
root commands.
4.3.37 ULOC
You can display the location of rack items.
• LIST ULOC
Syntax
LIST ULOC
[ NEWCOMPUTES={ new_computes_count | 'new_computes_list' } ]
[ NEWCELLS={ new_cells_count | 'new_cells_list' } ]
[ WHERE
RACKUMBER=rack_number ]
Arguments
• NEWCOMPUTES: Optionally specifies the number of new compute nodes to be added, or a
comma-separated list of new compute node host names. Default is 0.
• NEWCELLS: Optionally specifies the number of new storage cells to be added, or a comma-
separated list of new storage cell host names. Default is 0.
The following arguments are available in the WHERE clause:
Usage Notes
If you do not specify a WHERE clause, then the command displays the details for rack number 1.
4.3.38 VAULT
• ADD VAULT
This command adds a new Exascale vault.
4-98
Chapter 4
OEDACLI Command Reference
• ALTER VAULT
This command alters an existing Exascale vault.
• DELETE VAULT
This command deletes an existing Exascale vault.
• LIST VAULT
This command displays details for an existing Exascale vault.
• LIST VAULTS
This command displays details for existing Exascale vaults.
Syntax
ADD VAULT
NAME = vaultname
[ HC = hcsize ]
[ EF = efsize ]
[ WHERE
EXASCALECLUSTER = exascaleclustername ]
Arguments
• NAME: Specifies the name of the Exascale vault.
• HC: Optionally, provisions the vault with the specified amount of storage space in the High
Capacity storage pool. You can specify a size in GB or TB, or specify a percentage of the
High Capacity storage pool.
• EF: Optionally, provisions the vault with the specified amount of storage space in the
Extreme Flash storage pool. You can specify a size in GB or TB, or specify a percentage of
the Extreme Flash storage pool.
The following argument is available in the WHERE clause:
• EXASCALECLUSTER: Specifies the name for the Exascale cluster that contains the new vault.
Usage Notes
• If you specify any combination of the size arguments (HC, EF), then the vault is provisioned
to use only the specified storage resources. If you do not specify any size arguments, then
the vault is provisioned with unlimited access to all of the available storage pools.
• The WHERE clause is optional if the OEDA configuration file (es.xml) contains only one
Exascale cluster. Otherwise, the WHERE clause is mandatory.
Syntax
ALTER VAULT
[ NAME = vaultname ]
[ HC = hcsize ]
4-99
Chapter 4
OEDACLI Command Reference
[ EF = efsize ]
WHERE
[ EXASCALECLUSTER = exascaleclustername ]
NAME = vaultname
Arguments
• NAME: Changes the name of the Exascale vault.
• HC: Optionally, provisions the vault with the specified amount of storage space in the High
Capacity storage pool. You can specify a size in GB or TB, or specify a percentage of the
High Capacity storage pool.
• EF: Optionally, provisions the vault with the specified amount of storage space in the
Extreme Flash storage pool. You can specify a size in GB or TB, or specify a percentage of
the Extreme Flash storage pool.
The following arguments are available in the WHERE clause:
• EXASCALECLUSTER: Specifies the name of the Exascale cluster that contains the vault. This
argument is optional if the OEDA configuration file (es.xml) contains only one Exascale
cluster.
• NAME: Specifies the name of the Exascale vault that you want to alter.
Usage Notes
• If you alter any of the size arguments (HC, EF), then ensure that you set all of the required
size arguments.
Syntax
DELETE VAULT
WHERE
[ EXASCALECLUSTER = exascaleclustername ]
NAME = vaultname
Arguments
The following arguments are available in the WHERE clause:
• EXASCALECLUSTER: Specifies the name of the Exascale cluster that contains the vault. This
argument is optional if the OEDA configuration file (es.xml) contains only one Exascale
cluster.
• NAME: Specifies the name of the Exascale vault that you want to delete.
Usage Notes
• You cannot delete an Exascale vault while it provides resources to Oracle Grid
Infrastructure or an Oracle database.
4-100
Chapter 4
OEDACLI Command Reference
Syntax
LIST VAULT
WHERE
[ EXASCALECLUSTER = exascaleclustername ]
NAME = vaultname
Arguments
The following arguments are available in the WHERE clause:
• EXASCALECLUSTER: Specifies the name of the Exascale cluster that contains the vault. This
argument is optional if the OEDA configuration file (es.xml) contains only one Exascale
cluster.
• NAME: Specifies the name of the Exascale vault that you want to display.
Syntax
LIST VAULTS
[ WHERE
EXASCALECLUSTER = exascaleclustername
[ STORAGEPOOL = storagepoolname ]]
Arguments
The following arguments are available in the WHERE clause:
• EXASCALECLUSTER: Specifies the name of the Exascale cluster that contains the vault.
• STORAGEPOOL: Specifies the name of the Exascale storage pool for which you want to
display associated vaults.
4.3.39 VIP
You can add, alter, delete, or list the Oracle Clusterware VIPs.
• ADD VIP
• ALTER VIP
• DELETE VIP
• LIST VIPS
4-101
Chapter 4
OEDACLI Command Reference
Purpose
This command does not add additional VIPs. You should only use this command after
previously issuing a DELETE VIP command.
Syntax
ADD VIP
NAME=vip_name
DOMAINNAME=domain_name
IP=vip_ip_addr
WHERE
{ HOSTNAME=host_name |
CLUSTERNAME=cluster_name COMPUTENUMBER=compute_number |
CLUSTERNUMBER=cluster_number COMPUTENUMBER=compute_number |
CLUSTERID=cluster_id COMPUTENUMBER=compute_number }
Arguments
You must specify the following attributes when adding a VIP:
• NAME: Specifies the short DNS name for the VIP
• DOMAINNAME: Specifies the domain name for the VIP
• IP: Specifies the IP address for the VIP
The following arguments are available in the WHERE clause:
• HOSTNAME: Specifies the host name for the compute node in the cluster
• CLUSTERNUMBER: Specifies the cluster number in the es.xml, starting at 1
• CLUSTERNAME: Specifies the name of the cluster
• CLUSTERID: Specifies the es.xml ID of the cluster
• COMPUTENUMBER: Specifies the compute node number in the cluster, starting at 1
Usage Notes
When adding a VIP to a compute node, the node must not already have a VIP defined.
Syntax
ALTER VIP
{ NAME=vip_name |
DOMAINNAME=domain_name |
IP=vip_ip_addr } ...
WHERE
4-102
Chapter 4
OEDACLI Command Reference
{ HOSTNAME=host_name |
CLUSTERNAME=cluster_name COMPUTENUMBER=compute_number |
CLUSTERNUMBER=cluster_number COMPUTENUMBER=compute_number |
CLUSTERID=cluster_id COMPUTENUMBER=compute_number }
Arguments
You can modify the following attributes for the VIP:
• NAME: Specifies the short DNS name for the VIP
• DOMAINNAME: Specifies the domain name for the VIP
• IP: Specifies the IP address for the VIP
The following arguments are available in the WHERE clause:
• HOSTNAME: Specifies the host name for the compute node in the cluster
• CLUSTERNUMBER: Specifies the cluster number in the es.xml, starting at 1
• CLUSTERNAME: Specifies the name of the cluster
• CLUSTERID: Specifies the es.xml ID of the cluster
• COMPUTENUMBER: Specifies the compute node number in the cluster, starting at 1
Syntax
DELETE VIP
WHERE
{ ID=vip_id |
HOSTNAME=host_name |
CLUSTERNAME=cluster_name COMPUTENUMBER=compute_number |
CLUSTERNUMBER=cluster_number COMPUTENUMBER=compute_number |
CLUSTERID=cluster_id COMPUTENUMBER=compute_number }
Arguments
The following arguments are available in the WHERE clause:
• ID: Specifies the ID for the VIP in the XML configuration file
• HOSTNAME: Specifies the host name for the compute node in the cluster
• CLUSTERNUMBER: Specifies the cluster number in the XML configuration file, starting at 1
• CLUSTERNAME: Specifies the name of the cluster
• CLUSTERID: Specifies the ID of the cluster in the XML configuration file
• COMPUTENUMBER: Specifies the compute node number in the cluster, starting at 1
4-103
Chapter 4
OEDACLI Command Reference
Syntax
LIST VIPS
[ WHERE
{ HOSTNAME=host_name |
CLUSTERNAME=cluster_name [ COMPUTENUMBER=compute_number ] |
CLUSTERNUMBER=cluster_number [ COMPUTENUMBER=compute_number ] |
CLUSTERID=cluster_id [ COMPUTENUMBER=compute_number ] }
Arguments
The following arguments are available in the WHERE clause:
• ID: Specifies the ID for the VIP in the XML configuration file
• HOSTNAME: Specifies the host name for the compute node in the cluster
• CLUSTERNUMBER: Specifies the cluster number in the XML configuration file, starting at 1
• CLUSTERNAME: Specifies the name of the cluster
• CLUSTERID: Specifies the ID of the cluster in the XML configuration file
• COMPUTENUMBER: Specifies the compute node number in the cluster, starting at 1
Usage Notes
If you do not specify a WHERE clause, then this command lists the VIPs for all clusters.
4.3.40 VOLUME
You can display and manage storage volumes.
• ADD VOLUME
• DELETE VOLUME
• LIST VOLUMES
Syntax
ADD VOLUME
MOUNTPATH=mount_path
SIZE=size
WHERE
HOSTNAME=host_name
Arguments
You must specify the following attributes when adding a volume:
• MOUNTPATH: Specifies the mount point directory for the volume
• SIZE: Specifies the volume size in GB. Must be an integer value.
4-104
Chapter 4
OEDACLI Command Reference
Usage Notes
You can use this command to add a custom sized volume for the /u01 filesystem.
Syntax
DELETE VOLUME
WHERE
HOSTNAME=host_name
MOUNTPATH=mount_path
Arguments
The following arguments are required in the WHERE clause:
Syntax
LIST VOLUMES
WHERE
HOSTNAME=host_name
Arguments
The following arguments are required in the WHERE clause:
4.3.41 XMLACTION
You can manage actions relating to the Engineered System XML file.
• ALTER XMLACTION
• DELETE XMLACTION
• LIST XMLACTION
• LIST XMLACTIONS
4-105
Chapter 4
OEDACLI Command Reference
Syntax
ALTER XMLACTION
ID=action_identifer
CMDID=command_identifer
CMD=command
Arguments
• ID: Specifies the action identifier. See output from LIST XMLACTIONS.
• CMDID: Specifies the command identifier. See output from LIST XMLACTIONS.
• CMD: Specifies the command for the action.
Syntax
DELETE XMLACTION
ID=action_identifer
Arguments
ID: Specifies the action identifier. See output from LIST XMLACTIONS.
Syntax
LIST XMLACTION
ID=action_identifer
Arguments
ID: Specifies the action identifier. See output from LIST XMLACTIONS.
Syntax
LIST XMLACTIONS
4-106
5
Installing Oracle Exadata or Oracle Exadata
Storage Expansion Rack at the Site
This chapter describes how to move, install and configure the hardware through to powering
on the system.
Note:
For ease of reading, the name "Oracle Exadata Rack" is used when information
refers to both Oracle Exadata and Oracle Exadata Storage Expansion Rack.
5-1
Chapter 5
Unpacking and Installing Oracle Exadata Rack
• If you cannot reach the connector lock when disconnecting LAN cables, then press the
connector lock with a flathead screwdriver to disconnect the cable. You could damage the
system board if you force your fingers into the gap rather than using a flathead screwdriver.
• Do not place anything on top of Oracle Exadata Rack or perform any work directly above
the rack.
• Do not let the room temperature rise sharply, especially in winter. Sudden temperature
changes can cause condensation to form inside Oracle Exadata Rack. Allow for a
sufficient warm-up period prior to server operation.
• Do not install Oracle Exadata Rack near a photocopy machine, air conditioner, welding
machine, or any other equipment that generates loud, electronic noises.
• Avoid static electricity at the installation location. Static electricity transferred to Oracle
Exadata Rack can cause malfunctions. Static electricity is often generated on carpets.
• Confirm the supply voltage and frequency match the electrical ratings indicated for Oracle
Exadata Rack.
• Do not insert anything into any Oracle Exadata Rack opening, unless doing so is part of a
documented procedure. Oracle Exadata Rack contains high-voltage parts. If a metal object
or other electrically-conductive object enters an opening in Oracle Exadata Rack, then it
could cause a short circuit. This could result in personal injury, fire, electric shock, and
equipment damage.
• When using single phase power distribution units (PDUs), note the following:
– PDU A input 0 and PDU B input 2 must be on the same phase.
– PDU A input 1 and PDU B input 1 must be on the same phase.
– PDU A input 2 and PDU B input 0 must be on the same phase.
The inputs are labeled where they come out of the PDU. Connecting cables as described
ensures the phases are balanced on both sides, A and B, in case of a failover.
See Also:
5-2
Chapter 5
Acclimating Oracle Exadata
5-3
Chapter 5
Powering on the System the First Time
Note:
Oracle Exadata Database Machine X2-8 Full Rack database servers may take up to
15 minutes to start through the normal BIOS POST tests.
1. Switch on the PDU B circuit breakers, one at a time. PDU B is on the right side of the rack
when viewed from the rear. The circuit breakers are on the rear of the Oracle Exadata
Rack cabinet as shown in the following figure. Press the ON (|) side of the toggle switch.
When the breaker is in the ON position, the breakers are flush with the side of the PDU.
5-4
Chapter 5
Powering on the System the First Time
2. Verify the expected power LEDs are on. The LEDs are located as follows:
• Database servers: Right-hand LED
• Storage Servers: Top LED
• Cisco Management Network Switch: Left LED (viewed from front) is green, and the
other LEDs are red
• InfiniBand Network Fabric switches: Left LED (viewed from front) labeled PS0, or right
LED (viewed from front) labeled PS1
• Cisco RoCE Network Fabric switches: Left LED (viewed from front) labeled P1, or right
LED (viewed from front) labeled P2
• KVM switch on Oracle Exadata Database Machine X2-2: Lower LED B
• KMM switch on Oracle Exadata Database Machine X2-2: Only supplied by PDU B
3. Connect power to PDU A. Ensure the breaker switches are in the OFF position before
connecting the power cables.
4. Switch on the PDU A circuit breakers, one at a time.
5. Verify the expected LEDs are on.
6. Perform a visual check of all cable connections in the rack. Do not press every connector
to verify connection.
7. Verify the OK LED is blinking standby for all systems. The OK LED blinks on for 0.1
seconds, once every 3 seconds when in standby mode. The OK LED does not blink when
the ILOM is starting. The LED remains dark until it goes to standby mode after 2 to 3
minutes.
Related Topics
• Reviewing Safety Guidelines
Before Oracle Exadata Rack arrives, the following safety precautions should be reviewed
to ensure the site is safe, as well as ready for delivery.
5-5
6
Configuring Oracle Exadata Database
Machine
This chapter describes how to configure the system, accounts, and software for Oracle
Exadata Database Machine.
Note:
• For ease of reading, the name "Oracle Exadata Rack" is used when information
refers to both Oracle Exadata Database Machine and Oracle Exadata Storage
Expansion Rack.
• The procedures in this chapter are applicable to Oracle Exadata Storage
Expansion Rack as well as Oracle Exadata Database Machine.
• The procedures in this chapter use the information from Oracle Exadata
Database Machine Deployment Assistant (OEDA). Be sure to run OEDA before
starting the procedures in this chapter.
6-1
Chapter 6
Verifying the Network Configuration Prior to Configuring the Rack
6-2
Chapter 6
Configuring the RDMA Network Fabric Switch
Use a command similar to the following, where configuration_file is the name of the
configuration generated by the Oracle Exadata Deployment Assistant for the rack being
installed.
If the command is run from a Microsoft Windows machine, then the command is
checkip.cmd.
If this engineered system rack is an addition for an existing installation, then run the
checkip.sh script from an existing engineered system server. This enables the script to
identify in-use IP addresses in the fabric. Not identifying existing IP addresses may cause
IP collisions after installation of the new engineered system rack. To create a checkip.sh
that can run on an existing server, you must run OEDA on a server or client that uses the
same operating system as the existing engineered system server. OEDA supports IPv6
addresses.
The output from the script is a file that contains status messages such as GOOD or ERROR.
If there are conflicts that you are unable to resolve, then work with your assigned Oracle
representative to correct the problems.
6-3
Chapter 6
Configuring the RDMA Network Fabric Switch
Note:
If you do not have the password for the admin user, then contact Oracle Support
Services.
dbm0sw-rocea0# reload
7. Switch to normal setup and, when asked if you want to enforce secure password standard,
enter no, then enter a new password for the admin user.
Running S93thirdparty-script...
Abort Auto Provisioning and continue with normal setup ? (yes/no) [n]: yes
8. When the Basic System Configuration Dialog appears, choose to enter the basic
configuration dialog.
This setup utility will guide you through the basic configuration of
the system. Setup configures only enough connectivity for management
of the system.
6-4
Chapter 6
Configuring the RDMA Network Fabric Switch
Would you like to enter the basic configuration dialog (yes/no): yes
9. In the basic configuration, you can use the default inputs until asked to enter the switch
name.
In this example, the switch has a name of test123sw-rocea0.
10. Respond yes when asked to configure Out-of-band management configuration, and
specify appropriate network addresses when prompted.
12. Respond yes when asked to configure static route (this can be changed later).
13. Enter the destination prefix and mask, and other values as prompted.
15. Skip configuring the default domain name (this will be configured later).
6-5
Chapter 6
Configuring the RDMA Network Fabric Switch
16. Accept the default responses until asked to configure SSH and the NTP server.
17. Accept the default responses until asked to specify the CoPP system profile. Enter strict.
[########################################] 100%
Copy complete.
6-6
Chapter 6
Configuring the RDMA Network Fabric Switch
• Starting with Oracle Exadata System Software release 20.1.0, use the procedure
described in Applying Golden Configuration Settings on RoCE Network Fabric
Switches, in Oracle Exadata Database Machine Maintenance Guide.
• Otherwise, use the following procedure to apply the golden configuration on the switch:
a. Delete the configuration file on the switch for the target configuration.
Note:
If you do not remove the file you are replacing, then when you attempt to
overwrite the file you will get a 'permission denied' error.
Log in to the switch, enter configuration mode, then run a command similar to the
following:
b. Log in to a server that has SSH access to the switch, and contains the latest RDMA
Network Fabric patch ZIP file.
To find the available RDMA Network Fabric patches, search for 'RDMA network
switch' in My Oracle Support document 888828.1. Download and use the latest patch
for your Oracle Exadata System Software release.
c. Unzip the RDMA Network Fabric patch ZIP file and change directories to the location
of the patchmgr utility.
d. Locate the golden configuration files in the RDMA Network Fabric patch bundle.
The files are located within the roce_switch_templates directory.
The golden configuration files are as follows:
• Single rack leaf (leaf): roce_leaf_switch.cfg
• Multi-rack spine (mspine): roce_spine_switch_multi.cfg
• Multi-rack leaf (mleaf): roce_leaf_switch_multi.cfg
• Single rack leaf with Secure Fabric support (sfleaf): roce_sf_leaf_switch.cfg
• Multi-rack leaf with Secure Fabric support (msfleaf):
roce_sf_leaf_switch_multi.cfg
• Single rack leaf configured with 23 host ports (leaf23):
roce_leaf_switch_23hosts.cfg
• Multi-rack leaf configured with 23 host ports (mleaf23):
roce_leaf_switch_23hosts_multi.cfg
• Multi-rack leaf configured with 14 inter-switch links (mleaf_u14):
roce_leaf_switch_14uplinks_multi.cfg
• Multi-rack leaf configured with 14 inter-switch links and with Secure Fabric support
(msfleaf_u14): roce_sf_leaf_switch_14uplinks_multi.cfg
• Multi-rack leaf configured with 23 host ports and 13 inter-switch links
(mleaf23_u13): roce_leaf_switch_23hosts_13uplinks_multi.cfg
6-7
Chapter 6
Configuring the RDMA Network Fabric Switch
Note:
This command may take up to 1-2 minutes on a single-rack switch and up to
3-4 minutes on a multi-rack switch.
Follow the steps in Backing Up Settings on the ROCE Switch, in Oracle Exadata Database
Machine Maintenance Guide.
23. Optional: Set the clock, using the same procedure as in Setting the Clock on the Cisco
93108-1G or 9348 Ethernet Switch.
Related Topics
• Exadata Database Machine and Exadata Storage Server Supported Versions (My Oracle
Support Doc ID 888828.1)
6-8
Chapter 6
Configuring the RDMA Network Fabric Switch
To use Secure Fabric, you must enable Secure Fabric support in the RoCE Network Fabric
switch hardware before initial system deployment using Oracle Exadata Deployment Assistant
(OEDA):
For each RoCE Network Fabric leaf switch, perform the basic configuration steps outlined in
Configuring the Cisco Nexus 9336C-FX2 Switch.
Then, on each RoCE Network Fabric leaf switch, you must apply a specific golden
configuration to enable Secure Fabric support. Use the procedure described in Applying
Golden Configuration Settings on RoCE Network Fabric Switches, in Oracle Exadata Database
Machine Maintenance Guide. However, when you specify the configuration type for each leaf
switch, ensure that you specify the configuration type that enables Secure Fabric support.
After you complete the switch configuration, the leaf switch ports become trunk ports, which
can carry network traffic with multiple VLAN IDs.
Note:
If you do not have the password for the root user, then contact Oracle Support
Services.
2. Use SSH to log in to the Sun Datacenter InfiniBand Switch 36 switch as the ilom-admin
user. Find the default IP address for the Sun Datacenter InfiniBand Switch 36 switch for
your system in "Default IP Addresses". The following is an example of the command:
ssh ilom-admin@192.168.1.201
3. Use spsh to open the Integrated Lights Out Manager (ILOM) command line interface.
4. Configure the network interface using the following commands:
6-9
Chapter 6
Configuring the RDMA Network Fabric Switch
It is required that the second line has both fully-qualified and non-fully-qualified names.
7. Use the ILOM interface to configure the IP address, host name, NTP servers, and DNS
servers.
8. Restart the switch.
9. Examine the firmware version using the following command:
# version
Refer to My Oracle Support Note 888828.1 for the current firmware version.
10. Check the health of the switch using the following command:
# showunhealthy
OK - No unhealthy sensors
# env_test
6-10
Chapter 6
Configuring the RDMA Network Fabric Switch
12. Enable the InfiniBand Subnet Manager using the following command:
# enablesm
Note:
If you get an error indicating the InfiniBand Subnet Manager is already running,
then restart it as follows:
# disablesm
# enablesm
# ifconfig eth0
14. Verify the host name is correct using the following command:
# hostname
dm01sw-ib2.example.com
15. Set the Subnet Manager Master as described in "Setting the Subnet Manager Master on
Oracle Exadata Database Machine Full Rack and Oracle Exadata Database Machine Half
Rack". This step is needed for Oracle Exadata Database Machine Half Rack and Oracle
Exadata Database Machine Full Rack.
16. Log out from the InfiniBand switch using the following command:
# exit
6-11
Chapter 6
Setting the Subnet Manager Master on Oracle Exadata Database Machine Full Rack and Oracle Exadata Database Machine Half Rack
Note:
If the network settings did not appear after restart, then power cycle the switch by
removing both power cords for one minute.
Related Topics
• Exadata Database Machine and Exadata Storage Server Supported Versions (My Oracle
Support Doc ID 888828.1)
Note:
This procedure does not apply to Oracle Exadata X8M racks with RoCE Network
Fabric.
The switch located in rack unit 1 (U1) is referred to as the spine switch. The other two switches
are referred to as the leaf switches. The location of the leaf switches is as follows:
• Oracle Exadata Two-Socket Systems (X3-2 and later): rack unit 20 (U20) and rack unit 22
(U22)
• Oracle Exadata X2-2 racks: rack unit 20 (U20) and rack unit 24 (U24)
• Oracle Exadata Eight-Socket Systems (X2-8 and later) Full Racks: Rack unit 21 (U21) and
rack unit 23 (U23)
The spine switch is the Subnet Manager Master for the InfiniBand Network Fabric subnet. The
Subnet Manager Master has priority 8, and can be verified using the following procedure:
1. Log in to the spine switch as the root user.
2. Run the setsmpriority list command.
The command should show that smpriority has a value of 8. If smpriority has a different
value, then do the following:
a. Use the disablesm command to stop the Subnet Manager.
b. Use the setsmpriority 8 command to set the priority to 8.
c. Use the enablesm command to restart the Subnet Manager.
The leaf switches are the Standby Subnet Managers with a priority of 5. This can be verified
using the preceding procedure, substituting a value of 5 in the setsmpriority command
above.
6-12
Chapter 6
Setting the Subnet Manager Master on Oracle Exadata Database Machine Full Rack and Oracle Exadata Database Machine Half Rack
Note:
Oracle Exadata Half Rack with Sun Fire X4170 Oracle Database Servers include two
Sun Datacenter InfiniBand Switch 36 switches, which are set to priority 5.
To determine the Subnet Manager Master, log in as the root user on any InfiniBand Network
Fabric switch, and run the getmaster command. The location of the Subnet Manager Master is
displayed. The following is an example of the output from the getmaster command:
# getmaster
20100701 11:46:38 OpenSM Master on Switch : 0x0021283a8516a0a0 ports 36 Sun
DCS 36
QDR switch dm01sw-ib1.example.com enhanced port 0 lid 1 lmc 0
The preceding output shows the proper configuration. The Subnet Master Manager is running
on spine switch dm01sw-ib1.example.com.
If the spine switch is not the Subnet Manager Master, then do the following procedure to set
the Subnet Manager Master:
1. Use the getmaster command to identify the current location of the Subnet Manager
Master.
2. Log in as the root user on the leaf switch that is the Subnet Manager Master.
3. Disable Subnet Manager on the switch. The Subnet Manager Master relocates to another
switch.
4. Use the getmaster command to identify the current location of the Subnet Manager
Master. If the spine switch is not Subnet Manager Master, then repeat steps 2 and 3 until
the spine switch is the Subnet Manager Master.
5. Enable Subnet Manager on the leaf switches that were disabled during this procedure.
Note:
• If the InfiniBand Network Fabric network consists of four or more racks cabled
together, then only the spine switches should run Subnet Manager. The leaf
switches should have Subnet Manager disabled on them.
• Oracle Exadata Half Racks with Sun Fire X4170 Oracle Database Servers, and
Oracle Exadata Quarter Racks have two Sun Datacenter InfiniBand Switch 36
switches, and both are set to priority 5. The master is the one with the lowest
GUID.
6-13
Chapter 6
Configuring the Management Network Switch
See Also:
6-14
Chapter 6
Configuring the Management Network Switch
Note that the Cisco 4948E-F switch supports multiple uplinks to the customer network by
utilizing ports 49 - 52. This is a more complicated switch setup due to the redundant
connectivity, and should be performed by the customer's network administrator.
The following procedure describes how to configure the Cisco Ethernet switch. Configuration
should be done with the network administrator.
1. Connect a serial cable from the Cisco switch console to a laptop or similar device. An
Oracle supplied rollover cable is pre-installed on the Cisco serial console port. Obtain the
appropriate adapter and connect it at the end of the rollover cable. An Oracle P/N
530-3100 RJ45-DB9 adapter as used on ILOM ports will also work, connected at the end
of the network cable.
2. Ensure the terminal session is recorded on the laptop by logging the output. The output
can be used as a reference that the switch has been configured correctly. The default
serial port speed is 9600 baud, 8 bits, no parity, 1 stop bit, and no handshake.
Switch> enable
Password: ******
Switch#
Note:
If you do not have the password, then contact Oracle Support Services.
ROM: 12.2(44r)SG12
zdlra1sw-ip uptime is 1 minute
System returned to ROM by reload
System image file is "bootflash:cat4500e-ipbasek9-mz.152-3.E2.bin"
Hobgoblin Revision 22, Fortooine Revision 1.40
...
Switch#
The version of the Cisco 4948E-F switch firmware purchased and shipped by Oracle with
Oracle Exadata X6 is IPBASEK9-MZ, which includes telnet and ssh support. Currently
the full release version string is cat4500e-ipbasek9-mz.152-3.E2.bin.
6-15
Chapter 6
Configuring the Management Network Switch
5. Configure the network for a single VLAN. The following example assumes you are using
IPv4 addressing.
6. If IP routing is not used on the switch, this step is required. Disable the default IP routing
setting, and configure the default gateway.
Switch#configure terminal
Enter configuration commands,one per line.End with CNTL/Z.
Switch(config)#no ip routing
Switch(config)#ip default-gateway 10.7.7.1
Switch(config)#end
*Sep 15 14:12:46.309:%SYS-5-CONFIG_I:Configured from console by console
Switch#write memory
Building configuration...
Compressed configuration from 2492 bytes to 1070 bytes [OK ]
7. If IP routing is required on the switch, then leave the IP routing setting as the default, and
configure the default gateway. Replace 10.7.7.1 with the IP address of the gateway for the
installation:
Switch#configure terminal
Enter configuration commands,one per line.End with CNTL/Z.
Switch(config)#ip route 0.0.0.0 0.0.0.0 10.7.7.1
Switch(config)#end
*Sep 15 14:13:26.013:%SYS-5-CONFIG_I:Configured from console by console
Switch#write memory
Building configuration...
Compressed configuration from 2502 bytes to 1085 bytes [OK ]
Switch#configure terminal
Enter configuration commands,one per line.End with CNTL/Z.
Switch(config)#hostname exa1sw-ip
exa1sw-ip(config)#end
exa1sw-ip#write memory
Building configuration...
Compressed configuration from 3789 bytes to 1469 bytes [OK ]
6-16
Chapter 6
Configuring the Management Network Switch
9. Configure up to three DNS servers. Replace the domain name and IP addresses used in
this example with the values for the installation:
exa1sw-ip#configure terminal
Enter configuration commands,one per line.End with CNTL/Z.
exa1sw-ip(config)#ip domain-name example.com
exa1sw-ip(config)#ip name-server 10.7.7.3
exa1sw-ip(config)#ip name-server 198.51.100.5
exa1sw-ip(config)#ip name-server 10.8.160.1
exa1sw-ip(config)#end
*Sep 15 14:26:37.045:%SYS-5-CONFIG_I:Configured from console by console
exa1sw-ip#write memory
Building configuration...
Compressed configuration from 2603 bytes to 1158 bytes [OK ]
If you do not have DNS service available, you must still set the domain-name so that you
can configure the SSH keys.
10. (Optional) Set the password.
11. Verify telnet access is disabled. Telnet is not secure, and should not be enabled unless
there is a compelling reason. To enable telnet, set a password. To disable it, remove the
password.
exa1sw-ip#configure terminal
Enter configuration commands,one per line. End with CNTL/Z.
exa1sw-ip(config)#line vty 0 15
exa1sw-ip(config)#login
% Login disabled on line 1, until 'password' is set
% Login disabled on line 2, until 'password' is set
...
% Login disabled on line 16, until 'password' is set
exa1sw-ip(config)#end
If the login command returns output as shown above, then telnet access has been
disabled. If instead you get a prompt, then telnet access is not yet disabled so should be
disabled now.
exa1sw-ip(config-line)#no password
exa1sw-ip(config-line)#end
exa1sw-ip#write memory
Building configuration...
Compressed configuration from 3786 bytes to 1468 bytes [OK ]
6-17
Chapter 6
Configuring the Management Network Switch
13. Set the clock and time zone. The switch keeps internal time in Coordinated Universal Time
(UTC) format.
• To use UTC, use the following command:
In the preceding command, zone is the time zone to display when standard time in
effect, hours-offset is the hours offset from UTC, and minutes-offset is the minutes
offset from UTC.
• Daylight savings time (or summer time) is disabled by default. To set summer time
hours, use the following command:
clock summer-time zone recurring [week day monthhh:mm week day month \
hh:mm[offset]]
In the preceding command, zone is the time zone to be displayed when summer time
is in effect (EDT, for example), week is the week of the month (1 to 5 or last), day is the
day of the week (Sunday, Monday, ...), month is the month (January, February, ...),
hh:mm is the hours and minutes in 24-hour format, and offset is the number of minutes
to add during summer time. The default offset is 60 minutes.
6-18
Chapter 6
Configuring the Management Network Switch
• To manually set the clock to any time use the following command, where the time
specified is relative to the configured time zone:
In the preceding command, hh:mm:ss is the time in 24-hour format, day is the day by
date in the month, month is the name of the month, and year is the 4-digit year.
The ordering of commands is important when setting the local time and time zone. For
example, to set the local time to US Eastern time:
14. After setting the local time zone, you can configure up to two NTP servers. Replace the IP
addresses used in this example with the values for the installation:
The NTP server is synchronized to local time when you connect the Cisco switch to the
network and it has access to NTP.
Symbols that precede the show clock display indicate that the time is the following:
• * Not authoritative
• . Authoritative, but NTP is not synchronized.
• Authoritative (blank space).
15. Verify the Ethernet configuration using the following command:
6-19
Chapter 6
Configuring the Management Network Switch
!
version 15.2
no service pad
service timestamps debug datetime msec
service timestamps log datetime msec
no service password-encryption
service compress-config
.
.
.
Note:
If any setting is incorrect, then repeat the appropriate step. To erase a setting,
enter no in front of the same command. For example, to erase the default
gateway, use the following commands:
exa1sw-ip#configure terminal
Enter configuration commands, one per line. End with CNTL/Z.
exa1sw-ip(config)# no ip default-gateway 10.7.7.1
exa1sw-ip(config)# end
exa1sw-ip#
*Sep 15 14:13:26.013: %SYS-5-CONFIG_I: Configured from console by
console
exa1sw-ip(config)# write memory
Building configuration...
Compressed configuration from 2502 bytes to 1085 bytes[OK]
exa1sw-ip# exit
The Cisco switch must not be connected to the management network at this stage. The
switch will be connected later after Oracle has configured the systems with the necessary
IP addresses and you have worked with the field service engineer to make any additional
changes necessary for connecting to the network.
19. To check the Cisco switch, attach a laptop computer to port 48, and ping the IP address of
the internal management network to check the configuration.
6-20
Chapter 6
Configuring the Management Network Switch
Related Topics
• Network Connection and IP Address Requirements for Oracle Exadata Rack
• Network Configuration Checklist
Use this checklist to ensure that the network configuration requirements have been
addressed.
6.4.2.1 Performing the Initial Switch Configuration for the Cisco Nexus 93108-1G or
9348 Ethernet Switch
During the initial configuration, you reset the switch and use the Basic System Configuration
Dialog to configure the switch.
Before configuring the switch, note the following:
• The Cisco Ethernet switch should not be connected until the running configuration has
been verified, and any necessary changes have been made by the network administrator.
• The Cisco Ethernet switch should not be connected to the customer network until the IP
addresses on all components have been configured in Oracle Exadata Rack. This is to
prevent any duplicate IP address conflicts which are possible due to the default addresses
set in the components when shipped.
Configuration should be done with the network administrator.
1. Connect from the Cisco switch serial console to a laptop or similar device using the
available RJ45 cable.
2. Ensure the terminal session is recorded on the laptop by logging the output.
The output can be used as a reference that the switch has been configured correctly. The
default serial port speed is 9600 baud, 8 bits, no parity, 1 stop bit, and no handshake.
3. Power on the switch.
6-21
Chapter 6
Configuring the Management Network Switch
Note:
If you do not have the password for the admin user, then contact Oracle Support
Services.
exadatax7-adm0# reload
7. Switch to normal setup and, when asked if you want to enforce secure password standard,
enter no, then enter a new password for the admin user.
Running S93thirdparty-script...
Abort Auto Provisioning and continue with normal setup ? (yes/no) [n]: yes
6-22
Chapter 6
Configuring the Management Network Switch
8. When the Basic System Configuration Dialog appears, choose to enter the basic
configuration dialog.
This setup utility will guide you through the basic configuration of
the system. Setup configures only enough connectivity for management
of the system.
Would you like to enter the basic configuration dialog (yes/no): yes
9. In the basic configuration, you can use the default inputs until asked to enter the switch
name.
In this example, the switch has a name of test123sw-adm0.
12. Respond no when asked to configure static route (this will be configured later).
13. Enter the destination prefix and mask, and other values as prompted.
14. Skip configuring the DNS IPv4 addresses (this will be configured later).
6-23
Chapter 6
Configuring the Management Network Switch
15. Skip configuring the default domain name (this will be configured later).
16. Accept the default responses until asked to configure SSH and the NTP server.
17. Accept the default responses until asked to specify the CoPP system profile. Enter
lenient.
[########################################] 100%
Copy complete.
20. Set the spanning tree port type for ports 1-47.
21. Set switchport on all 48 ports and set port 48 to a network port (instead of a host port).
6-24
Chapter 6
Configuring the Power Distribution Units
6.4.2.2 Setting the Clock on the Cisco 93108-1G or 9348 Ethernet Switch
After you have performed the initial configuration, you can adjust the time used by the switch.
1. Log in as the admin user.
2. View the current time.
6-25
Chapter 6
Configuring the Power Distribution Units
• Default gateway
• Ethernet cables
• Laptop computer with either Oracle Solaris or Microsoft Windows
For systems less than full racks, the PDU Ethernet connections may use available ports in the
Management Network Switch. Note that for full rack systems, you cannot connect PDUs to the
Management Network Switch because all the ports on the switch are already reserved for
other components.
The following procedure describes how to configure and connect the PDU to the network:
1. Power off the PDU.
2. Disconnect the power leads from the power source.
3. Select an unused LAN network connection from the available network connections on the
laptop as follows:
• For Oracle Solaris:
a. Log in as a super user.
b. Use the dladm show-link command to find an unused Ethernet interface.
c. Use the ifconfig -a command to determine which interface is being used.
d. Use the following command to plumb the unused interface:
Note:
The network interfaces configured with the ifconfig command do not
persist across system restarts.
6-26
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
f. Enter the IP address in the IP address field. Do not use 192.168.0.1 because that
is the default PDU metering unit address.
g. Enter the IP address in the Subnet mask field.
h. Leave the Default gateway field blank.
i. Click OK.
4. Connect the PDU and the laptop to two ports on the Management Network Switch. The
equipment currently using the Management Network Switch must be disconnected
temporarily.
5. Connect the PDU power input lead to the power source. Only one PDU power input lead
needs to be connected, as follows:
• On PDUs with one power input lead, connect the one lead to the power source.
• On PDUs with two power leads, connect the first power lead to the power source. The
first power lead is labeled 0.
• On PDUs with three power input leads, connect the middle power lead to the power
source. The middle power lead is labeled 1.
6. Use a Web browser to access the PDU metering unit by entering the factory default IP
address for the unit, 192.168.0.1, in the address line of the browser. The Current
Measurement page should appear.
7. Click Network Configuration in the upper left of the page.
8. Log in as the admin user on the PDU metering unit. Change the password after configuring
the network.
9. Confirm the DHCP Enable check box is not selected.
10. Enter the following network settings for the PDU metering unit:
• IP address
• Subnet mask address
• Default gateway
11. Click Submit to set the network settings, and reset the PDU metering unit.
12. Disconnect the PDU and laptop from the Management Network Switch.
13. Reconnect the two cables that were originally connected to the Management Network
Switch.
14. Connect an Ethernet cable to the PDU metering unit RJ-45 Ethernet port and to the
network.
15. Log in to the PDU metering unit using a Web browser. Use the PDU metering unit's static
IP address in the browser's address line. If the configuration was successful, then the
Current Measurement page is displayed.
16. Connect the remaining PDU power input leads to the power source.
6-27
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
size of Oracle Exadata Rack and type PDU. The configurable threshold values for each
metering unit module and phase are Info low, Pre Warning, and Alarm.
Note:
The thresholds must be set in the Param Configuration section of the PDU metering
unit. Setting threshold values using the Oracle Enterprise Manager Grid Control plug-
in has no effect.
• PDU Thresholds for Oracle Exadata Database Machine X5-2 and Later
• PDU Thresholds for Oracle Exadata Database Machine X4-2
• PDU Thresholds for Oracle Exadata Database Machine X3-2
• PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 M2 and X4270
M2 servers)
• PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 and X4275
servers)
• PDU Thresholds for Oracle Exadata Database Machine X4-8 and Later
This section contains the PDU thresholds for Oracle Exadata Database Machine Eight-
Socket systems for X4-8 and later.
• PDU Thresholds for Oracle Exadata Database Machine X3-8 Full Rack
• PDU Thresholds for Oracle Exadata Database Machine X2-8 Full Rack
• PDU Thresholds for Oracle Exadata Storage Expansion Rack with Exadata Storage Server
with Sun Fire X4270 M2 Servers
See Also:
6.6.1 PDU Thresholds for Oracle Exadata Database Machine X5-2 and
Later
Starting with Oracle Exadata Database Machine X5-2, Oracle Exadata Configuration Assistant
(OECA) is the only source for PDU thresholds. OECA is available on Oracle Technology
6-28
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Network at http://www.oracle.com/technetwork/database/exadata/oeca-
download-2817713.html
If for some reason you are unable to utilize OECA, contact Oracle Support.
Note:
The values listed here are reliable for use on systems in the configuration received
upon deployment and delivery from the Oracle Factory. Any changes to this
configuration should be modeled in Oracle Exadata Configuration Assistant (OECA),
and the PDU thresholds listed in OECA should then be used. OECA is available on
Oracle Technology Network.
• PDU Thresholds for Oracle Exadata Database Machine X4-2 Full Rack
• PDU Thresholds for Oracle Exadata Database Machine X4-2 Half Rack
• PDU Thresholds for Oracle Exadata Database Machine X4-2 Quarter Rack
6.6.2.1 PDU Thresholds for Oracle Exadata Database Machine X4-2 Full Rack
The following tables list the threshold values for Oracle Exadata Database Machine X4-2 Full
Rack:
• Table 6-1 Threshold Values for Oracle Exadata Database Machine X4-2 Full Rack with
Single-phase, Low-voltage PDU
• Table 6-2 Threshold Values for Oracle Exadata Database Machine X4-2 Full Rack with
Three-phase, Low-voltage PDU
• Table 6-3 Threshold Values for Oracle Exadata Database Machine X4-2 Full Rack with
Single-phase, High-voltage PDU
• Table 6-4 Threshold Values for Oracle Exadata Database Machine X4-2 Full Rack with
Three-phase, High-voltage PDU
Table 6-1 lists the threshold values for Oracle Exadata Database Machine X4-2 Full Rack
using a single-phase, low-voltage PDU.
Table 6-1 Threshold Values for Oracle Exadata Database Machine X4-2 Full Rack with
Single-phase, Low-voltage PDU
6-29
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-1 (Cont.) Threshold Values for Oracle Exadata Database Machine X4-2 Full
Rack with Single-phase, Low-voltage PDU
Table 6-2 lists the threshold values for Oracle Exadata Database Machine X4-2 Full Rack
using a three-phase, low-voltage PDU.
Table 6-2 Threshold Values for Oracle Exadata Database Machine X4-2 Full Rack with
Three-phase, Low-voltage PDU
Table 6-3 lists the threshold values for Oracle Exadata Database Machine X4-2 Full Rack
using a single-phase, high-voltage PDU.
Table 6-3 Threshold Values for Oracle Exadata Database Machine X4-2 Full Rack with
Single-phase, High-voltage PDU
Table 6-4 lists the threshold values for Oracle Exadata Database Machine X4-2 Full Rack
using a three-phase, high-voltage PDU.
Table 6-4 Threshold Values for Oracle Exadata Database Machine X4-2 Full Rack with
Three-phase, High-voltage PDU
6-30
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
6.6.2.2 PDU Thresholds for Oracle Exadata Database Machine X4-2 Half Rack
The following tables list the threshold values for Oracle Exadata Database Machine X4-2 Half
Rack:
• Table 6-5 Threshold Values for Oracle Exadata Database Machine X4-2 Half Rack with
Single-phase, Low-voltage PDU
• Table 6-6 Threshold Values for Oracle Exadata Database Machine X4-2 Half Rack with
Three-phase, Low-voltage PDU
• Table 6-7 Threshold Values for Oracle Exadata Database Machine X4-2 Half Rack with
Single-phase, High-voltage PDU
• Table 6-8 Threshold Values for Oracle Exadata Database Machine X4-2 Half Rack with
Three-phase, High-voltage PDU
Table 6-5 lists the threshold values for Oracle Exadata Database Machine X4-2 Half Rack
using a single-phase, low-voltage PDU.
Table 6-5 Threshold Values for Oracle Exadata Database Machine X4-2 Half Rack with
Single-phase, Low-voltage PDU
Table 6-6 lists the threshold values for Oracle Exadata Database Machine X4-2 Half Rack
using a three-phase, low-voltage PDU.
Table 6-6 Threshold Values for Oracle Exadata Database Machine X4-2 Half Rack with
Three-phase, Low-voltage PDU
Table 6-7 lists the threshold values for Oracle Exadata Database Machine X4-2 Half Rack
using a single-phase, high-voltage PDU.
6-31
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-7 Threshold Values for Oracle Exadata Database Machine X4-2 Half Rack with
Single-phase, High-voltage PDU
Table 6-8 lists the threshold values for Oracle Exadata Database Machine X4-2 Half Rack
using a three-phase, high-voltage PDU.
Table 6-8 Threshold Values for Oracle Exadata Database Machine X4-2 Half Rack with
Three-phase, High-voltage PDU
6.6.2.3 PDU Thresholds for Oracle Exadata Database Machine X4-2 Quarter Rack
The following tables list the threshold values for Oracle Exadata Database Machine X4-2
Quarter Rack:
• Table 6-9 Threshold Values for Oracle Exadata Database Machine X4-2 Quarter Rack with
Single-phase, Low-voltage PDU
• Table 6-10 Threshold Values for Oracle Exadata Database Machine X4-2 Quarter Rack
with Three-phase, Low-voltage PDU
• Table 6-11 Threshold Values for Oracle Exadata Database Machine X4-2 Quarter Rack
with Single-phase, High-voltage PDU
• Table 6-12 Threshold Values for Oracle Exadata Database Machine X4-2 Quarter Rack
with Three-phase, High-voltage PDU
Table 6-9 lists the threshold values for Oracle Exadata Database Machine X4-2 Quarter Rack
using a single-phase, low-voltage PDU.
Table 6-9 Threshold Values for Oracle Exadata Database Machine X4-2 Quarter Rack
with Single-phase, Low-voltage PDU
6-32
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-9 (Cont.) Threshold Values for Oracle Exadata Database Machine X4-2 Quarter
Rack with Single-phase, Low-voltage PDU
Table 6-10 lists the threshold values for Oracle Exadata Database Machine X4-2 Quarter Rack
using a three-phase, low-voltage PDU.
Table 6-10 Threshold Values for Oracle Exadata Database Machine X4-2 Quarter Rack
with Three-phase, Low-voltage PDU
Table 6-11 lists the threshold values for Oracle Exadata Database Machine X4-2 Quarter Rack
using a single-phase, high-voltage PDU.
Table 6-11 Threshold Values for Oracle Exadata Database Machine X4-2 Quarter Rack
with Single-phase, High-voltage PDU
Table 6-12 lists the threshold values for Oracle Exadata Database Machine X4-2 Quarter Rack
using a three-phase, high-voltage PDU.
Table 6-12 Threshold Values for Oracle Exadata Database Machine X4-2 Quarter Rack
with Three-phase, High-voltage PDU
6-33
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-12 (Cont.) Threshold Values for Oracle Exadata Database Machine X4-2
Quarter Rack with Three-phase, High-voltage PDU
Note:
The values listed here are reliable for use on systems in the configuration received
upon deployment and delivery from the Oracle Factory. Any changes to this
configuration should be modeled in Oracle Exadata Configuration Assistant (OECA),
and the PDU thresholds listed in OECA should then be used. OECA is available on
Oracle Technology Network.
• PDU Thresholds for Oracle Exadata Database Machine X3-2 Full Rack
• PDU Thresholds for Oracle Exadata Database Machine X3-2 Half Rack
• PDU Thresholds for Oracle Exadata Database Machine X3-2 Quarter Rack
6.6.3.1 PDU Thresholds for Oracle Exadata Database Machine X3-2 Full Rack
The following tables list the threshold values for Oracle Exadata Database Machine X3-2 Full
Rack:
• Table 6-13 Threshold Values for Oracle Exadata Database Machine X3-2 Full Rack with
Single-phase, Low-voltage PDU
• Table 6-14 Threshold Values for Oracle Exadata Database Machine X3-2 Full Rack with
Three-phase, Low-voltage PDU
• Table 6-15 Threshold Values for Oracle Exadata Database Machine X3-2 Full Rack with
Single-phase, High-voltage PDU
• Table 6-16
Threshold Values for Oracle Exadata Database Machine X3-2 Full Rack with Three-phase,
High-voltage PDU
Table 6-13 lists the threshold values for Oracle Exadata Database Machine X3-2 Full Rack
using a single-phase, low-voltage PDU.
Table 6-13 Threshold Values for Oracle Exadata Database Machine X3-2 Full Rack with
Single-phase, Low-voltage PDU
6-34
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-13 (Cont.) Threshold Values for Oracle Exadata Database Machine X3-2 Full
Rack with Single-phase, Low-voltage PDU
Table 6-14 lists the threshold values for Oracle Exadata Database Machine X3-2 Full Rack
using a three-phase, low-voltage PDU.
Table 6-14 Threshold Values for Oracle Exadata Database Machine X3-2 Full Rack with
Three-phase, Low-voltage PDU
Table 6-15 lists the threshold values for Oracle Exadata Database Machine X3-2 Full Rack
using a single-phase, high-voltage PDU.
Table 6-15 Threshold Values for Oracle Exadata Database Machine X3-2 Full Rack with
Single-phase, High-voltage PDU
Table 6-16 lists the threshold values for Oracle Exadata Database Machine X3-2 Full Rack
using a three-phase, high-voltage PDU.
Table 6-16 Threshold Values for Oracle Exadata Database Machine X3-2 Full Rack with
Three-phase, High-voltage PDU
6-35
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-16 (Cont.) Threshold Values for Oracle Exadata Database Machine X3-2 Full
Rack with Three-phase, High-voltage PDU
6.6.3.2 PDU Thresholds for Oracle Exadata Database Machine X3-2 Half Rack
The following tables list the threshold values for Oracle Exadata Database Machine X3-2 Half
Rack:
• Table 6-17 Threshold Values for Oracle Exadata Database Machine X3-2 Half Rack with
Single-phase, Low-voltage PDU
• Table 6-18 Threshold Values for Oracle Exadata Database Machine X3-2 Half Rack with
Three-phase, Low-voltage PDU
• Table 6-19 Threshold Values for Oracle Exadata Database Machine X3-2 Half Rack with
Single-phase, High-voltage PDU
• Table 6-20 Threshold Values for Oracle Exadata Database Machine X3-2 Half Rack with
Three-phase, High-voltage PDU
Table 6-17 lists the threshold values for Oracle Exadata Database Machine X3-2 Half Rack
using a single-phase, low-voltage PDU.
Table 6-17 Threshold Values for Oracle Exadata Database Machine X3-2 Half Rack with
Single-phase, Low-voltage PDU
Table 6-18 lists the threshold values for Oracle Exadata Database Machine X3-2 Half Rack
using a three-phase, low-voltage PDU.
Table 6-18 Threshold Values for Oracle Exadata Database Machine X3-2 Half Rack with
Three-phase, Low-voltage PDU
6-36
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-19 lists the threshold values for Oracle Exadata Database Machine X3-2 Half Rack
using a single-phase, high-voltage PDU.
Table 6-19 Threshold Values for Oracle Exadata Database Machine X3-2 Half Rack with
Single-phase, High-voltage PDU
Table 6-20 lists the threshold values for Oracle Exadata Database Machine X3-2 Half Rack
using a three-phase, high-voltage PDU.
Table 6-20 Threshold Values for Oracle Exadata Database Machine X3-2 Half Rack with
Three-phase, High-voltage PDU
6.6.3.3 PDU Thresholds for Oracle Exadata Database Machine X3-2 Quarter Rack
The following tables list the threshold values for Oracle Exadata Database Machine X3-2
Quarter Rack:
• Table 6-21 Threshold Values for Oracle Exadata Database Machine X3-2 Quarter Rack
with Single-phase, Low-voltage PDU
• Table 6-22 Threshold Values for Oracle Exadata Database Machine X3-2 Quarter Rack
with Three-phase, Low-voltage PDU
• Table 6-23 Threshold Values for Oracle Exadata Database Machine X3-2 Quarter Rack
with Single-phase, High-voltage PDU
• Table 6-24 Threshold Values for Oracle Exadata Database Machine X3-2 Quarter Rack
with Three-phase, High-voltage PDU
Table 6-21 lists the threshold values for Oracle Exadata Database Machine X3-2 Quarter Rack
using a single-phase, low-voltage PDU.
6-37
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-21 Threshold Values for Oracle Exadata Database Machine X3-2 Quarter Rack
with Single-phase, Low-voltage PDU
Table 6-22 lists the threshold values for Oracle Exadata Database Machine X3-2 Quarter Rack
using a three-phase, low-voltage PDU.
Table 6-22 Threshold Values for Oracle Exadata Database Machine X3-2 Quarter Rack
with Three-phase, Low-voltage PDU
Table 6-23 lists the threshold values for Oracle Exadata Database Machine X3-2 Quarter Rack
using a single-phase, high-voltage PDU.
Table 6-23 Threshold Values for Oracle Exadata Database Machine X3-2 Quarter Rack
with Single-phase, High-voltage PDU
Table 6-24 lists the threshold values for Oracle Exadata Database Machine X3-2 Quarter Rack
using a three-phase, high-voltage PDU.
6-38
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-24 Threshold Values for Oracle Exadata Database Machine X3-2 Quarter Rack
with Three-phase, High-voltage PDU
6.6.4 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers)
This section contains the PDU thresholds for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers).
Note:
The values listed here are reliable for use on systems in the configuration received
upon deployment and delivery from the Oracle Factory. Any changes to this
configuration should be modeled in Oracle Exadata Configuration Assistant (OECA),
and the PDU thresholds listed in OECA should then be used. OECA is available on
Oracle Technology Network.
• PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 M2 and X4270
M2 servers) Full Rack
• PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 M2 and X4270
M2 servers) Half Rack
• PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 M2 and X4270
M2 servers) Quarter Rack
6.6.4.1 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 M2
and X4270 M2 servers) Full Rack
The following tables list the threshold values for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers) Full Rack:
• Table 6-25 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 M2
and X4270 M2 servers) Full Rack with Single-phase, Low-voltage PDU
• Table 6-26 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 M2
and X4270 M2 servers) Full Rack with Three-phase, Low-voltage PDU
• Table 6-27 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 M2
and X4270 M2 servers) Full Rack with Single-phase, High-voltage PDU
• Table 6-28 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 M2
and X4270 M2 servers) Full Rack with Three-phase, High-voltage PDU
Table 6-25 lists the threshold values for Oracle Exadata Database Machine Full Rack using a
single-phase, low-voltage PDU.
6-39
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-25 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170
M2 and X4270 M2 servers) Full Rack with Single-phase, Low-voltage PDU
Table 6-26 lists the threshold values for Oracle Exadata Database Machine Full Rack using a
three-phase, low-voltage PDU.
Table 6-26 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170
M2 and X4270 M2 servers) Full Rack with Three-phase, Low-voltage PDU
Table 6-27 lists the threshold values for Oracle Exadata Database Machine Full Rack using a
single-phase, high-voltage PDU.
Table 6-27 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170
M2 and X4270 M2 servers) Full Rack with Single-phase, High-voltage PDU
Table 6-28 lists the threshold values for Oracle Exadata Database Machine Full Rack using a
three-phase, high-voltage PDU.
6-40
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-28 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170
M2 and X4270 M2 servers) Full Rack with Three-phase, High-voltage PDU
6.6.4.2 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 M2
and X4270 M2 servers) Half Rack
The following tables list the threshold values for Oracle Exadata Database Machine Half Rack:
• Table 6-29 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 M2
and X4270 M2 servers) Half Rack with Single-phase, Low-voltage PDU
• Table 6-30 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 M2
and X4270 M2 servers) Half Rack with Three-phase, Low-voltage PDU
• Table 6-31 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 M2
and X4270 M2 servers) Half Rack with Single-phase, High-voltage PDU
• Table 6-32 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 M2
and X4270 M2 servers) Half Rack with Three-phase, High-voltage PDU
Table 6-29 lists the threshold values for Oracle Exadata Database Machine Half Rack using a
single-phase, low-voltage PDU.
Table 6-29 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170
M2 and X4270 M2 servers) Half Rack with Single-phase, Low-voltage PDU
Table 6-30 lists the threshold values for Oracle Exadata Database Machine Half Rack using a
three-phase, low-voltage PDU.
Table 6-30 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170
M2 and X4270 M2 servers) Half Rack with Three-phase, Low-voltage PDU
6-41
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-30 (Cont.) Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) Half Rack with Three-phase, Low-voltage PDU
Table 6-31 lists the threshold values for Oracle Exadata Database Machine Half Rack using a
single-phase, high-voltage PDU.
Table 6-31 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170
M2 and X4270 M2 servers) Half Rack with Single-phase, High-voltage PDU
Table 6-32 lists the threshold values for Oracle Exadata Database Machine Half Rack using a
three-phase, high-voltage PDU.
Table 6-32 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170
M2 and X4270 M2 servers) Half Rack with Three-phase, High-voltage PDU
6.6.4.3 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 M2
and X4270 M2 servers) Quarter Rack
The following tables list the threshold values for Oracle Exadata Database Machine Quarter
Rack:
• Table 6-33 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 M2
and X4270 M2 servers) Quarter Rack with Single-phase, Low-voltage PDU
• Table 6-34 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 M2
and X4270 M2 servers) Quarter Rack with Three-phase, Low-voltage PDU
• Table 6-35 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 M2
and X4270 M2 servers) Quarter Rack with Single-phase, High-voltage PDU
6-42
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
• Table 6-36 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 M2
and X4270 M2 servers) Quarter Rack with Three-phase, High-voltage PDU
Table 6-33 lists the threshold values for Oracle Exadata Database Machine Quarter Rack using
a single-phase, low-voltage PDU.
Table 6-33 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170
M2 and X4270 M2 servers) Quarter Rack with Single-phase, Low-voltage PDU
Table 6-34 lists the threshold values for Oracle Exadata Database Machine Quarter Rack using
a three-phase, low-voltage PDU.
Table 6-34 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170
M2 and X4270 M2 servers) Quarter Rack with Three-phase, Low-voltage PDU
Table 6-35 lists the threshold values for Oracle Exadata Database Machine Quarter Rack using
a single-phase, high-voltage PDU.
Table 6-35 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170
M2 and X4270 M2 servers) Quarter Rack with Single-phase, High-voltage PDU
Table 6-36 lists the threshold values for Oracle Exadata Database Machine Quarter Rack using
a three-phase, high-voltage PDU.
6-43
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-36 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170
M2 and X4270 M2 servers) Quarter Rack with Three-phase, High-voltage PDU
6.6.5 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers)
This section contains the PDU thresholds for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers).
Note:
The values listed here are reliable for use on systems in the configuration received
upon deployment and delivery from the Oracle Factory. Any changes to this
configuration should be modeled in Oracle Exadata Configuration Assistant (OECA),
and the PDU thresholds listed in OECA should then be used. OECA can be
downloaded from Oracle Technology Network.
• PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 and X4275
servers) Full Rack
• PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 and X4275
servers) Half Rack
• PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 and X4275
servers) Quarter Rack
6.6.5.1 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 and
X4275 servers) Full Rack
The following tables list the threshold values for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers) Full Rack:
• Table 6-37 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 and
X4275 servers) Full Rack with Single-phase, Low-voltage PDU
• Table 6-38 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 and
X4275 servers) Full Rack with Three-phase, Low-voltage PDU
• Table 6-39 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 and
X4275 servers) Full Rack with Single-phase, High-voltage PDU
• Table 6-40 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 and
X4275 servers) Full Rack with Three-phase, High-voltage PDU
Table 6-37 lists the threshold values for Oracle Exadata Database Machine Full Rack using a
single-phase, low-voltage PDU.
6-44
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-37 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170
and X4275 servers) Full Rack with Single-phase, Low-voltage PDU
Table 6-38 lists the threshold values for Oracle Exadata Database Machine Full Rack using a
three-phase, low-voltage PDU.
Table 6-38 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170
and X4275 servers) Full Rack with Three-phase, Low-voltage PDU
Table 6-39 lists the threshold values for Oracle Exadata Database Machine Full Rack using a
single-phase, high-voltage PDU.
Table 6-39 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170
and X4275 servers) Full Rack with Single-phase, High-voltage PDU
Table 6-40 lists the threshold values for Oracle Exadata Database Machine Full Rack using a
three-phase, high-voltage PDU.
6-45
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-40 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170
and X4275 servers) Full Rack with Three-phase, High-voltage PDU
6.6.5.2 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 and
X4275 servers) Half Rack
The following tables list the threshold values for Oracle Exadata Database Machine Half Rack:
• Table 6-41 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 and
X4275 servers) Half Rack with Single-phase, Low-voltage PDU
• Table 6-42 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 and
X4275 servers) Half Rack with Three-phase, Low-voltage PDU
• Table 6-43 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 and
X4275 servers) Half Rack with Single-phase, High-voltage PDU
• Table 6-44 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 and
X4275 servers) Half Rack with Three-phase, High-voltage PDU
Table 6-41 lists the threshold values for Oracle Exadata Database Machine Half Rack using a
single-phase, low-voltage PDU.
Table 6-41 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170
and X4275 servers) Half Rack with Single-phase, Low-voltage PDU
Table 6-42 lists the threshold values for Oracle Exadata Database Machine Half Rack using a
three-phase, low-voltage PDU.
Table 6-42 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170
and X4275 servers) Half Rack with Three-phase, Low-voltage PDU
6-46
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-42 (Cont.) Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers) Half Rack with Three-phase, Low-voltage PDU
Table 6-43 lists the threshold values for Oracle Exadata Database Machine Half Rack using a
single-phase, high-voltage PDU.
Table 6-43 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170
and X4275 servers) Half Rack with Single-phase, High-voltage PDU
Table 6-44 lists the threshold values for Oracle Exadata Database Machine Half Rack using a
three-phase, high-voltage PDU.
Table 6-44 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170
and X4275 servers) Half Rack with Three-phase, High-voltage PDU
6.6.5.3 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 and
X4275 servers) Quarter Rack
The following tables list the threshold values for Oracle Exadata Database Machine Quarter
Rack:
• Table 6-45
Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 and X4275
servers) Quarter Rack with Single-phase, Low-voltage PDU
• Table 6-46
Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 and X4275
servers) Quarter Rack with Three-phase, Low-voltage PDU
6-47
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
• Table 6-47
Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 and X4275
servers) Quarter Rack with Single-phase, High-voltage PDU
• Table 6-48
Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 and X4275
servers) Quarter Rack with Three-phase, High-voltage PDU
Table 6-45 lists the threshold values for Oracle Exadata Database Machine Quarter Rack using
a single-phase, low-voltage PDU.
Table 6-45 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170
and X4275 servers) Quarter Rack with Single-phase, Low-voltage PDU
Table 6-46 lists the threshold values for Oracle Exadata Database Machine Quarter Rack using
a three-phase, low-voltage PDU.
Table 6-46 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170
and X4275 servers) Quarter Rack with Three-phase, Low-voltage PDU
Table 6-47 lists the threshold values for Oracle Exadata Database Machine Quarter Rack using
a single-phase, high-voltage PDU.
Table 6-47 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170
and X4275 servers) Quarter Rack with Single-phase, High-voltage PDU
6-48
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-47 (Cont.) Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers) Quarter Rack with Single-phase, High-voltage PDU
Table 6-48 lists the threshold values for Oracle Exadata Database Machine Quarter Rack using
a three-phase, high-voltage PDU.
Table 6-48 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170
and X4275 servers) Quarter Rack with Three-phase, High-voltage PDU
6.6.6 PDU Thresholds for Oracle Exadata Database Machine X4-8 and
Later
This section contains the PDU thresholds for Oracle Exadata Database Machine Eight-Socket
systems for X4-8 and later.
Oracle Exadata Configuration Assistant (OECA) is the only source for PDU thresholds for
Oracle Exadata Database Machine X4-8 and later systems. OECA is available on Oracle
Technology Network at http://www.oracle.com/technetwork/database/exadata/oeca-
download-2817713.html
If for some reason you are unable to utilize OECA, contact Oracle Support.
6.6.7 PDU Thresholds for Oracle Exadata Database Machine X3-8 Full
Rack
This section contains the PDU thresholds for Oracle Exadata Database Machine X3-8 Full
Rack.
• Table 6-49 Threshold Values for Oracle Exadata Database Machine X3-8 Full Rack with
Single-phase, Low-voltage 22 kVA PDU
• Table 6-50 Threshold Values for Oracle Exadata Database Machine X3-8 Full Rack with
Three-phase, Low-voltage 24 kVA PDU
• Table 6-51 Threshold Values for Oracle Exadata Database Machine X3-8 Full Rack with
Single-phase, High-voltage 22 kVA PDU
• Table 6-52 Threshold Values for Oracle Exadata Database Machine X3-8 Full Rack with
Three-phase, High-voltage 24 kVA PDU
Table 6-49 lists the threshold values for Oracle Exadata Database Machine X3-8 Full Rack
using a single-phase, low-voltage 22 kVA PDU.
6-49
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-49 Threshold Values for Oracle Exadata Database Machine X3-8 Full Rack with
Single-phase, Low-voltage 22 kVA PDU
Table 6-50 lists the threshold values for Oracle Exadata Database Machine X3-8 Full Rack
using a three-phase, low-voltage 24 kVA PDU.
Table 6-50 Threshold Values for Oracle Exadata Database Machine X3-8 Full Rack with
Three-phase, Low-voltage 24 kVA PDU
Table 6-51 lists the threshold values for Oracle Exadata Database Machine X3-8 Full Rack
using a single-phase, high-voltage 22 kVA PDU.
Table 6-51 Threshold Values for Oracle Exadata Database Machine X3-8 Full Rack with
Single-phase, High-voltage 22 kVA PDU
6-50
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-52 lists the threshold values for Oracle Exadata Database Machine X3-8 Full Rack
using a three-phase, high-voltage 24 kVA PDU.
Table 6-52 Threshold Values for Oracle Exadata Database Machine X3-8 Full Rack with
Three-phase, High-voltage 24 kVA PDU
6.6.8 PDU Thresholds for Oracle Exadata Database Machine X2-8 Full
Rack
This section contains the PDU thresholds for Oracle Exadata Database Machine X2-8 Full
Rack.
• Table 6-53 Threshold Values for Oracle Exadata Database Machine X2-8 Full Rack with
Single-phase, Low-voltage 22 kVA PDU
• Table 6-54 Threshold Values for Oracle Exadata Database Machine X2-8 Full Rack with
Three-phase, Low-voltage 24 kVA PDU
• Table 6-55 Threshold Values for Oracle Exadata Database Machine X2-8 Full Rack with
Single-phase, High-voltage 22 kVA PDU
• Table 6-56 Threshold Values for Oracle Exadata Database Machine X2-8 Full Rack with
Three-phase, High-voltage 24 kVA PDU
Table 6-53 lists the threshold values for Oracle Exadata Database Machine X2-8 Full Rack
using a single-phase, low-voltage 22 kVA PDU.
Table 6-53 Threshold Values for Oracle Exadata Database Machine X2-8 Full Rack with
Single-phase, Low-voltage 22 kVA PDU
6-51
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-53 (Cont.) Threshold Values for Oracle Exadata Database Machine X2-8 Full
Rack with Single-phase, Low-voltage 22 kVA PDU
Table 6-54 lists the threshold values for Oracle Exadata Database Machine X2-8 Full Rack
using a three-phase, low-voltage 24 kVA PDU.
Table 6-54 Threshold Values for Oracle Exadata Database Machine X2-8 Full Rack with
Three-phase, Low-voltage 24 kVA PDU
Table 6-55 lists the threshold values for Oracle Exadata Database Machine X2-8 Full Rack
using a single-phase, high-voltage 22 kVA PDU.
Table 6-55 Threshold Values for Oracle Exadata Database Machine X2-8 Full Rack with
Single-phase, High-voltage 22 kVA PDU
Table 6-56 lists the threshold values for Oracle Exadata Database Machine X2-8 Full Rack
using a three-phase, high-voltage 24 kVA PDU.
Table 6-56 Threshold Values for Oracle Exadata Database Machine X2-8 Full Rack with
Three-phase, High-voltage 24 kVA PDU
6-52
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
6.6.9 PDU Thresholds for Oracle Exadata Storage Expansion Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers
This section contains the PDU thresholds for Oracle Exadata Storage Expansion Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers.
• PDU Thresholds for Oracle Exadata Storage Expansion Full Rack with Exadata Storage
Server with Sun Fire X4270 M2 Servers
• PDU Thresholds for Oracle Exadata Storage Expansion Half Rack with Exadata Storage
Server with Sun Fire X4270 M2 Servers
• PDU Thresholds for Oracle Exadata Storage Expansion Quarter Rack with Exadata
Storage Server with Sun Fire X4270 M2 Servers
6.6.9.1 PDU Thresholds for Oracle Exadata Storage Expansion Full Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers
The following tables list the threshold values for Oracle Exadata Storage Expansion Full Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers Full Rack:
• Table 6-57 Threshold Values for Oracle Exadata Storage Expansion Full Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers with Single-phase, Low-voltage
PDU
• Table 6-58 Threshold Values for Oracle Exadata Storage Expansion Full Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers with Three-phase, Low-voltage
PDU
• Table 6-59 Threshold Values for Oracle Exadata Storage Expansion Full Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers with Single-phase, High-voltage
PDU
• Table 6-60 Threshold Values for Oracle Exadata Storage Expansion Full Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers with Three-phase, High-voltage
PDU
Table 6-57 lists the threshold values for Oracle Exadata Storage Expansion Full Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers using a single-phase, low-voltage
PDU.
Table 6-57 Threshold Values for Oracle Exadata Storage Expansion Full Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers with Single-phase, Low-voltage
PDU
6-53
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-58 lists the threshold values for Oracle Exadata Storage Expansion Full Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers using a three-phase, low-voltage
PDU.
Table 6-58 Threshold Values for Oracle Exadata Storage Expansion Full Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers with Three-phase, Low-voltage
PDU
Table 6-59 lists the threshold values for Oracle Exadata Storage Expansion Full Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers using a single-phase, high-voltage
PDU.
Table 6-59 Threshold Values for Oracle Exadata Storage Expansion Full Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers with Single-phase, High-voltage
PDU
Table 6-60 lists the threshold values for Oracle Exadata Storage Expansion Full Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers using a three-phase, high-voltage
PDU.
Table 6-60 Threshold Values for Oracle Exadata Storage Expansion Full Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers with Three-phase, High-voltage
PDU
6-54
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
6.6.9.2 PDU Thresholds for Oracle Exadata Storage Expansion Half Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers
The following tables list the threshold values for Oracle Exadata Storage Expansion Half Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers:
• Table 6-61 Threshold Values for Oracle Exadata Storage Expansion Half Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers with Single-phase, Low-voltage
PDU
• Table 6-62 Threshold Values for Oracle Exadata Storage Expansion Half Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers with Three-phase, Low-voltage
PDU
• Table 6-63 Threshold Values for Oracle Exadata Storage Expansion Half Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers with Single-phase, High-voltage
PDU
• Table 6-64 Threshold Values for Oracle Exadata Storage Expansion Half Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers with Three-phase, High-voltage
PDU
Table 6-61 lists the threshold values for Oracle Exadata Storage Expansion Half Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers using a single-phase, low-voltage
PDU.
Table 6-61 Threshold Values for Oracle Exadata Storage Expansion Half Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers with Single-phase, Low-voltage
PDU
Table 6-62 lists the threshold values for Oracle Exadata Storage Expansion Half Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers using a three-phase, low-voltage
PDU.
Table 6-62 Threshold Values for Oracle Exadata Storage Expansion Half Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers with Three-phase, Low-voltage
PDU
6-55
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-63 lists the threshold values for Oracle Exadata Storage Expansion Half Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers using a single-phase, high-voltage
PDU.
Table 6-63 Threshold Values for Oracle Exadata Storage Expansion Half Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers with Single-phase, High-voltage
PDU
Table 6-64 lists the threshold values for Oracle Exadata Storage Expansion Half Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers using a three-phase, high-voltage
PDU.
Table 6-64 Threshold Values for Oracle Exadata Storage Expansion Half Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers with Three-phase, High-voltage
PDU
6.6.9.3 PDU Thresholds for Oracle Exadata Storage Expansion Quarter Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers
The following tables list the threshold values for Oracle Exadata Storage Expansion Quarter
Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers:
• Table 6-65 Threshold Values for Oracle Exadata Storage Expansion Quarter Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers with Single-phase, Low-voltage
PDU
• Table 6-66 Threshold Values for Oracle Exadata Storage Expansion Quarter Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers with Three-phase, Low-voltage
PDU
• Table 6-67 Threshold Values for Oracle Exadata Storage Expansion Quarter Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers with Single-phase, High-voltage
PDU
• Table 6-68 Threshold Values for Oracle Exadata Storage Expansion Quarter Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers with Three-phase, High-voltage
PDU
6-56
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-65 lists the threshold values for Oracle Exadata Storage Expansion Quarter Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers using a single-phase, low-voltage
PDU.
Table 6-65 Threshold Values for Oracle Exadata Storage Expansion Quarter Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers with Single-phase, Low-voltage
PDU
Table 6-66 lists the threshold values for Oracle Exadata Storage Expansion Quarter Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers using a three-phase, low-voltage
PDU.
Table 6-66 Threshold Values for Oracle Exadata Storage Expansion Quarter Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers with Three-phase, Low-voltage
PDU
Table 6-67 lists the threshold values for Oracle Exadata Storage Expansion Quarter Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers using a single-phase, high-voltage
PDU.
Table 6-67 Threshold Values for Oracle Exadata Storage Expansion Quarter Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers with Single-phase, High-voltage
PDU
6-57
Chapter 6
Checking Exadata Storage Servers
Table 6-68 lists the threshold values for Oracle Exadata Storage Expansion Quarter Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers using a three-phase, high-voltage
PDU.
Table 6-68 Threshold Values for Oracle Exadata Storage Expansion Quarter Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers with Three-phase, High-voltage
PDU
Note:
If you do not have the password for the root user, then contact Oracle Support
Services.
6-58
Chapter 6
Checking Exadata Storage Servers
3. Verify the SysSN label for the storage server matches the product_serial_number value
using the following command:
# /opt/oracle.SupportTools/CheckHWnFWProfile
If output does not show success, then examine the output for mismatched hardware or
firmware and take steps to correct those as explained in the following steps.
5. Verify the disks on the server are visible and online using the following command. The
disks are numbered slot 0 to slot 11.
• If you are using Oracle Exadata System Software release 19c or later, then get the
enclosure ID:
# cd /opt/MegaRAID/storcli
# ./storcli64 /c0/eall show
Controller = 0
Status = Success
Description = None
Properties :
==========
------------------------------------------------------------------------
-----------------
EID State Slots PD PS Fans TSs Alms SIM Port#
ProdID VendorSpecific
------------------------------------------------------------------------
-----------------
8 OK 14 12 0 0 0 0 0 Port 0 - 3 & Port 4 - 7 x8
X5-2L SPMS v`
252 OK 8 0 0 0 0 0 1 Internal
SGPIO
------------------------------------------------------------------------
-----------------
# cd /opt/MegaRAID/storcli
# ./storcli64 /c0/e8/sall show all | grep "8:"
8:0 16 Onln 0 7.151 TB SAS HDD N N 512B H7280A520SUN8.0T U
6-59
Chapter 6
Checking Exadata Storage Servers
The rows displayed are from a table that displays the following information:
• If you are using Oracle Exadata System Software release 18c or earlier, then use the
following command:
# cd /opt/MegaRAID/MegaCli
# ./MegaCli64 -Pdlist -aAll |grep "Slot \|Firmware"
Slot Number:0
Firmware state:Online, Spun Up
Slot Number:1
Firmware state:Online, Spun Up
Slot Number:2
Firmware state:Online, Spun Up
Slot Number:3
Firmware state:Online, Spun Up
Slot Number:4
Firmware state:Online, Spun Up
Slot Number:5
Firmware state:Online, Spun Up
Slot Number:6
Firmware state:Online, Spun Up
Slot Number:7
Firmware state:Online, Spun Up
Slot Number:8
Firmware state:Online, Spun Up
Slot Number:9
Firmware state:Online, Spun Up
Slot Number:10
Firmware state:Online, Spun Up
6-60
Chapter 6
Checking Oracle Exadata Database Servers
Slot Number:11
Firmware state:Online, Spun Up
7. Verify the flash modules are visible. The number of cards and modules varies depending
on the model.
If any flash modules are missing, then power cycle the system, and wait 10 minutes after
restarting before checking again. If this does not resolve the problem, then re-seat the
module and flash card. If the problem continues, then replace the card with the on-site
spare.
8. Check the rear of the rack to ensure the flash card LEDs are green all the way across. If
any LED is amber, then check again after the next step. If the LED is still amber after
restart, then re-seat the card and ESM or flash module. If the problem continues, then
replace the card with the on-site spare.
Note:
This step can be done when all systems are on. It does not have to be done on a
per-server basis.
# logout
6-61
Chapter 6
Checking Oracle Exadata Database Servers
After you connect to ILOM, run the start /SP/console command to connect to the
host console.
For more details, see Connect to Oracle ILOM.
• Connect using the KVM switch, if one is available.
2. Log in as the root user to the database server.
Note:
If you do not have the password for the root user, then contact Oracle Support
Services.
3. Verify the SysSN label for the server matches the product_serial_number value using the
following command:
/SYS
Properties:
product_serial_number =093ABCD5001
->Session closed
Disconnected
cd /opt/oracle.SupportTools/firstconf
5. Create a group file with the list of server IP addresses to use in the dcli utility commands,
if required.
If you are configuring Oracle Exadata Rack X8M, then you must manually create a file and
add the IP addresses.
On racks that use InfiniBand Network Fabric, you can use the following command to
identify the servers and copy the results into a text file.
In the preceding command, group_file is name of the file to create with the server IP
addresses.
6. Verify the hardware profile is correct using the following command. The command checks
CPU type and count, component firmware, and so on.
# more /tmp/checkhwfw.out
6-62
Chapter 6
Checking Oracle Exadata Database Servers
If a profile check fails and the firmware needs to be refreshed, then run the following
command from the system with the problem.
# /opt/oracle.SupportTools/CheckHWnFWProfile -U /opt/oracle.cellos/iso/
cellbits
Now updating the ILOM and the BIOS …
The command must be entered on a single line. After running the command, power off the
system, reset the Integrated Lights Out Manager (ILOM), and wait 10 minutes before
powering on the system.
7. Verify the disks on the server are visible and online.
• If you are using Oracle Exadata System Software release 19c or later, then use the
following command:
# cd /opt/MegaRAID/storcli
# ./storcli64 /call show | grep "Physical Drives" -A 25
Physical Drives = 8
PD LIST :
=======
------------------------------------------------------------------------
------
EID:Slt DID State DG Size Intf Med SED PI SeSz Model
Sp Type
------------------------------------------------------------------------
------
39:0 31 Onln 0 278.464 GB SAS HDD N N 512B ST930003SSUN300G
U -
39:1 35 Onln 0 278.464 GB SAS HDD N N 512B ST930003SSUN300G
U -
39:2 41 Onln 0 278.464 GB SAS HDD N N 512B H103030SCSUN300G
U -
39:3 37 Onln 0 278.464 GB SAS HDD N N 512B ST930003SSUN300G
U -
39:4 38 Onln 0 278.464 GB SAS HDD N N 512B ST930003SSUN300G
U -
39:5 44 Onln 0 278.464 GB SAS HDD N N 512B H109030SESUN300G
U -
39:6 33 Onln 0 278.464 GB SAS HDD N N 512B ST930003SSUN300G
U -
39:7 43 Onln 0 278.464 GB SAS HDD N N 512B ST930003SSUN300G
U -
6-63
Chapter 6
Checking Oracle Exadata Database Servers
------------------------------------------------------------------------
------
• If you are using Oracle Exadata System Software release 18c or earlier, then use the
following command:
# cd /opt/MegaRAID/MegaCli
# ./MegaCli64 -Pdlist -aAll |grep "Slot \|Firmware"
Slot Number:0
Firmware state:Online, Spun Up
Slot Number:1
Firmware state:Online, Spun Up
Slot Number:2
Firmware state:Online, Spun Up
Slot Number:3
Firmware state:Online, Spun Up
Slot Number:4
Firmware state:Online, Spun Up
Slot Number:5
Firmware state:Online, Spun Up
Slot Number:6
Firmware state:Online, Spun Up
Slot Number:7
Firmware state:Online, Spun Up
Slot Number:8
Firmware state:Online, Spun Up
Slot Number:9
Firmware state:Online, Spun Up
Slot Number:10
Firmware state:Online, Spun Up
Slot Number:11
Firmware state:Online, Spun Up
• If you are using Oracle Exadata System Software release 18c or earlier, then you can
use the following command:
6-64
Chapter 6
Performing Additional Checks and Configuration
9. (Oracle Exadata Database Machine based on Sun Fire X4170 Oracle Database Servers
only) Check that the ILOM is configured for the proper fan cooling on each database server
using the following command:
• If the policy is present and enabled, then no additional steps are needed.
• If the policy is present and disabled, then enable the policy using the following
command:
# ntpq -p
# logout
# cd /opt/oracle.SupportTools/firstconf
3. Create a group file with the list of IP addresses to use in the dcli utility commands, if you
want to query multiple racks.
4. Verify the rack master serial number is set correctly using the following command:
# more /tmp/show-rack-msn.out
If none of the serial numbers are set, then contact Oracle Support Services. If one serial
number is not set correctly, then run the following command to correct it, where rack_type
is the rack designation, such as X8-8 and the string serial_number represents the serial
number:
6-65
Chapter 6
Verifying the RoCE Network Fabric Configuration
5. If you are running an Oracle Exadata System Software release earlier than 18.1, then
ensure disk cache policy is set to Disabled using the following command as the root user
on the first database server in the cluster:
If any server shows different output, then identify the LUN and use the following command
to reset the policy to Disabled, where LUNn is the LUN number, such as L2:
1. Verify the proper oracle-rdma-release software versions are being used on the database
servers.
3. Visually check all the RDMA Network Fabric cable connections within the rack.
The port lights should be on, and the LEDs should be on. Do not press each connector to
verify connectivity.
4. Complete the steps described in My Oracle Support Doc ID 2587717.1
Related Topics
• Verify RoCE Cabling on Oracle Exadata Database Machine X8M-2 and X8M-8 Servers
(My Oracle Support Doc ID 2587717.1)
6-66
Chapter 6
Verifying the InfiniBand Network Fabric Network
# cd /opt/oracle.SupportTools/ibdiagtools
# ./verify-topology [-t rack_size]
The following example shows the output when the network components are correct.
In the preceding command, rack_size is the size of the rack. The -t rack_size option is
needed if the rack is Oracle Exadata Half Rack or Oracle Exadata Quarter Rack. Use the
value halfrack or quarterrack, if needed.
The following example shows the output when there is a bad RDMA Network Fabric switch
to cable connection:
#./verify-topology
[DB Machine Infiniband Cabling Topology Verification Tool ]
Is every external switch connected to every internal switch......[SUCCESS ]
Are any external switches connected to each other................[SUCCESS ]
Are any hosts connected to spine switch..........................[SUCCESS ]
Check if all hosts have 2 CAs to different switches..............[SUCCESS ]
Leaf switch check:cardinality and even distribution..............[SUCCESS ]
Check if each rack has an valid internal ring....................[ERROR ]
The following example shows the output when there is a bad RDMA Network Fabric cable
on a database server:
#./verify-topology
[DB Machine Infiniband Cabling Topology Verification Tool ]
Is every external switch connected to every internal switch......[SUCCESS ]
Are any external switches connected to each other................[SUCCESS ]
Are any hosts connected to spine switch..........................[SUCCESS ]
Check if all hosts have 2 CAs to different switches..............[ERROR ]
Node db01 has 1 endpoints.(Should be 2)
6-67
Chapter 6
Imaging a New System
The following example shows the output when there is a bad connection on the switch and
the system:
#./verify-topology
[DB Machine Infiniband Cabling Topology Verification Tool ]
Is every external switch connected to every internal switch......[SUCCESS ]
Are any external switches connected to each other................[SUCCESS ]
Are any hosts connected to spine switch..........................[SUCCESS ]
Check if all hosts have 2 CAs to different switches..............[ERROR ]
6-68
Chapter 6
Imaging a New System
To prepare a new Exadata system for deployment using ISO images, perform the following
steps:
1. Obtain the latest Oracle Exadata Deployment Assistant (OEDA).
2. Run the OEDA configuration tool to generate the configuration files. You will need the
configuration files when you run applyElasticConfig.sh later.
3. Power on all the servers.
a. Database nodes and cells will automatically assign to themselves unused IP
addresses on eth0 in the 172.16 range.
b. Host names of the nodes will be of the format nodeN, where N is a number.
4. After booting from the ISO, follow the prompts and imaging will start automatically. You will
be prompted to enter IP addresses.
You can use a preconf.csv by following the steps in Using ISO to Image a New System to
mount the image on an NFS repository. You need to place the preconf.csv file in the same
NFS directory.
6-69
Chapter 6
Imaging a New System
5. If you are using virtualization on the database servers (Oracle VM Server or Oracle Linux
KVM), then run switch_to_ovm.sh on each database server. The database servers will
reboot if you are using Oracle VM Server.
For example:
# /opt/oracle.SupportTools/switch_to_ovm.sh
2014-12-07 11:58:36 -0800 [INFO] Switch to DOM0 system partition /dev/
VGExaDb/LVDbSys3 (/dev/mapper/VGExaDb-LVDbSys3)
2014-12-07 11:58:36 -0800 [INFO] Active system device: /dev/mapper/VGExaDb-
LVDbSys1
2014-12-07 11:58:36 -0800 [INFO] Active system device in boot area: /dev/
mapper/VGExaDb-LVDbSys1
2014-12-07 11:58:36 -0800 [INFO] Set active systen device to /dev/VGExaDb/
LVDbSys3 in /boot/I_am_hd_boot
2014-12-07 11:58:36 -0800 [INFO] Reboot has been initiated to switch to
the DOM0 system partition
Caution:
Do not skip this step. Skipping this step results in unused space that can no
longer be reclaimed by reclaimdisks.sh.
[ Minimal BASH-like line editing is supported. For the first word, TAB
lists possible command completions. Anywhere else TAB lists the possible
completions of a device/filename.]
grub> root (hd0,0)
Filesystem type is ext2fs, partition type 0x83
grub> setup (hd0)
Checking if "/boot/grub/stage1" exists... no
Checking if "/grub/stage1" exists... yes
Checking if "/grub/stage2" exists... yes
Checking if "/grub/e2fs_stage1_5" exists... yes
Running "embed /grub/e2fs_stage1_5 (hd0)"... failed (this is not fatal)
6-70
Chapter 6
Imaging a New System
7. If you have an Oracle Exadata Rack X8 or earlier, then run ibhosts and verify that all
nodes show the correct IP addresses and host names. There should be no nodes with
elasticNode in the description.
8. Run the OEDA tool to deploy.
Related Topics
• Exadata 12.1.2.1.1 release and patch (20240049) (My Oracle Support Doc ID 1959143.1)
6-71
Chapter 6
Imaging a New System
# /opt/oracle.SupportTools/switch_to_ovm.sh
2014-12-07 11:58:36 -0800 [INFO] Switch to DOM0 system partition /dev/
VGExaDb/LVDbSys3 (/dev/mapper/VGExaDb-LVDbSys3)
2014-12-07 11:58:36 -0800 [INFO] Active system device: /dev/mapper/VGExaDb-
LVDbSys1
2014-12-07 11:58:36 -0800 [INFO] Active system device in boot area: /dev/
mapper/VGExaDb-LVDbSys1
2014-12-07 11:58:36 -0800 [INFO] Set active systen device to /dev/VGExaDb/
LVDbSys3 in /boot/I_am_hd_boot
2014-12-07 11:58:36 -0800 [INFO] Reboot has been initiated to switch to
the DOM0 system partition
Caution:
Do not skip this step. Skipping this step results in unused space that can no
longer be reclaimed by reclaimdisks.sh.
[ Minimal BASH-like line editing is supported. For the first word, TAB
lists possible command completions. Anywhere else TAB lists the possible
completions of a device/filename.]
grub> root (hd0,0)
6-72
Chapter 6
Imaging a New System
6-73
Chapter 6
Imaging a New System
b. Host names of the nodes will be of the format nodeN, where N is a number.
4. Run OEDA to generate the preconf.csv file that can be used to image the system.
5. Connect to the first database node.
Use one of the following connection options:
• Attach a serial cable between a console and the SER MGT port on the server.
Connections through the modular jack serial port must use shielded cables to comply
with radio frequency emission limits.
Set the terminal device communication properties to these values: 9600 baud, 8 bit, no
parity, 1 stop bit.
For more details, see Connect to Oracle ILOM.
• Attach an Ethernet cable to the NET MGT port on the server and then connect using a
workstation on the network.
For more details, see Connect to Oracle ILOM.
6. Obtain the eth0 MAC address for each database node. This is the fru_macaddress field
from /SYS/MB/NET0 in the ILOM (or through ip addr if logged into the console).
a. Connect to the other database nodes using ssh from the console.
b. Run ibhosts to get a list of node names and IP addresses.
7. Insert the MAC addresses using uppercase characters in the seventh field of the
preconf.csv file for each node. This field should be empty, that is, you should see two
consecutive comma characters (,,). For example:
orhb42-b08-01,example.com,db,eth0,eth0,Management,00:10:E0:69:34:52,
10.196.3.106,255.255.224.0,10.196.31.250,orhb42-b08-01-priv,Private:ac
tive-bond-ib,192.168.10.15,255.255.255.0,,,America/Los_Angeles
8. Run ipconf to verify the generated preconf.csv file. This can be done on any Exadata
server, and although not required, it is useful to ensure the preconf.csv is valid before
proceeding.
9. Prepare and locate the files required for system imaging. The procedure varies depending
on the Oracle Exadata System Software version being used.
• If you are using version 12.1.2.2.0 or later, it is no longer necessary to use imagemaker
to create the image files. The relevant PXE, ISO, and USB image files are already in
the patch archive.
Use Exadata Database Machine and Exadata Storage Server Supported Versions (My
Oracle Support Doc ID 888828.1) to locate the relevant patch archive. Then, unzip the
patch archive and follow the steps in the patch README.txt to copy the ISO file and
optional preconf.csv file into place.
6-74
Chapter 6
Imaging a New System
Note:
– Using ISO with the preconf.csv file is supported only if the ISO image
is mounted on an NFS repository in ILOM and the preconf.csv file is
located in the same NFS directory.
All other methods of mounting the ISO image in ILOM (SAMBA URI and
Java Remote Console) and burning ISO image to DVD will not work with
the preconf.csv file. For instructions on how to mount the ISO image
from a NFS central repository, see "Configure a Host Storage Device
Redirection Session" in the Oracle X5 Series Servers Administration
Guide
– If a newly imaged system does not have access to DHCP, then the
imaging procedure will not be able to access the preconf.csv file. In
this case, the imaging procedure will attempt to locate the preconf.csv
inside a dedicated ISO image located in the same directory and named
preconf.iso.
To use this method, you can create the preconf.iso file by using the
following command:
– When a preconf.csv file is not being used, the ISO image can be made
available as virtual media on the ILOM of the node being re-imaged.
– Because of possible late echos of text to the console, be aware that the
boot process will be waiting for input to complete the interactive ipconf
by prompting for Nameserver:
– Due to a bug, ipconf will prompt you twice to enter the network settings.
• If you are using versions prior to 12.1.2.2.0, use ImageMaker to create the image files
as follows:
a. Download the imagemaker kit to prepare and create the files for the USB drive.
This kit is available publicly on the Oracle Software Delivery Cloud
(edelivery.oracle.com) site under “Oracle Database Products -> Linux x86-64”.
There are separate ImageMaker files for database nodes and cells.
b. After download, unzip the first file, called something similar to V75080-01.zip, and
then unzip the subsequent file as well. Finally, extract the resulting archive.
Perform the commands as the root user.
# unzip V75080-01.zip
# unzip cellImageMaker_12.1.2.1.1_LINUX.X64_150316.2-1.x86_64.zip
# tar -pxvf
cellImageMaker_12.1.2.1.1_LINUX.X64_150316.2-1.x86_64.tar
6-75
Chapter 6
Imaging a New System
For ISO imaging, note that you must run makeImageMedia.sh from an Oracle
Exadata database server if you are using the -preconf option.
For example:
6-76
Chapter 6
Imaging a New System
d. Attach the ISO as virtual media to the ILOM of the database server to be re-
imaged, and select CDROM as the next boot device.
10. Reboot the database node or cell to start the imaging process from the ISO.
11. If you are using Oracle VM, run switch_to_ovm.sh on each database server. The
database servers will reboot.
For example:
# /opt/oracle.SupportTools/switch_to_ovm.sh
2014-12-07 11:58:36 -0800 [INFO] Switch to DOM0 system partition /dev/
VGExaDb/LVDb
Sys3 (/dev/mapper/VGExaDb-LVDbSys3)
2014-12-07 11:58:36 -0800 [INFO] Active system device: /dev/mapper/VGExaDb-
LVDbSys
1
2014-12-07 11:58:36 -0800 [INFO] Active system device in boot area: /dev/
mapper/VG
ExaDb-LVDbSys1
2014-12-07 11:58:36 -0800 [INFO] Set active systen device to /dev/VGExaDb/
LVDbSys3
in /boot/I_am_hd_boot
2014-12-07 11:58:36 -0800 [INFO] Reboot has been initiated to switch to
the DOM0 s
ystem partition
6-77
Chapter 6
Imaging a New System
Caution:
Do not skip this step. Skipping this step results in unused space that can no
longer be reclaimed by reclaimdisks.sh.
[ Minimal BASH-like line editing is supported. For the first word, TAB
lists possible command completions. Anywhere else TAB lists the possible
completions of a device/filename.]
grub> root (hd0,0)
Filesystem type is ext2fs, partition type 0x83
grub> setup (hd0)
Checking if "/boot/grub/stage1" exists... no
Checking if "/grub/stage1" exists... yes
Checking if "/grub/stage2" exists... yes
Checking if "/grub/e2fs_stage1_5" exists... yes
Running "embed /grub/e2fs_stage1_5 (hd0)"... failed (this is not fatal)
Running "embed /grub/e2fs_stage1_5 (hd0,0)"... failed (this is not fatal)
Running "install /grub/stage1 (hd0) /grub/stage2 p /grub/grub.conf "...
succeeded
Done.
grub> quit
13. Run ibhosts and verify that all nodes show the correct IP addresses and host names.
There should be no nodes with elasticNode in the description.
14. Run the OEDA tool to deploy.
6-78
Chapter 6
Imaging a New System
Related Topics
• Oracle Software Delivery Cloud
• Exadata Database Machine and Exadata Storage Server Supported Versions (My Oracle
Support Doc ID 888828.1)
6.12.4.1 Using PXE to Image a New System Using Release 12.1.2.2.0 or Later
You can use PXE to prepare a new Exadata system running Oracle Exadata System Software
release 12.1.2.2.0 or later for deployment using a simplified method.
1. Obtain the latest Oracle Exadata Deployment Assistant (OEDA) from http://
www.oracle.com/technetwork/database/exadata/oeda-download-2076737.html.
2. Run the OEDA configuration tool to generate the configuration files.
3. Power on all the servers.
When the system is first started, the following conditions exist:
a. Database nodes and cells will automatically assign to themselves unused IP
addresses on eth0 in the 172.16 range.
b. Host names of the nodes will be of the format nodeN, where N is a number.
4. Run OEDA to generate the preconf.csv file that you will use to image the system.
5. Connect to the first database node.
Use one of the following connection options:
• Attach a serial cable between a console and the SER MGT port on the server.
Connections through the modular jack serial port must use shielded cables to comply
with radio frequency emission limits.
6-79
Chapter 6
Imaging a New System
Set the terminal device communication properties to these values: 9600 baud, 8 bit, no
parity, 1 stop bit.
For more details, see Connect to Oracle ILOM.
• Attach an Ethernet cable to the NET MGT port on the server and then connect using a
workstation on the network.
For more details, see Connect to Oracle ILOM.
6. Obtain the eth0 MAC address for each database node.
The eth0 MAC address is the fru_macaddress field from /SYS/MB/NET0 in the ILOM (or
from ip addr if logged into the console).
a. Connect to the each database node through SSH from the console.
b. Run ibhosts to get a list of node names and IP addresses.
7. Insert the MAC addresses using uppercase characters in the seventh field of the
preconf.csv file for each node.
This field should be empty, that is, you should see two consecutive comma characters (,,).
For example:
orhb42-
b08-01,example.com,db,eth0,eth0,Management,00:10:E0:69:34:52,10.196.3.
106,255.255.224.0,10.196.31.250,orhb42-b08-01-priv,Private:active-bond-
ib,192.1
68.10.15,255.255.255.0,,,America/Los_Angeles
kernel vmlinux-iso-file-name
append initrd=img_file pxe factory stit reboot-on-success
notests=diskgroup dhcp
preconf=n.n.n.n:/directory/preconf.csv iso-uri=http://web_server/
x86_64/iso/image_n
ame.iso console=ttyS0,115200n8
On systems with Oracle Exadata System Software release 20.1.0 or later, you can enable
or disable Exadata Secure RDMA Fabric Isolation by adding qinq=yes or qinq=no to the
kernel options. For example:
kernel vmlinux-iso-file-name
append initrd=img_file pxe factory stit reboot-on-success
notests=diskgroup dhcp
preconf=n.n.n.n:/directory/preconf.csv iso-uri=http://web_server/
x86_64/iso/image_n
ame.iso console=ttyS0,115200n8 qinq=no
6-80
Chapter 6
Imaging a New System
If you want to use this option, then perform the following for each node:
a. Create an RSA public and private key pair using a utility such as ssh-keygen.
For example:
b. Rename the public key file so that the file name conforms to the following format:
id_rsa.short_hostname.root.pub
In the public key file name, short_hostname is the node host name as defined in the
first field of the corresponding node entry in the preconf.csv file.
c. Copy the renamed public key file to the directory that contains the preconf.csv file.
This is the same directory that you previously specified in the PXE configuration file
preconf parameter, which defines the path to the preconf.csv file.
If you configure key-based authentication, then password-based authentication is disabled
after the imaging process. Consequently, root access to the node is only possible using
the matching private key. ILOM access using the root password is also disabled.
By default, if the public key file is not named or located correctly, then password-based
authentication is enabled for the node. You can also make key-based authentication
mandatory by specifying root-ssh-key=yes as a boot option in the PXE configuration file.
In this case, the imaging process fails if the public key is not in the correct location.
Regardless of any public keys, you can disable the configuration of key-based
authentication by specifying root-ssh-key=no as a boot option in the PXE configuration
file.
10. Create the image files, if necessary.
If you are using version 12.1.2.2.0 or later, it is no longer necessary to use ImageMaker to
create the image files. The relevant PXE, ISO, and USB image files have already been
created in the patches themselves. Simply download the patch containing the pre-built
PXE image files from Oracle Software Delivery Cloud and place them into the appropriate
directories on the PXE server. For all releases, see My Oracle Support note 888828.1 for
the patch numbers. There are separate PXE image patches for database servers and
storage servers.
Note: For image version 12.1.2.2.0 the format of the downloadable image files has
changed.
The downloaded zip file contains four image files:
• For 12.1.2.2.0 up to 12.2.1.1.0:
kernel: vmlinux-version-ImageName-{DL180|DL360}
initrd: initrd-version-ImageName-{DL180|DL360}.img
image: nfsimg-version-ImageName-{DL180|DL360}.tar
image: nfsimg-version-ImageName-{DL180|DL360}.tar.md5
kernel: vmlinux-iso-ImageName-{cell|compute}
initrd: initrd-iso-ImageName-{cell|compute}.img
image: vmlinux-iso-ImageName-{cell|compute}.tar
6-81
Chapter 6
Imaging a New System
11. Change the boot order using the ILOM to boot from PXE and then restart the server to
start the imaging process.
For example, from the Oracle Linux prompt on the host:
# shutdown -r now
12. If you are using Oracle VM, run switch_to_ovm.sh on all Oracle VM database servers
before running the OEDA installation tool.
When you run this command, the database servers will reboot.
# /opt/oracle.SupportTools/switch_to_ovm.sh
2014-12-07 11:58:36 -0800 [INFO] Switch to DOM0 system partition /dev/
VGExaDb/LV
DbSys3 (/dev/mapper/VGExaDb-LVDbSys3)
2014-12-07 11:58:36 -0800 [INFO] Active system device: /dev/mapper/VGExaDb-
LVDbS
ys1
2014-12-07 11:58:36 -0800 [INFO] Active system device in boot area: /dev/
mapper/
VGExaDb-LVDbSys1
2014-12-07 11:58:36 -0800 [INFO] Set active systen device to /dev/VGExaDb/
LVDbSy
s3 in /boot/I_am_hd_boot
2014-12-07 11:58:36 -0800 [INFO] Reboot has been initiated to switch to
the DOM0
system partition
Caution:
Do not skip this step. Skipping this step results in unused space that can no
longer be reclaimed by reclaimdisks.sh.
6-82
Chapter 6
Imaging a New System
[ Minimal BASH-like line editing is supported. For the first word, TAB
lists possible command completions. Anywhere else TAB lists the possible
completions of a device/filename.]
grub> root (hd0,0)
Filesystem type is ext2fs, partition type 0x83
grub> setup (hd0)
Checking if "/boot/grub/stage1" exists... no
Checking if "/grub/stage1" exists... yes
Checking if "/grub/stage2" exists... yes
Checking if "/grub/e2fs_stage1_5" exists... yes
Running "embed /grub/e2fs_stage1_5 (hd0)"... failed (this is not fatal)
Running "embed /grub/e2fs_stage1_5 (hd0,0)"... failed (this is not fatal)
Running "install /grub/stage1 (hd0) /grub/stage2 p /grub/grub.conf "...
succeeded
Done.
grub> quit
14. Run ibhosts and verify that all nodes show the correct IP addresses and host names.
Note:
If you configured key-based authentication for the root OS user, then you must
first copy the node private keys into the OEDA WorkDir.
6-83
Chapter 6
Imaging a New System
Related Topics
• Exadata Database Machine and Exadata Storage Server Supported Versions (My Oracle
Support Doc ID 888828.1)
6.12.4.2 Using PXE to Image a New System for Releases Earlier than 12.1.2.2.0
You can use PXE to prepare a new Exadata system running an Oracle Exadata System
Software release earlier than 12.1.2.2.0 for deployment.
1. Obtain the latest Oracle Exadata Deployment Assistant (OEDA) from http://
www.oracle.com/technetwork/database/exadata/oeda-download-2076737.html.
2. Run the OEDA configuration tool to generate the configuration files.
3. Power on all the servers.
When the system is first started, the following conditions exist:
a. Database nodes and cells will automatically assign to themselves unused IP
addresses on eth0 in the 172.16 range.
b. Host names of the nodes will be of the format nodeN, where N is a number.
4. Run OEDA to generate the preconf.csv file that you will use to image the system.
5. Connect to the first database node.
Use one of the following connection options:
• Attach a serial cable between a console and the SER MGT port on the server.
Connections through the modular jack serial port must use shielded cables to comply
with radio frequency emission limits.
Set the terminal device communication properties to these values: 9600 baud, 8 bit, no
parity, 1 stop bit.
For more details, see Connect to Oracle ILOM.
• Attach an Ethernet cable to the NET MGT port on the server and then connect using a
workstation on the network.
For more details, see Connect to Oracle ILOM.
6. Obtain the eth0 MAC address for each database node.
The eth0 MAC address is the fru_macaddress field from /SYS/MB/NET0 in the ILOM (or
from ip addr if logged into the console).
a. Connect to the each database node through SSH from the console.
b. Run ibhosts to get a list of node names and IP addresses.
7. Insert the MAC addresses using uppercase characters in the seventh field of the
preconf.csv file for each node.
This field should be empty, that is, you should see two consecutive comma characters (,,).
For example:
orhb42-
b08-01,example.com,db,eth0,eth0,Management,00:10:E0:69:34:52,10.196.3.
106,255.255.224.0,10.196.31.250,orhb42-b08-01-priv,Private:active-bond-
ib,192.1
68.10.15,255.255.255.0,,,America/Los_Angeles
6-84
Chapter 6
Imaging a New System
Below are the recommended options for PXE imaging of versions prior to release
12.1.2.2.0. The line starting with append should be entered as a single line with no line
breaks.
9. Download the ImageMaker kit to prepare and create the files for the PXE server.
The kit is available publicly on the Oracle Software Delivery Cloud (edelivery) site under
“Oracle Database Products -> Linux x86-64”. There are separate ImageMaker files for
database nodes and cells.
10. After downloading the kit, as the root user, unzip the first file that has a name similar to
V75080-01.zip, and then unzip the subsequent ZIP file. Finally, extract the resulting
archive.
# unzip V75080-01.zip
# unzip cellImageMaker_12.1.2.1.1_LINUX.X64_150316.2-1.x86_64.zip
View the README_FOR_FACTORY.txt file in the resulting directory for additional details.
11. Run makeImageMedia.sh to build the kernel, initrd, and image files, if necessary.
Place the image files in the relevant directories on the PXE server. These files will be sent
at boot time to the node being imaged.
• Change directory to the dl180 or dl360 directory and make the PXE build using:
If the dl180 or dl360 directory are not available, then change directory to the cell or
compute directory.
The makeImageMedia.sh command creates four files in the ./PXE subdirectory:
kernel: vmlinux-version-ImageName-{DL180|DL360}
initrd: initrd-version-ImageName-{DL180|DL360}.img
image: nfsimg-version-ImageName-{DL180|DL360}.tar
image: nfsimg-version-ImageName-{DL180|DL360}.tar.md5
12. Change the boot order using the ILOM to boot from PXE and then restart the server to
start the imaging process.
For example, from the Oracle Linux prompt on the host:
# shutdown -r now
6-85
Chapter 6
Imaging a New System
13. If you are using Oracle VM run switch_to_ovm.sh on all Oracle VM database servers
before running the OEDA installation tool.
When you run this command, the database servers will reboot.
# /opt/oracle.SupportTools/switch_to_ovm.sh
2014-12-07 11:58:36 -0800 [INFO] Switch to DOM0 system partition /dev/
VGExaDb/LV
DbSys3 (/dev/mapper/VGExaDb-LVDbSys3)
2014-12-07 11:58:36 -0800 [INFO] Active system device: /dev/mapper/VGExaDb-
LVDbS
ys1
2014-12-07 11:58:36 -0800 [INFO] Active system device in boot area: /dev/
mapper/
VGExaDb-LVDbSys1
2014-12-07 11:58:36 -0800 [INFO] Set active systen device to /dev/VGExaDb/
LVDbSy
s3 in /boot/I_am_hd_boot
2014-12-07 11:58:36 -0800 [INFO] Reboot has been initiated to switch to
the DOM0
system partition
Caution:
Do not skip this step. Skipping this step results in unused space that can no
longer be reclaimed by reclaimdisks.sh.
[ Minimal BASH-like line editing is supported. For the first word, TAB
lists possible command completions. Anywhere else TAB lists the possible
completions of a device/filename.]
grub> root (hd0,0)
Filesystem type is ext2fs, partition type 0x83
grub> setup (hd0)
Checking if "/boot/grub/stage1" exists... no
6-86
Chapter 6
Imaging a New System
15. Run ibhosts and verify that all nodes show the correct IP addresses and host names.
Related Topics
• Oracle Software Delivery Cloud
6-87
Chapter 6
Performing Initial Elastic Configuration of Oracle Exadata
The meaning of the factory keyword has changed as of 12.1.2.1.0. The use of "factory"
now enforces additional options such as "ovs=yes". This should be used for all imaging,
regardless of the ultimate system configuration (Oracle VM, Physical etc.)
• OVS=yes|no
This option defaults to "no". However it is not recommended to use this at all because it
may change in the future. In its place, use the "factory" option which will override some
default options.
There are some additional command line options which may be useful:
• To create a hot spare on dbnodes, use the enable_hot_spare option.
– makeImageMedia.sh option: -enable_hot_spare
– PXE option: enable_hot_spare
• To force active bond or no active bond for InfiniBand interfaces (mainly for expansion rack
cases), use the active-bond-ib option.
– makeImageMedia.sh option: -active-bond-ib <yes|no>
– PXE option: active-bond-ib=<yes|no>
The README_FOR_FACTORY.txt file shipped with the imagemaker software explains each option
in more detail.
Related Topics
• Exadata 12.1.2.2.0 release and patch (20131726) (My Oracle Support Doc ID 2038073.1)
• Reimaging Exadata Cell Node Guidance (My Oracle Support Doc ID 2151671.1)
6-88
Chapter 6
Performing Initial Elastic Configuration of Oracle Exadata
the ports of the RDMA Network Fabric switches. Assuming the rack is always populated
following this map, a node's rack unit location can be identified by querying the RDMA Network
Fabric to determine the RDMA Network Fabric switch port the node is connected to. Once
found, that information is used to determine the rack unit location of the node. With this
information, nodes can be allocated initial IP addresses based on their rack unit location, with
nodes lower in the rack getting lower IP addresses.
Note:
• Disk space for unused system partitions must be reclaimed before installing
software on all database servers with InfiniBand Network Fabric. Use the
following command to reclaim the disk space: /opt/oracle.SupportTools/
reclaimdisks.sh -free -reclaim. This command is not required on RoCE-
based Exadata database servers.
• If a RAID rebuild/reconstruction (that is, a disk replacement or expansion) is in
progress, wait until it is finished before performing the steps in this section. The
reason is that the reclaimdisks.sh script is blocked from running until the
RAID rebuild/reconstruction is complete.
1. Open a console session to the first database server. The first database server is the lowest
database server in the rack, which is rack position U16. In the case of an expansion
involving only cells, the procedure should be run from a storage server instead of a
database node.
Note:
The network connection and configuration for Oracle Exadata has not occurred
yet.
Note:
If you do not have the password for the root user, then contact Oracle Support
Services.
3. On systems with InfiniBand Network Fabric only, verify all servers are configured with the
172.16.* IP address for the eth0 interface using the following command:
# ibhosts
6-89
Chapter 6
Performing Initial Elastic Configuration of Oracle Exadata
172.16.2.40,172.16.2.40 ETH0"
Ca : 0x0010e000014908b8 ports 2 "node2 elasticNode
172.16.2.38,172.16.2.38 ETH0"
Ca : 0x0010e0000148ca68 ports 2 "node1 elasticNode
172.16.2.37,172.16.2.37 ETH0"
Ca : 0x0010e00001485fd8 ports 2 "node3 elasticNode
172.16.2.39,172.16.2.39 ETH0"
Note:
Starting with Oracle Exadata Database Machine X8M-2, Oracle Linux KVM is the
virtualization technology for systems that use RoCE Network Fabric. Otherwise,
Oracle VM Server (OVM) is a Xen-based virtualization technology, which is used
across Oracle Exadata Database Machine systems that use InfiniBand Network
Fabric.
This step applies to both virtualization technologies.
# /opt/oracle.SupportTools/switch_to_ovm.sh
Note:
It is not possible or supported to switch between physical and virtualized
configurations.
5. On systems with InfiniBand Network Fabric only, reclaim the unused disk space on the
database servers.
Disk space for unused system partitions must be reclaimed before installing software on all
database servers with InfiniBand Network Fabric. Use the following command to reclaim
the disk space: /opt/oracle.SupportTools/reclaimdisks.sh -free -reclaim. This
command is not required on RoCE-based Exadata database servers.
reclaimdisks.sh performs partition reconfiguration and a few other necessary
configuration changes that take typically less than a minute to complete.
6. On systems with InfiniBand Network Fabric only, verify the disk configuration on the
database servers.
# /opt/oracle.SupportTools/reclaimdisks.sh -check
If the system is a physical (bare metal) deployment, the last line of output will be the
following:
6-90
Chapter 6
Performing Initial Elastic Configuration of Oracle Exadata
If the system is an Oracle VM deployment, the last line of output will be the following:
7. Copy the OEDA configuration files to the database server using one of the following
methods. If adding only storage servers, the steps can be run from a storage server.
• Using a USB flash drive:
a. Copy the configuration file to a USB flash drive.
b. Connect the USB drive to the database server or storage server.
c. Locate the USB drive using the following command:
/dev/sdb1
Note:
If an Oracle Exadata Storage Server X6 or X5 Extreme Flash (EF) is
used, the command will also return the two internal USB drives,
usually /dev/sda1 and /dev/sdb1. The newly inserted USB drive will
be the additional device, usually /dev/sdc1.
The expected output is similar to:
/dev/sda1
/dev/sdb1
/dev/sdc1
d. Create a directory on the database server or storage server using the following
command:
# mkdir /mnt/usb
# mkdir /opt/oracle.SupportTools/onecommand
6-91
Chapter 6
Performing Initial Elastic Configuration of Oracle Exadata
If the directory already exists, then rename the existing one to onecommand.old,
and then re-create the empty directory.
Note:
Do not use a directory under /u01 or /EXAVMIMAGES because
reclaimdidsks.sh will fail if there is content in those directories.
f. Mount the device. Use the device name given in step 7.c. The following is an
example of the command.
g. Copy OEDA and the configuration files from the USB flash drive to the onecommand
directory on the database server or storage server using the following command:
# cp /mnt/usb/path_to_file/*.* /opt/oracle.SupportTools/onecommand
# umount /mnt/usb
i. Remove the USB flash drive from the database server or storage server.
• Using a temporary network connection:
This option is only needed if there were IP address conflicts, and Oracle Exadata is not
already connected to the network.
a. Connect a network cable to the Ethernet port labeled NET0 on the back of the first
database server.
b. Bring up the eth0:1 interface as follows:
In the preceding command, real_gateway is the default gateway to use for the
database server.
d. Copy the configuration files to the /opt/oracle.SupportTools/onecommand
directory on the database server or storage server using a file transfer utility such
as scp.
e. Disconnect the network cable from Ethernet port NET0.
6-92
Chapter 6
Performing Initial Elastic Configuration of Oracle Exadata
Note:
It is not necessary to reconfigure the network because the network is
reconfigured automatically during the restart step.
8. Download and unzip the OEDA archive to a host on the same network as the servers in
the rack (172.16.*).
The applyElasticConfig.sh script is not configured by default on the servers in the rack.
9. Run the applyElasticConfig.sh script.
For example, if you unzipped the OEDA ZIP file into the /opt/oracle.SupportTools/
onecommand/linux-x64 directory, then use the following commands:
# cd /opt/oracle.SupportTools/onecommand/linux-x64
The applyElasticConfig.sh script performs network configuration for all database servers
and storage servers. All servers restart at the end of the process.
10. Connect the corporate network cable for the management network to the Management
Network Switch.
11. Connect the corporate network cables for the client access network to the database
servers.
12. Restart all database servers and storage servers.
13. Log in to the first database server (or storage server, if only storage servers were added for
expansion) to verify network connectivity using the following commands:
# cd /opt/oracle.SupportTools/onecommand/linux-x64
In the preceding command, configuration_file is the name of the configuration file from
OEDA, and includes the full path.
Note:
14. Use OEDA to install and configure the software for Oracle Exadata.
Related Topics
• Cabling Information for Oracle Exadata Database Machine
6-93
Chapter 6
Adding Additional Elastic Nodes to an Existing Rack
<uLocation>16</uLocation>
5. Log in to the ILOM on the new server using the local serial management connection (SER
MGT port), and review the system location in the SP.
For example:
/SP
Properties:
system_location = ru_06
->
6. If the location in the ILOM SP is different from the OEDA location, then modify the location
in the ILOM SP to match the value from OEDAILOM.
Note:
Ensure that there are no duplicate locations in the OEDA rack configuration XML
file.
6-94
Chapter 6
Using the OEDA setuprootssh Utility
Set the system location in the ILOM SP with the following command:
-> set /SP/ system_location=RU16
7. For a database server with InfiniBand Network Fabric only, log in to the server and reclaim
the unused disk space.
Disk space for unused system partitions must be reclaimed before installing software on all
database servers with InfiniBand Network Fabric. Use the following command to reclaim
the disk space: /opt/oracle.SupportTools/reclaimdisks.sh -free -reclaim. This
command is not required on RoCE-based Exadata database servers.
reclaimdisks.sh performs partition reconfiguration and a few other necessary
configuration changes that take typically less than a minute to complete.
8. Log in to the server where you unzipped the OEDA configuration files and run the
applyElasticConfig.sh script.
For example, if you unzipped the OEDA ZIP file into the /opt/oracle.SupportTools/
onecommand/linux-x64 directory, then use the following commands:
# cd /opt/oracle.SupportTools/onecommand/linux-x64
The applyElasticConfig.sh script performs network configuration for the new servers.
The new servers are restarted at the end of the process.
For config.xml, specify the full path name to the deployment file created by OEDA.
For each physical and virtual machine (VM) host in the deployment file, the
setuprootssh.sh utility creates an SSH key pair. The keys are saved in the OEDA
WorkDir using the following file naming conventions:
– Private key: id_rsa.short_hostname.root
– Public key: id_rsa.short_hostname.root.pub
In the key file names, short_hostname is the corresponding server host name without any
domain name qualification.
Where possible, the utility also installs the public key on the host and disables password-
based authentication for the root user.
If the utility cannot install the public key on the host, then the key file remains ready for
later use in the OEDA WorkDir. For example, this occurs to keys for VM hosts if you run
the utility before you create the VMs.
6-95
Chapter 6
Loading the Configuration Information and Installing the Software
• If your system has a non-default root password, you must specify it by using the -p
root_password option.
• Use the -h option to display the usage information.
See Also:
Using Oracle Exadata Deployment Assistant for descriptions of the configuration files
generated by OEDA.
6-96
Chapter 6
Loading the Configuration Information and Installing the Software
Note:
OEDA configures all Exadata components, including the database servers (with or
without virtualization), storage servers, and the RDMA Network Fabric. For
successful configuration, OEDA requires access to:
• The client and administration network interfaces on the database servers,
including the VM server host and the VM guests where applicable.
• The administration network interfaces on the storage servers.
• The administration network interfaces on the RDMA Network Fabric switches.
Ensure that you run the OEDA deployment phase on a host with access to all of the
required network interfaces.
Note:
Running OEDA from a client machine outside of the rack means the software image
files are transferred over the network, causing the process to be slower.
Note:
For this procedure, Oracle VM refers to OVM and KVM. Starting with Oracle Exadata
Database Machine X8M-2, Oracle Linux KVM is the virtualization technology for
systems that use RoCE Network Fabric. Otherwise, Oracle VM is a Xen-based
virtualization technology, which is used across Oracle Exadata Database Machine
systems that use InfiniBand Network Fabric.
You must have completed the other tasks described in Overview of Oracle Exadata
Deployment Assistant before starting this task.
1. If you are installing Oracle VMs on the database servers, then run /opt/
oracle.SupportTools/switch_to_ovm.sh on each database server.
2. Disk space for unused system partitions must be reclaimed before installing software on all
database servers with InfiniBand Network Fabric. Use the following command to reclaim
the disk space: /opt/oracle.SupportTools/reclaimdisks.sh -free -reclaim. This
command is not required on RoCE-based Exadata database servers.
3. Create a directory for the extracted OEDA files on the host where you will run install.sh.
OEDA will not run if staged on the root file system (/)of any database server. Create a
directory to store the latest version of OEDA and all required files on a file system that has
at least 30 GB of available free space.
• For bare-metal database servers, create a directory on the /u01 file system, for
example /u01/onecommand or /u01/oeda.
• For Oracle VM servers, create a directory on the /EXAVMIMAGES file system.
4. Download the latest version of OEDA for the operating system of the client or server where
you will run install.sh.
6-97
Chapter 6
Loading the Configuration Information and Installing the Software
Unzip the downloaded file into the OEDA home directory you created. This will create a
directory like /u01/onecommand/linux-x64. This directory is referred to as the OEDA
home directory.
5. Download the required image files for the Oracle software.
OEDA requires patches available from My Oracle Support or Oracle Software Delivery
Cloud ( https://edelivery.oracle.com). Review the README file for OEDA to determine the
file name or patch number, which is based on the version of Oracle software being
installed. Place the files in the WorkDir sub-directory in the OEDA home directory.
• If you are installing on a bare-metal database server, then download the patches, as
specified in Section 2 of the OEDA README file. After downloading the patch ZIP file,
extract the contents into the WorkDir sub-directory.
• If you are configuring Oracle VM on the database servers, then download the gold
image files as indicated in the topic "Oracle Exadata Deployment Assistant Support for
Oracle Virtual Machines" in the OEDA README file. After downloading the gold image
ZIP files, extract the contents into the WorkDir sub-directory.
A gold image is a copy of a software-only, installed Oracle home. It is used to copy an
image of an Oracle home to a new host on a new file system to serve as an active,
usable Oracle home.
6. Copy the required OEDA configuration files to the WorkDir sub-directory on the database
server or Oracle VM.
When you used OEDA to specify the configuration details for your new engineered system,
it created several configuration files and a ZIP file that contains all the generated files. The
required files are also listed at the bottom of the InstallationTemplate.html file that was
generated by OEDA. You can copy the ZIP file and extract it into the WorkDir sub-
directory, or copy the required files directly into the WorkDir sub-directory.
7. Log in to the database server or Oracle VM and go to the OEDA home directory.
8. Run the install.sh script to install and deploy the software on your new engineered
system.
In the following command syntax, configuration_file is the full path name for the main
configuration file, CustomerName-rackname.xml
You can use the following options with the install.sh script:
• -cf file: Configuration file name
• -h: Help output for the script
• -l: List the steps of OEDA
• -r {n-N | n }: Run steps n through N of OEDA, or run the specified step.
• -s n: Run step n of OEDA.
• -u {n-N | n }: Undo steps n through N, or one step.
6-98
Chapter 6
Loading the Configuration Information and Installing the Software
Note:
Always use the latest OEDA patch listed in My Oracle Support note 888828.1. Refer
to the README in the patch for the latest steps.
The following steps are performed by the OEDA deployment script. However, the actual steps
for a specific deployment may differ depending on the deployment options chosen. For
example, the "Update Nodes for Eighth Rack" step is performed only if you are deploying an
Eighth Rack configuration.
Related Topics
• Oracle Exadata Deployment Assistant Downloads
• Exadata Database Machine and Exadata Storage Server Supported Versions (My Oracle
Support Doc ID 888828.1)
To use this feature, you must first set up the required SSH keys. The easiest way to do this is
to use the setuprootssh.sh utility included with OEDA. For example:
For more information about the setuprootssh.sh utility, see Using the OEDA setuprootssh
Utility.
6-99
Chapter 6
Loading the Configuration Information and Installing the Software
After you set up the required SSH keys, add the -sshkeys option to the regular command-line
options when you start up OEDA. For example:
When you specify the -sshkeys option, OEDA uses SSH key-based authentication. In
conjunction with this option, the OEDA WorkDir must contain the SSH private key for each host
in the deployment file (config.xml). The private keys must conform to the following file naming
convention:
id_rsa.short_hostname.root
In the key file names, short_hostname is the corresponding server host name without any
domain name qualification.
As shown in the previous example, when you specify the -sshkeys option, you must also
specify the -usesu option to instruct OEDA to run non-root commands from the root user
using su.
When you first log in to a host following the Resecure Machine deployment step, you are
prompted to reset the root password. This still occurs even when SSH key-based
authentication is enabled, and password-based authentication is disabled.
The -p option causes OEDA to prompt for the root password. Make sure you enter the correct
password because an incorrect password disables root access for 10 minutes, and after 5
failed login attempts, the server is locked down.
Related Topics
• Default Security Settings Enacted by OEDA
6-100
Chapter 6
Using the OEDA changePassword Utility
The utility is located in the same directory as the install and config scripts.
You cannot use this utility if the servers are locked down.
• To change the password of both oracle and grid users on all database servers and
clusters, run the changePassword command.
For config.xml, specify the full path name to the deployment file created by OEDA.
The utility prompts for the current root password and allows you to change the password
of any users in the rack.
• To change the password for a specific user, such as oracle or grid, use the -userName
user_name option with the command.
• To change the password for all users within a specific cluster, use the -clusterName
cluster_name option with the command.
• Use the -h option with the command to display the usage information.
6-101
Chapter 6
Adding a VM Cluster to Oracle Exadata Database Machine Using OEDA
6-102
Chapter 6
Adding a VM Cluster to Oracle Exadata Database Machine Using OEDA
9. In the new tab, specify the configuration details for the new database home. Then, click
Apply.
Ensure that you select the newly defined cluster as the location to contain the new
database home.
Afterward, OEDA displays the Create Database section.
10. Click the Add Database button, which contains the plus symbol (+) and is adjacent to the
existing tabs.
A new tab appears in the Create Database section to contain the configuration details for
a new database.
11. In the new tab, specify the configuration details for the new database. Then, click Apply.
Ensure that you select the newly defined database home to support the new database.
Afterward, OEDA displays the Cluster Networks section.
12. For each network in the Cluster Networks section, select the tab that is associated with
the new cluster and specify the network settings. Then, click Apply.
As you step through the network settings, ensure that you specify valid IP address settings
that are compatible with the existing system configuration.
Afterward, OEDA displays the Alerting section.
13. Click Comments in the navigation menu. Then, click Apply and Download to save the
updated system configuration information.
14. Unzip the zip file located in the directory containing the newly saved system configuration
information.
The directory containing the newly saved system configuration information contains
multiple files, including the updated XML system configuration file and HTML installation
template. However, the zip file contains additional cluster-specific XML configuration files.
15. Locate the cluster-specific XML configuration file for the new cluster.
The new cluster-specific XML configuration file is located in the unzipped directory that you
created in the previous step. The names of the cluster-specific XML configuration files
contain a numeric sequence that reflects the order of cluster creation, with the newest
cluster having the highest number.
16. Use the cluster-specific XML configuration file to deploy the new cluster.
Use the OEDA deployment utility (install.sh) in conjunction with the cluster-specific XML
configuration file for the new cluster.
Perform all of the deployment steps except for the following, which do not apply. Ensure
that you do not perform the following deployment steps as they may impact system
performance and availability:
• Update Nodes for Eighth Rack (For Eighth Rack systems only)
• Calibrate Cells
• Create Cell Disks
• Resecure Machine
6-103
Chapter 6
Adding a VM Cluster to Oracle Exadata Database Machine Using OEDA
Also, when you perform the Create Installation Summary step, ensure that you use the
-nocalibratecell option to ensure that cell calibration is not performed during that step.
For example, if the step number for the Create Installation Summary step is 18:
To view a complete list of the deployment steps and the corresponding step numbers, use
install.sh with the -l option. For example:
To run an individual step, use install.sh with the -s option and specify the step number.
For example, to run step 1:
To run a range of steps, use install.sh with the -r option and specify the step range. For
example, to run steps 12-16:
Related Topics
• Configuring Oracle Exadata Database Machine Using OEDA
Use Oracle Exadata Deployment Assistant (OEDA) to configure your engineered system.
6-104
A
Site Checklists
Complete the checklists in this appendix to ensure the site is prepared for your new Oracle
Engineered System.
Note:
For ease of reading, the Oracle Engineered System is sometimes referred to simply
as "the rack", which indicates the entire system, not just the cabinet.
A-1
Appendix A
System Components Checklist
A-2
Appendix A
Data Center Room Checklist
A-3
Appendix A
Data Center Environment Checklist
Related Topics
• Space Requirements
• Flooring Requirements
Oracle Exadata Rack may be installed on raised floor or solid floor environments.
• Installing Oracle Exadata or Oracle Exadata Storage Expansion Rack at the Site
A-4
Appendix A
Data Center Environment Checklist
Related Topics
• Temperature and Humidity Requirements
Excessive internal temperatures may result in full or partial shut down of Oracle Exadata.
• Ventilation and Cooling Requirements
Always provide adequate space in front and behind the rack to allow for proper ventilation.
• General Environmental Requirements
A-5
Appendix A
Access Route Checklist
A-6
Appendix A
Access Route Checklist
A-7
Appendix A
Facility Power Checklist
Related Topics
• Table: Access Route Requirements.
• Rack Weights for Oracle Exadata
Review the weight of your Oracle Exadata Rack to ensure that it can be delivered and
located safely.
• Rack Weights for Oracle Exadata Storage Expansion Rack
• Flooring Requirements
Oracle Exadata Rack may be installed on raised floor or solid floor environments.
A-8
Appendix A
Safety Checklist
A-9
Appendix A
Logistics Checklist
Related Topics
• Temperature and Humidity Requirements
Excessive internal temperatures may result in full or partial shut down of Oracle Exadata.
See Also:
"Powering On and Off Oracle Exadata Rack" in the Oracle Exadata Database
Machine Maintenance Guide
A-10
Appendix A
Logistics Checklist
A-11
Appendix A
Logistics Checklist
A-12
Appendix A
Network Configuration Checklist
Related Topics
• Space Requirements
A-13
Appendix A
Auto Service Request Checklist
Related Topics
• Understanding the Network Requirements for Oracle Exadata
Review the network requirements for Oracle Exadata before installing or configuring the
hardware.
A-14
Appendix A
Re-racking Checklists
See Also:
"Understanding Auto Service Request" in the Oracle Exadata Database Machine
Maintenance Guide
Note:
• Customer must purchase both the Oracle Re-racking Service and Oracle
Installation Service.
• Oracle does not provide support for customer-supplied equipment.
A-15
Appendix A
Re-racking Checklists
A-16
Appendix A
Re-racking Checklists
A-17
Appendix A
PDU Checklist for Re-racking
A-18
Appendix A
Recycling the Racks
A-19
Appendix A
Recycling the Racks
Related Topics
• Product Take Back and Recycling website
A-20
B
Database High Availability Checklist
Use this checklist to ensure the requirements for high availability are met for Oracle Exadata
Database Machine.
B-1
Appendix B
Related Topics
• Oracle Database High Availability Overview and Best Practices
• Exadata Patching Overview and Patch Testing Guidelines (My Oracle Support Doc ID
1262380.1)
• Oracle Maximum Availability Architecture website
• Oracle Exadata Database Machine Exachk (My Oracle Support Doc ID 1070954.1)
• Exadata Health and Resource Usage Monitoring Technical Paper (My Oracle Support Doc
ID 1920255.1)
• Exadata Database Machine and Exadata Storage Server Supported Versions (My Oracle
Support Doc ID 888828.1)
• Oracle Exadata Best Practices (My Oracle Support Doc ID 757552.1)
B-2