Data ONTAP 7G Cook Book v4 - 1
Data ONTAP 7G Cook Book v4 - 1
Data ONTAP 7G Cook Book v4 - 1
https://communities.netapp.com/docs/DOC-8121 A compilation of step-by-step instructions for performing common tasks in Data ONTAP 7G. Most of the content is based on Data ONTAP 7.2. Features exclusive to Data ONTAP 7.3 are indicated by [7.3] See the Data ONTAP 8.x 7-Mode Cookbook for ONTAP 8 commands and procedures. Table of Contents Best Practices for Installation and Maintenance ................................................................................ 7 1 Aggregates and FlexVols ............................................................................................................ 8 1.1 Creating Aggregates ...................................................................................................................... 8 1.1.1. Software Disk Ownership ......................................................................................................... 8 1.1.1.1 1.1.1.2 Modifying disk ownership ..................................................................................................8 Associated Key OPTIONS .................................................................................................9
1.1.2 Aggregates ................................................................................................................................. 9 1.1.2.1 1.1.2.2 1.1.2.3 Add disks to Aggregates ....................................................................................................9 Disk right-size and max disk per aggregate matrix ........................................................ 10 Key aggregate OPTIONS ............................................................................................... 10
1.1.3 Modifying RAID groups............................................................................................................. 11 1.1.4 Create Flexible Volumes (FlexVols) ......................................................................................... 11 1.1.4.1 Root volume minimum size recommendations ............................................................... 11
1.1.5 Manage Flexible Volumes (FlexVols) ....................................................................................... 12 1.1.5.1 1.1.5.2 1.1.5.3 1.1.5.4 General management commands .................................................................................. 12 Resize a FlexVol ............................................................................................................. 13 Prioritize volume I/O with FlexShare .............................................................................. 13 Key Volume command Options ...................................................................................... 14
1.1.7 Create Qtrees ........................................................................................................................... 15 2 NAS Implementation .................................................................................................................. 16 2.1 NFS exports ................................................................................................................................. 16 2.1.1 Support NFSv4 clients .............................................................................................................. 17 2.1.2 Associated Key NFS OPTIONS ............................................................................................... 17 2.2 CIFS shares ................................................................................................................................. 18 2.2.1 Associated Key CIFS Shares OPTIONS .................................................................................. 19 2.3 Using Quotas ............................................................................................................................... 20 2.3.1 Guidelines for using quotas ...................................................................................................... 20
Page 1 NetApp
SAN Implementation .................................................................................................................. 21 3.1 Fiber Channel SAN ...................................................................................................................... 21 3.1.1 Enable the Fibre Channel Protocol .......................................................................................... 21 3.1.2 Configure FCP ports ................................................................................................................. 22 3.1.3 Create WWPN aliases [7.3] ...................................................................................................... 22 3.1.4 Change cfmode of an active-active cluster .............................................................................. 22 3.1.5 Create a LUN ............................................................................................................................ 23 3.1.6 Access LUNs on a Solaris Host ............................................................................................... 23 3.1.7 Multipathing Software for Solaris .............................................................................................. 25 3.1.8 Access LUNs on a Windows Host ............................................................................................ 25 3.1.9 Obtain HBA information ............................................................................................................ 26 3.1.10 Resolving FCP Partner Path Misconfigured messages ....................................................... 26 3.2 iSCSI SAN ................................................................................................................................... 26 3.2.1 Enable the iSCSI Protocol ........................................................................................................ 26 3.2.2 Install iSCSI Initiator and SnapDrive for Windows ................................................................... 27 3.2.3 Connect Windows to a LUN with iSCSI.................................................................................... 27 3.2.4 Create an iSCSI LUN using SnapDrive for Windows ............................................................... 27 3.3 Resize a LUN ............................................................................................................................... 28 3.4 Clone a LUN ................................................................................................................................ 28 3.5 [7.3] FlexClone a LUN.................................................................................................................. 29 3.6 Delete a LUN ............................................................................................................................... 29 3.7 Access a LUN with NFS/CIFS protocols...................................................................................... 30
Networking and Appliance Access .......................................................................................... 31 4.1 Configure Network Interfaces ...................................................................................................... 31 4.2 Setting Time and Date ................................................................................................................. 31 4.2.1 Synchronize with a time server ................................................................................................ 31 4.3 Creating VLANS ........................................................................................................................... 32 4.4 Managing Virtual Interfaces (VIF) ................................................................................................ 32 4.4.1 Create a VIF ............................................................................................................................. 32 4.4.2 Delete a VIF interface or VIF .................................................................................................... 33 4.5 IP version 6 [7.3.1] ....................................................................................................................... 33 4.5.1 Associated Key OPTIONS ....................................................................................................... 33 4.6 Baseboard Management Controller (BMC) ................................................................................. 33
Page 2 NetApp
4.6.1 Configure the BMC ................................................................................................................... 33 4.6.2 Using the BMC ......................................................................................................................... 34 4.6.3 Upgrade the BMC ..................................................................................................................... 34 4.7 Remote LAN Module (RLM) ........................................................................................................ 35 4.7.1 Configure the RLM ................................................................................................................... 35 4.7.2 Configure the Remote Support Agent (RSA) ........................................................................... 35 4.7.3 Use the RLM ............................................................................................................................. 36 4.7.4 Upgrade RLM firmware ............................................................................................................ 36 4.8 Service Processor (SP)................................................................................................................ 36 4.8.1 Configure the SP ...................................................................................................................... 36 4.8.2 Use the SP ............................................................................................................................... 37 4.8.3 Upgrade SP firmware ............................................................................................................... 37 4.9 Create Local User Accounts ........................................................................................................ 37 4.10 Key Network and FAS Security OPTIONS .................................................................................. 38 5 Space Management ................................................................................................................... 39 5.1 Managing Volume Free Space .................................................................................................... 39 5.1.1 Volume Space Management Settings ...................................................................................... 39 5.1.2 FPolicy ...................................................................................................................................... 39 5.1.3 Reallocate ................................................................................................................................. 40 5.1.4 Managing inodes ...................................................................................................................... 42 5.1.5 Automatic Space Preservation (vol_autogrow, snap autodelete) ............................................ 42 5.2 Deduplication ............................................................................................................................... 43 5.2.1 Maximum volume deduplication limits [7.3] .............................................................................. 44 5.2.2 Features not compatible with deduplication ............................................................................. 45 6 Data Replication, Migration and Recovery .............................................................................. 46 6.1 Network Data Management Protocol (NDMP) Copy ................................................................... 46 6.1.1 Enable NDMP ........................................................................................................................... 46 6.1.2 ndmpcopy ................................................................................................................................. 46 6.1.3 Associated Key OPTIONS ....................................................................................................... 46 6.2 Volume Copy ............................................................................................................................... 47 6.3 Snapshots .................................................................................................................................... 47 6.4 SnapRestore ................................................................................................................................ 48 6.5 Asynchronous SnapMirror ........................................................................................................... 48
Data ONTAP 7G Cook Book v4_1.doc 1 May 2012 Page 3 NetApp
6.5.1 Create an Asynchronous Volume SnapMirror Relationship ..................................................... 48 6.5.2 Convert a read-only SnapMirror Volume to read-write............................................................. 49 6.5.3 Resync a Broken Volume SnapMirror Relationship ................................................................. 49 6.5.4 Create an Asynchronous Qtree SnapMirror ............................................................................. 50 6.5.5 Convert read-only Qtree SnapMirrror destination to writeable ................................................. 50 6.5.6 Purging Asynchronous Mirrors ................................................................................................. 51 6.6 SnapVault .................................................................................................................................... 51 6.6.1 Perform a SnapVault restore .................................................................................................... 52 6.6.2 Turn SnapVault destination into SnapMirror destination. ......................................................... 52 6.6.3 Release a SnapVault relationship ............................................................................................ 53 6.7 Associated Key SnapMirror/Vault OPTIONS ............................................................................... 53 6.8 FlexClone ..................................................................................................................................... 54 6.8.1 Clone a flexible volume ............................................................................................................ 54 6.8.2 Split a FlexClone volume from the parent volume ................................................................... 54 6.8.3 FlexClone a file or LUN [7.3] .................................................................................................... 55 7 Security ....................................................................................................................................... 56 7.1 General Storage Controller Security ............................................................................................ 56 7.1.1 Managing SSH ......................................................................................................................... 56 7.1.2 Managing SSL .......................................................................................................................... 56 7.1.3 Associated Key Security OPTIONS ......................................................................................... 56 7.2 CIFS Security ............................................................................................................................... 57 7.2.1 Restricting CIFS access ........................................................................................................... 57 7.2.2 Monitoring CIFS Events............................................................................................................ 58 7.2.3 CIFS Network Security OPTIONS ............................................................................................ 58 7.3 AntiVirus ....................................................................................................................................... 59 8 System and Disk Maintenance ................................................................................................. 60 8.1 System Maintenance ................................................................................................................... 60 8.1.1 Associated Key OPTIONS ....................................................................................................... 60 8.2 Special Boot Menu and Maintenance Mode ................................................................................ 61 8.3 Disk Shelf Maintenance ............................................................................................................... 61 8.3.1 DS14 Shelves ........................................................................................................................... 61 8.3.2 [7.3]SAS Shelves (DS4243 & DS2246).................................................................................... 62
Page 4 NetApp
8.3.3 Associated Key Disk Shelf OPTIONS ...................................................................................... 62 8.4 Disk Maintenance ........................................................................................................................ 62 8.4.1 Drive zeroing time estimates .................................................................................................... 63 8.4.2 Update disk firmware and disk qualification file ....................................................................... 63 8.4.3 Associated Key OPTIONS ....................................................................................................... 64 8.5 Tape Device Maintenance ........................................................................................................... 64 8.5.1 Managing Tape Devices ........................................................................................................... 64 8.5.2 Associated Key Tape OPTIONS .............................................................................................. 64 9 Controller Failover Implementation ......................................................................................... 65 9.1 Enable controller failover functionality ......................................................................................... 65 9.1.1 Associated Key OPTIONS ....................................................................................................... 65 9.2 Setup network takeover interfaces .............................................................................................. 66 9.3 Perform cf takeover/giveback ...................................................................................................... 66 10 MultiStore (vfiler) Implementation ............................................................................................ 68
10.1 MultiStore (vfiler) Configuration ................................................................................................... 68 10.1.1 Changing system limits on vFilers .......................................................................................... 68 10.2 MultiStore (vfiler) Administration .................................................................................................. 69 10.2.1 Stop/Destroy a vfiler ............................................................................................................... 69 11 Configuration Files .................................................................................................................... 70
11.1 sample /etc/quota......................................................................................................................... 70 11.2 sample /etc/rc ............................................................................................................................... 71 11.3 sample /etc/hosts ......................................................................................................................... 71 11.4 sample /etc/resolv.conf ................................................................................................................ 71 11.5 sample /etc/exports ...................................................................................................................... 71 11.6 sample /etc/snapmirror.conf ........................................................................................................ 72 12 Troubleshooting Commands .................................................................................................... 73
12.1 General Troubleshooting ............................................................................................................. 73 12.2 NFS Troubleshooting ................................................................................................................... 74 12.3 CIFS Troubleshooting .................................................................................................................. 77 12.4 Network Troubleshooting ............................................................................................................. 77 12.5 NDMP Troubleshooting................................................................................................................ 78 12.6 SAN Troubleshooting ................................................................................................................... 78 12.6.1 FAS SAN Utilities.................................................................................................................... 78 12.6.2 Solaris SAN Utilities................................................................................................................ 78
Data ONTAP 7G Cook Book v4_1.doc 1 May 2012 Page 5 NetApp
12.6.3 Windows SAN Utilities ............................................................................................................ 79 12.6.4 Finding and fixing LUN alignment issues ............................................................................... 79 12.6.5 Configuring Cisco EtherChannels .......................................................................................... 79 12.6.6 Common Brocade SAN Switch Commands ........................................................................... 80 12.7 Test & Simulation Tools ............................................................................................................... 80
DISCLAIMER: This unofficial document is intended for NetApp and NetApp Authorized support personnel and experienced storage administrators who understand the concepts behind these procedures. It should never be used as the definitive source for carrying out administrative tasks. Always defer to Data ONTAP documentation, the NetApp Support website, and instructions from the Tech Support Center (8884NETAPP). Send any corrections to mcope@netapp.com Follow Best Practices by running WireGauge and generating an AutoSupport email before and after making changes to a production storage system. Community Forums: http://communities.netapp.com TechNet: http://tech.netapp.com Field Portal: http://fieldportal.netapp.com IBM Redbooks and Redpapers: http://www.redbooks.ibm.com/cgi-bin/searchsite.cgi?query=ONTAP
Page 6 NetApp
Page 7 NetApp
2 3 4 OR
FAS> disk show -v FAS> disk show -n FAS> disk assign 0b.43 0b.41 FAS> disk assign 2a.* FAS> disk assign all Warning: Use with caution. Not restricted by A and B loop in clusters V-FAS> disk assign <lun_id_list> -c {block | zoned}
OR -
1.1.1.1 Modifying disk ownership Step 1 OR 2 Command/Action FAS> disk assign 0b.43 0b.41 -s unowned [ -f ] FAS> priv set advanced FAS*> disk remove_ownership 0b.41 0b.43 FAS> disk show -n Verify disks are available for assignment. Description Change disks from owned to unowned
Alternative: reboot system and go into Maintenance Mode 1 *> storage release disk Used in Maintenance Mode to release disk reservations
Page 8 NetApp
Used in Maintenance Mode to reassign disk ownership of all disks owned by a single system to another system
1.1.1.2 Associated Key OPTIONS Option FAS> options disk.auto_assign Default on Description Specifies if disks are auto assigned to a controller. Occurs within 10 minutes of disk insertion.
1.1.2 Aggregates
Create an aggregate of physical disks to store Flexible Volumes. See the matrix below for the maximum number of disks an aggregate can use based on disk size and ONTAP version. Step 1 Command/Action FAS> aggr status -s Description View all available spare disks Create an aggregate called "aggr03" using raid_dp, a maximum raid size of 14 disks with an initial size of 9 disks Optional: Reduces aggregate snapshot reserve from 5% to 3%. Do not set to 0. View the options settings for the aggregate. Also lists all volumes contained in the aggregate.
1.1.2.1 Add disks to Aggregates Step 1 2 3 Command/Action FAS> aggr status -s FAS> aggr options aggr0 FAS> aggr status aggr0 -r FAS> aggr add aggr0 -d 7a.17 7a.26 FAS> aggr add aggr0 4@272 -f -g rg1 Description Display list of available spare disks and their disk IDs Verify the value of the raidsize option Check the RAID groups in the aggregate to see if there are any short RAID groups Add disks 7a.17 and 7a.26 to aggr0. They will be added to the last RAID group created (if it is incomplete) or will create a new RAID group Add four 300GB disks to aggr0 by adding them to RAID group number 1 Note: See disk size matrix below for size values
4 OR
Page 9 NetApp
Delete aggregate snapshots to allow reallocate access to all data blocks Enable block reallocation OPTIONAL: Temporarily affects performance and may significantly increase snapshot consumption, but recommended when adding 3 or more disks Run reallocate -f on all volumes in the aggregate to redistribute them across the new drives Note: Avoid using reallocate on volumes with deduplication enabled
FAS> reallocate on
1.1.2.2 Disk right-size and max disk per aggregate matrix Use these values when creating an aggregate and when adding disks using n@size The max size numbers include the parity and diagonal-parity drives. Optimal RAID group sizes indicate what value to use for the raidsize option to use the least amount of parity drives, have the most data disks, and not harm performance by creating short raid groups (# of raid groups@raidsize value). Manufacturer size 72 GB FC 144 GB FC/SAS 300 GB FC/SAS 450 GB FC/SAS 600GB FC/SAS 250 GB SATA 300 & 320 GB SATA 500 GB SATA 750 GB SATA 1 TB SATA 2 TB SATA (8.0) Right-sized value 68 GB 136 GB 272 GB 408 GB 560 GB 212 GB 274 GB 423 GB 635 GB 847 GB 1,695 GB Max drives 7.2 241 120 59 39 Unsupported 76 61 39 26 15 Unsupported Optimal 7.2 RAID size 15@16 disks 8@15 disks 4@15 disks 2@19 disks Unsupported 6@13 disks 4@16 disks 3@13 disks 2@13 disks 1@15 disks Unsupported Max drives 7.3 282 141 69 46 33 86 71 45 30 23 11 Optimal 7.3 RAID size 15@19 disks 8@18 disks 4@18 disks 3@15 disks 2@17 disks 7@13 disks 5@15 disks 3@15 disks 2@15 disks 2@12 disks 1@11 disks
1.1.2.3 Key aggregate OPTIONS Option fas> aggr options raidsize** fas> aggr options raidtype fas> aggr options nosnap Default 16 (FC/SAS) 14 (SATA) raid_dp Off Description Maximum number of disks in each RAID group Set RAID parity type to raid4, raid_dp or raid0 When on, disables aggregate snapshots
Page 10 NetApp
Off On On
Enforces separations of disks by disk type Enforce separation of ATA drives by rotational speed (5400 and 7200 RPM) Enforces separation of FC drives by rotational speed (10k and 15k RPM)
2 3 4
1.1.4.1 Root volume minimum size recommendations The Data ONTAP System Administration Guide recommends setting the root volume to 5x the amount of system memory. In practice, 2x is often enough or 20GB, whichever is larger. You must increase the size of the root volume for ONTAP 8. Therefore on ONTAP 7.3.x systems we recommend using the 8.0 settings on systems capable of running ONTAP 8 7-Mode.
Data ONTAP 7G Cook Book v4_1.doc 1 May 2012 Page 11 NetApp
Platform FAS3020 FAS3050 FAS3040 FAS3070 FAS2020 FAS2040 FAS2050 FAS3140 FAS3160 FAS3170 FAS3210 FAS3240 FAS3270 FAS6030/6040 FAS6070/6080
7.x size 12 GB 16 GB 16 GB 23 GB 10 GB 16 GB 12 GB 20 GB 24 GB 38 GB 10 GB 15 GB 30 GB 37 GB 69 GB
8.0 size Not Supported Not Supported 160 GB 230 GB Not Supported 160 GB Not Supported 160 GB 230 GB 250 GB 100 GB 150 GB 300 GB 250 GB 250 GB
Page 12 NetApp
1.1.5.2 Resize a FlexVol Step 1 Command/Action FAS> vol container vol4 FAS> df -A aggr07 OR FAS> aggr show_space -g aggr07 FAS> vol size vol4 150g FAS> vol size vol4 [+ | -] 30g Description Determine which aggregate vol4 resides in. Check size and available space in the containing aggregate named aggr07 Set the size of flexvol vol4 to 150GB Note: size includes snapshot reserve space Add or remove 30GB from flexvol vol4
Note: See chapter 5 of this guide for procedures to auto-manage volume growth. 1.1.5.3 Prioritize volume I/O with FlexShare FlexShare is built into ONTAP for prioritizing system resources for volumes. If you assign a priority to one volume, you should assign a priority to all volumes. Any volumes without a priority are assigned to the default queue where they share the same resources. This may degrade their performance. Step 1 Command/Action FAS1> priority on FAS2> priority on FAS> priority set volume dbvol level=VeryHigh system=30 Description Enables FlexShare. Both nodes of an HA cluster must enable FlexShare even if only one uses it dbvol is given the highest priority and system operations (e.g, SnapMirror) are selected over user operations 30% of the time Instruct ONTAP to retain data in the buffer cache from dbvol as long as possible Instruct ONTAP to quickly flush data in the buffer cache from db_logs Display the priority assigned to user_vol03 Temporarily disable priority on testvol1 and places it into the default queu Removes all priority settings on testvol1 and places it into the default queue
FAS> priority set volume dbvol cache=keep FAS> priority set volume db_logs cache=reuse FAS> priority show volume user_vol03 FAS> priority set volume testvol1 service=off FAS> priority delete volume testvol1
4 5 6 7
Page 13 NetApp
1.1.5.4 Key Volume command Options Since new volumes inherit many of their settings from the root volume, plan accordingly by setting the options on the root volume most likely to be used on the system. The Data ONTAP System Administration Guide contains a chapter dedicated to the root volume. Volume option convert_ucode create_ucode Default off off Description Turns UNICODE character set on/off. Should be on for SnapMirror and SnapVault volumes Force UNICODE character use on/off when files are created. Turn on for SnapMirror and SnapVault volumes Volume setting preallocates disk space for entire volume. File only allocates space for space reserved files and LUNs in the volume. None means no disk space is guaranteed When on, turns speculative file read-ahead OFF and may reduce performance. When on, prevents update of access time in inode when a file is read, possibly increasing performance. Use with caution. When on, disables automatic snapshots of the volume When on, disables the .snapshot directory for NFS Designates the volume as the root volume.
guarantee
volume
minra
off
Page 14 NetApp
4 5 6 7
FAS> date -c initialize FAS> date -c FAS> vol create lock_vol01 lock_aggr01 100g FAS> vol options lock_vol01 snaplock_minimum_period 6m FAS> vol options lock_vol01 snaplock_maximum_period 10y FAS> vol options lock_vol01 snaplock_default_period 7y
8 9
Runs a wizard to initiate the ComplianceClock View the ComplianceClock time Create a 100GB FlexVol named lock_vol01 inside the lock_aggr01 aggregate Sets the minimum retention period that can be assigned to WORM files in lock_vol01 to 6 months Sets the maximum retention period that can be assigned to WORM files in lock_vol01 to 10 years Sets the default retention period for WORM files in lock_vol01 to 7 years
1.1.6.1 Associated Key OPTIONS Option snaplock.compliance.write_verify snaplock.autocommit_period none | {count|h|d|m|y} Default Off Description An immediate verification occurs after every write to provide an additional level of data integrity. NOTE: effects performance and may affect data throughput. Only valid with a Compliance license When set, files not changed during the delay period are turned into WORM files
none
Page 15 NetApp
NAS Implementation
This section describes procedures to access data using NFS or CIFS. Data can also be accessed using HTTP or FTP protocols, but will not be covered in this guide. Refer to the Data ONTAP File Access and Protocols Management Guide for more information.
OR
Edit /etc/exports with a text editor FAS> exportfs -a FAS> exportfs -q /vol/flex1/qtree1
6 7
Note: The implementation of NFS in Data ONTAP performs reverse DNS lookups for all hosts trying to access NFS exports. Hosts without a reverse address in DNS will be denied access. Step 2. On UNIX/Linux Server: Create new mount point and mount export: Step 1 2 3 4 5 6 Command/Action # showmount -e FAS2 # mkdir /mnt/FAS2/unix_vol # mount FAS2:/vol/flex2 /mnt/NA-2/unix_vol # cd /mnt/FAS2/unix_vol # ls -al Add mount command and options to /etc/vfstab (Solaris) or /etc/fstab (HP-UX, Linux) Description Verify available mounts on FAS2 Create a mount point Mount the Unix export from FAS2. Change to new mount point Verify mount was successful Make mount persistent
Page 16 NetApp
Note: If you change the name of the exported volume or qtree you must update the /etc/fstab or /etc/vfstab file on the host. Data Ontap will automatically modify the /etc/exports entry.
nfs.export. allow_provisional_access
On
Page 17 NetApp
FAS> date
5 6
FAS> qtree security /vol/flex_cifs ntfs FAS> cifs shares -add cifs_share /vol/flex_cifs comment 'New CIFS Share' FAS> cifs access cifs_share SysAdmins Full Control FAS> cifs access -delete cifs_share Cust_svc FAS> cifs shares -change Cust_svc accessbasedenum
8 9
Apply folder and file security using Windows administration server (e.g, AD or Domain server)
Step 2. On Windows Server: Step Command/Action * Log into Windows 2000 domain controller as Administrator * Start -> Programs -> Administrative Tools -> Active Directory Users and Computers. Click on "Action", select "New" then "User" * Create a new user to access the FAS. * Open Computer Management: Start -> Programs -> Administrative Tools -> Computer Management * Click on Action and select "Connect to another computer". Enter the name of the storage appliance * System Tools -> Shared Folders -> Shares Description
Page 18 NetApp
* At the Windows desktop, right click on My Network Places, select Map Network Drive * \\fbfiler2\cifs_share
Note: If you change the name of the shared volume or qtree the share will still be accessible because CIFS tracks an unique SSID rather than the pathname.
cifs.client.dup-detection cifs.enable_share_browsing cifs.gpo.enable cifs.home_dir_namestyle cifs.idle_timeout cifs.ms_snapshot_mode cifs.netbios_aliases cifs.nfs_root_ignore_ACL cifs.oplocks.enable cifs.per_client_stats.enable cifs.perm_check_use_gid
A security feature provided by CIFS to prevent manin-the middle attacks. Performance penalty when on. Enables support for the SMB 2.0 protocol Enables support for the FAS controller to communicate to Windows servers using SMB 2.0 When on, preserves disk space by sharing data blocks with active files and snapshots (unique to MS Office files). Small performance penalty when on A comma-seperated list of network interfaces for which CIFS is blocked
cifs.snapshot_file_folding.enable
Off
[7.3] interface.cifs.blocked
Null
d. The syntax of a quota entry in the quotas file is quota_target type[@/vol/dir/qtree_path] disk [files] [threshold] [soft_disk] [soft_files]. Fields are separated by space characters or tabs.
Page 20 NetApp
SAN Implementation
This section provides a summary of the procedures to enable access to a LUN on the storage appliance using either the Fibre Channel Protocol or iSCSI protocol. It is highly recommended to use SnapDrive rather than the CLI, Filerview, or OnCommand System Manager. Refer to the Data ONTAP Block Access Management Guide for iSCSI and FC for more information.
Step 2. Enabling the Fibre Channel Protocol on a Solaris Server Step 1 2 3 Command/Action # /driver_directory/install # reboot -- -r # /opt/NTAP/SANToolkit/bin/sanlun fcp show adapter -v # /usr/sbin/lpfc/lputil Description Install the Fibre Channel Card driver application Restart the Solaris server to enable the new hardware device Show full details of the Fibre Channel card on the server Light Pulse Common Utility to get information regarding Emulux host adapters.
Step 3. Enabling the Fibre Channel Protocol on a Windows Server Step 1 Command/Action Locate the host adapter driver and install on the Windows server Description Install the Host Adapter driver
Page 21 NetApp
2 3
Restart the Windows Server Run Light Pulse Common Utility to gather information regarding the host adapter
7 8 9
FAS*> fcp nodename FAS*> fcp config FAS*> priv set admin
Check the WWNNs of the cluster List WWPNs if switch rezoning is necessary Return to administrative mode
Note:
Page 23 NetApp
# /usr/sbin/lpfc/lputil - Select "5. Persistent Bindings" - Select "1. Display Current Bindings" # vi /kernel/drv/sd.conf Entry e.g: name="sd" parent="lpfc" target="0" lun=1; # reboot -- -r
5 6
Update the sd.conf file with newly bound LUN target and LUN ID values.
Reboot the Solaris server. Verify the new LUN can be viewed from the Solaris server. Locate and record the controller, target, disk and slice information of the LUN. If the devices are not located, re-scan for devices. Check again for the LUN. If required, reboot the Solaris server. Run the Solaris format command to create Solaris file system on the new LUN.
8 9
# devfsadm # sanlun lun show # reboot -- -r # format * Select the appropriate disk * Disk not labeled. Label it now? Y * format> partition * partition> modify * "1. All Free Hog" * Create the new partition? <CR> * Free Hog partition [6]? <CR> * Enter size of partition '0': 1c (1 Cylinder) * Enter size of partition '1': <CR> * Enter size of partition '7': <CR> * Okay to make this the current partition table [yes]? <CR> * Enter table name: "multiprotocol" * Ready to label disk, continue? Y * partition> print * partition> quit * format> quit # sanlun lun show
10
11
Display a list of available LUNs. Locate and record the controller, target, disk and slice information of the LUN. Construct a new file system on the new LUN. Create a mount directory for the LUN Mount the new LUN
Page 24 NetApp
12 13 14
15
# cd /mnt/slu2-luna
Option 2: Use SnapDrive to create and attach to an FCP LUN. Step 1 Command/Action Open Computer Management: Start -> Programs -> Administrative Tools -> Computer Management Storage -> SnapDrive -> Disks Description Use the Computer Management console View the available disks via the SnapDrive manager
Page 25 NetApp
3 4
Right click on Disk and select "Create disk" Via the SnapDrive wizard, enter the details of the new LUN
Create a new LUN via SnapDrive Enter the details of the new LUN
Description Display the WWNN of a target HBA display the port name and igroup name of initiator HBAs connected to target HBAs. Display the node name, port name, and link state of all target HBAs
Page 26 NetApp
3 4
Storage Appliance should now be a persistent connection Storage Appliance should now be an Active connection Windows host server initiator should now be available from the Storage Appliance
Page 27 NetApp
FAS> cifs shares -add LunQTree /vol/vol1/LunQTree Using SnapDrive, right click on "Disks" and select "Create Disk". Enter the following details: * Virtual Disk UNC Path: /vol/vol1/LunQTree * Virtual Disk (LUN) Name: Xluna * Virtual Disk Type: Dedicated * Disk Space to Accommodate Snapshot (Space-reserved): Yes * Lun Size: 2g * Driver Letter: <any> * Select initiator for Windows Host FAS> lun show -m Use Windows Explorer to verify the disk is available. If not, log off and then back on to the server again.
Verify the LUN wa created on the Storage Appliance Verify the drive is ready for use. Note: SnapDrive auto-formats the drive, no further management should be required.
Page 28 NetApp
4 5 6 7
FAS> lun clone split start /vol/vol1/LunQTree/Xluna.clone FAS> lun create status /vol/vol1/LunQTree/Xluna.clone FAS> snap delete vol1 mysnap Mount new LUN to host using commands in sections 3.1.6, 3.2.3, or 3.2.4 FAS> lun clone split start /vol/vol1/LunQtree/Xluna.clone FAS> lun clone split status parent_lun_path
Split the clone from the source Snapshot to make it permanent Verify LUN cloning progress Delete source snapshot Connect the LUN to client systems Optional: Split the LUN from the backing Snapshot to delete the Snapshot. Check status of the splitting operation.
3 4 3
Page 29 NetApp
Page 30 NetApp
Page 31 NetApp
Page 32 NetApp
6 7 8
FAS> vif favor e1a FAS> vif nofavor e1a FAS> vif stat <vif_name> <interval>
Set the interface e1 to be the primary/active VIF interface e1 became active when e0 failed. Now e0 is repaired and should be the primary. Display usage statistics of a VIF
Description
8 9
Obtain an IP address for the RLM, the gateway IP address, the mail server hostname and IP address. FAS> rlm setup FAS> rlm status FAS> rlm test autosupport FAS> rlm reboot Run the setup wizard Verify proper functioning Send a test ASUP to verify network settings Reset RLM and force self-test
Page 35 NetApp
Obtain an IP address for the SP, the gateway IP address, the mail server hostname and IP address. FAS> sp setup FAS> sp status Run the setup wizard Verify proper functioning
Page 36 NetApp
4 5
Send a test ASUP to verify network settings Reset SP and force self-test
2 3 4 5 6
Page 37 NetApp
ip.ipsec.enable
off
ip.ping_throtle.drop_level
150
telnet.enable telnet.distinct.enable
on on
trusted.hosts
N/A
Page 38 NetApp
Space Management
AND
AND
Warning: When you take a FlexVol volume offline, it releases its allocation of free space in its containing aggregate. Other volumes can then use this space. On a nearly full aggregate, this may prevent the volume from coming back online since the aggregate can no longer honor the space guarantee.
5.1.2 FPolicy
FPolicy performs file screening which is like a firewall for files. FPolicy works with CIFS and NFS to restrict user-defined file types from being stored on the system. FPolicy can perform basic file blocking natively or work with third-party file screening software. Refer to the Data ONTAP File Access and Protocols Management Guide for more information. Note: Antivirus scans bypass FPolicy and can open and scan files that have been blocked. Note: FPolicy configuration information is maintained in the registry. Copying or recreating this information is extremely difficult. Therefore, it is highly recommended you keep updated documentation on the fpolicy settings applied to each volume. Step 1 2 Command/Action FAS> license add <CIFS code> FAS> license add <NFS code> FAS> options fpolicy.enable on Description FPolicy requires a CIFS license to operate, even in NFS environments Turn on the fpolicy engine
Page 39 NetApp
3 4 5
FAS> fpolicy create music_files screen FAS> fpolicy FAS> fpolicy extensions include add music_files mp3,ogg,mid
Create a policy named music_files and set it to a policy type of screen Display all policies and their status Adds files with these filename extensions to the policy, restricting them from being stored or modified Ignores .wav files during screening. Warning: Creating an exclude list causes all file types not excluded to be screened as if they were part of an include list Removes .mid files and the default ??? extension wildcard from the include list Show the list of file extensions on the include list Requires all files being accessed to be screened by the policy before access is granted. Note: If no third-party file screening server is available, screening reverts to native file blocking Instructs the policy to activate when files are created or renamed. This example will prevent files from being copied and then renamed to avoid file screening Activates the policy to begin file screening Apply music_files policy only to users_vol volume rather than all volumes Do not screen the rootvol volume. Warning: Creating an exclude list causes all volumes not excluded to be screened as if they were part of an include list Disable and delete the music_files policy
FAS> fpolicy extensions exclude add music_files wav FAS> fpolicy extensions include remove music_files mid,??? FAS> fpolicy extensions include show music_files
7 8
10
FAS> fpolicy monitor set music_files -p cifs,nfs create,rename FAS> fpolicy enable music_files FAS> fpolicy volume include add music_files users_vol FAS> fpolicy volume exclude add music_files rootvol FAS> fpolicy disable music_files FAS> fpolicy destroy music_files
11 12
13
14
5.1.3 Reallocate
Reallocation is like a filesystem defrag it optimizes the block layout of files, LUNs, and volumes to improve performance. You should define a reallocation scan when you first create the LUN, file, or volume. This ensures that the layout remains optimized as a result of regular reallocation scans. More info on reallocate and volume read_realloc is in the Data ONTAP System Administration Guide and TR-3929 Reallocate Best Practices Guide. NOTE: Snapshots created before the reallocate hold onto unoptimized blocks and consume space. In most cases, NetApp recommends deleting snapshots before initializing the reallocate process
Page 40 NetApp
Warning: Do not use reallocate or volume read_realloc on deduplicated volumes. Warning: Reallocate the SnapMirror source volume rather than the destination. Step 1 Command/Action FAS> reallocate on Description Turn on the reallocation process on the storage controller. Set the space guarantee to volume to ensure reallocate does no t create an overcommitment issue in the aggregate Snapshots lock blocks in place so delete unneeded snapshots for better results Enable reallocation on the oradb03 volume. now reallocate will run on the volume every day at midnight (see step 3) Run reallocate, but do not change logical layout so snapshots may be preserved. Warning: This will degrade performance when reading old, unoptimized snapshots (e.g,. SnapRestores and using cloned LUNs and volumes). Reallocate free space in aggr03. This will not move data blocks Run reallocate on the LUN every Saturday at 11 PM. Display status of reallocation jobs for entire system or specified pathname. Delete a reallocate job.
FAS> reallocate start -A -o aggr03 5 6 7 FAS> reallocate schedule -s "0 23 * 6" /vol/db/lun1 FAS> reallocate status [ pathname ] FAS> reallocate stop /vol/exchdb/lun2.lun
The read_realloc volume option is not part of the reallocation command but uses many of the same system processes to perform a similar function to defragment files read sequentially. Note: Files in a volume are identified as defragmented only after they have been read into memory once and determined to be fragmented. Not all files will be reallocated and volumes with small files and mostly random reads may not see any benefit. Step 1 Command/Action FAS> vol options testvol read_realloc on Description Turn on file read reallocation . Use on volumes with few snapshots because it may duplicate blocks and consume space Turn on file read reallocation but save space by not reallocating files in snapshots. This will reduce read performance when reading files in a snapshot (during file restore or using FlexClone volumes)
Page 41 NetApp
FAS> vol autosize vol17 on 2 FAS> vol size apps_vol FAS> vol autosize apps_vol -m 50g -i 500m on FAS> vol autosize apps_vol 3 [7.3] FAS> vol status -v apps_vol 4 FAS> snap autodelete vol17 show FAS> snap autodelete vol17 on
The default, try only permits snapshots not locked by data protection utilities (mirroring, NDMPcopy) AND data backing functionalities (volume and LUN clones) to be deleted. disrupt only permits snapshots not locked by data backing functionalities (volume and LUN clones) to be deleted. The default, volume triggers snapshot delete when the volume reaches 98% full AND the snap reserve is full. snap_reserve triggers snapshot delete when the snap reserve reaches 98%. Stop deleting snapshots when either volume or snap_reserve (determined by the trigger setting) reaches 10%. Default setting is 20%.
FAS> snap autodelete vol17 trigger volume 6 FAS> snap autodelete vol17 trigger snap_reserve FAS> snap autodelete vol17 target_free_space 10 FAS> snap autodelete vol17 delete order newest_first | oldest_first ] [
The default is to delete oldest snapshots first. By default, user_created (manual or script created snapshots - including SnapDrive, SnapMirror, and SnapVault) are deleted last. If set to scheduled then snapshots created by snap sched are deleted last.
5.2 Deduplication
Deduplication is a form of compression that looks for identical data blocks in a volume and deletes duplicates blocks by adding reference counters in the metadata of a few master blocks . Read TR-3505 NetApp Deduplication for FAS and V-Series Deployment and Implementation Guide for more information. Note: NDMP copies and backups, SnapVault and Qtree SnapMirror decompress or rehydrate the data which will consume space on the destination tape or disk system. Warning: Each storage controller model has a volume size limit and limit on how much non-duplicate and deduplicated data those volumes can hold. Check the matrix in TR-3505 for your systems limits. Data ONTAP 7.2 requires 1 - 6% free volume space to hold the deduplication metadata. Data ONTAP 7.3.x moves most of the metadata into the aggregate and requires 2% volume free space and 4% aggregate free space (if you have set aggregate snap reserve below 4%, you will want to increase it). Step 1 2 Command/Action FAS> license add <code> FAS> sis on /vol/group_vol Description Add licenses for A_SIS and Nearstore to use deduplication. Enable duplication on specified volume.
Page 43 NetApp
3 4
Start a scan of the volume and then run every day at midnight. Display the schedules of SIS enabled volumes. Schedule deduplication scan every Wednesday and Saturday at 3 AM. Note: Stagger schedules because an HA cluster can only support 8 concurrent deduplication operations. No schedule. Run deduplication scans run when new or changed blocks changed since last scan exceed 35% of total deduplicated blocks. Without a number, the default for auto is 20% Display status of all SIS enabled volumes. Display space savings created by deduplication Abort the currently active SIS operation. This option reduces the duplication of blocks from temp files (which are a copyon-save process) in CIFS volumes. File folding compares blocks in the active file (temp file) with blocks in snapshot copies of the file and re-uses common blocks. There is a small trade-off between performance and space utilization. If the folding process begins to consume memory, it is suspended until later.
FAS> sis config -s /vol/group_vol wed, sat@03 5 FAS> sis config -s auto@35 /vol/vol01
6 7 8
16 16 16 16 16 16 16 16 16
1 3 2 2 4 3 16 4 16
17 19 18 18 20 19 32 20 32
Page 44
NetApp
16 16 16 16
16 16 16 4
32 32 32 20
(not recommended) VM swap files, pagefiles, user and system temp directories
Page 45 NetApp
This chapter introduces some of the data backup and recovery applications. Refer to the Data ONTAP Data Protection Online Backup and Recovery Guide for more information.
2 3
6.1.2 ndmpcopy
Copy volumes, qtrees or single files between multiples systems or within a single system. Note: Even for internal copying, ndmpcopy requires an active network connection. Data is sent through the loopback adapter so use a fast network connection (i.e., a Gb/e switch rather than a 100Mb/e hub). Step 1 2 Command/Action FAS1> ndmpcopy fas1:/vol/data/my_stuff fas2:/vol/users/ FAS1> backup status Description Copies the qtree my_stuff on FAS1 to the volume /vol/users on FAS2 display all active instances of backup jobs
Page 46 NetApp
OR 5 6
7 8
FAS1> vol copy abort [operation_number] FAS1> vol options destination_vol online
6.3 Snapshots
Step 1 Command/Action FAS> snap create vol1 mysnap Description Create a snapshot of volume vol1 Shedule snapshots of vol1 to retain 1 weekly, 6 nightly and 12 hourly snapshots. Take the snapshots at 0800, 1000, 1200, 1400, 1600 and 1800 set the snap reserve on vol1 to 12% List all snapshots for vol1 Show the amount of change between snapshots on vol1 (or between 2 snapshots) List amount of space freed if listed snapshot(s) were deleted
3 4 5
FAS> snap reserve vol1 12 FAS> snap list vol1 FAS> snap delta vol1 [snap1 snap2] FAS> snap reclaimable vol1 snap1 [snap2 ]
Page 47 NetApp
7 8 9
FAS> snap rename vol1 old_name new_name FAS> snap delete vol1 snap1 FAS> snap autodelete vol1
Rename a snapshot in vol1 Delete snapshot snap1 in vol1 set/change settings to automatically delete snapshots when volume and snap reserve are nearly full
6.4 SnapRestore
Warning: All file changes and snapshots created after the snapshot used for the SnapRestore will be permanently lost Step 1 2 3 Command/Action FAS> license add <code> FAS> snap restore -t file /vol/vol1/etc/rc FAS> snap restore -t vol -s weekly.1 vol1 Description Install license code for SnapRestore SnapRestore specific file from snapshot SnapRestore entire volume from a weekly Snapshot
3 4 5 6
Page 48 NetApp
7 8
FAS2> vol status vol1 FAS1> options snapmirror.access host=fas2 FAS2> options snapmirror.access host=fas1 FAS2> wrfile -a /etc/snapmirror.conf fas1:vol1 fas2:vol1 - * * * * or fas1:vol1 fas2:vol1 0-55/5 * * * (every 5 mins of every hour) FAS1> snapmirror on FAS2> snapmirror on FAS2> snapmirror initialize -S fas1:vol1 fas2:vol1 FAS2> snapmirror status -l
Verify volume is now restricted Allow snapmirror access by each storage controller to the other. Create a snapmirror schedule on the destination FAS defining when to synchronise (Min of Hr, Hr of Day, Day of Mth, Day of Wk) See section 11.6 for a sample snapmirror.conf file Enable snapmirror on both the source and destination systems. Initialize transfer of files from source to destination system and create a baseline from which to mirror. Verify status of transfer or of mirror
10 11
Page 49 NetApp
7a
FAS1> snapmirror break vol1 FAS1> snapmirror quiesce fas1:/vol/vol1/mytree FAS1> snapmirror break fas1:/vol/vol1/mytree FAS2> snapmirror resync -S fas1:vol1 fas1_vol1 FAS2> snapmirror resync -S fas1:/vol/vol1/mytree /vol/fas1_vol1/mymirror
Break the current snapmirror relationship so it can be reversed and set to its original direction. For Qtrees, the snapmirror must be first quiesced and then broken. Perform a second resync, setting FAS1 as the source again. Perform a second resync on a Qtree.
7b 8a 8b
4 5
Page 50 NetApp
6.6 SnapVault
SnapVault performs backup (versus replication like SnapMirror) of qtrees and directories from a primary storage system (source) to a secondary storage system (destination). Step 1 2 3 4 5 Command/Action FAS1> license add <sv_primary_license> FAS2> license add <sv_secondary_license> FAS> ndmpd on FAS> options snapvault.enable on FAS1> options snapvault.access host=fas2 FAS2> options snapvault.access host=fas1,fas3 FAS2> snapvault start -S fas1:/vol/vol1/qtree1 /vol/sv_vol/na1_qtree1 FAS1> snapvault snap sched vol1 sv_weekly 1@sat@19 FAS1> snapvault snap sched vol1 sv_nightly 6@mon-fri@19 FAS1> snapvault snap sched vol1 sv_hourly 14@mon-fri@7-18 Description License SnapVault on the primary and secondary systems. Enable the NDMP service. Enable SnapVault. Allow host access from the SnapVault Secondary (destination) system. Allow host access from all the clients. Initialize the relationship between source qtree1 on FAS1 to a unique destination qtree in /vol/sv_vol Create a schedule of snapshots for SnapVault use on each client volume containing qtrees to backup. There are weekly, nightly and hourly snapshots. Specify number to retain, @what days to run, @what times to take snapshots
Page 51 NetApp
FAS2> snapvault snap sched -x vol1 sv_weekly 1@sat@19 FAS2> snapvault snap sched -x vol1 sv_nightly 6@mon-fri@19 FAS2> snapvault snap sched -x vol1 sv_hourly 14@mon-fri@7-18 FAS> snapvault status [-l] [-s]
Create a schedule of transfers from all clients containing qtrees in vol1. There are weekly, nightly and hourly snapshots. Specify number to retain, @what days to run, @what times to take snapshots Check on the status of SnapVault transfers
4 5 6 7 8
Page 52 NetApp
Stop the existing relationship Verify the relationship no longer exists Verify qtree q1 no longer exists Remove all snapshot schedules for the volume vol1 on the source FAS
List the existing relationships Release the relationship between /vol/vol1/q1 and the qtree on FAS2 Verify the relationship no longer exists
6.7
off
replication.throttle.incoming.max_kbs
unlimited
replication.throttle.outgoing.max_kbs
unlimited
off
Page 53 NetApp
6.8 FlexClone
This section describes how to create replicas of FlexVols using the licensed product FlexClone. A FlexClone volume saves space by using the blocks in a shared snapshot rather than duplicating the blocks. Only changes or additions to the data in the volume clone consume space.
FAS> df -m newvol
Page 54 NetApp
FAS> clone start /vol/raw_video/test_video.avi /vol/raw_video/test_video_clone.avi FAS> clone start <src_path> [dest_path] <-r <src_fbn>:<dest_fbn>:<fbn_cnt> ...> FAS> clone start <src_path> <dest_path> -s <snapshot_name> FAS> clone status <vol_name> FAS> clone stop <vol-name> <ID>
OR
OR 4 5
FAS> df -s raw_video
Page 55 NetApp
Security
Page 56 NetApp
[7.3] interface.blocked.cifs ip.fastpath.enable rsh.enable security.passwd.rootaccess.enable ssh.pubkey_auth.enable telnet.enable trusted.hosts (ignored unless telnet.access is set to legacy)
Off
Set to a comma-separated list of interfaces or VIFs to prevent use by CIFS Turn off to reduce ARP spoofing and session hijacking attacks
On On Off On
Turn off to disable RSH access Turn off to disable root user access to the storage system Turn on to enable SSH public key authentication Turn off to disable Telnet access Set to a dash to disable all Telnet access, insert hostnames to restrict access, set to * to allow access to all hosts
Page 57 NetApp
cifs.signing.enable
Off
[7.3] cifs.smb2.client.enable [7.3] cifs.smb2.durable_handle.enable [7.3] cifs.smb2.durable_handle.timeout [7.3] cifs.smb2.enable [7.3] cifs.smb2.signing.required [7.3] interface.blocked.cifs [port | VIF ]
Page 58 NetApp
7.3 AntiVirus
Data ONTAP is a memory-resident OS not vulnerable to viruses or other malware. The data stored on the system is not protected by Data ONTAP so external antivirus servers must screen files for viruses. Step 1 2 3 Command/Action Install and configure a Data ONTAP compliant virus scanner on a PC server(s) FAS> vscan scanners FAS> vscan scanners secondary_scanners <IP addresses> FAS> vscan on FAS> cifs shares -change cifs.homedir -vscan FAS> cifs shares -change App_logs -novscan Description Most major AV vendors have compliant versions of their software Scan the network for AV servers For multiple AV scanners, designate all but one as secondary scanners Enable virus scanning. By default, Data ONTAP sends every CIFS file a client accesses to the scanner(s) for scanning Turn on scanning of the home directories Disable virus scanning of the App_logs CIFS share Display status of vscanners, file extensions being scanned, and number of files scanned Change scanner timeout value from the default of 10 seconds to 1 45 seconds. The larger the timeout, the longer the delay until a user is given file access. The default is On which prevents file access if a scan can not be performed. Turn on to notify users an infected file has been found. Otherwise, users are only told file unavailable Enable virus scanning on a vFiler Stop virus scanning sessions for the specified scanner server ONTAP caches information about previously scanned files to avoid rescanning those files. When you load a new virus-scanning signature file, reset the cache to rescan files that were scanned using an old signature file.
4 5 6
FAS> vscan
10 11 12
FAS> vscan options client_msgbox on FAS> vscan options use_host_scanners on FAS> vscan scanners stop <IP address>
13
Page 59 NetApp
FAS> config restore 25Apr2009.cfg FAS> environment FAS> memerr FAS> options FAS> options autosupport.doit <subject> FAS> logger <free text message> FAS> source <filename>
Page 60 NetApp
3. Change password
5. Maintenance Mode
FAS> shelfchk
FAS> priv set advanced FAS*> storage download shelf FAS*> priv set
Page 61 NetApp
Display all the FC disk adapters in the system and then disable adapter 7b in preparation to replace a shelf controller module connected to the 7b interface.
FAS> sasadmin shelf FAS> priv set advanced FAS> sasadmin adapter_online <adapter name> FAS> options acp.enabled on FAS> storage show acp
5 6
shelf.esh4.auto.reset.enable acp.enabled
Off Off
Page 62 NetApp
Sends disk 0a.25 to Maintenance Center for analysis. NOTE: This forces a disk failure Manually fail disk 0a.27 to a spare drive. This initiates Rapid RAID recovery and will take time to copy data to the spare. Uses Rapid RAID Recovery to swap a spare drive with drive 0a.25 Spin down spare disk 0a.25 before removing from FAS Convert disks from a destroyed aggregate/tradvol into spares Runs about 5 minutes to diagnose loop and disk issues. A confidence factor less than 1 indicates problems. Any disk with hard disk errors should be failed manually
5 6 7
FAS> disk replace 0a.25 FAS> disk remove 0a.25 FAS> disk zero spares Boot into Maintenance Mode : *> disktest -v
Type
FC
Speed
15k rpm
SAS
15k rpm
SAS SATA
Note : New models of disk drives often require updating the disk qualification list in order to be properly recognized by Data ONTAP 1 Download the qual_devices.zip (or .tar.gz) file and extract into the /etc folder on the root volume http://support.netapp.com/NOW/download/tools/diskqual/
Page 63 NetApp
2 3
Wait 5 minutes for ONTAP to process the file Insert new drives or attach new shelf to system (Assuming you knew beforehand there would be an issue with the new disks)
raid.reconstruct.perf_impact
medium
raid.rpm.ata.enable
Off
raid.rpm.fcal.enable
On
Page 64 NetApp
This section covers basic cluster setup and failover. See the Data ONTAP Active/Active Configuration Guide and Data ONTAP System Administration Guide for more details. Also refer to TR-3450 HA Pair Configuration and Best Practices
Default On On off
Description Determine if a giveback is performed when a down node is repaired and reboots When off, disables automatic takeover Enable takeover on failure of all monitored NICs (NICs must be set in ifconfig statements in /etc/rc file.) By default, all NICs must fail to initiate failover. When set to any_nics then one NIC failure results in failover. Uses the RLM to notify partner of hardware failures, reducing delay before initiation of takeover. Define partner IP address to receive HardwareAssisted Takeover messages Define partner NIC port to receive HardwareAssisted Takeover
cf.takeover.on_network_interface_fail ure.policy
all_nics
[7.3] cf.hw_assist.enable
On
Null Null
Page 65 NetApp
FAS1> ifconfig e0 10.41.72.103 partner 10.41.72.104 FAS2> ifconfig e0 10.41.72.104 partner 10.41.72.103 or FAS1> ifconfig e0 partner 10.41.72.104 FAS2> ifconfig e0 partner 10.41.72.103 Modify /etc/rc ifconfig e0 `hostname`-e0 mediatype auto flowcontrol full netmask 255.255.255.0 partner 10.41.72.104 FAS1> ifconfig e0 e0: flags=948043<UP,BROADCAST,RUNNING,MULTICAST,T CPCKSUM> mtu 1500 inet 10.41.72.103 netmask 0xffffff00 broadcast 10.41.72.255 partner inet 10.41.72.104 (not in use) ether 00:0e:0c:2e:f8:54 (auto-1000t-fd-up) flowcontrol full
Command/Action
Description Verify cluster is normal status Local node takes over partner node Verify FAS1 has taken over FAS2 Switch to partners CLI context
FAS1(takeover)> partner
Page 66 NetApp
FAS2/FAS1> sysconfig -v *** This system has been taken over by fas1 NetApp Release 7.1: Fri Dec 23 02:32:04 PST 2005 System ID: 9950393031 (NA-2); partner ID: 9950393390 (FAS1) System Serial Number: 9990073 (FAS2); partner Serial Number: 9990079 (FAS1) System Rev: C2 No hardware device information is available. FAS2/FAS1> ifconfig -a FAS2/FAS1> vif status FAS2/FAS1> partner
6 7
Verify FAS2s network interfaces and VIFs have been created and are online. Switch back to FAS1 CLI Partner node reboots and functions normally Note: It is sometimes necessary to run cf giveback -f to terminate certain services that will prevent a giveback.
FAS1(takeover)> cf giveback [lots of console messages] Cluster monitor: takeover of fas2 enabled
9 10
Verify clients can access data using all licensed protocols FAS1> cf status Cluster enabled, fas2 is up. Verify cluster is back to normal status
Page 67 NetApp
7 8 9
vfiler1> qtree create eng /vol/vol1/eng vfiler1> cifs shares -add eng /vol/vol1/eng
Verify clients in the same IPspace can Verify everything worked access the share within this vfiler To return to the root filer, type vfiler context vfiler0. Additionally, you may type vfiler run before every command to run the command on the specified vfilers context.
3 4
Page 69 NetApp
11 Configuration Files
Filename cifs_homedir.cfg cifs_nbalias.cfg exports ftpusers group hosts hosts.equiv netgroup networks nsswitch.conf passwd quotas rc registery resolv.conf snapmirror.allow snapmirror.conf symlink.translations syslog.conf usermap.cfg Purpose configuration file for CIFS home directories configuration file for CIFS NetBIOS aliases a list of export entries for all file system paths that Data ONTAP exports automatically when NFS starts up. lists users for whom ftp login privileges are disallowed. stores Unix security group membership data base Maps IP addresses to host names and aliases. list of hosts and users with rsh permission network groups data base network name data base Specifies the order in which Data ONTAP searches local, NIS, DNS, and LDAP files. Unix security username and password data base quota description file system initialization command script registry database configuration file for domain name system (DNS) resolver list of allowed destination filers volume and qtree replication schedules and configurations Enables use of NFS absolute symlinks by mapping them to CIFS-based paths configuration file for syslogd logger daemon mappings between UNIX and Windows NT accounts and users
Note: Important quota commands: - FAS> quota resize <vol> - FAS> quota off <vol> / quota on <vol>
Data ONTAP 7G Cook Book v4_1.doc 1 May 2012 Page 70 NetApp
# minute hour dayofmonth dayofweek(0-Sunday to 6-Sat) ####define snapmirror compression relationships na01-na02=multi (192.168.1.107,192.168.1.112) fas1=multi(10.10.10.50,10.10.10.200) (192.168.1.52,192.168.1.202) ###end ##Start snapmirror fridge-gig:db icebox:db - 0-55/5 * * * filer1:build filer2:backup - 15,45 8,9,10,11,12,13,14,15,16 * * fas1_DR:user_vol fas2:user_vol_dr compression=enable 15,45 * * * na01-na02:vmware013 na02:sm_vmware013 compression=enable - - - -
Page 72 NetApp
12 Troubleshooting Commands
12.1 General Troubleshooting
1. 2. 3. 4. 5. 6. 7. 8. Define the problem. Gather facts related to the problem. Identify potential cause of problem. Create an action plan. Test the plan. Implement the plan. Observe results. Document the solution. Command FAS> sysstat -x 1 FAS> statit -b, statit -e FAS> stats FAS> wafl_susp -w FAS> perfstat FAS> sysconfig -v FAS> sysconfig -r FAS> sysconfig -c FAS> environment status FAS> memerr FAS> disk shm_stats FAS> aggr status -f FAS> aggr show_space <aggr name> FAS> fcstat device_map Description Display total system statistics every second Storage Appliance statistics printout (a priv set advanced command) Collects statistical data Display WAFL Statistics Collects performance statistics (Note: May increase load on system) System hardware configuration information System raid group information Checks config levels of hardware against DOT software requirement. Display power and temperature conditions print history of memory errors since boot Display I/O statistics per disk List failed disks Display usage of space by volumes, snapshots and WAFL overhead Display shelves and drives attached to FC ports
Page 73 NetApp
Page 74 NetApp
Page 75 NetApp
Page 76 NetApp
Enable per client CIFS statistics Diagnose security checking for both UNIX-style (uname) and NT-style security (ntname) Monitor CIFS login attempts. Test domain controller communications SecureShare Access application for windows. Shows UNIX/NTFS ACLs
Page 77 NetApp
Page 78 NetApp
Utilities installed as part of the FCP attach kit. Used to collect all config info on the respective devices. Check if lpfc driver is loaded
Control Panel->ISCSI
This example shows how to configure an EtherChannel on a single switch in the stack. It assigns two ports as static-access ports in VLAN 10 to channel 5 with the LACP mode active:
Data ONTAP 7G Cook Book v4_1.doc 1 May 2012 Page 79 NetApp
Switch# configure terminal Switch(config)# interface range gigabitethernet2/0/1 -2 Switch(config-if-range)# switchport mode access Switch(config-if-range)# switchport access vlan 10 Switch(config-if-range)# channel-group 5 mode active Switch(config-if-range)# end
This example shows how to configure cross-stack EtherChannel. It assigns two ports on stack member 2 and one port on stack member 3 as static-access ports in VLAN 10 to channel 5 with the PAgP and LACP modes disabled (on):
Switch# configure terminal Switch(config)# interface range gigabitethernet2/0/3 -4 Switch(config-if-range)# switchport mode access Switch(config-if-range)# switchport access vlan 10 Switch(config-if-range)# channel-group 5 mode on Switch(config-if-range)# exit Switch(config)# interface gigabitethernet3/0/3 Switch(config-if)# switchport mode access Switch(config-if)# switchport access vlan 10 Switch(config-if)# channel-group 5 mode on Switch(config-if)# exit
Ontap Simulator
Page 80 NetApp
Credits
Name
David Thiessen Australia PSE Eli Rodriguez RTP TSE Michael Cope San Diego PSE/ Services SE mcope@netapp.com
Date
Mar 2005
Description
Original author Added Clustering, MultiStore, SAN Troubleshooting
May 2006
Most information was taken from NHTT v2.1 training guides and Data ONTAP docs. Expanded to include all installation and implementation procedures. Upkeep with new versions of ONTAP
Page 81 NetApp