CommCell Performance Tuning
CommCell Performance Tuning
CommCell Performance Tuning
Overview
You can improve the performance of data movement operations using the parameters described below. You can
use one or more parameters at a time.
On a Subclient
Use Multiple Data Readers
Data Readers
Data Readers determines the number of parallel read operations while the data is backed up. Configuring
multiple data readers per subclient on disk arrays can improve the backup performance of clients.
Modify the number of data readers on a subclient to twice the number of tape drives.
See Streams ‐ Getting Started for instructions about how to modify the value.
Allow multiple data readers within a drive or mount point
Configure multiple data readers for a disk array that contains several physical drives that are logically
addressed as a single drive. This allows you to take advantage of the fast read access from the array.
See Streams ‐ Getting Started for instructions about how to enable this option.
Network Bandwidth
Network Agents establish data pipes to transfer data from the client to the MediaAgent. Therefore,
increasing the number of Network Agents increases the data transfer throughput from the client.
Depending upon your environment, change the Network Agents value to 2 or 4.
See Network Agents for instructions about modifying the value for network agents.
On a Storage Policy
Device Streams
Device Streams are logical channels that connect client data to the media where data that is secured by
backup operations are stored.
On Storage Policy, set the device stream to twice to the number of tape drives or writer of all libraries those
are defined in the storage policy copy.
See Setting the Device Streams on a Storage Policy for instructions about how to modify the value.
Stream Randomization
http://documentation.commvault.com/commvault/v10/article?p=features/performance_tuning/tunable_parameters.htm 1/21
26/12/2016 CommCell Performance Tuning
Use Stream Randomization to choose device streams randomly for backup operations. This increases the rate
of data transfer by backing up data to more number of parallel streams.
See Configuring Stream Randomization.
Incremental Storage Policy
Enable Incremental Storage Policy on Storage Policy properties. Once this option is enabled, the selected
storage policy is used to perform incremental and differential backups.
See Enabling Incremental Storage Policy.
On a CommCell
Increase the Chunk Size
Setting the chunk size higher ﴾for example, 16384 MB for a Linux file system﴿ increases throughput.
See Setting the Chunk Size for the CommCell.
On a MediaAgent
Increasing streams for concurrent backups
Enable maximum number of parallel data transfer operations on a MediaAgent to manage the maximum
number of concurrent read/write operations.
See Setting the Maximum Number of Parallel Data Transfer Operations.
Enable Optimize for concurrent LAN backups to increase the number of streams for concurrent backups from
large number of clients. The current stream count limit is increased by 200 more streams.
See Optimize the MediaAgent for Concurrent LAN backups.
http://documentation.commvault.com/commvault/v10/article?p=features/performance_tuning/tunable_parameters.htm 2/21
26/12/2016 CommCell Performance Tuning
The following table gives default chunk size for tape and disk backups and the recommended range of chunk
size:
Recommended Range of
Storage Media Backup Type Default Chunk Size
Chunk Size
Tape Granular Backup 4 GB 8 GB, 16 GB, 32 GB
Database Backup 16 GB 8 GB, 16 GB, 32 GB
Disk All Backups 2 GB ‐‐‐‐
Direct Attached All backups 4 GB ‐‐‐‐
NDMP
Even though a higher chunk size increases the throughput. granular restores ﴾for example, single file restore﴿
become slower. However, large restores, like a full‐machine rebuild, become a bit faster.
We recommend a lower value for frequent checks of slower backups, especially when data is moving across a
WAN link.
1. On the ribbon in the CommCell Console, click the Storage tab, and then click Media Management.
2. In the Media Management Configuration dialog box, click the Chunk Size tab, in the Agent Type column,
select the <Agent>, and then enter the appropriate chunk size value.
This value applies only to tape media.
3. Click OK.
The chunk size that is specified in the additional setting overrides the values that is specified in the chunk size set
for the CommCell in the Media Management configuration.
4. In the Add Additional Settings on Windows Client dialog box, in the Name box, type DMMBCHUNKSIZE.
The Category and Type details are automatically populated.
5. In the Value box, specify chunk size value in MB ﴾for example, 1024 MB and 2048 MB﴿.
6. Click OK and click OK to close the MediaAgent Properties dialog box.
For other file servers, the chunk size is based on the size of the tape that is used to back up the data. This is not
configurable.
Use the following procedure to modify the chunk size for filers that support restartability:
Use the following steps to modify the chunk size for data path.
http://documentation.commvault.com/commvault/v10/article?p=features/performance_tuning/tunable_parameters.htm 4/21
26/12/2016 CommCell Performance Tuning
New block size is supported by the Host Bus Adapter Driver installed in the MediaAgent and the tape device.
The most commonly used values are 128 KB or 256 KB.
All the MediaAgents that are associated with a Storage Policy support the block size that is configured on
that storage policy
If different MediaAgents are used for backup and restore operations, and the backup MediaAgent has higher
block size, then ensure that the restore MediaAgent is configured with Host Bus Adapters, and that tape
drives that are able to read the data written with higher block size.
If you want to modify the block size, use the following supported values of block size:
* If you specify a block size that is larger than the allowed limit, the NAS backup process automatically changes
your entry to the maximum allowable block size.
This information is updated at the close of each chunk, or within 5‐minute intervals, whichever occurs sooner.
When larger chunks are configured for data movement operations, the amount of time between Job Manager
Updates is automatically extended by that configuration.
http://documentation.commvault.com/commvault/v10/article?p=features/performance_tuning/tunable_parameters.htm 5/21
26/12/2016 CommCell Performance Tuning
By default, the number of collect files is equal to twice the number of data readers ﴾2 x Number of Data Readers﴿.
Two is a multiplication factor which is the number of Collect files that are created for the job. You can change the
multiplication factor.
Note that each application internally allocates a buffer size that is suitable for handling the application data.
When the size of the application data read during backup operations matches the source application's internal
buffer allocation then the overhead is minimized. So to achieve optimal rate of data transfer during backups,
configure this value based on the source application's buffer allocation.
The value of application read size may be increased to reduce the amount of data read from the given
application, which in turn reduces the amount of I/O operations performed against it. As a result, overall backup
performance may increase. However, backup memory usage may also increase, which may inadvertently
consume additional resources from the application. Thus, it is recommended that this value be set at either the
default value or match the block size directed by the application.
1. In the CommCell Browser, expand Client Computers > client > File System. Click defaultBackupSet.
2. Right‐click a subclient, then click Properties.
http://documentation.commvault.com/commvault/v10/article?p=features/performance_tuning/tunable_parameters.htm 6/21
26/12/2016 CommCell Performance Tuning
This is applicable for Windows MediaAgents and disks that are mounted directly ﴾not UNC paths﴿.
To control the number of read ahead buffers in the unbuffered I/O mode:
The read streams for deduplication jobs are not unbuffered. Therefore, this additional setting does
not have an effect on deduplicated data and in completion of Auxiliary copy jobs of deduplication
data sets.
If required, modify the other network parameters of the client, such as network card speed, network switch speed
etc., to get the optimum data transfer throughput.
All subclients except those using NAS iDataAgents support network bandwidth throttling.
http://documentation.commvault.com/commvault/v10/article?p=features/performance_tuning/tunable_parameters.htm 7/21
26/12/2016 CommCell Performance Tuning
To set a limit for network bandwidth and the number of concurrent network agents for a subclient backup
operation, perform these steps:
1. In the CommCell Browser, expand Client Computers > client_name > agent.
2. Click a backup_set_name, then on the backup_set tab, right‐click a subclient and click Properties.
If your iDataAgent is DB2, DB2 MultiNode, Informix, Oracle, Oracle RAC, SAP, or Sybase, right‐click an
instance, then click Properties.
3. Click the Storage Device tab, then the Data Transfer Option tab.
Set the maximum number of Network Agents to run concurrently when performing a subclient or
instance backup.
Select the Throttle Network Bandwidth ﴾MB/HR﴿ option, then enter the throughput limit as needed.
Note that the Simpana software throttles the transfer on a per‐network‐agent basis.
4. Click OK to save your changes.
When you increase the number of data pipe buffers, more shared memory is consumed by the client or
MediaAgent. This may degrade the server performance. Therefore, before increasing the number of data pipe
buffers, ensure that adequate shared memory is available. You can optimize the number of data pipe buffers by
monitoring the number of concurrent backups completed on the server.
1. It is recommended to verify the disk performance using the DiskReadWrite utility available in resource pack.
For more information, refer to Resource Pack.
2. If the client computer has multiple disks, create multiple subclients. This will enable the parallel data
movement operations from the client.
3. Configure multiple data streams for the storage policy that is assigned to the subclients. For more
information, refer to Change the Maximum Number of Data Streams.
If the Storage Policy is not configured for multiple data streams, then subclients will perform the data
protection operations one after the other in a serial.
4. For Windows and Unix File System iDataAgent, configure the subclient for multi‐stream backups. By default,
multi‐streaming is not configured for clients with a single disk. However, you can choose to override the
default configuration. For more information, refer to Streams.
http://documentation.commvault.com/commvault/v10/article?p=features/performance_tuning/tunable_parameters.htm 9/21
26/12/2016 CommCell Performance Tuning
The select(2)code has been modified to use the high resolution timer functionality. The applications which use
select(2)and specify small timeouts will timeout right after the specified duration and this will reduce the long
wait time. With this higher resolution, the timer API interfaces can support time intervals less than the current 10
ms. The hires_timeout_enable parameter changes take effect immediately. So it can be done while the server
is up and running.
SQL iDataAgent
You can improve the performance of backup and restore operations by modifying the following parameters for
SQL iDataAgent:
For more information on how to setup these parameters, refer to Enhancing Performance During Backups.
Exchange iDataAgent
Exchange Mailbox data movement operations are constrained by the Microsoft MAPI API which limits data
movement operations to an average of 2GB per hour per stream. This mode of data movement actually logs into
each mailbox and scans each piece of mail as it is delivered to the Inbox.
You can improve the performance of data movement operations by creating multiple subclients. This will enable
parallel data movement operations. However, the cumulative throughput of the Exchange server may decrease if
sufficient system resources are not available. Therefore create user‐defined subclients to divide mailbox backups
into groups based on specific criteria. For more information, refer to Grouping Mailboxes Into User‐Defined
Subclients.
Consider the size of the volume to be protected by the Image Level iDataAgent relative to the size of the extent
to be used. For example, a 512KB extent setting against a backup of 10KB of data is backed up entirely, including
all of the empty blocks of data ﴾502KB of data﴿.
For more information, refer to Change the extent size for Backup Applications.
When you are changing the extent size, keep in mind that:
Backup extent size must be uniform across source and destination computers and not larger than the size of
the source volume.
In a clustered environment, all of the physical nodes must have the same Backup extent size.
Once the disk extent size is reconfigured any incremental and differential backups completed prior to the
reconfiguration are lost. The next data movement operation will be converted to a FULL.
You must restart the client after changing the extent size.
Consider the size of the volume to be protected by the Image Level iDataAgent relative to the size of the extent
to be used. For example, a 512KB extent setting against a backup of 10KB of data is backed up entirely, including
all of the empty blocks of data ﴾502KB of data﴿.
You can change the Disk Extent Size while configuring the CXBF device. For more information, refer to Configure
a CXBF Device in Volume Explorer.
You can also use the following additional setting to change the disk extent size:
Additional
Location Supported Values
Setting
DsnapChunkSi /etc/CommVaultRegistry/Galaxy/Instance<xxx>/ 128, 256, 512, 1024, 2048, 4096, 8192,
ze UnixImageIDA/.properties 16384, 32768, etc. The value must be
power of 2.
When you are changing the extent size, keep in mind that:
Backup extent size must be uniform across source and destination computers and not larger than the size of
the source volume.
In a clustered environment, all of the physical nodes must have the same Backup extent size.
http://documentation.commvault.com/commvault/v10/article?p=features/performance_tuning/tunable_parameters.htm 11/21
26/12/2016 CommCell Performance Tuning
For Image Level backups for Linux or Solaris client servers, the extent size can only be changed when the
CXBF device is configured. To modify the extent size of an existing CXBF device, the server administrator
should first de‐configure the CXBF device and reconfigure with the new extent size.
If the source volume has high levels of disk fragmentation or small average file sizes, use lower values extent
size.
Once the CXBF device is reconfigured any incremental and differential backups completed prior to the
reconfiguration are lost. The next data movement operation will be converted to a FULL.
Oracle iDataAgent
You can improve the performance of backup and restore operations by modifying the following parameters for
Oracle iDataAgent:
Default
Parameter Description
Value
Number of data files and archive files to be 32 Increase the value of this parameter for faster
included in each RMAN backup set backups. However, increasing the value in this
parameter will create additional CPU overhead
in order to optimize the population of the
Archive file. The granular restore of individual
table spaces and data files will be slower.
Number of open data files that can be read by 8 Reduce the value of this parameter for faster
RMAN during the backup backup and less system load on the Oracle
server.
Buffer size used by Oracle agent to transfer 262144 KB Increase the value of this parameter for faster
data to a storage media tape drives or disk libraries.
For Example: For SDLT or LTO tape drives, a
minimum value of 1048576 ﴾1MB﴿ is
recommended.
For more information on how to setup these parameters, refer to Enhancing Backup Performance.
Also, if you are experiencing performance issues during backup, you can troubleshoot them by enabling logging
of performance details in the log files. These performance counters contain information that help in resolving the
performance related issues during backups. See Troubleshooting Performance Issues for more information.
Informix iDataAgent
You can optimize the performance by modifying the following parameters for Informix iDataAgent:
You can also configure the following parameters on the Informix database server:
Parameter Description
BAR_IDLE_TIMEOUT This parameter specifies the maximum number of minutes that an ON‐Bar worker
process is idle before it is shut down.
BAR_MAX_BACKUP This parameter specifies the maximum number of backup processes per ON–Bar
command. You can control parallel execution of ON–Bar processes using this
configuration parameter.
BAR_NB_XPORT_COUNT This parameter specifies the number of shared‐memory data buffers for each
backup or restore process.
BAR_PROGRESS_FREQ This parameter specifies how frequently the backup or restore progress messages
display in the activity log.
LTAPEBLK This parameter specifies the block size for logical‐log backups made with ontape,
onload, onunload.
LTAPEDEV This parameter specifies the tape device used for logical‐log backups made with
ontape.
TAPESIZE This parameter specifies tape size for logical‐log backups made with ontape.
DB2 iDataAgent
The following options are available for enhancing the backup performance and reducing the network bandwidth
used for performing the backups.
The configured values have a direct impact on the DB2 performance. The DB2 client computer must also be
considered when you assign values to these parameters.
When you set the values to a higher number, the operations use more of the client computer memory. The
performance is reduced on computers that cannot handle higher memory usage.
The number of sessions is limited by the number of streams configured at the storage policy level. If the tape
drives are not available at Simpana media library when a backup is directed to the tape storage pool, some of the
sessions will have to wait until the tape mounts are free and available again.
http://documentation.commvault.com/commvault/v10/article?p=features/performance_tuning/tunable_parameters.htm 13/21
26/12/2016 CommCell Performance Tuning
This value is used as the buffer allocation size in pages ﴾4 KB﴿ when you build the backup image. When backing
up a database, the data is first copied to an internal buffer. Data is then written from this buffer to the backup
media when the buffer is full. Tuning BACKBUFSZ can help improve the performance of the Simpana backup
utility as well as minimize the impact on the performance of other concurrent database operations.
Use a buffer size that is a multiple of the extent size. If multiple table spaces have different extent sizes, the buffer
size value must be a multiple of the largest extent size.
If the DB2 database contains large number of tablespaces and indexes, you can perform backups and restores
faster when you set a maximum number of concurrent parallelism queries to take advantage of available
Input/Output bandwidth and processor power of DB2 server. DB2's query parallelism targets Input/Output
intensive queries for example, tablespace scans, large index scans etc.﴿ and CPU intensive queries ﴾for example,
joins, sorts, complex expressions etc.﴿. If the number is not set, the optimal value is automatically chosen. When
you set this parameter, it can reduce the time required to complete the backup ﴾specially, if the backup is going
to a disk﴿.
This parameter defines the number ﴾n﴿ of processes that are started to read the data from the database. A
specific table space is assigned to backup as part of each process. When it completes the tablespace backup, it
requests another. If you are trying to backup to different targets ﴾for example, using multiple sessions to send
the data﴿, parallelism should not be greater than the number of targets ﴾sessions﴿.
http://documentation.commvault.com/commvault/v10/article?p=features/performance_tuning/tunable_parameters.htm 14/21
26/12/2016 CommCell Performance Tuning
If the tape is attached to a NAS client, the indexing operation is completed on the MediaAgent. Ensure that
the MediaAgent has sufficient memory available for indexing.
Use the syssat command to review the CPU consumption.
When the backup is running, use the following command to fetch information about MediaAgent
performance:
netstat a
The send_q information will determine whether network queues are becoming full.
Do not fill an aggregate more than 90% of capacity, as there is a sharp decline in performance when an
aggregate is too full.
Configure backup volumes or LUNs with 0% fractional reserve, 0% snap reserve, and snapshots disabled.
Refer to NetApp Support TR 3348 for descriptions associated with each of these settings:
http://media.netapp.com/documents/tr‐3348.pdf
When you are configuring a large disk library, maintain individual LUN sizes in 4‐8 TB range. You can scale
down if only a small TB footprint will be used for storage on disk.
If you are using iSCSI LUNs and not Fiber Channel ones, refer to NetApp Support technical report 3749 for
additional background: http://media.netapp.com/documents/tr‐3749.pdf . This report provides
information regarding NetApp performance and LAN configuration that can help you with the CommVault
MediaAgent configuration.
Do not Thin provision LUNs or Volumes that are disk library mount points. This increases the write overhead
on the NetApp appliance. When backups are running, the controllers are allocating space for the volume at
the same time as the write operations are occurring.
Before performing the Direct Access Restore, refer to FAQs for NAS iDataAgent.
Create multiple subclients before performing the backup.
Do not use the nRESTORELIMIT additional setting to improve the performance of restore operation for
NetApp File Server. When you are restoring a single directory, the list of items to restore contains one entry.
The nRESTORELIMIT is used to change the number of items sent in each restore request. The default value is
8192 entries. Therefore, unless the you select more than 8192 items for restore there is no need to use the
nRESTORELIMIT key.
Auxiliary Copy
You can improve the performance of Auxiliary Copy operations using the following guidelines:
Configuring an Alert
The Auxiliary copy operation enables you to create a secondary copies of data associated with a storage policy.
When the data to be copied exceeds a specific threshold or if the data is not copied for specific number of days,
http://documentation.commvault.com/commvault/v10/article?p=features/performance_tuning/tunable_parameters.htm 15/21
26/12/2016 CommCell Performance Tuning
you can receive a notification. Once you receive the notification, you can optimize and troubleshoot the auxiliary
copy operation.
You can enable an alert to receive the notification and set the thresholds. For more information, refer to Auxiliary
Copy ‐ Alert.
You can select the method of encryption from several algorithms and key length options. For more information
about Configuration options, refer to Data Encryption.
It is recommended to select specific data from a client for encryption, instead of performing bulk encryption for
the client. Do not encrypt Windows executable and programs and similar object types.
Note:
These settings consume large amounts of memory on the MediaAgents. Therefore, we do not recommend these
settings for low‐speed networks.
http://documentation.commvault.com/commvault/v10/article?p=features/performance_tuning/tunable_parameters.htm 16/21
26/12/2016 CommCell Performance Tuning
Check that Cloud performance‐specific additional settings are set correctly on the MediaAgent. Check the list
below for Backup and Restore.
Check the Storage Policy copy > Data Path property > set Chunk size to 2 GB.
Check the Storage Policy copy > Data Path property > Set Block size to 1024 Kb.
Check that the Number of Streams is set to 10 or higher in the Storage Policy properties.
Check the Subclient property > Number of Data Readers are set to a higher value ﴾for example, 10﴿ and
select the Allow multiple data readers within a drive or mount point check box.
Backup Jobs
Enabling or Disabling the Temp File for Upload
Value 0 is for memory buffer.
Restore Jobs
Enabling or Disabling the Temp File for Downloads
Value 0 is for memory buffer.
7. Click OK.
Reduce the fragmentation to 128MB. For more information refer to Reduce Fragmentation of Data on a
Mount Path.
Do not modify the value of the additional setting nNumPipelineBuffers.
Set the block size between 256 KB to 512 KB
Optimize the MediaAgent for LAN free backup. For more information, refer to Best Practices for Shared Disk
Libraries.
Enable TCP Offload engine on the HBA.
Deploy multiple 10GB ports on a MediaAgent. One port will be available for client input traffic and one port
of Disk Library output traffic.
© 1997‐ 2016 Commvault Systems® Inc. All Rights Reserved.
http://documentation.commvault.com/commvault/v10/article?p=features/performance_tuning/tunable_parameters.htm 19/21
26/12/2016 CommCell Performance Tuning
http://documentation.commvault.com/commvault/v10/article?p=features/performance_tuning/tunable_parameters.htm 20/21
26/12/2016 CommCell Performance Tuning
http://documentation.commvault.com/commvault/v10/article?p=features/performance_tuning/tunable_parameters.htm 21/21