Azure MS Docs PDF
Azure MS Docs PDF
Azure MS Docs PDF
Azure Virtual Machines (VM ) is one of several types of on-demand, scalable computing resources that Azure
offers. Typically, you choose a VM when you need more control over the computing environment than the other
choices offer. This article gives you information about what you should consider before you create a VM, how you
create it, and how you manage it.
An Azure VM gives you the flexibility of virtualization without having to buy and maintain the physical hardware
that runs it. However, you still need to maintain the VM by performing tasks, such as configuring, patching, and
installing the software that runs on it.
Azure virtual machines can be used in various ways. Some examples are:
Development and test – Azure VMs offer a quick and easy way to create a computer with specific
configurations required to code and test an application.
Applications in the cloud – Because demand for your application can fluctuate, it might make economic
sense to run it on a VM in Azure. You pay for extra VMs when you need them and shut them down when you
don’t.
Extended datacenter – Virtual machines in an Azure virtual network can easily be connected to your
organization’s network.
The number of VMs that your application uses can scale up and out to whatever is required to meet your needs.
METHOD DESCRIPTION
Azure portal Select a location from the list when you create a VM.
VM size
The size of the VM that you use is determined by the workload that you want to run. The size that you choose then
determines factors such as processing power, memory, and storage capacity. Azure offers a wide variety of sizes to
support many types of uses.
Azure charges an hourly price based on the VM’s size and operating system. For partial hours, Azure charges only
for the minutes used. Storage is priced and charged separately.
VM Limits
Your subscription has default quota limits in place that could impact the deployment of many VMs for your
project. The current limit on a per subscription basis is 20 VMs per region. Limits can be raised by filing a support
ticket requesting an increase
Operating system disks and images
Virtual machines use virtual hard disks (VHDs) to store their operating system (OS ) and data. VHDs are also used
for the images you can choose from to install an OS.
Azure provides many marketplace images to use with various versions and types of Windows Server operating
systems. Marketplace images are identified by image publisher, offer, sku, and version (typically version is specified
as latest). Only 64-bit operating systems are supported. For more information on the supported guest operating
systems, roles, and features, see Microsoft server software support for Microsoft Azure virtual machines .
This table shows some ways that you can find the information for an image.
METHOD DESCRIPTION
Azure portal The values are automatically specified for you when you select
an image to use.
METHOD ARTICLE
Azure portal Create a virtual machine running Windows using the portal
You hope it never happens, but occasionally something goes wrong. If this situation happens to you, look at the
information in Troubleshoot Resource Manager deployment issues with creating a Windows virtual machine in
Azure.
METHOD DESCRIPTION
Azure portal On the hub menu, click Virtual Machines and then select the
VM from the list. On the blade for the VM, you have access to
overview information, setting values, and monitoring metrics.
Azure PowerShell For information about using PowerShell to manage VMs, see
Create and manage Windows VMs with the Azure PowerShell
module.
Client SDKs For information about using C# to manage VMs, see Manage
Azure Virtual Machines using Azure Resource Manager and
C#.
Azure CLI For information about using Azure CLI to manage VMs, see
Azure CLI Reference.
Log on to the VM
You use the Connect button in the Azure portal to start a Remote Desktop (RDP ) session. Things can sometimes
go wrong when trying to use a remote connection. If this situation happens to you, check out the help information
in Troubleshoot Remote Desktop connections to an Azure virtual machine running Windows.
Manage availability
It’s important for you to understand how to ensure high availability for your application. This configuration
involves creating multiple VMs to ensure that at least one is running.
In order for your deployment to qualify for our 99.95 VM Service Level Agreement, you need to deploy two or
more VMs running your workload inside an availability set. This configuration ensures your VMs are distributed
across multiple fault domains and are deployed onto hosts with different maintenance windows. The full Azure
SLA explains the guaranteed availability of Azure as a whole.
Back up the VM
A Recovery Services vault is used to protect data and assets in both Azure Backup and Azure Site Recovery
services. You can use a Recovery Services vault to deploy and manage backups for Resource Manager-deployed
VMs using PowerShell.
Next steps
If your intent is to work with Linux VMs, look at Azure and Linux.
Learn more about the guidelines around setting up your infrastructure in the Example Azure infrastructure
walkthrough.
Quickstart: Create a Windows virtual machine in the
Azure portal
10/5/2018 • 2 minutes to read • Edit Online
Azure virtual machines (VMs) can be created through the Azure portal. This method provides a browser-based
user interface to create VMs and their associated resources. This quickstart shows you how to use the Azure
portal to deploy a virtual machine (VM ) in Azure that runs Windows Server 2016. To see your VM in action, you
then RDP to the VM and install the IIS web server.
If you don't have an Azure subscription, create a free account before you begin.
Sign in to Azure
Sign in to the Azure portal at https://portal.azure.com.
4. Under Instance details, type myVM for the Virtual machine name and choose East US for your
Location. Leave the other defaults.
5. Under Administrator account, provide a username, such as azureuser and a password. The password
must be at least 12 characters long and meet the defined complexity requirements.
6. Under Inbound port rules, choose Allow selected ports and then select RDP (3389) and HTTP from
the drop-down.
7. Leave the remaining defaults and then select the Review + create button at the bottom of the page.
Next steps
In this quickstart, you deployed a simple virtual machine, open a network port for web traffic, and installed a basic
web server. To learn more about Azure virtual machines, continue to the tutorial for Windows VMs.
Azure Windows virtual machine tutorials
Quickstart: Create a Windows virtual machine in
Azure with PowerShell
10/5/2018 • 3 minutes to read • Edit Online
The Azure PowerShell module is used to create and manage Azure resources from the PowerShell command line
or in scripts. This quickstart shows you how to use the Azure PowerShell module to deploy a virtual machine (VM )
in Azure that runs Windows Server 2016. To see your VM in action, you then RDP to the VM and install the IIS
web server.
If you don't have an Azure subscription, create a free account before you begin.
New-AzureRmVm `
-ResourceGroupName "myResourceGroup" `
-Name "myVM" `
-Location "East US" `
-VirtualNetworkName "myVnet" `
-SubnetName "mySubnet" `
-SecurityGroupName "myNetworkSecurityGroup" `
-PublicIpAddressName "myPublicIpAddress" `
-OpenPorts 80,3389
Connect to virtual machine
After the deployment has completed, RDP to the VM. To see your VM in action, the IIS web server is then
installed.
To see the public IP address of the VM, use the Get-AzureRmPublicIpAddress cmdlet:
Use the following command to create a remote desktop session from your local computer. Replace the IP address
with the public IP address of your VM.
mstsc /v:publicIpAddress
In the Windows Security window, select More choices, and then select Use a different account. Type the
username as localhost\username, enter password you created for the virtual machine, and then click OK.
You may receive a certificate warning during the sign-in process. Click Yes or Continue to create the connection
Next steps
In this quickstart, you deployed a simple virtual machine, open a network port for web traffic, and installed a basic
web server. To learn more about Azure virtual machines, continue to the tutorial for Windows VMs.
Azure Windows virtual machine tutorials
Quickstart: Create a Windows virtual machine with
the Azure CLI
9/24/2018 • 3 minutes to read • Edit Online
The Azure CLI is used to create and manage Azure resources from the command line or in scripts. This quickstart
shows you how to use the Azure CLI to deploy a virtual machine (VM ) in Azure that runs Windows Server 2016.
To see your VM in action, you then RDP to the VM and install the IIS web server.
If you don't have an Azure subscription, create a free account before you begin.
If you choose to install and use the CLI locally, this quickstart requires that you are running the Azure CLI version
2.0.30 or later. Run az --version to find the version. If you need to install or upgrade, see Install Azure CLI.
It takes a few minutes to create the VM and supporting resources. The following example output shows the VM
create operation was successful.
{
"fqdns": "",
"id":
"/subscriptions/<guid>/resourceGroups/myResourceGroup/providers/Microsoft.Compute/virtualMachines/myVM",
"location": "eastus",
"macAddress": "00-0D-3A-23-9A-49",
"powerState": "VM running",
"privateIpAddress": "10.0.0.4",
"publicIpAddress": "52.174.34.95",
"resourceGroup": "myResourceGroup"
}
Note your own publicIpAddress in the output from your VM. This address is used to access the VM in the next
steps.
mstsc /v:publicIpAddress
Next steps
In this quickstart, you deployed a simple virtual machine, open a network port for web traffic, and installed a basic
web server. To learn more about Azure virtual machines, continue to the tutorial for Windows VMs.
Azure Windows virtual machine tutorials
Tutorial: Create and Manage Windows VMs with
Azure PowerShell
10/17/2018 • 7 minutes to read • Edit Online
Azure virtual machines provide a fully configurable and flexible computing environment. This tutorial covers basic
Azure virtual machine deployment items such as selecting a VM size, selecting a VM image, and deploying a VM.
You learn how to:
Create and connect to a VM
Select and use VM images
View and use specific VM sizes
Resize a VM
View and understand VM state
Click the Cloud Shell button on the menu in the upper right
of the Azure portal.
If you choose to install and use the PowerShell locally, this tutorial requires the Azure PowerShell module version
5.7.0 or later. Run Get-Module -ListAvailable AzureRM to find the version. If you need to upgrade, see Install Azure
PowerShell module. If you are running PowerShell locally, you also need to run Connect-AzureRmAccount to create
a connection with Azure.
The resource group is specified when creating or modifying a VM, which can be seen throughout this tutorial.
Create virtual machine
When creating a virtual machine, several options are available such as operating system image, network
configuration, and administrative credentials. In this example, a virtual machine is created with a name of myVM
running the default latest version of Windows Server 2016 Datacenter.
Set the username and password needed for the administrator account on the virtual machine with Get-Credential:
$cred = Get-Credential
New-AzureRmVm `
-ResourceGroupName "myResourceGroupVM" `
-Name "myVM" `
-Location "EastUS" `
-VirtualNetworkName "myVnet" `
-SubnetName "mySubnet" `
-SecurityGroupName "myNetworkSecurityGroup" `
-PublicIpAddressName "myPublicIpAddress" `
-Credential $cred
Connect to VM
After the deployment has completed, create a remote desktop connection with the virtual machine.
Run the following commands to return the public IP address of the virtual machine. Take note of this IP Address
so you can connect to it with your browser to test web connectivity in a future step.
Use the following command, on your local machine, to create a remote desktop session with the virtual machine.
Replace the IP address with the publicIPAddress of your virtual machine. When prompted, enter the credentials
used when creating the virtual machine.
mstsc /v:<publicIpAddress>
In the Windows Security window, select More choices and then Use a different account. Type the username
and password you created for the virtual machine and then click OK.
Understand VM images
The Azure marketplace includes many virtual machine images that can be used to create a new virtual machine.
In the previous steps, a virtual machine was created using the Windows Server 2016 Datacenter image. In this
step, the PowerShell module is used to search the marketplace for other Windows images, which can also be used
as a base for new VMs. This process consists of finding the publisher, offer, SKU, and optionally a version number
to identify the image.
Use the Get-AzureRmVMImagePublisher command to return a list of image publishers:
Use the Get-AzureRmVMImageOffer to return a list of image offers. With this command, the returned list is
filtered on the specified publisher:
The Get-AzureRmVMImageSku command will then filter on the publisher and offer name to return a list of
image names.
This information can be used to deploy a VM with a specific image. This example deploys a virtual machine using
the latest version of a Windows Server 2016 with Containers image.
New-AzureRmVm `
-ResourceGroupName "myResourceGroupVM" `
-Name "myVM2" `
-Location "EastUS" `
-VirtualNetworkName "myVnet" `
-SubnetName "mySubnet" `
-SecurityGroupName "myNetworkSecurityGroup" `
-PublicIpAddressName "myPublicIpAddress2" `
-ImageName "MicrosoftWindowsServer:WindowsServer:2016-Datacenter-with-Containers:latest" `
-Credential $cred `
-AsJob
The -AsJob parameter creates the VM as a background task, so the PowerShell prompts return to you. You can
view details of background jobs with the Get-Job cmdlet.
Understand VM sizes
A virtual machine size determines the amount of compute resources such as CPU, GPU, and memory that are
made available to the virtual machine. Virtual machines need to be created with a size appropriate for the expect
workload. If workload increases, an existing virtual machine can be resized.
VM Sizes
The following table categorizes sizes into use cases.
General purpose Dsv3, Dv3, DSv2, Dv2, DS, D, Av2, A0- Balanced CPU-to-memory. Ideal for
7 dev / test and small to medium
applications and data solutions.
Memory optimized Esv3, Ev3, M, GS, G, DSv2, DS, Dv2, D High memory-to-core. Great for
relational databases, medium to large
caches, and in-memory analytics.
Resize a VM
After a VM has been deployed, it can be resized to increase or decrease resource allocation.
Before resizing a VM, check if the desired size is available on the current VM cluster. The Get-AzureRmVMSize
command returns a list of sizes.
If the desired size is available, the VM can be resized from a powered-on state, however it is rebooted during the
operation.
If the desired size is not on the current cluster, the VM needs to be deallocated before the resize operation can
occur. Note, when the VM is powered back on, any data on the temp disk are removed, and the public IP address
change unless a static IP address is being used.
Stop-AzureRmVM -ResourceGroupName "myResourceGroupVM" -Name "myVM" -Force
$vm = Get-AzureRmVM -ResourceGroupName "myResourceGroupVM" -VMName "myVM"
$vm.HardwareProfile.VmSize = "Standard_F4s"
Update-AzureRmVM -VM $vm -ResourceGroupName "myResourceGroupVM"
Start-AzureRmVM -ResourceGroupName "myResourceGroupVM" -Name $vm.name
VM power states
An Azure VM can have one of many power states. This state represents the current state of the VM from the
standpoint of the hypervisor.
Power states
POWER STATE DESCRIPTION
Get-AzureRmVM `
-ResourceGroupName "myResourceGroupVM" `
-Name "myVM" `
-Status | Select @{n="Status"; e={$_.Statuses[1].Code}}
Output:
Status
------
PowerState/running
Management tasks
During the lifecycle of a virtual machine, you may want to run management tasks such as starting, stopping, or
deleting a virtual machine. Additionally, you may want to create scripts to automate repetitive or complex tasks.
Using Azure PowerShell, many common management tasks can be run from the command line or in scripts.
Stop virtual machine
Stop and deallocate a virtual machine with Stop-AzureRmVM:
If you want to keep the virtual machine in a provisioned state, use the -StayProvisioned parameter.
Start virtual machine
Next steps
In this tutorial, you learned about basic VM creation and management such as how to:
Create and connect to a VM
Select and use VM images
View and use specific VM sizes
Resize a VM
View and understand VM state
Advance to the next tutorial to learn about VM disks.
Create and Manage VM disks
Tutorial - Manage Azure disks with Azure PowerShell
10/8/2018 • 5 minutes to read • Edit Online
Azure virtual machines use disks to store the VMs operating system, applications, and data. When creating a VM it
is important to choose a disk size and configuration appropriate to the expected workload. This tutorial covers
deploying and managing VM disks. You learn about:
OS disks and temporary disks
Data disks
Standard and Premium disks
Disk performance
Attaching and preparing data disks
Click the Cloud Shell button on the menu in the upper right
of the Azure portal.
If you choose to install and use the PowerShell locally, this tutorial requires the Azure PowerShell module version
5.7.0 or later. Run Get-Module -ListAvailable AzureRM to find the version. If you need to upgrade, see Install Azure
PowerShell module. If you are running PowerShell locally, you also need to run Connect-AzureRmAccount to create a
connection with Azure.
GPU N series 64
VM disk types
Azure provides two types of disk.
Standard disk
Standard Storage is backed by HDDs, and delivers cost-effective storage while still being performant. Standard
disks are ideal for a cost effective dev and test workload.
Premium disk
Premium disks are backed by SSD -based high-performance, low -latency disk. Perfect for VMs running production
workload. Premium Storage supports DS -series, DSv2-series, GS -series, and FS -series VMs. Premium disks come
in five types (P10, P20, P30, P40, P50), the size of the disk determines the disk type. When selecting, a disk size the
value is rounded up to the next type. For example, if the size is below 128 GB the disk type is P10, or between 129
GB and 512 GB the disk is P20.
Premium disk performance
PREMIUM
STORAGE
DISK TYPE P4 P6 P10 P20 P30 P40 P50
Throughput 25 MB/s 50 MB/s 100 MB/s 150 MB/s 200 MB/s 250 MB/s 250 MB/s
per disk
While the above table identifies max IOPS per disk, a higher level of performance can be achieved by striping
multiple data disks. For instance, 64 data disks can be attached to Standard_GS5 VM. If each of these disks are
sized as a P30, a maximum of 80,000 IOPS can be achieved. For detailed information on max IOPS per VM, see
VM types and sizes.
$cred = Get-Credential
New-AzureRmVm `
-ResourceGroupName "myResourceGroupDisk" `
-Name "myVM" `
-Location "East US" `
-VirtualNetworkName "myVnet" `
-SubnetName "mySubnet" `
-SecurityGroupName "myNetworkSecurityGroup" `
-PublicIpAddressName "myPublicIpAddress" `
-Credential $cred `
-AsJob
The -AsJob parameter creates the VM as a background task, so the PowerShell prompts return to you. You can
view details of background jobs with the Job cmdlet.
Create the initial configuration with New -AzureRmDiskConfig. The following example configures a disk that is 128
gigabytes in size.
$diskConfig = New-AzureRmDiskConfig `
-Location "EastUS" `
-CreateOption Empty `
-DiskSizeGB 128
Get the virtual machine that you want to add the data disk to with the Get-AzureRmVM command.
Add the data disk to the virtual machine configuration with the Add-AzureRmVMDataDisk command.
$vm = Add-AzureRmVMDataDisk `
-VM $vm `
-Name "myDataDisk" `
-CreateOption Attach `
-ManagedDiskId $dataDisk.Id `
-Lun 1
Next steps
In this tutorial, you learned about VM disks topics such as:
OS disks and temporary disks
Data disks
Standard and Premium disks
Disk performance
Attaching and preparing data disks
Advance to the next tutorial to learn about automating VM configuration.
Automate VM configuration
Tutorial - Deploy applications to a Windows virtual
machine in Azure with the Custom Script Extension
10/19/2018 • 3 minutes to read • Edit Online
To configure virtual machines (VMs) in a quick and consistent manner, some form of automation is typically
desired. A common approach to customize a Windows VM is to use Custom Script Extension for Windows. In this
tutorial you learn how to:
Use the Custom Script Extension to install IIS
Create a VM that uses the Custom Script Extension
View a running IIS site after the extension is applied
Click the Cloud Shell button on the menu in the upper right
of the Azure portal.
If you choose to install and use the PowerShell locally, this tutorial requires the Azure PowerShell module version
5.7.0 or later. Run Get-Module -ListAvailable AzureRM to find the version. If you need to upgrade, see Install Azure
PowerShell module. If you are running PowerShell locally, you also need to run Connect-AzureRmAccount to create
a connection with Azure.
Now you can create the VM with New -AzureRmVM. The following example creates a VM named myVM in the
EastUS location. If they do not already exist, the resource group myResourceGroupAutomate and supporting
network resources are created. To allow web traffic, the cmdlet also opens port 80.
New-AzureRmVm `
-ResourceGroupName "myResourceGroupAutomate" `
-Name "myVM" `
-Location "East US" `
-VirtualNetworkName "myVnet" `
-SubnetName "mySubnet" `
-SecurityGroupName "myNetworkSecurityGroup" `
-PublicIpAddressName "myPublicIpAddress" `
-OpenPorts 80 `
-Credential $cred
Get-AzureRmPublicIPAddress `
-ResourceGroupName "myResourceGroupAutomate" `
-Name "myPublicIPAddress" | select IpAddress
You can then enter the public IP address in to a web browser. The website is displayed, including the hostname of
the VM that the load balancer distributed traffic to as in the following example:
Next steps
In this tutorial, you automated the IIS install on a VM. You learned how to:
Use the Custom Script Extension to install IIS
Create a VM that uses the Custom Script Extension
View a running IIS site after the extension is applied
Advance to the next tutorial to learn how to create custom VM images.
Create custom VM images
Tutorial: Create a custom image of an Azure VM with
Azure PowerShell
7/3/2018 • 3 minutes to read • Edit Online
Custom images are like marketplace images, but you create them yourself. Custom images can be used to
bootstrap configurations such as preloading applications, application configurations, and other OS configurations.
In this tutorial, you create your own custom image of an Azure virtual machine. You learn how to:
Sysprep and generalize VMs
Create a custom image
Create a VM from a custom image
List all the images in your subscription
Delete an image
Click the Cloud Shell button on the menu in the upper right
of the Azure portal.
If you choose to install and use the PowerShell locally, this tutorial requires the AzureRM module version 5.7.0 or
later. Run Get-Module -ListAvailable AzureRM to find the version. If you need to upgrade, see Install Azure
PowerShell module.
Prepare VM
To create an image of a virtual machine, you need to prepare the VM by generalizing the VM, deallocating, and
then marking the source VM as generalized in Azure.
Generalize the Windows VM using Sysprep
Sysprep removes all your personal account information, among other things, and prepares the machine to be used
as an image. For details about Sysprep, see How to Use Sysprep: An Introduction.
1. Connect to the virtual machine.
2. Open the Command Prompt window as an administrator. Change the directory to
%windir%\system32\sysprep, and then run sysprep.exe.
3. In the System Preparation Tool dialog box, select Enter System Out-of-Box Experience (OOBE ), and make
sure that the Generalize check box is selected.
4. In Shutdown Options, select Shutdown and then click OK.
5. When Sysprep completes, it shuts down the virtual machine. Do not restart the VM.
Deallocate and mark the VM as generalized
To create an image, the VM needs to be deallocated and marked as generalized in Azure.
Deallocated the VM using Stop-AzureRmVM.
group.
This example creates a VM named myVMfromImage from the myImage, in the myResourceGroup.
New-AzureRmVm `
-ResourceGroupName "myResourceGroup" `
-Name "myVMfromImage" `
-ImageName "myImage" `
-Location "East US" `
-VirtualNetworkName "myImageVnet" `
-SubnetName "myImageSubnet" `
-SecurityGroupName "myImageNSG" `
-PublicIpAddressName "myImagePIP" `
-OpenPorts 3389
Image management
Here are some examples of common managed image tasks and how to complete them using PowerShell.
List all images by name.
Delete an image. This example deletes the image named myOldImage from the myResourceGroup.
Remove-AzureRmImage `
-ImageName myOldImage `
-ResourceGroupName myResourceGroup
Next steps
In this tutorial, you created a custom VM image. You learned how to:
Sysprep and generalize VMs
Create a custom image
Create a VM from a custom image
List all the images in your subscription
Delete an image
Advance to the next tutorial to learn about how highly available virtual machines.
Create highly available VMs
Tutorial: Create and deploy highly available virtual
machines with Azure PowerShell
10/19/2018 • 5 minutes to read • Edit Online
In this tutorial, you learn how to increase the availability and reliability of your Virtual Machine solutions on Azure
using a capability called Availability Sets. Availability sets ensure that the VMs you deploy on Azure are distributed
across multiple isolated hardware nodes in a cluster. Doing this ensures that if a hardware or software failure
within Azure happens, only a subset of your VMs are impacted and that your overall solution remains available
and operational.
In this tutorial, you learn how to:
Create an availability set
Create a VM in an availability set
Check available VM sizes
Check Azure Advisor
Click the Cloud Shell button on the menu in the upper right
of the Azure portal.
If you choose to install and use the PowerShell locally, this tutorial requires the Azure PowerShell module version
5.7.0 or later. Run Get-Module -ListAvailable AzureRM to find the version. If you need to upgrade, see Install Azure
PowerShell module. If you are running PowerShell locally, you also need to run Connect-AzureRmAccount to create
a connection with Azure.
Create a managed availability set using New -AzureRmAvailabilitySet with the -sku aligned parameter.
New-AzureRmAvailabilitySet `
-Location "EastUS" `
-Name "myAvailabilitySet" `
-ResourceGroupName "myResourceGroupAvailability" `
-Sku aligned `
-PlatformFaultDomainCount 2 `
-PlatformUpdateDomainCount 2
$cred = Get-Credential
Now create two VMs with New -AzureRmVM in the availability set.
for ($i=1; $i -le 2; $i++)
{
New-AzureRmVm `
-ResourceGroupName "myResourceGroupAvailability" `
-Name "myVM$i" `
-Location "East US" `
-VirtualNetworkName "myVnet" `
-SubnetName "mySubnet" `
-SecurityGroupName "myNetworkSecurityGroup" `
-PublicIpAddressName "myPublicIpAddress$i" `
-AvailabilitySetName "myAvailabilitySet" `
-Credential $cred
}
The -AsJob parameter creates the VM as a background task, so the PowerShell prompts return to you. You can
view details of background jobs with the Job cmdlet. It takes a few minutes to create and configure both VMs.
When finished, you have two virtual machines distributed across the underlying hardware.
If you look at the availability set in the portal by going to Resource Groups > myResourceGroupAvailability >
myAvailabilitySet, you should see how the VMs are distributed across the two fault and update domains.
Get-AzureRmVMSize `
-ResourceGroupName "myResourceGroupAvailability" `
-AvailabilitySetName "myAvailabilitySet"
Next steps
In this tutorial, you learned how to:
Create an availability set
Create a VM in an availability set
Check available VM sizes
Check Azure Advisor
Advance to the next tutorial to learn about virtual machine scale sets.
Create a VM scale set
Tutorial: Create a virtual machine scale set and
deploy a highly available app on Windows with
Azure PowerShell
10/19/2018 • 7 minutes to read • Edit Online
A virtual machine scale set allows you to deploy and manage a set of identical, auto-scaling virtual machines. You
can scale the number of VMs in the scale set manually, or define rules to autoscale based on resource usage such
as CPU, memory demand, or network traffic. In this tutorial, you deploy a virtual machine scale set in Azure. You
learn how to:
Use the Custom Script Extension to define an IIS site to scale
Create a load balancer for your scale set
Create a virtual machine scale set
Increase or decrease the number of instances in a scale set
Create autoscale rules
Click the Cloud Shell button on the menu in the upper right
of the Azure portal.
If you choose to install and use the PowerShell locally, this tutorial requires the Azure PowerShell module version
5.7.0 or later. Run Get-Module -ListAvailable AzureRM to find the version. If you need to upgrade, see Install Azure
PowerShell module. If you are running PowerShell locally, you also need to run Connect-AzureRmAccount to create a
connection with Azure.
New-AzureRmVmss `
-ResourceGroupName "myResourceGroupScaleSet" `
-Location "EastUS" `
-VMScaleSetName "myScaleSet" `
-VirtualNetworkName "myVnet" `
-SubnetName "mySubnet" `
-PublicIpAddressName "myPublicIPAddress" `
-LoadBalancerName "myLoadBalancer" `
-UpgradePolicy "Automatic"
It takes a few minutes to create and configure all the scale set resources and VMs.
# Use Custom Script Extension to install IIS and configure basic website
Add-AzureRmVmssExtension -VirtualMachineScaleSet $vmss `
-Name "customScript" `
-Publisher "Microsoft.Compute" `
-Type "CustomScriptExtension" `
-TypeHandlerVersion 1.8 `
-Setting $publicSettings
# Update the scale set and apply the Custom Script Extension to the VM instances
Update-AzureRmVmss `
-ResourceGroupName "myResourceGroupScaleSet" `
-Name "myScaleSet" `
-VirtualMachineScaleSet $vmss
Get-AzureRmPublicIPAddress `
-ResourceGroupName "myResourceGroupScaleSet" `
-Name "myPublicIPAddress" | select IpAddress
Enter the public IP address in to a web browser. The web app is displayed, including the hostname of the VM that
the load balancer distributed traffic to:
To see the scale set in action, you can force-refresh your web browser to see the load balancer distribute traffic
across all the VMs running your app.
Management tasks
Throughout the lifecycle of the scale set, you may need to run one or more management tasks. Additionally, you
may want to create scripts that automate various lifecycle-tasks. Azure PowerShell provides a quick way to do
those tasks. Here are a few common tasks.
View VMs in a scale set
To view a list of VM instances in a scale set, use Get-AzureRmVmssVM as follows:
The following example output shows two VM instances in the scale set:
To view additional information about a specific VM instance, add the -InstanceId parameter to Get-
AzureRmVmssVM. The following example views information about VM instance 1:
You can then manually increase or decrease the number of virtual machines in the scale set with Update-
AzureRmVmss. The following example sets the number of VMs in your scale set to 3:
If takes a few minutes to update the specified number of instances in your scale set.
Configure autoscale rules
Rather than manually scaling the number of instances in your scale set, you define autoscale rules. These rules
monitor the instances in your scale set and respond accordingly based on metrics and thresholds you define. The
following example scales out the number of instances by one when the average CPU load is greater than 60% over
a 5-minute period. If the average CPU load then drops below 30% over a 5-minute period, the instances are scaled
in by one instance:
# Define your scale set information
$mySubscriptionId = (Get-AzureRmSubscription)[0].Id
$myResourceGroup = "myResourceGroupScaleSet"
$myScaleSet = "myScaleSet"
$myLocation = "East US"
$myScaleSetId = (Get-AzureRmVmss -ResourceGroupName $myResourceGroup -VMScaleSetName $myScaleSet).Id
# Create a scale up rule to increase the number instances after 60% average CPU usage exceeded for a 5-minute
period
$myRuleScaleUp = New-AzureRmAutoscaleRule `
-MetricName "Percentage CPU" `
-MetricResourceId $myScaleSetId `
-Operator GreaterThan `
-MetricStatistic Average `
-Threshold 60 `
-TimeGrain 00:01:00 `
-TimeWindow 00:05:00 `
-ScaleActionCooldown 00:05:00 `
-ScaleActionDirection Increase `
-ScaleActionValue 1
# Create a scale down rule to decrease the number of instances after 30% average CPU usage over a 5-minute
period
$myRuleScaleDown = New-AzureRmAutoscaleRule `
-MetricName "Percentage CPU" `
-MetricResourceId $myScaleSetId `
-Operator LessThan `
-MetricStatistic Average `
-Threshold 30 `
-TimeGrain 00:01:00 `
-TimeWindow 00:05:00 `
-ScaleActionCooldown 00:05:00 `
-ScaleActionDirection Decrease `
-ScaleActionValue 1
# Create a scale profile with your scale up and scale down rules
$myScaleProfile = New-AzureRmAutoscaleProfile `
-DefaultCapacity 2 `
-MaximumCapacity 10 `
-MinimumCapacity 2 `
-Rule $myRuleScaleUp,$myRuleScaleDown `
-Name "autoprofile"
For more design information on the use of autoscale, see autoscale best practices.
Next steps
In this tutorial, you created a virtual machine scale set. You learned how to:
Use the Custom Script Extension to define an IIS site to scale
Create a load balancer for your scale set
Create a virtual machine scale set
Increase or decrease the number of instances in a scale set
Create autoscale rules
Advance to the next tutorial to learn more about load balancing concepts for virtual machines.
Load balance virtual machines
Tutorial: Load balance Windows virtual machines in
Azure to create a highly available application with
Azure PowerShell
10/19/2018 • 8 minutes to read • Edit Online
Load balancing provides a higher level of availability by spreading incoming requests across multiple virtual
machines. In this tutorial, you learn about the different components of the Azure load balancer that distribute
traffic and provide high availability. You learn how to:
Create an Azure load balancer
Create a load balancer health probe
Create load balancer traffic rules
Use the Custom Script Extension to create a basic IIS site
Create virtual machines and attach to a load balancer
View a load balancer in action
Add and remove VMs from a load balancer
Click the Cloud Shell button on the menu in the upper right
of the Azure portal.
If you choose to install and use the PowerShell locally, this tutorial requires the Azure PowerShell module version
5.7.0 or later. Run Get-Module -ListAvailable AzureRM to find the version. If you need to upgrade, see Install Azure
PowerShell module. If you are running PowerShell locally, you also need to run Connect-AzureRmAccount to create
a connection with Azure.
New-AzureRmResourceGroup `
-ResourceGroupName "myResourceGroupLoadBalancer" `
-Location "EastUS"
$publicIP = New-AzureRmPublicIpAddress `
-ResourceGroupName "myResourceGroupLoadBalancer" `
-Location "EastUS" `
-AllocationMethod "Static" `
-Name "myPublicIP"
$frontendIP = New-AzureRmLoadBalancerFrontendIpConfig `
-Name "myFrontEndPool" `
-PublicIpAddress $publicIP
Create a backend address pool with New -AzureRmLoadBalancerBackendAddressPoolConfig. The VMs attach to
this backend pool in the remaining steps. The following example creates a backend address pool named
myBackEndPool:
Now, create the load balancer with New -AzureRmLoadBalancer. The following example creates a load balancer
named myLoadBalancer using the frontend and backend IP pools created in the preceding steps:
$lb = New-AzureRmLoadBalancer `
-ResourceGroupName "myResourceGroupLoadBalancer" `
-Name "myLoadBalancer" `
-Location "EastUS" `
-FrontendIpConfiguration $frontendIP `
-BackendAddressPool $backendPool
Add-AzureRmLoadBalancerProbeConfig `
-Name "myHealthProbe" `
-LoadBalancer $lb `
-Protocol tcp `
-Port 80 `
-IntervalInSeconds 15 `
-ProbeCount 2
To apply the health probe, update the load balancer with Set-AzureRmLoadBalancer:
Add-AzureRmLoadBalancerRuleConfig `
-Name "myLoadBalancerRule" `
-LoadBalancer $lb `
-FrontendIpConfiguration $lb.FrontendIpConfigurations[0] `
-BackendAddressPool $lb.BackendAddressPools[0] `
-Protocol Tcp `
-FrontendPort 80 `
-BackendPort 80 `
-Probe $probe
Virtual NICs are created with New -AzureRmNetworkInterface. The following example creates three virtual NICs.
(One virtual NIC for each VM you create for your app in the following steps). You can create additional virtual
NICs and VMs at any time and add them to the load balancer:
$availabilitySet = New-AzureRmAvailabilitySet `
-ResourceGroupName "myResourceGroupLoadBalancer" `
-Name "myAvailabilitySet" `
-Location "EastUS" `
-Sku aligned `
-PlatformFaultDomainCount 2 `
-PlatformUpdateDomainCount 2
Set an administrator username and password for the VMs with Get-Credential:
$cred = Get-Credential
Now you can create the VMs with New -AzureRmVM. The following example creates three VMs and the required
virtual network components if they do not already exist:
for ($i=1; $i -le 3; $i++)
{
New-AzureRmVm `
-ResourceGroupName "myResourceGroupLoadBalancer" `
-Name "myVM$i" `
-Location "East US" `
-VirtualNetworkName "myVnet" `
-SubnetName "mySubnet" `
-SecurityGroupName "myNetworkSecurityGroup" `
-OpenPorts 80 `
-AvailabilitySetName "myAvailabilitySet" `
-Credential $cred `
-AsJob
}
The -AsJob parameter creates the VM as a background task, so the PowerShell prompts return to you. You can
view details of background jobs with the Job cmdlet. It takes a few minutes to create and configure all three VMs.
Install IIS with Custom Script Extension
In a previous tutorial on How to customize a Windows virtual machine, you learned how to automate VM
customization with the Custom Script Extension for Windows. You can use the same approach to install and
configure IIS on your VMs.
Use Set-AzureRmVMExtension to install the Custom Script Extension. The extension runs
powershell Add-WindowsFeature Web-Server to install the IIS webserver and then updates the Default.htm page to
show the hostname of the VM:
Get-AzureRmPublicIPAddress `
-ResourceGroupName "myResourceGroupLoadBalancer" `
-Name "myPublicIP" | select IpAddress
You can then enter the public IP address in to a web browser. The website is displayed, including the hostname of
the VM that the load balancer distributed traffic to as in the following example:
To see the load balancer distribute traffic across all three VMs running your app, you can force-refresh your web
browser.
$nic = Get-AzureRmNetworkInterface `
-ResourceGroupName "myResourceGroupLoadBalancer" `
-Name "myVM2"
$nic.Ipconfigurations[0].LoadBalancerBackendAddressPools=$null
Set-AzureRmNetworkInterface -NetworkInterface $nic
To see the load balancer distribute traffic across the remaining two VMs running your app you can force-refresh
your web browser. You can now perform maintenance on the VM, such as installing OS updates or performing a
VM reboot.
Add a VM to the load balancer
After performing VM maintenance, or if you need to expand capacity, set the LoadBalancerBackendAddressPools
property of the virtual NIC to the BackendAddressPool from Get-AzureRMLoadBalancer:
Get the load balancer:
$lb = Get-AzureRMLoadBalancer `
-ResourceGroupName myResourceGroupLoadBalancer `
-Name myLoadBalancer
$nic.IpConfigurations[0].LoadBalancerBackendAddressPools=$lb.BackendAddressPools[0]
Set-AzureRmNetworkInterface -NetworkInterface $nic
Next steps
In this tutorial, you created a load balancer and attached VMs to it. You learned how to:
Create an Azure load balancer
Create a load balancer health probe
Create load balancer traffic rules
Use the Custom Script Extension to create a basic IIS site
Create virtual machines and attach to a load balancer
View a load balancer in action
Add and remove VMs from a load balancer
Advance to the next tutorial to learn how to manage VM networking.
Manage VMs and virtual networks
Tutorial: Create and manage Azure virtual networks
for Windows virtual machines with Azure PowerShell
7/18/2018 • 7 minutes to read • Edit Online
Azure virtual machines use Azure networking for internal and external network communication. This tutorial walks
through deploying two virtual machines and configuring Azure networking for these VMs. The examples in this
tutorial assume that the VMs are hosting a web application with a database back-end, however an application is
not deployed in the tutorial. In this tutorial, you learn how to:
Create a virtual network and subnet
Create a public IP address
Create a front-end VM
Secure network traffic
Create back-end VM
Click the Cloud Shell button on the menu in the upper right
of the Azure portal.
If you choose to install and use the PowerShell locally, this tutorial requires the Azure PowerShell module version
5.7.0 or later. Run Get-Module -ListAvailable AzureRM to find the version. If you need to upgrade, see Install Azure
PowerShell module. If you are running PowerShell locally, you also need to run Connect-AzureRmAccount to create a
connection with Azure.
VM networking overview
Azure virtual networks enable secure network connections between virtual machines, the internet, and other Azure
services such as Azure SQL database. Virtual networks are broken down into logical segments called subnets.
Subnets are used to control network flow, and as a security boundary. When deploying a VM, it generally includes
a virtual network interface, which is attached to a subnet.
While completing this tutorial, you can see these resources created:
myVNet - The virtual network that the VMs use to communicate with each other and the internet.
myFrontendSubnet - The subnet in myVNet used by the front-end resources.
myPublicIPAddress - The public IP address used to access myFrontendVM from the internet.
myFrontendNic - The network interface used by myFrontendVM to communicate with myBackendVM.
myFrontendVM - The VM used to communicate between the internet and myBackendVM.
myBackendNSG - The network security group that controls communication between the myFrontendVM and
myBackendVM.
myBackendSubnet - The subnet associated with myBackendNSG and used by the back-end resources.
myBackendNic - The network interface used by myBackendVM to communicate with myFrontendVM.
myBackendVM - The VM that uses port 1433 to communicate with myFrontendVM.
$frontendSubnet = New-AzureRmVirtualNetworkSubnetConfig `
-Name myFrontendSubnet `
-AddressPrefix 10.0.0.0/24
And, create a subnet configuration named myBackendSubnet:
$backendSubnet = New-AzureRmVirtualNetworkSubnetConfig `
-Name myBackendSubnet `
-AddressPrefix 10.0.1.0/24
$vnet = New-AzureRmVirtualNetwork `
-ResourceGroupName myRGNetwork `
-Location EastUS `
-Name myVNet `
-AddressPrefix 10.0.0.0/16 `
-Subnet $frontendSubnet, $backendSubnet
At this point, a network has been created and segmented into two subnets, one for front-end services, and another
for back-end services. In the next section, virtual machines are created and connected to these subnets.
$pip = New-AzureRmPublicIpAddress `
-ResourceGroupName myRGNetwork `
-Location EastUS `
-AllocationMethod Dynamic `
-Name myPublicIPAddress
You could change the -AllocationMethod parameter to Static to assign a static public IP address.
Create a front-end VM
For a VM to communicate in a virtual network, it needs a virtual network interface (NIC ). Create a NIC using
New -AzureRmNetworkInterface:
$frontendNic = New-AzureRmNetworkInterface `
-ResourceGroupName myRGNetwork `
-Location EastUS `
-Name myFrontend `
-SubnetId $vnet.Subnets[0].Id `
-PublicIpAddressId $pip.Id
Set the username and password needed for the administrator account on the VM using Get-Credential. You use
these credentials to connect to the VM in additional steps:
$cred = Get-Credential
New-AzureRmVM `
-Credential $cred `
-Name myFrontend `
-PublicIpAddressName myPublicIPAddress `
-ResourceGroupName myRGNetwork `
-Location "EastUS" `
-Size Standard_D1 `
-SubnetName myFrontendSubnet `
-VirtualNetworkName myVNet
$nsgFrontendRule = New-AzureRmNetworkSecurityRuleConfig `
-Name myFrontendNSGRule `
-Protocol Tcp `
-Direction Inbound `
-Priority 200 `
-SourceAddressPrefix * `
-SourcePortRange * `
-DestinationAddressPrefix * `
-DestinationPortRange 80 `
-Access Allow
You can limit internal traffic to myBackendVM from only myFrontendVM by creating an NSG for the back-end
subnet. The following example creates an NSG rule named myBackendNSGRule:
$nsgBackendRule = New-AzureRmNetworkSecurityRuleConfig `
-Name myBackendNSGRule `
-Protocol Tcp `
-Direction Inbound `
-Priority 100 `
-SourceAddressPrefix 10.0.0.0/24 `
-SourcePortRange * `
-DestinationAddressPrefix * `
-DestinationPortRange 1433 `
-Access Allow
$nsgFrontend = New-AzureRmNetworkSecurityGroup `
-ResourceGroupName myRGNetwork `
-Location EastUS `
-Name myFrontendNSG `
-SecurityRules $nsgFrontendRule
Now, add a network security group named myBackendNSG using New -AzureRmNetworkSecurityGroup:
$nsgBackend = New-AzureRmNetworkSecurityGroup `
-ResourceGroupName myRGNetwork `
-Location EastUS `
-Name myBackendNSG `
-SecurityRules $nsgBackendRule
$vnet = Get-AzureRmVirtualNetwork `
-ResourceGroupName myRGNetwork `
-Name myVNet
$frontendSubnet = $vnet.Subnets[0]
$backendSubnet = $vnet.Subnets[1]
$frontendSubnetConfig = Set-AzureRmVirtualNetworkSubnetConfig `
-VirtualNetwork $vnet `
-Name myFrontendSubnet `
-AddressPrefix $frontendSubnet.AddressPrefix `
-NetworkSecurityGroup $nsgFrontend
$backendSubnetConfig = Set-AzureRmVirtualNetworkSubnetConfig `
-VirtualNetwork $vnet `
-Name myBackendSubnet `
-AddressPrefix $backendSubnet.AddressPrefix `
-NetworkSecurityGroup $nsgBackend
Set-AzureRmVirtualNetwork -VirtualNetwork $vnet
Create a back-end VM
The easiest way to create the back-end VM for this tutorial is by using a SQL Server image. This tutorial only
creates the VM with the database server, but doesn't provide information about accessing the database.
Create myBackendNic:
$backendNic = New-AzureRmNetworkInterface `
-ResourceGroupName myRGNetwork `
-Location EastUS `
-Name myBackend `
-SubnetId $vnet.Subnets[1].Id
Set the username and password needed for the administrator account on the VM with Get-Credential:
$cred = Get-Credential
Create myBackendVM.
New-AzureRmVM `
-Credential $cred `
-Name myBackend `
-ImageName "MicrosoftSQLServer:SQL2016SP1-WS2016:Enterprise:latest" `
-ResourceGroupName myRGNetwork `
-Location "EastUS" `
-SubnetName MyBackendSubnet `
-VirtualNetworkName myVNet
The image that is used has SQL Server installed, but is not used in this tutorial. It is included to show you how you
can configure a VM to handle web traffic and a VM to handle database management.
Next steps
In this tutorial, you created and secured Azure networks as related to virtual machines.
Create a virtual network and subnet
Create a public IP address
Create a front-end VM
Secure network traffic
Create a back-end VM
Advance to the next tutorial to learn about monitoring securing data on virtual machines using Azure backup.
Back up Windows virtual machines in Azure
Tutorial: Back up and restore files for Windows virtual
machines in Azure
4/30/2018 • 4 minutes to read • Edit Online
You can protect your data by taking backups at regular intervals. Azure Backup creates recovery points that are
stored in geo-redundant recovery vaults. When you restore from a recovery point, you can restore the whole VM
or specific files. This article explains how to restore a single file to a VM running Windows Server and IIS. If you
don't already have a VM to use, you can create one using the Windows quickstart. In this tutorial you learn how to:
Create a backup of a VM
Schedule a daily backup
Restore a file from a backup
Backup overview
When the Azure Backup service initiates a backup job, it triggers the backup extension to take a point-in-time
snapshot. The Azure Backup service uses the VMSnapshot extension. The extension is installed during the first VM
backup if the VM is running. If the VM is not running, the Backup service takes a snapshot of the underlying
storage (since no application writes occur while the VM is stopped).
When taking a snapshot of Windows VMs, the Backup service coordinates with the Volume Shadow Copy Service
(VSS ) to get a consistent snapshot of the virtual machine's disks. Once the Azure Backup service takes the
snapshot, the data is transferred to the vault. To maximize efficiency, the service identifies and transfers only the
blocks of data that have changed since the previous backup.
When the data transfer is complete, the snapshot is removed and a recovery point is created.
Create a backup
Create a simple scheduled daily backup to a Recovery Services Vault.
1. Sign in to the Azure portal.
2. In the menu on the left, select Virtual machines.
3. From the list, select a VM to back up.
4. On the VM blade, in the Settings section, click Backup. The Enable backup blade opens.
5. In Recovery Services vault, click Create new and provide the name for the new vault. A new vault is created
in the same Resource Group and location as the virtual machine.
6. Click Backup policy. For this example, keep the defaults and click OK.
7. On the Enable backup blade, click Enable Backup. This creates a daily backup based on the default schedule.
8. To create an initial recovery point, on the Backup blade click Backup now.
9. On the Backup Now blade, click the calendar icon, use the calendar control to select the last day this recovery
point is retained, and click Backup.
10. In the Backup blade for your VM, you see the number of recovery points that are complete.
The first backup takes about 20 minutes. Proceed to the next part of this tutorial after your backup is finished.
Recover a file
If you accidentally delete or make changes to a file, you can use File Recovery to recover the file from your backup
vault. File Recovery uses a script that runs on the VM, to mount the recovery point as local drive. These drives
remain mounted for 12 hours so that you can copy files from the recovery point and restore them to the VM.
In this example, we show how to recover the image file that is used in the default web page for IIS.
1. Open a browser and connect to the IP address of the VM to show the default IIS page.
Next steps
In this tutorial, you learned how to:
Create a backup of a VM
Schedule a daily backup
Restore a file from a backup
Advance to the next tutorial to learn about monitoring virtual machines.
Govern virtual machines
Tutorial: Learn about Windows virtual machine
governance with Azure PowerShell
10/12/2018 • 10 minutes to read • Edit Online
When deploying resources to Azure, you have tremendous flexibility when deciding what types of resources to
deploy, where they are located, and how to set them up. However, that flexibility may open more options than you
would like to allow in your organization. As you consider deploying resources to Azure, you might be wondering:
How do I meet legal requirements for data sovereignty in certain countries?
How do I control costs?
How do I ensure that someone does not inadvertently change a critical system?
How do I track resource costs and bill it accurately?
This article addresses those questions. Specifically, you:
Assign users to roles and assign the roles to a scope so users have permission to perform expected actions but
not more actions.
Apply policies that prescribe conventions for resources in your subscription.
Lock resources that are critical to your system.
Tag resources so you can track them by values that make sense to your organization.
This article focuses on the tasks you take to implement governance. For a broader discussion of the concepts, see
Governance in Azure.
Click the Cloud Shell button on the menu in the upper right
of the Azure portal.
The examples in this article require version 6.0 or later of Azure PowerShell. If you're running PowerShell locally
and you don't have version 6.0 or later, update your version. You also need to run Connect-AzureRmAccount to create
a connection with Azure. For local installations, you must also download the Azure AD PowerShell module to
create a new Azure Active Directory group.
Understand scope
Before creating any items, let's review the concept of scope. Azure provides four levels of management:
management groups, subscription, resource group, and resource. Management groups are in a preview release.
The following image shows an example of these layers.
You apply management settings at any of these levels of scope. The level you select determines how widely the
setting is applied. Lower levels inherit settings from higher levels. When you apply a setting to the subscription,
that setting is applied to all resource groups and resources in your subscription. When you apply a setting on the
resource group, that setting is applied the resource group and all its resources. However, another resource group
does not have that setting.
Usually, it makes sense to apply critical settings at higher levels and project-specific requirements at lower levels.
For example, you might want to make sure all resources for your organization are deployed to certain regions. To
accomplish this requirement, apply a policy to the subscription that specifies the allowed locations. As other users
in your organization add new resource groups and resources, the allowed locations are automatically enforced.
In this tutorial, you apply all management settings to a resource group so you can easily remove those settings
when done.
Let's create that resource group.
If you receive an error stating Principal does not exist in the directory, the new group hasn't propagated
throughout Azure Active Directory. Try running the command again.
Typically, you repeat the process for Network Contributor and Storage Account Contributor to make sure users
are assigned to manage the deployed resources. In this article, you can skip those steps.
Azure Policy
Azure Policy helps you make sure all resources in subscription meet corporate standards. Your subscription already
has several policy definitions. To see the available policy definitions, use the Get-AzureRmPolicyDefinition
command:
You see the existing policy definitions. The policy type is either BuiltIn or Custom. Look through the definitions
for ones that describe a condition you want assign. In this article, you assign policies that:
Limit the locations for all resources.
Limit the SKUs for virtual machines.
Audit virtual machines that don't use managed disks.
In the following example, you retrieve three policy definitions based on the display name. You use the New -
AzureRMPolicyAssignment command to assign those definitions to the resource group. For some policies, you
provide parameter values to specify the allowed values.
# Values to use for parameters
$locations ="eastus", "eastus2"
$skus = "Standard_DS1_v2", "Standard_E2s_v2"
# Get policy definitions for allowed locations, allowed SKUs, and auditing VMs that don't use managed disks
$locationDefinition = Get-AzureRmPolicyDefinition | where-object {$_.properties.displayname -eq "Allowed
locations"}
$skuDefinition = Get-AzureRmPolicyDefinition | where-object {$_.properties.displayname -eq "Allowed virtual
machine SKUs"}
$auditDefinition = Get-AzureRmPolicyDefinition | where-object {$_.properties.displayname -eq "Audit VMs that
do not use managed disks"}
After your deployment finishes, you can apply more management settings to the solution.
Lock resources
Resource locks prevent users in your organization from accidentally deleting or modifying critical resources. Unlike
role-based access control, resource locks apply a restriction across all users and roles. You can set the lock level to
CanNotDelete or ReadOnly.
To lock the virtual machine and network security group, use the New -AzureRmResourceLock command:
# Add CanNotDelete lock to the VM
New-AzureRmResourceLock -LockLevel CanNotDelete `
-LockName LockVM `
-ResourceName myVM `
-ResourceType Microsoft.Compute/virtualMachines `
-ResourceGroupName myResourceGroup
You see an error stating that the delete operation can't be completed because of a lock. The resource group can
only be deleted if you specifically remove the locks. That step is shown in Clean up resources.
Tag resources
You apply tags to your Azure resources to logically organize them by categories. Each tag consists of a name and a
value. For example, you can apply the name "Environment" and the value "Production" to all the resources in
production.
To add two tags to a resource group, use the Set-AzureRmResourceGroup command:
Let's suppose you want to add a third tag. Every time you apply tags to a resource or a resource group, you
overwrite the existing tags on that resource or resource group. To add a new tag without losing the existing tags,
you must retrieve the existing tags, add a new tag, and reapply the collection of tags:
Resources don't inherit tags from the resource group. Currently, your resource group has three tags but the
resources do not have any tags. To apply all tags from a resource group to its resources, and retain existing tags on
resources that are not duplicates, use the following script:
# Get the resource group
$group = Get-AzureRmResourceGroup myResourceGroup
Alternatively, you can apply tags from the resource group to the resources without keeping the existing tags:
# Find all the resources in the resource group, and for each resource apply the tags from the resource group
Get-AzureRmResource -ResourceGroupName $g.ResourceGroupName | ForEach-Object {Set-AzureRmResource -ResourceId
$_.ResourceId -Tag $g.Tags -Force }
To add a new tag with several values without losing the existing tags, you must retrieve the existing tags, use a
JSON string for the new tag, and reapply the collection of tags:
You can use the returned values for management tasks like stopping all virtual machines with a tag value.
Clean up resources
The locked network security group can't be deleted until the lock is removed. To remove the lock, use the Remove-
AzureRmResourceLock command:
When no longer needed, you can use the Remove-AzureRmResourceGroup command to remove the resource
group, VM, and all related resources.
Next steps
In this tutorial, you created a custom VM image. You learned how to:
Assign users to a role
Apply policies that enforce standards
Protect critical resources with locks
Tag resources for billing and management
Advance to the next tutorial to learn about how highly available virtual machines.
Monitor virtual machines
Tutorial: Monitor and update a Windows virtual
machine in Azure
10/18/2018 • 11 minutes to read • Edit Online
Azure monitoring uses agents to collect boot and performance data from Azure VMs, store this data in Azure
storage, and make it accessible through portal, the Azure PowerShell module, and the Azure CLI. Update
management allows you to manage updates and patches for your Azure Windows VMs.
In this tutorial, you learn how to:
Enable boot diagnostics on a VM
View boot diagnostics
View VM host metrics
Install the diagnostics extension
View VM metrics
Create an alert
Manage Windows updates
Monitor changes and inventory
Set up advanced monitoring
This tutorial requires the Azure PowerShell module version 5.7.0 or later. Run Get-Module -ListAvailable AzureRM
to find the version. If you need to upgrade, see Install Azure PowerShell module.
$cred = Get-Credential
Now create the VM with New -AzureRmVM. The following example creates a VM named myVM in the EastUS
location. If they do not already exist, the resource group myResourceGroupMonitorMonitor and supporting
network resources are created:
New-AzureRmVm `
-ResourceGroupName "myResourceGroupMonitor" `
-Name "myVM" `
-Location "East US" `
-Credential $cred
Create alerts
You can create alerts based on specific performance metrics. Alerts can be used to notify you when average CPU
usage exceeds a certain threshold or available free disk space drops below a certain amount, for example. Alerts
are displayed in the Azure portal or can be sent via email. You can also trigger Azure Automation runbooks or
Azure Logic Apps in response to alerts being generated.
The following example creates an alert for average CPU usage.
1. In the Azure portal, click Resource Groups, select myResourceGroupMonitor, and then select myVM in the
resource list.
2. Click Alert rules on the VM blade, then click Add metric alert across the top of the alerts blade.
3. Provide a Name for your alert, such as myAlertRule
4. To trigger an alert when CPU percentage exceeds 1.0 for five minutes, leave all the other defaults selected.
5. Optionally, check the box for Email owners, contributors, and readers to send email notification. The default
action is to present a notification in the portal.
6. Click the OK button.
Maintenance window (minutes) - Specify the period of time you want the update deployment to occur
within. This helps ensure changes are performed within your defined service windows.
After you have completed configuring the schedule, click Create button and you return to the status dashboard.
Notice that the Scheduled table shows the deployment schedule you created.
WARNING
For updates that require a reboot, the VM is restarted automatically.
The chart shows changes that have occurred over time. After you have added an Activity Log connection, the line
graph at the top displays Azure Activity Log events. Each row of bar graphs represents a different trackable
Change type. These types are Linux daemons, files, Windows Registry keys, software, and Windows services. The
change tab shows the details for the changes shown in the visualization in descending order of time that the
change occurred (most recent first).
Advanced monitoring
You can do more advanced monitoring of your VM by using the solutions like Update Management and Change
and Inventory provided by Azure Automation.
When you have access to the Log Analytics workspace, you can find the workspace key and workspace identifier
on by selecting Advanced settings under SETTINGS. Use the Set-AzureRmVMExtension command to add the
Microsoft Monitoring agent extension to the VM. Update the variable values in the below sample to reflect you
Log Analytics workspace key and workspace Id.
After a few minutes, you should see the new VM in the Log Analytics workspace.
Next steps
In this tutorial, you configured and reviewed VMs with Azure Security Center. You learned how to:
Create a virtual network
Create a resource group and VM
Enable boot diagnostics on the VM
View boot diagnostics
View host metrics
Install the diagnostics extension
View VM metrics
Create an alert
Manage Windows updates
Monitor changes and inventory
Set up advanced monitoring
Advance to the next tutorial to learn about Azure security center.
Manage VM security
Tutorial: Use Azure Security Center to monitor
Windows virtual machines
9/10/2018 • 5 minutes to read • Edit Online
Azure Security Center can help you gain visibility into your Azure resource security practices. Security Center
offers integrated security monitoring. It can detect threats that otherwise might go unnoticed. In this tutorial, you
learn about Azure Security Center, and how to:
Set up data collection
Set up security policies
View and fix configuration health issues
Review detected threats
Security Center goes beyond data discovery to provide recommendations for issues that it detects. For example, if
a VM was deployed without an attached network security group, Security Center displays a recommendation, with
remediation steps you can take. You get automated remediation without leaving the context of Security Center.
To automate the build, test, and deployment phases of application development, you can use a continuous
integration and deployment (CI/CD ) pipeline. In this tutorial, you create a CI/CD pipeline using Azure DevOps
Services and a Windows virtual machine (VM ) in Azure that runs IIS. You learn how to:
Publish an ASP.NET web application to a Azure DevOps Services project
Create a build pipeline that is triggered by code commits
Install and configure IIS on a virtual machine in Azure
Add the IIS instance to a deployment group in Azure DevOps Services
Create a release pipeline to publish new web deploy packages to IIS
Test the CI/CD pipeline
This tutorial requires the Azure PowerShell module version 5.7.0 or later. Run Get-Module -ListAvailable AzureRM
to find the version. If you need to upgrade, see Install Azure PowerShell module.
3. Select Web templates, and then choose the ASP.NET Web Application template.
a. Enter a name for your application, such as myWebApp, and uncheck the box for Create directory for
solution.
b. If the option is available, uncheck the box to Add Application Insights to project. Application Insights
requires you to authorize your web application with Azure Application Insights. To keep it simple in this
tutorial, skip this process.
c. Select OK.
4. Choose MVC from the template list.
a. Select Change Authentication, choose No Authentication, then select OK.
b. Select OK to create your solution.
5. In the Team Explorer window, choose Changes.
6. In the commit text box, enter a message such as Initial commit. Choose Commit All and Sync from the
drop-down menu.
5. On the Triggers tab, move the slider for Enable this trigger to Enabled.
6. Save the build pipeline and queue a new build by selecting Save & queue , then Save & queue again. Leave
the defaults and select Queue.
Watch as the build is scheduled on a hosted agent, then begins to build. The output is similar to the following
example:
To connect to your VM, obtain the public IP address with Get-AzureRmPublicIpAddress as follows:
mstsc /v:<publicIpAddress>
On the VM, open an Administrator PowerShell command prompt. Install IIS and required .NET features as
follows:
Install-WindowsFeature Web-Server,Web-Asp-Net45,NET-Framework-Features
8. Choose Add next to IIS Web App Deploy(Preview), then select Close.
9. Select the Run on deployment group parent task.
a. For Deployment Group, select the deployment group you created earlier, such as myIIS.
b. In the Machine tags box, select Add and choose the web tag.
10. Select the Deploy: IIS Web App Deploy task to configure your IIS instance settings as follows:
a. For Website Name, enter Default Web Site.
b. Leave all the other default settings.
11. Choose Save, then select OK twice.
5. After the release is complete, open a web browser and enter the public IIP address of your VM. Your
ASP.NET web application is running.
Test the whole CI/CD pipeline
With your web application running on IIS, now try the whole CI/CD pipeline. After you make a change in Visual
Studio and commit your code, a build is triggered which then triggers a release of your updated web deploy
package to IIS:
1. In Visual Studio, open the Solution Explorer window.
2. Navigate to and open myWebApp | Views | Home | Index.cshtml
3. Edit line 6 to read:
<h1>ASP.NET with Azure DevOps Services and CI/CD!</h1>
In this tutorial, we install a SQL/IIS/.NET stack using Azure PowerShell. This stack consists of two VMs running
Windows Server 2016, one with IIS and .NET and the other with SQL Server.
Create a VM
Install IIS and the .NET Core SDK on the VM
Create a VM running SQL Server
Install the SQL Server extension
Click the Cloud Shell button on the menu in the upper right
of the Azure portal.
If you choose to install and use the PowerShell locally, this tutorial requires the AzureRM.Compute module version
5.7.0 or later. Run Get-Module -ListAvailable AzureRM.Compute to find the version. If you need to upgrade, see Install
Azure PowerShell module.
Create a IIS VM
In this example, we use New -AzureRMVM cmdlet in the PowerShell Cloud Shell to quickly create a Windows
Server 2016 VM and then install IIS and the .NET Framework. The IIS and SQL VMs share a resource group and
virtual network, so we create variables for those names.
$vmName = "IISVM"
$vNetName = "myIISSQLvNet"
$resourceGroup = "myIISSQLGroup"
New-AzureRmVm `
-ResourceGroupName $resourceGroup `
-Name $vmName `
-Location "East US" `
-VirtualNetworkName $vNetName `
-SubnetName "myIISSubnet" `
-SecurityGroupName "myNetworkSecurityGroup" `
-AddressPrefix 192.168.0.0/16 `
-PublicIpAddressName "myIISPublicIpAddress" `
-OpenPorts 80,3389
Install IIS and the .NET framework using the custom script extension.
Set-AzureRmVMExtension `
-ResourceGroupName $resourceGroup `
-ExtensionName IIS `
-VMName $vmName `
-Publisher Microsoft.Compute `
-ExtensionType CustomScriptExtension `
-TypeHandlerVersion 1.4 `
-SettingString '{"commandToExecute":"powershell Add-WindowsFeature Web-Server,Web-Asp-Net45,NET-Framework-
Features"}' `
-Location EastUS
$vNet = Get-AzureRmVirtualNetwork `
-Name $vNetName `
-ResourceGroupName $resourceGroup
Add-AzureRmVirtualNetworkSubnetConfig `
-AddressPrefix 192.168.0.0/24 `
-Name mySQLSubnet `
-VirtualNetwork $vNet `
-ServiceEndpoint Microsoft.Sql
Update the vNet with the new subnet information using Set-AzureRmVirtualNetwork
$vNet | Set-AzureRmVirtualNetwork
Azure SQL VM
Use a pre-configured Azure marketplace image of a SQL server to create the SQL VM. We first create the VM,
then we install the SQL Server Extension on the VM.
New-AzureRmVm `
-ResourceGroupName $resourceGroup `
-Name "mySQLVM" `
-ImageName "MicrosoftSQLServer:SQL2016SP1-WS2016:Enterprise:latest" `
-Location eastus `
-VirtualNetworkName $vNetName `
-SubnetName "mySQLSubnet" `
-SecurityGroupName "myNetworkSecurityGroup" `
-PublicIpAddressName "mySQLPublicIpAddress" `
-OpenPorts 3389,1401
Use Set-AzureRmVMSqlServerExtension to add the SQL Server extension to the SQL VM.
Set-AzureRmVMSqlServerExtension `
-ResourceGroupName $resourceGroup `
-VMName mySQLVM `
-Name "SQLExtension" `
-Location "EastUS"
Next steps
In this tutorial, you installed a SQL\IIS\.NET stack using Azure PowerShell. You learned how to:
Create a VM
Install IIS and the .NET Core SDK on the VM
Create a VM running SQL Server
Install the SQL Server extension
Advance to the next tutorial to learn how to secure IIS web server with SSL certificates.
Secure IIS web server with SSL certificates
Tutorial: Secure a web server on a Windows virtual
machine in Azure with SSL certificates stored in Key
Vault
10/19/2018 • 4 minutes to read • Edit Online
To secure web servers, a Secure Sockets Layer (SSL ) certificate can be used to encrypt web traffic. These SSL
certificates can be stored in Azure Key Vault, and allow secure deployments of certificates to Windows virtual
machines (VMs) in Azure. In this tutorial you learn how to:
Create an Azure Key Vault
Generate or upload a certificate to the Key Vault
Create a VM and install the IIS web server
Inject the certificate into the VM and configure IIS with an SSL binding
Click the Cloud Shell button on the menu in the upper right
of the Azure portal.
If you choose to install and use the PowerShell locally, this tutorial requires the Azure PowerShell module version
5.7.0 or later. Run Get-Module -ListAvailable AzureRM to find the version. If you need to upgrade, see Install Azure
PowerShell module. If you are running PowerShell locally, you also need to run Connect-AzureRmAccount to create a
connection with Azure.
Overview
Azure Key Vault safeguards cryptographic keys and secrets, such certificates or passwords. Key Vault helps
streamline the certificate management process and enables you to maintain control of keys that access those
certificates. You can create a self-signed certificate inside Key Vault, or upload an existing, trusted certificate that
you already own.
Rather than using a custom VM image that includes certificates baked-in, you inject certificates into a running VM.
This process ensures that the most up-to-date certificates are installed on a web server during deployment. If you
renew or replace a certificate, you don't also have to create a new custom VM image. The latest certificates are
automatically injected as you create additional VMs. During the whole process, the certificates never leave the
Azure platform or are exposed in a script, command-line history, or template.
Create an Azure Key Vault
Before you can create a Key Vault and certificates, create a resource group with New -AzureRmResourceGroup. The
following example creates a resource group named myResourceGroupSecureWeb in the East US location:
$resourceGroup = "myResourceGroupSecureWeb"
$location = "East US"
New-AzureRmResourceGroup -ResourceGroupName $resourceGroup -Location $location
Next, create a Key Vault with New -AzureRmKeyVault. Each Key Vault requires a unique name, and should be all
lower case. Replace mykeyvault in the following example with your own unique Key Vault name:
$keyvaultName="mykeyvault"
New-AzureRmKeyVault -VaultName $keyvaultName `
-ResourceGroup $resourceGroup `
-Location $location `
-EnabledForDeployment
$policy = New-AzureKeyVaultCertificatePolicy `
-SubjectName "CN=www.contoso.com" `
-SecretContentType "application/x-pkcs12" `
-IssuerName Self `
-ValidityInMonths 12
Add-AzureKeyVaultCertificate `
-VaultName $keyvaultName `
-Name "mycert" `
-CertificatePolicy $policy
$cred = Get-Credential
Now you can create the VM with New -AzureRmVM. The following example creates a VM named myVM in the
EastUS location. If they do not already exist, the supporting network resources are created. To allow secure web
traffic, the cmdlet also opens port 443.
# Create a VM
New-AzureRmVm `
-ResourceGroupName $resourceGroup `
-Name "myVM" `
-Location $location `
-VirtualNetworkName "myVnet" `
-SubnetName "mySubnet" `
-SecurityGroupName "myNetworkSecurityGroup" `
-PublicIpAddressName "myPublicIpAddress" `
-Credential $cred `
-OpenPorts 443
It takes a few minutes for the VM to be created. The last step uses the Azure Custom Script Extension to install the
IIS web server with Set-AzureRmVmExtension.
$PublicSettings = '{
"fileUris":["https://raw.githubusercontent.com/Azure-Samples/compute-automation-
configurations/master/secure-iis.ps1"],
"commandToExecute":"powershell -ExecutionPolicy Unrestricted -File secure-iis.ps1"
}'
Now you can open a web browser and enter https://<myPublicIP> in the address bar. To accept the security
warning if you used a self-signed certificate, select Details and then Go on to the webpage:
The following table provides links to PowerShell script samples that create and manage Windows virtual machines
(VMs).
Quickly create a virtual machine Creates a resource group, a virtual machine, and all related
resources, with a minimum of prompts.
Create a fully configured virtual machine Creates a resource group, a virtual machine, and all related
resources.
Create highly available virtual machines Creates several virtual machines in a highly-available and
load-balanced configuration.
Create a VM and run a configuration script Creates a virtual machine and uses the Azure Custom Script
extension to install IIS.
Create a VM and run a DSC configuration Creates a virtual machine and uses the Azure Desired State
Configuration (DSC) extension to install IIS.
Upload a VHD and create VMs Uploads a local VHD file to Azure, creates an image from the
VHD, and then creates a VM from that image.
Create a VM from a managed OS disk Creates a virtual machine by attaching an existing Managed
Disk as OS disk.
Create a VM from a snapshot Creates a virtual machine from a snapshot by first creating a
managed disk from the snapshot and then attaching the new
managed disk as OS disk.
Manage storage
Create a managed disk from a VHD in the same or a different Creates a managed disk from a specialized VHD as an OS disk,
subscription or from a data VHD as a data disk, in the same or a different
subscription.
Create a managed disk from a snapshot Creates a managed disk from a snapshot.
Copy a managed disk to the same or a different subscription Copies a managed disk to the same or a different subscription
that is in the same region as the parent managed disk.
Export a snapshot as a VHD to a storage account Exports a managed snapshot as a VHD to a storage account
in a different region.
Export the VHD of a managed disk to a storage account Exports the underlying VHD of a managed disk to a storage
account in a different region.
Create a snapshot from a VHD Creates a snapshot from a VHD and then uses that snapshot
to create multiple identical managed disks quickly.
Copy a snapshot to the same or a different subscription Copies snapshot to the same or a different subscription that is
in the same region as the parent snapshot.
Encrypt a VM and its data disks Creates an Azure key vault, an encryption key, and a service
principal, and then encrypts a VM.
Monitor a VM with Log Analytics Creates a virtual machine, installs the Azure Log Analytics
agent, and enrolls the VM in a Log Analytics workspace.
Azure CLI Samples for Windows virtual machines
10/18/2018 • 2 minutes to read • Edit Online
The following table includes links to bash scripts built using the Azure CLI that deploy Windows virtual machines.
Create a fully configured virtual machine Creates a resource group, virtual machine, and all related
resources.
Create highly available virtual machines Creates several virtual machines in a highly available and load
balanced configuration.
Create a VM and run configuration script Creates a virtual machine and uses the Azure Custom Script
extension to install IIS.
Create a VM and run DSC configuration Creates a virtual machine and uses the Azure Desired State
Configuration (DSC) extension to install IIS.
Secure network traffic between virtual machines Creates two virtual machines, all related resources, and an
internal and external network security groups (NSG).
Encrypt a VM and data disks Creates an Azure Key Vault, encryption key, and service
principal, then encrypts a VM.
Monitor a VM with Log Analytics Creates a virtual machine, installs the Log Analytics agent, and
enrolls the VM in a Log Analytics workspace.
Azure Resource Manager overview
10/18/2018 • 15 minutes to read • Edit Online
The infrastructure for your application is typically made up of many components – maybe a virtual machine,
storage account, and virtual network, or a web app, database, database server, and third-party services. You don't
see these components as separate entities, instead you see them as related and interdependent parts of a single
entity. You want to deploy, manage, and monitor them as a group. Azure Resource Manager enables you to work
with the resources in your solution as a group. You can deploy, update, or delete all the resources for your
solution in a single, coordinated operation. You use a template for deployment and that template can work for
different environments such as testing, staging, and production. Resource Manager provides security, auditing,
and tagging features to help you manage your resources after deployment.
Terminology
If you're new to Azure Resource Manager, there are some terms you might not be familiar with.
resource - A manageable item that is available through Azure. Some common resources are a virtual
machine, storage account, web app, database, and virtual network, but there are many more.
resource group - A container that holds related resources for an Azure solution. The resource group can
include all the resources for the solution, or only those resources that you want to manage as a group. You
decide how you want to allocate resources to resource groups based on what makes the most sense for your
organization. See Resource groups.
resource provider - A service that supplies the resources you can deploy and manage through Resource
Manager. Each resource provider offers operations for working with the resources that are deployed. Some
common resource providers are Microsoft.Compute, which supplies the virtual machine resource,
Microsoft.Storage, which supplies the storage account resource, and Microsoft.Web, which supplies resources
related to web apps. See Resource providers.
Resource Manager template - A JavaScript Object Notation (JSON ) file that defines one or more resources
to deploy to a resource group. It also defines the dependencies between the deployed resources. The template
can be used to deploy the resources consistently and repeatedly. See Template deployment.
declarative syntax - Syntax that lets you state "Here is what I intend to create" without having to write the
sequence of programming commands to create it. The Resource Manager template is an example of
declarative syntax. In the file, you define the properties for the infrastructure to deploy to Azure.
Guidance
The following suggestions help you take full advantage of Resource Manager when working with your solutions.
1. Define and deploy your infrastructure through the declarative syntax in Resource Manager templates, rather
than through imperative commands.
2. Define all deployment and configuration steps in the template. You should have no manual steps for setting
up your solution.
3. Run imperative commands to manage your resources, such as to start or stop an app or machine.
4. Arrange resources with the same lifecycle in a resource group. Use tags for all other organizing of resources.
For guidance on how enterprises can use Resource Manager to effectively manage subscriptions, see Azure
enterprise scaffold - prescriptive subscription governance.
For recommendations on creating Resource Manager templates that you can use across global Azure, Azure
sovereign clouds, and Azure Stack, see Develop Azure Resource Manager templates for cloud consistency.
Use the Azure portal Generate a template using the portal, and the process of
editing and deploying the template.
Use Visual Studio Code Use Visual Studio Code to create and edit templates, and
how to use the Azure Cloud shell to deploy templates.
Use Visual Studio Use Visual Studio to create, edit, and deploy templates.
Tutorials
TITLE DESCRIPTION
Set resource deployment order Define resource dependencies. In the tutorial, you create
a virtual network, a virtual machine, and the dependent
Azure resources. You learn how the dependencies are
defined.
Integrate key vault Retrieve secrets/passwords from Azure Key Vault. In the
tutorial, you create a virtual machine. The virtual machine
administrator password is retrieved from a Key Vault.
Create linked templates Modularize templates, and call other templates from a
template. In the tutorial, you create a virtual network, a
virtual machine, and the dependent resources. The
dependent storage account is defined in a linked
template.
Resource groups
There are some important factors to consider when defining your resource group:
1. All the resources in your group should share the same lifecycle. You deploy, update, and delete them together.
If one resource, such as a database server, needs to exist on a different deployment cycle it should be in
another resource group.
2. Each resource can only exist in one resource group.
3. You can add or remove a resource to a resource group at any time.
4. You can move a resource from one resource group to another group. For more information, see Move
resources to new resource group or subscription.
5. A resource group can contain resources that reside in different regions.
6. A resource group can be used to scope access control for administrative actions.
7. A resource can interact with resources in other resource groups. This interaction is common when the two
resources are related but don't share the same lifecycle (for example, web apps connecting to a database).
When creating a resource group, you need to provide a location for that resource group. You may be wondering,
"Why does a resource group need a location? And, if the resources can have different locations than the resource
group, why does the resource group location matter at all?" The resource group stores metadata about the
resources. Therefore, when you specify a location for the resource group, you're specifying where that metadata
is stored. For compliance reasons, you may need to ensure that your data is stored in a particular region.
Resource providers
Each resource provider offers a set of resources and operations for working with an Azure service. For example,
if you want to store keys and secrets, you work with the Microsoft.KeyVault resource provider. This resource
provider offers a resource type called vaults for creating the key vault.
The name of a resource type is in the format: {resource-provider}/{resource-type}. For example, the key vault
type is Microsoft.KeyVault/vaults.
Before getting started with deploying your resources, you should gain an understanding of the available resource
providers. Knowing the names of resource providers and resources helps you define resources you want to
deploy to Azure. Also, you need to know the valid locations and API versions for each resource type. For more
information, see Resource providers and types.
Template deployment
With Resource Manager, you can create a template (in JSON format) that defines the infrastructure and
configuration of your Azure solution. By using a template, you can repeatedly deploy your solution throughout
its lifecycle and have confidence your resources are deployed in a consistent state. When you create a solution
from the portal, the solution automatically includes a deployment template. You don't have to create your
template from scratch because you can start with the template for your solution and customize it to meet your
specific needs. For a sample, see Quickstart: Create and deploy Azure Resource Manager templates by using the
Azure portal. You can also retrieve a template for an existing resource group by either exporting the current state
of the resource group, or viewing the template used for a particular deployment. Viewing the exported template
is a helpful way to learn about the template syntax.
To learn about the format of the template and how you construct it, see Quickstart: Create and deploy Azure
Resource Manager templates by using the Azure portal. To view the JSON syntax for resources types, see Define
resources in Azure Resource Manager templates.
Resource Manager processes the template like any other request (see the image for Consistent management
layer). It parses the template and converts its syntax into REST API operations for the appropriate resource
providers. For example, when Resource Manager receives a template with the following resource definition:
"resources": [
{
"apiVersion": "2016-01-01",
"type": "Microsoft.Storage/storageAccounts",
"name": "mystorageaccount",
"location": "westus",
"sku": {
"name": "Standard_LRS"
},
"kind": "Storage",
"properties": {
}
}
]
It converts the definition to the following REST API operation, which is sent to the Microsoft.Storage resource
provider:
PUT
https://management.azure.com/subscriptions/{subscriptionId}/resourceGroups/{resourceGroupName}/providers/Micr
osoft.Storage/storageAccounts/mystorageaccount?api-version=2016-01-01
REQUEST BODY
{
"location": "westus",
"properties": {
}
"sku": {
"name": "Standard_LRS"
},
"kind": "Storage"
}
How you define templates and resource groups is entirely up to you and how you want to manage your solution.
For example, you can deploy your three tier application through a single template to a single resource group.
But, you don't have to define your entire infrastructure in a single template. Often, it makes sense to divide your
deployment requirements into a set of targeted, purpose-specific templates. You can easily reuse these templates
for different solutions. To deploy a particular solution, you create a master template that links all the required
templates. The following image shows how to deploy a three tier solution through a parent template that
includes three nested templates.
If you envision your tiers having separate lifecycles, you can deploy your three tiers to separate resource groups.
Notice the resources can still be linked to resources in other resource groups.
For information about nested templates, see Using linked templates with Azure Resource Manager.
Azure Resource Manager analyzes dependencies to ensure resources are created in the correct order. If one
resource relies on a value from another resource (such as a virtual machine needing a storage account for disks),
you set a dependency. For more information, see Defining dependencies in Azure Resource Manager templates.
You can also use the template for updates to the infrastructure. For example, you can add a resource to your
solution and add configuration rules for the resources that are already deployed. If the template specifies creating
a resource but that resource already exists, Azure Resource Manager performs an update instead of creating a
new asset. Azure Resource Manager updates the existing asset to the same state as it would be as new.
Resource Manager provides extensions for scenarios when you need additional operations such as installing
particular software that isn't included in the setup. If you're already using a configuration management service,
like DSC, Chef or Puppet, you can continue working with that service by using extensions. For information about
virtual machine extensions, see About virtual machine extensions and features.
Finally, the template becomes part of the source code for your app. You can check it in to your source code
repository and update it as your app evolves. You can edit the template through Visual Studio.
After defining your template, you're ready to deploy the resources to Azure. For the commands to deploy the
resources, see:
Deploy resources with Resource Manager templates and Azure PowerShell
Deploy resources with Resource Manager templates and Azure CLI
Deploy resources with Resource Manager templates and Azure portal
Deploy resources with Resource Manager templates and Resource Manager REST API
Tags
Resource Manager provides a tagging feature that enables you to categorize resources according to your
requirements for managing or billing. Use tags when you have a complex collection of resource groups and
resources, and need to visualize those assets in the way that makes the most sense to you. For example, you
could tag resources that serve a similar role in your organization or belong to the same department. Without
tags, users in your organization can create multiple resources that may be difficult to later identify and manage.
For example, you may wish to delete all the resources for a particular project. If those resources aren't tagged for
the project, you have to manually find them. Tagging can be an important way for you to reduce unnecessary
costs in your subscription.
Resources do not need to reside in the same resource group to share a tag. You can create your own tag
taxonomy to ensure that all users in your organization use common tags rather than users inadvertently applying
slightly different tags (such as "dept" instead of "department").
The following example shows a tag applied to a virtual machine.
"resources": [
{
"type": "Microsoft.Compute/virtualMachines",
"apiVersion": "2015-06-15",
"name": "SimpleWindowsVM",
"location": "[resourceGroup().location]",
"tags": {
"costCenter": "Finance"
},
...
}
]
The usage report for your subscription includes tag names and values, which enables you to break out costs by
tags. For more information about tags, see Using tags to organize your Azure resources.
Access control
Resource Manager enables you to control who has access to specific actions for your organization. It natively
integrates role-based access control (RBAC ) into the management platform and applies that access control to all
services in your resource group.
There are two main concepts to understand when working with role-based access control:
Role definitions - describe a set of permissions and can be used in many assignments.
Role assignments - associate a definition with an identity (user or group) for a particular scope (subscription,
resource group, or resource). The assignment is inherited by lower scopes.
You can add users to pre-defined platform and resource-specific roles. For example, you can take advantage of
the pre-defined role called Reader that permits users to view resources but not change them. You add users in
your organization that need this type of access to the Reader role and apply the role to the subscription, resource
group, or resource.
Azure provides the following four platform roles:
1. Owner - can manage everything, including access
2. Contributor - can manage everything except access
3. Reader - can view everything, but can't make changes
4. User Access Administrator - can manage user access to Azure resources
Azure also provides several resource-specific roles. Some common ones are:
1. Virtual Machine Contributor - can manage virtual machines but not grant access to them, and can't manage
the virtual network or storage account to which they're connected
2. Network Contributor - can manage all network resources, but not grant access to them
3. Storage Account Contributor - Can manage storage accounts, but not grant access to them
4. SQL Server Contributor - Can manage SQL servers and databases, but not their security-related policies
5. Website Contributor - Can manage websites, but not the web plans to which they're connected
For the full list of roles and permitted actions, see RBAC: Built in Roles. For more information about role-based
access control, see Azure Role-based Access Control.
In some cases, you want to run code or script that accesses resources, but you don't want to run it under a user’s
credentials. Instead, you want to create an identity called a service principal for the application and assign the
appropriate role for the service principal. Resource Manager enables you to create credentials for the application
and programmatically authenticate the application. To learn about creating service principals, see one of
following topics:
Use Azure PowerShell to create a service principal to access resources
Use Azure CLI to create a service principal to access resources
Use portal to create Azure Active Directory application and service principal that can access resources
You can also explicitly lock critical resources to prevent users from deleting or modifying them. For more
information, see Lock resources with Azure Resource Manager.
Customized policies
Resource Manager enables you to create customized policies for managing your resources. The types of policies
you create can include diverse scenarios. You can enforce a naming convention on resources, limit which types
and instances of resources can be deployed, or limit which regions can host a type of resource. You can require a
tag value on resources to organize billing by departments. You create policies to help reduce costs and maintain
consistency in your subscription.
There are many more types of policies you can create. For more information, see What is Azure Policy?.
SDKs
Azure SDKs are available for multiple languages and platforms. Each of these language implementations is
available through its ecosystem package manager and GitHub.
Here are the Open Source SDK repositories.
Azure SDK for .NET
Azure Management Libraries for Java
Azure SDK for Node.js
Azure SDK for PHP
Azure SDK for Python
Azure SDK for Ruby
For information about using these languages with your resources, see:
Azure for .NET developers
Azure for Java developers
Azure for Node.js developers
Azure for Python developers
NOTE
If the SDK doesn't provide the required functionality, you can also call to the Azure REST API directly.
Next steps
In this article, you learned how to use Azure Resource Manager for deployment, management, and access control
of resources on Azure. Proceed to the next article to learn how to create your first Azure Resource Manager
template.
Quickstart: Create and deploy Azure Resource Manager templates by using the Azure portal
Regions and availability for virtual machines in Azure
7/9/2018 • 6 minutes to read • Edit Online
Azure operates in multiple datacenters around the world. These datacenters are grouped in to geographic regions,
giving you flexibility in choosing where to build your applications. It is important to understand how and where
your virtual machines (VMs) operate in Azure, along with your options to maximize performance, availability, and
redundancy. This article provides you with an overview of the availability and redundancy features of Azure.
Region pairs
Each Azure region is paired with another region within the same geography (such as US, Europe, or Asia). This
approach allows for the replication of resources, such as VM storage, across a geography that should reduce the
likelihood of natural disasters, civil unrest, power outages, or physical network outages affecting both regions at
once. Additional advantages of region pairs include:
In the event of a wider Azure outage, one region is prioritized out of every pair to help reduce the time to
restore for applications.
Planned Azure updates are rolled out to paired regions one at a time to minimize downtime and risk of
application outage.
Data continues to reside within the same geography as its pair (except for Brazil South) for tax and law
enforcement jurisdiction purposes.
Examples of region pairs include:
PRIMARY SECONDARY
West US East US
Feature availability
Some services or VM features are only available in certain regions, such as specific VM sizes or storage types.
There are also some global Azure services that do not require you to select a particular region, such as Azure
Active Directory, Traffic Manager, or Azure DNS. To assist you in designing your application environment, you can
check the availability of Azure services across each region. You can also programmatically query the supported VM
sizes and restrictions in each region.
Storage availability
Understanding Azure regions and geographies becomes important when you consider the available storage
replication options. Depending on the storage type, you have different replication options.
Azure Managed Disks
Locally redundant storage (LRS )
Replicates your data three times within the region in which you created your storage account.
Storage account-based disks
Locally redundant storage (LRS )
Replicates your data three times within the region in which you created your storage account.
Zone redundant storage (ZRS )
Replicates your data three times across two to three facilities, either within a single region or across two
regions.
Geo-redundant storage (GRS )
Replicates your data to a secondary region that is hundreds of miles away from the primary region.
Read-access geo-redundant storage (RA-GRS )
Replicates your data to a secondary region, as with GRS, but also then provides read-only access to the
data in the secondary location.
The following table provides a quick overview of the differences between the storage replication types:
REPLICATION
STRATEGY LRS ZRS GRS RA-GRS
Number of copies of 3 3 6 6
data maintained on
separate nodes.
You can read more about Azure Storage replication options here. For more information about managed disks, see
Azure Managed Disks overview.
Storage costs
Prices vary depending on the storage type and availability that you select.
Azure Managed Disks
Premium Managed Disks are backed by Solid-State Drives (SSDs) and Standard Managed Disks are backed by
regular spinning disks. Both Premium and Standard Managed Disks are charged based on the provisioned
capacity for the disk.
Unmanaged disks
Premium storage is backed by Solid-State Drives (SSDs) and is charged based on the capacity of the disk.
Standard storage is backed by regular spinning disks and is charged based on the in-use capacity and desired
storage availability.
For RA-GRS, there is an additional Geo-Replication Data Transfer charge for the bandwidth of
replicating that data to another Azure region.
See Azure Storage Pricing for pricing information on the different storage types and availability options.
Availability sets
An availability set is a logical grouping of VMs within a datacenter that allows Azure to understand how your
application is built to provide for redundancy and availability. We recommended that two or more VMs are created
within an availability set to provide for a highly available application and to meet the 99.95% Azure SLA. There is
no cost for the Availability Set itself, you only pay for each VM instance that you create. When a single VM is using
Azure Premium Storage, the Azure SLA applies for unplanned maintenance events.
An availability set is composed of two additional groupings that protect against hardware failures and allow
updates to safely be applied - fault domains (FDs) and update domains (UDs). You can read more about how to
manage the availability of Linux VMs or Windows VMs.
Fault domains
A fault domain is a logical group of underlying hardware that share a common power source and network switch,
similar to a rack within an on-premises datacenter. As you create VMs within an availability set, the Azure platform
automatically distributes your VMs across these fault domains. This approach limits the impact of potential
physical hardware failures, network outages, or power interruptions.
Update domains
An update domain is a logical group of underlying hardware that can undergo maintenance or be rebooted at the
same time. As you create VMs within an availability set, the Azure platform automatically distributes your VMs
across these update domains. This approach ensures that at least one instance of your application always remains
running as the Azure platform undergoes periodic maintenance. The order of update domains being rebooted may
not proceed sequentially during planned maintenance, but only one update domain is rebooted at a time.
Managed Disk fault domains
For VMs using Azure Managed Disks, VMs are aligned with managed disk fault domains when using a managed
availability set. This alignment ensures that all the managed disks attached to a VM are within the same managed
disk fault domain. Only VMs with managed disks can be created in a managed availability set. The number of
managed disk fault domains varies by region - either two or three managed disk fault domains per region. You can
read more about these managed disk fault domains for Linux VMs or Windows VMs.
Availability zones
Availability zones, an alternative to availability sets, expand the level of control you have to maintain the availability
of the applications and data on your VMs. An Availability Zone is a physically separate zone within an Azure
region. There are three Availability Zones per supported Azure region. Each Availability Zone has a distinct power
source, network, and cooling. By architecting your solutions to use replicated VMs in zones, you can protect your
apps and data from the loss of a datacenter. If one zone is compromised, then replicated apps and data are instantly
available in another zone.
Learn more about deploying a Windows or Linux VM in an Availability Zone.
Next steps
You can now start to use these availability and redundancy features to build your Azure environment. For best
practices information, see Azure availability best practices.
Sizes for Windows virtual machines in Azure
10/17/2018 • 2 minutes to read • Edit Online
This article describes the available sizes and options for the Azure virtual machines you can use to run your
Windows apps and workloads. It also provides deployment considerations to be aware of when you're planning
to use these resources. This article is also available for Linux virtual machines.
General purpose B, Dsv3, Dv3, DSv2, Dv2, Av2, DC Balanced CPU-to-memory ratio. Ideal
for testing and development, small to
medium databases, and low to
medium traffic web servers.
Memory optimized Esv3, Ev3, M, GS, G, DSv2, Dv2 High memory-to-CPU ratio. Great for
relational database servers, medium to
large caches, and in-memory analytics.
GPU NV, NVv2, NC, NCv2, NCv3, ND Specialized virtual machines targeted
for heavy graphic rendering and video
editing, as well as model training and
inferencing (ND) with deep learning.
Available with single or multiple GPUs.
For information about pricing of the various sizes, see Virtual Machines Pricing.
To see general limits on Azure VMs, see Azure subscription and service limits, quotas, and constraints.
Storage costs are calculated separately based on used pages in the storage account. For details, Azure
Storage Pricing.
Learn more about how Azure compute units (ACU ) can help you compare compute performance across
Azure SKUs.
REST API
For information on using the REST API to query for VM sizes, see the following:
List available virtual machine sizes for resizing
List available virtual machine sizes for a subscription
List available virtual machine sizes in an availability set
ACU
Learn more about how Azure compute units (ACU ) can help you compare compute performance across Azure
SKUs.
Benchmark scores
Learn more about compute performance for Windows VMs using the CoreMark benchmark scores.
Next steps
Learn more about the different VM sizes that are available:
General purpose
Compute optimized
Memory optimized
Storage optimized
GPU optimized
High performance compute
Check the Previous generation page for A Standard, Dv1 (D1-4 and D11-14 v1), and A8-A11 series
General purpose virtual machine sizes
10/8/2018 • 8 minutes to read • Edit Online
General purpose VM sizes provide balanced CPU -to-memory ratio. Ideal for testing and development, small to
medium databases, and low to medium traffic web servers. This article provides information about the number
of vCPUs, data disks and NICs as well as storage throughput for sizes in this grouping.
The DC -series is a new family of virtual machines in Azure that can help protect the confidentiality and
integrity of your data and code while it’s processed in the public cloud. These machines are backed by the
latest generation of 3.7GHz Intel XEON E -2176G Processor with SGX technology. With the Intel Turbo
Boost Technology these machines can go up to 4.7GHz. DC series instances enable customers to build
secure enclave-based applications to protect their code and data while it’s in use.
The Av2-series VMs can be deployed on a variety of hardware types and processors. A-series VMs have
CPU performance and memory configurations best suited for entry level workloads like development
and test. The size is throttled, based upon the hardware, to offer consistent processor performance for the
running instance, regardless of the hardware it is deployed on. To determine the physical hardware on
which this size is deployed, query the virtual hardware from within the Virtual Machine.
Example use cases include development and test servers, low traffic web servers, small to medium
databases, proof-of-concepts, and code repositories.
Dv2-series, a follow -on to the original D -series, features a more powerful CPU and optimal CPU -to-
memory configuration making them suitable for most production workloads. The Dv2-series CPU is
about 35% faster than the D -series CPU. It is based on the latest generation Intel Xeon® E5-2673 v3 2.4
GHz (Haswell) or E5-2673 v4 2.3 GHz (Broadwell) processors, and with the Intel Turbo Boost Technology
2.0, can go up to 3.1 GHz. The Dv2-series has the same memory and disk configurations as the D -series.
The Dv3-series features the 2.4 GHz Intel Xeon® E5-2673 v3 (Haswell) processor or the latest 2.3 GHz
Intel XEON ® E5-2673 v4 (Broadwell) processor in a hyper-threaded configuration, providing a better
value proposition for most general purpose workloads. Memory has been expanded (from ~3.5
GiB/vCPU to 4 GiB/vCPU ) while disk and network limits have been adjusted on a per core basis to align
with the move to hyperthreading. The Dv3 no longer has the high memory VM sizes of the D/Dv2
families, those have been moved to the new Ev3 family.
Example D -series use cases include enterprise-grade applications, relational databases, in-memory
caching, and analytics.
B-series
Premium Storage: Supported
Premium Storage Caching: Not Supported
The B -series burstable VMs are ideal for workloads that do not need the full performance of the CPU
continuously, like web servers, small databases and development and test environments. These workloads
typically have burstable performance requirements. The B -Series provides these customers the ability to
purchase a VM size with a price conscious baseline performance that allows the VM instance to build up credits
when the VM is utilizing less than its base performance. When the VM has accumulated credit, the VM can
burst above the VM’s baseline using up to 100% of the CPU when your application requires the higher CPU
performance.
Example use cases include development and test servers, low -traffic web servers, small databases, micro
services, servers for proof-of-concepts, build servers.
MAX
MAX UNCAC
CREDIT MAX LOCAL HED
S BANKE DISK DISK
LOCAL BASE BANKE D MAX PERF: PERF:
MEMOR SSD: PERF OF D/ CREDIT DATA IOPS / IOPS / MAX
SIZE VCPU Y: GIB GIB A CORE HOUR S DISKS MBPS MBPS NICS
Dsv3-series 1
ACU: 160-190
Premium Storage: Supported
Premium Storage Caching: Supported
Dsv3-series sizes are based on the 2.4 GHz Intel Xeon® E5-2673 v3 (Haswell) processor or the latest 2.3 GHz
Intel XEON ® E5-2673 v4 (Broadwell) processor that can achieve 3.5GHz with Intel Turbo Boost Technology
2.0 and use premium storage. The Dsv3-series sizes offer a combination of vCPU, memory, and temporary
storage for most production workloads.
MAX
CACHED
AND TEMP
STORAGE MAX
THROUGHP UNCACHED MAX NICS /
UT: IOPS / DISK EXPECTED
TEMP MBPS THROUGHP NETWORK
MEMORY: STORAGE MAX DATA (CACHE SIZE UT: IOPS / BANDWIDT
SIZE VCPU GIB (SSD) GIB DISKS IN GIB) MBPS H (MBPS)
Dv3-series 1
ACU: 160-190
Premium Storage: Not Supported
Premium Storage Caching: Not Supported
Dv3-series sizes are based on the 2.4 GHz Intel Xeon® E5-2673 v3 (Haswell) processor or 2.3 GHz Intel XEON
® E5-2673 v4 (Broadwell) processor that can achieve 3.5GHz with Intel Turbo Boost Technology 2.0. The Dv3-
series sizes offer a combination of vCPU, memory, and temporary storage for most production workloads.
Data disk storage is billed separately from virtual machines. To use premium storage disks, use the Dsv3 sizes.
The pricing and billing meters for Dsv3 sizes are the same as Dv3-series.
MAX TEMP
STORAGE
THROUGHPUT:
TEMP IOPS / READ MAX NICS /
STORAGE MAX DATA MBPS / WRITE NETWORK
SIZE VCPU MEMORY: GIB (SSD) GIB DISKS MBPS BANDWIDTH
DSv2-series
ACU: 210-250
Premium Storage: Supported
Premium Storage Caching: Supported
MAX
CACHED
AND TEMP
STORAGE MAX
THROUGHP UNCACHED MAX NICS /
UT: IOPS / DISK EXPECTED
TEMP MBPS THROUGHP NETWORK
MEMORY: STORAGE MAX DATA (CACHE SIZE UT: IOPS / BANDWIDT
SIZE VCPU GIB (SSD) GIB DISKS IN GIB) MBPS H (MBPS)
Dv2-series
ACU: 210-250
Premium Storage: Not Supported
Premium Storage Caching: Not Supported
MAX TEMP
STORAGE
THROUGHP MAX NICS /
UT: IOPS / EXPECTED
TEMP READ MBPS NETWORK
MEMORY: STORAGE / WRITE MAX DATA THROUGHP BANDWIDT
SIZE VCPU GIB (SSD) GIB MBPS DISKS UT: IOPS H (MBPS)
Av2-series
ACU: 100
Premium Storage: Not Supported
Premium Storage Caching: Not Supported
MAX TEMP
STORAGE MAX NICS /
THROUGHPUT: MAX DATA EXPECTED
TEMP IOPS / READ DISKS / NETWORK
STORAGE MBPS / WRITE THROUGHPUT: BANDWIDTH
SIZE VCPU MEMORY: GIB (SSD) GIB MBPS IOPS (MBPS)
MAX
CACHED
AND TEMP
STORAGE MAX
THROUGHP UNCACHED MAX NICS /
UT: IOPS / DISK EXPECTED
TEMP MBPS THROUGHP NETWORK
MEMORY: STORAGE MAX DATA (CACHE SIZE UT: IOPS / BANDWIDT
SIZE VCPU GIB (SSD) GIB DISKS IN GIB) MBPS H (MBPS)
Other sizes
Compute optimized
Memory optimized
Storage optimized
GPU optimized
High performance compute
Previous generations
Next steps
Learn more about how Azure compute units (ACU ) can help you compare compute performance across Azure
SKUs.
B-series burstable virtual machine sizes
4/9/2018 • 4 minutes to read • Edit Online
The B -series VM family allows you to choose which VM size provides you the necessary base level performance
for your workload, with the ability to burst CPU performance up to 100% of an Intel® Broadwell E5-2673 v4 2.3
GHz, or an Intel® Haswell 2.4 GHz E5-2673 v3 processor vCPU.
The B -series VMs are ideal for workloads that do not need the full performance of the CPU continuously, like web
servers, proof of concepts, small databases and development build environments. These workloads typically have
burstable performance requirements. The B -series provides you with the ability to purchase a VM size with
baseline performance and the VM instance builds up credits when it is using less than its baseline. When the VM
has accumulated credit, the VM can burst above the baseline using up to 100% of the vCPU when your application
requires higher CPU performance.
The B -series comes in the following six VM sizes:
Q&A
Q: How do you get 135% baseline performance from a VM?
A: The 135% is shared amongst the 8 vCPU’s that make up the VM size. For example, if your application uses 4 of
the 8 cores working on batch processing and each of those 4 vCPU’s are running at 30% utilization the total
amount of VM CPU performance would equal 120%. Meaning that your VM would be building credit time based
on the 15% delta from your baseline performance. But it also means that when you have credits available that
same VM can use 100% of all 8 vCPU’s giving that VM a Max CPU performance of 800%.
Q: How can I monitor my credit balance and consumption
A: We will be introducing 2 new metrics in the coming weeks, the Credit metric will allow you to view how many
credits your VM has banked and the ConsumedCredit metric will show how many CPU credits your VM has
consumed from the bank. You will be able to view these metrics from the metrics pane in the portal or
programmatically through the Azure Monitor APIs.
For more information on how to access the metrics data for Azure, see Overview of metrics in Microsoft Azure.
Q: How are credits accumulated?
A: The VM accumulation and consumption rates are set such that a VM running at exactly its base performance
level will have neither a net accumulation or consumption of bursting credits. A VM will have a net increase in
credits whenever it is running below its base performance level and will have a net decrease in credits whenever
the VM is utilizing the CPU more than its base performance level.
Example: I deploy a VM using the B1ms size for my small time and attendance database application. This size
allows my application to use up to 20% of a vCPU as my baseline, which is 0.2 credits per minute I can use or
bank.
My application is busy at the beginning and end of my employees work day, between 7:00-9:00 AM and 4:00 -
6:00PM. During the other 20 hours of the day, my application is typically at idle, only using 10% of the vCPU. For
the non-peak hours, I earn 0.2 credits per minute but only consume 0.l credits per minute, so my VM will bank 0.1
x 60 = 6 credits per hour. For the 20 hours that I am off-peak, I will bank 120 credits.
During peak hours my application averages 60% vCPU utilization, I still earn 0.2 credits per minute but I consume
0.6 credits per minute, for a net cost of 0.4 credits a minute or 0.4 x 60 = 24 credits per hour. I have 4 hours per day
of peak usage, so it costs 4 x 24 = 96 credits for my peak usage.
If I take the 120 credits I earned off-peak and subtract the 96 credits I used for my peak times, I bank an additional
24 credits per day that I can use for other bursts of activity.
Q: Does the B -Series support Premium Storage data disks?
A: Yes, all B -Series sizes support Premium Storage data disks.
Q: Why is my remaining credit set to 0 after a redeploy or a stop/start?
A : When a VM is “REDPLOYED” and the VM moves to another node, the accumulated credit is lost. If the VM is
stopped/started, but remains on the same node, the VM retains the accumulated credit. Whenever the VM starts
fresh on a node, it gets an initial credit, for Standard_B8ms it is 240 mins.
Other sizes
General purpose
Compute optimized
Memory optimized
Storage optimized
GPU optimized
High performance compute
Next steps
Learn more about how Azure compute units (ACU ) can help you compare compute performance across Azure
SKUs.
Compute optimized virtual machine sizes
7/6/2018 • 5 minutes to read • Edit Online
Compute optimized VM sizes have a high CPU -to-memory ratio and are good for medium traffic web servers,
network appliances, batch processes, and application servers. This article provides information about the
number of vCPUs, data disks, and NICs as well as storage throughput and network bandwidth for each size in
this grouping.
Fsv2-series is based on the Intel® Xeon® Platinum 8168 processor, featuring a base core frequency of 2.7 GHz
and a maximum single-core turbo frequency of 3.7 GHz. Intel® AVX-512 instructions, which are new on Intel
Scalable Processors, will provide up to a 2X performance boost to vector processing workloads on both single
and double precision floating point operations. In other words, they are really fast for any computational
workload.
At a lower per-hour list price, the Fsv2-series is the best value in price-performance in the Azure portfolio based
on the Azure Compute Unit (ACU ) per vCPU.
F -series is based on the 2.4 GHz Intel Xeon® E5-2673 v3 (Haswell) processor, which can achieve clock speeds
as high as 3.1 GHz with the Intel Turbo Boost Technology 2.0. This is the same CPU performance as the Dv2-
series of VMs.
F -series VMs are an excellent choice for workloads that demand faster CPUs but do not need as much memory
or temporary storage per vCPU. Workloads such as analytics, gaming servers, web servers, and batch
processing will benefit from the value of the F -series.
The Fs-series provides all the advantages of the F -series, in addition to Premium storage.
Fsv2-series 1
ACU: 195 - 210
Premium Storage: Supported
Premium Storage Caching: Supported
MAX
CACHED
AND TEMP
STORAGE MAX
THROUGHP UNCACHED MAX NICS /
UT: IOPS / DISK EXPECTED
TEMP MBPS THROUGHP NETWORK
MEMORY: STORAGE MAX DATA (CACHE SIZE UT: IOPS / BANDWIDT
SIZE VCPU'S GIB (SSD) GIB DISKS IN GIB) MBPS H (MBPS)
Fs-series 1
ACU: 210 - 250
Premium Storage: Supported
Premium Storage Caching: Supported
MAX
CACHED
AND TEMP
STORAGE MAX
THROUGHP UNCACHED MAX NICS /
UT: IOPS / DISK EXPECTED
TEMP MBPS THROUGHP NETWORK
MEMORY: STORAGE MAX DATA (CACHE SIZE UT: IOPS / BANDWIDT
SIZE VCPU GIB (SSD) GIB DISKS IN GIB) MBPS H (MBPS)
F-series
ACU: 210 - 250
Premium Storage: Not Supported
Premium Storage Caching: Not Supported
MAX TEMP
STORAGE MAX NICS /
THROUGHPUT: MAX DATA EXPECTED
TEMP IOPS / READ DISKS / NETWORK
STORAGE MBPS / WRITE THROUGHPUT: BANDWIDTH
SIZE VCPU MEMORY: GIB (SSD) GIB MBPS IOPS (MBPS)
Other sizes
General purpose
Memory optimized
Storage optimized
GPU optimized
High performance compute
Previous generations
Next steps
Learn more about how Azure compute units (ACU ) can help you compare compute performance across Azure
SKUs.
Memory optimized virtual machine sizes
10/18/2018 • 10 minutes to read • Edit Online
Memory optimized VM sizes offer a high memory-to-CPU ratio that are great for relational database servers,
medium to large caches, and in-memory analytics. This article provides information about the number of vCPUs,
data disks and NICs as well as storage throughput and network bandwidth for each size in this grouping.
The M -Series offers the highest vCPU count (up to 128 vCPUs) and largest memory (up to 3.8 TiB ) of any
VM in the cloud. It’s ideal for extremely large databases or other applications that benefit from high vCPU
counts and large amounts of memory.
Dv2-series, G -series, and the DSv2/GS counterparts are ideal for applications that demand faster vCPUs,
better temporary storage performance, or have higher memory demands. They offer a powerful
combination for many enterprise-grade applications.
Dv2-series, a follow -on to the original D -series, features a more powerful CPU. The Dv2-series CPU is
about 35% faster than the D -series CPU. It is based on the latest generation 2.4 GHz Intel Xeon® E5-2673
v3 2.4 GHz (Haswell) or E5-2673 v4 2.3 GHz (Broadwell) processors, and with the Intel Turbo Boost
Technology 2.0, can go up to 3.1 GHz. The Dv2-series has the same memory and disk configurations as the
D -series.
The Ev3-series features the E5-2673 v4 2.3 GHz (Broadwell) processor in a hyper-threaded configuration,
providing a better value proposition for most general purpose workloads, and bringing the Ev3 into
alignment with the general purpose VMs of most other clouds. Memory has been expanded (from 7
GiB/vCPU to 8 GiB/vCPU ) while disk and network limits have been adjusted on a per core basis to align
with the move to hyperthreading. The Ev3 is the follow up to the high memory VM sizes of the D/Dv2
families.
Azure Compute offers virtual machine sizes that are Isolated to a specific hardware type and dedicated to a
single customer. These virtual machine sizes are best suited for workloads that require a high degree of
isolation from other customers for workloads involving elements like compliance and regulatory
requirements. Customers can also choose to further subdivide the resources of these Isolated virtual
machines by using Azure support for nested virtual machines . Please see the tables of virtual machine
families below for your isolated VM options.
Esv3-series
ACU: 160-190 1
Premium Storage: Supported
Premium Storage Caching: Supported
ESv3-series instances are based on the 2.3 GHz Intel XEON ® E5-2673 v4 (Broadwell) processor and can achieve
3.5GHz with Intel Turbo Boost Technology 2.0 and use premium storage. Ev3-series instances are ideal for
memory-intensive enterprise applications.
MAX
CACHED
AND TEMP
STORAGE MAX
THROUGHP UNCACHED MAX NICS /
UT: IOPS / DISK EXPECTED
TEMP MBPS THROUGHP NETWORK
MEMORY: STORAGE MAX DATA (CACHE SIZE UT: IOPS / BANDWIDT
SIZE VCPU GIB (SSD) GIB DISKS IN GIB) MBPS H (MBPS)
Ev3-series
ACU: 160 - 190 1
Premium Storage: Not Supported
Premium Storage Caching: Not Supported
Ev3-series instances are based on the 2.3 GHz Intel XEON ® E5-2673 v4 (Broadwell) processor and can achieve
3.5GHz with Intel Turbo Boost Technology 2.0. Ev3-series instances are ideal for memory-intensive enterprise
applications.
Data disk storage is billed separately from virtual machines. To use premium storage disks, use the ESv3 sizes. The
pricing and billing meters for ESv3 sizes are the same as Ev3-series.
MAX TEMP
STORAGE
THROUGHPUT:
IOPS / READ MAX NICS /
TEMP STORAGE MAX DATA MBPS / WRITE NETWORK
SIZE VCPU MEMORY: GIB (SSD) GIB DISKS MBPS BANDWIDTH
M-series
ACU: 160-180 1
Premium Storage: Supported
Premium Storage Caching: Supported
Write Accelerator: Supported
MAX
CACHED
AND TEMP
STORAGE MAX
THROUGHP UNCACHED MAX NICS /
UT: IOPS / DISK EXPECTED
TEMP MBPS THROUGHP NETWORK
MEMORY: STORAGE MAX DATA (CACHE SIZE UT: IOPS / BANDWIDT
SIZE VCPU GIB (SSD) GIB DISKS IN GIB) MBPS H (MBPS)
4
4 Instance is isolated to hardware dedicated to a single customer.
GS-series
ACU: 180 - 240 1
Premium Storage: Supported
Premium Storage Caching: Supported
MAX
CACHED
AND TEMP
STORAGE MAX
THROUGHP UNCACHED MAX NICS /
UT: IOPS / DISK EXPECTED
TEMP MBPS THROUGHP NETWORK
MEMORY: STORAGE MAX DATA (CACHE SIZE UT: IOPS / BANDWIDT
SIZE VCPU GIB (SSD) GIB DISKS IN GIB) MBPS H (MBPS)
1 The maximum disk throughput (IOPS or MBps) possible with a GS series VM may be limited by the number,
size and striping of the attached disk(s). For details, see Premium Storage: High-performance storage for Azure
virtual machine workloads.
2 Instance is isolated to hardware dedicated to a single customer.
G-series
ACU: 180 - 240
Premium Storage: Not Supported
Premium Storage Caching: Not Supported
MAX TEMP
STORAGE MAX NICS /
THROUGHPUT: MAX DATA EXPECTED
IOPS / READ DISKS / NETWORK
TEMP STORAGE MBPS / WRITE THROUGHPUT: BANDWIDTH
SIZE VCPU MEMORY: GIB (SSD) GIB MBPS IOPS (MBPS)
DSv2-series 11-15
ACU: 210 - 250 1
Premium Storage: Supported
Premium Storage Caching: Supported
MAX
CACHED
AND TEMP
STORAGE MAX
THROUGHP UNCACHED MAX NICS /
UT: IOPS / DISK EXPECTED
TEMP MBPS THROUGHP NETWORK
MEMORY: STORAGE MAX DATA (CACHE SIZE UT: IOPS / BANDWIDT
SIZE VCPU GIB (SSD) GIB DISKS IN GIB) MBPS H (MBPS)
1 The maximum disk throughput (IOPS or MBps) possible with a DSv2 series VM may be limited by the number,
size and striping of the attached disk(s). For details, see Premium Storage: High-performance storage for Azure
virtual machine workloads.
2
2 Instance is isolated to hardware dedicated to a single customer.
Dv2-series 11-15
ACU: 210 - 250
Premium Storage: Not Supported
Premium Storage Caching: Not Supported
MAX TEMP
STORAGE MAX NICS /
THROUGHPUT: MAX DATA EXPECTED
IOPS / READ DISKS / NETWORK
TEMP STORAGE MBPS / WRITE THROUGHPUT: BANDWIDTH
SIZE VCPU MEMORY: GIB (SSD) GIB MBPS IOPS (MBPS)
Other sizes
General purpose
Compute optimized
Storage optimized
GPU optimized
High performance compute
Previous generations
Next steps
Learn more about how Azure compute units (ACU ) can help you compare compute performance across Azure
SKUs.
Constrained vCPU capable VM sizes
3/9/2018 • 2 minutes to read • Edit Online
Some database workloads like SQL Server or Oracle require high memory, storage, and I/O bandwidth, but not a
high core count. Many database workloads are not CPU -intensive. Azure offers certain VM sizes where you can
constrain the VM vCPU count to reduce the cost of software licensing, while maintaining the same memory,
storage, and I/O bandwidth.
The vCPU count can be constrained to one half or one quarter of the original VM size. These new VM sizes have a
suffix that specifies the number of active vCPUs to make them easier for you to identify.
For example, the current VM size Standard_GS5 comes with 32 vCPUs, 448 GB RAM, 64 disks (up to 256 TB ), and
80,000 IOPs or 2 GB/s of I/O bandwidth. The new VM sizes Standard_GS5-16 and Standard_GS5-8 comes with
16 and 8 active vCPUs respectively, while maintaining the rest of the specs of the Standard_GS5 for memory,
storage, and I/O bandwidth.
The licensing fees charged for SQL Server or Oracle are constrained to the new vCPU count, and other products
should be charged based on the new vCPU count. This results in a 50% to 75% increase in the ratio of the VM
specs to active (billable) vCPUs. These new VM sizes that are only available in Azure, allowing workloads to push
higher CPU utilization at a fraction of the (per-core) licensing cost. At this time, the compute cost, which includes
OS licensing, remains the same one as the original size. For more information, see Azure VM sizes for more cost-
effective database workloads.
Other sizes
Compute optimized
Memory optimized
Storage optimized
GPU
High performance compute
Next steps
Learn more about how Azure compute units (ACU ) can help you compare compute performance across Azure
SKUs.
Storage optimized virtual machine sizes
7/6/2018 • 2 minutes to read • Edit Online
Storage optimized VM sizes offer high disk throughput and IO, and are ideal for Big Data, SQL, and NoSQL
databases. This article provides information about the number of vCPUs, data disks and NICs as well as storage
throughput and network bandwidth for each size in this grouping.
The Ls-series offers up to 32 vCPUs, using the Intel® Xeon® processor E5 v3 family. The Ls-series gets the same
CPU performance as the G/GS -Series and comes with 8 GiB of memory per vCPU. Ls-series VMs are ideal for
applications requiring low latency, high throughput, and large local disk storage.
Example use cases include NoSQL databases such as Cassandra, MongoDB, Cloudera, and Redis, data
warehousing, and large transactional databases.
NOTE
The Ls-series is optimized for use of the temporary disk attached to the VM machine rather than use of durable data disks.
The high throughput and IOPS of the temporary disk makes the Ls-series ideal for NoSQL stores such as Apache
Cassandra and MongoDB which replicate data across multiple VMs to achieve persistence in the event of the failure of a
single VM. The Ls-series does not support the creation of a local cache to increase the IOPS achievable by durable data
disks.
Ls-series
ACU: 180-240
Premium Storage: Supported
Premium Storage Caching: Not Supported
MAX
MAX TEMP UNCACHED MAX NICS /
STORAGE DISK EXPECTED
TEMP THROUGHP THROUGHP NETWORK
MEMORY: STORAGE MAX DATA UT: IOPS / UT: IOPS / BANDWIDT
SIZE VCPU GIB (SSD) GIB DISKS MBPS MBPS H (MBPS)
The maximum disk throughput possible with Ls-series VMs may be limited by the number, size, and striping of
any attached disks. For details, see Premium Storage: High-performance storage for Azure virtual machine
workloads.
1 Instance is isolated to hardware dedicated to a single customer.
Size table definitions
Storage capacity is shown in units of GiB or 1024^3 bytes. When comparing disks measured in GB (1000^3
bytes) to disks measured in GiB (1024^3) remember that capacity numbers given in GiB may appear smaller.
For example, 1023 GiB = 1098.4 GB
Disk throughput is measured in input/output operations per second (IOPS ) and MBps where MBps = 10^6
bytes/sec.
If you want to get the best performance for your VMs, you should limit the number of data disks to 2 disks per
vCPU.
Expected network bandwidth is the maximum aggregated bandwidth allocated per VM type across all
NICs, for all destinations. Upper limits are not guaranteed, but are intended to provide guidance for selecting
the right VM type for the intended application. Actual network performance will depend on a variety of factors
including network congestion, application loads, and network settings. For information on optimizing network
throughput, see Optimizing network throughput for Windows and Linux. To achieve the expected network
performance on Linux or Windows, it may be necessary to select a specific version or optimize your VM. For
more information, see How to reliably test for virtual machine throughput.
Other sizes
General purpose
Compute optimized
Memory optimized
GPU optimized
High performance compute
Previous generations
Next steps
Learn more about how Azure compute units (ACU ) can help you compare compute performance across Azure
SKUs.
GPU optimized virtual machine sizes
9/24/2018 • 8 minutes to read • Edit Online
GPU optimized VM sizes are specialized virtual machines available with single or multiple NVIDIA GPUs.
These sizes are designed for compute-intensive, graphics-intensive, and visualization workloads. This article
provides information about the number and type of GPUs, vCPUs, data disks, and NICs. Storage throughput
and network bandwidth are also included for each size in this grouping.
NC, NCv2, NCv3, and ND sizes are optimized for compute-intensive and network-intensive applications
and algorithms. Some examples are CUDA- and OpenCL -based applications and simulations, AI, and Deep
Learning. The NCv3-series is focused on high-performance computing workloads featuring NVIDIA’s Tesla
V100 GPU. The ND -series is focused on training and inference scenarios for deep learning. It uses the
NVIDIA Tesla P40 GPU.
NV and NVv2 sizes are optimized and designed for remote visualization, streaming, gaming, encoding, and
VDI scenarios using frameworks such as OpenGL and DirectX. These VMs are backed by the NVIDIA Tesla
M60 GPU.
NC-series
Premium Storage: Not Supported
Premium Storage Caching: Not Supported
NC -series VMs are powered by the NVIDIA Tesla K80 card. Users can crunch through data faster by leveraging
CUDA for energy exploration applications, crash simulations, ray traced rendering, deep learning and more. The
NC24r configuration provides a low latency, high-throughput network interface optimized for tightly coupled
parallel computing workloads.
TEMP
STORAGE MAX DATA
SIZE VCPU MEMORY: GIB (SSD) GIB GPU DISKS MAX NICS
Standard_NC 6 56 340 1 24 1
6
NCv2-series
Premium Storage: Supported
Premium Storage Caching: Supported
NCv2-series VMs are powered by NVIDIA Tesla P100 GPUs. These GPUs can provide more than 2x the
computational performance of the NC -series. Customers can take advantage of these updated GPUs for
traditional HPC workloads such as reservoir modeling, DNA sequencing, protein analysis, Monte Carlo
simulations, and others. The NC24rs v2 configuration provides a low latency, high-throughput network
interface optimized for tightly coupled parallel computing workloads.
IMPORTANT
For this size family, the vCPU (core) quota in your subscription is initially set to 0 in each region. Request a vCPU quota
increase for this family in an available region.
TEMP
STORAGE MAX DATA
SIZE VCPU MEMORY: GIB (SSD) GIB GPU DISKS MAX NICS
NCv3-series
Premium Storage: Supported
Premium Storage Caching: Supported
NCv3-series VMs are powered by NVIDIA Tesla V100 GPUs. These GPUs can provide 1.5x the computational
performance of the NCv2-series. Customers can take advantage of these updated GPUs for traditional HPC
workloads such as reservoir modeling, DNA sequencing, protein analysis, Monte Carlo simulations, and others.
The NC24rs v3 configuration provides a low latency, high-throughput network interface optimized for tightly
coupled parallel computing workloads.
IMPORTANT
For this size family, the vCPU (core) quota in your subscription is initially set to 0 in each region. Request a vCPU quota
increase for this family in an available region.
TEMP
STORAGE MAX DATA
SIZE VCPU MEMORY: GIB (SSD) GIB GPU DISKS MAX NICS
ND-series
Premium Storage: Supported
Premium Storage Caching: Supported
The ND -series virtual machines are a new addition to the GPU family designed for AI and Deep Learning
workloads. They offer excellent performance for training and inference. ND instances are powered by NVIDIA
Tesla P40 GPUs. These instances provide excellent performance for single-precision floating point operations,
for AI workloads utilizing Microsoft Cognitive Toolkit, TensorFlow, Caffe, and other frameworks. The ND -series
also offers a much larger GPU memory size (24 GB ), enabling to fit much larger neural net models. Like the
NC -series, the ND -series offers a configuration with a secondary low -latency, high-throughput network
through RDMA, and InfiniBand connectivity so you can run large-scale training jobs spanning many GPUs.
IMPORTANT
For this size family, the vCPU (core) quota per region in your subscription is initially set to 0. Request a vCPU quota
increase for this family in an available region.
TEMP
STORAGE MAX DATA
SIZE VCPU MEMORY: GIB (SSD) GIB GPU DISKS MAX NICS
Standard 6 56 340 1 24 1 1 25
_NV6
NVv2-series (Preview)
Premium Storage: Supported
Premium Storage Caching: Supported
The NVv2-series virtual machines are powered by NVIDIA Tesla M60 GPUs and NVIDIA GRID technology
with Intel Broadwell CPUs. These virtual machines are targeted for GPU accelerated graphics applications and
virtual desktops where customers want to visualize their data, simulate results to view, work on CAD, or render
and stream content. Additionally, these virtual machines can run single precision workloads such as encoding
and rendering. NVv2 virtual machines support Premium Storage and come with twice the system memory
(RAM ) when compared with its predecessor NV -series.
Each GPU in NVv2 instances comes with a GRID license. This license gives you the flexibility to use an NV
instance as a virtual workstation for a single user, or 25 concurrent users can connect to the VM for a virtual
application scenario.
Deployment considerations
For availability of N -series VMs, see Products available by region.
N -series VMs can only be deployed in the Resource Manager deployment model.
N -series VMs differ in the type of Azure Storage they support for their disks. NC and NV VMs only
support VM disks that are backed by Standard Disk Storage (HDD ). NCv2, NCv3, ND, and NVv2 VMs
only support VM disks that are backed by Premium Disk Storage (SSD ).
If you want to deploy more than a few N -series VMs, consider a pay-as-you-go subscription or other
purchase options. If you're using an Azure free account, you can use only a limited number of Azure
compute cores.
You might need to increase the cores quota (per region) in your Azure subscription, and increase the
separate quota for NC, NCv2, NCv3, ND, NV, or NVv2 cores. To request a quota increase, open an
online customer support request at no charge. Default limits may vary depending on your subscription
category.
Other sizes
General purpose
Compute optimized
High performance compute
Memory optimized
Storage optimized
Previous generations
Next steps
Learn more about how Azure compute units (ACU ) can help you compare compute performance across Azure
SKUs.
Install NVIDIA GPU drivers on N-series VMs running
Windows
9/24/2018 • 2 minutes to read • Edit Online
To take advantage of the GPU capabilities of Azure N -series VMs running Windows, NVIDIA GPU drivers must be
installed. The NVIDIA GPU Driver Extension installs appropriate NVIDIA CUDA or GRID drivers on an N -series
VM. Install or manage the extension using the Azure portal or tools such as Azure PowerShell or Azure Resource
Manager templates. See the NVIDIA GPU Driver Extension documentation for supported operating systems and
deployment steps.
If you choose to install GPU drivers manually, this article provides supported operating systems, drivers, and
installation and verification steps. Manual driver setup information is also available for Linux VMs.
For basic specs, storage capacities, and disk details, see GPU Windows VM sizes.
TIP
As an alternative to manual CUDA driver installation on a Windows Server VM, you can deploy an Azure Data Science Virtual
Machine image. The DSVM editions for Windows Server 2016 pre-install NVIDIA CUDA drivers, the CUDA Deep Neural
Network Library, and other tools.
OS DRIVER
OS DRIVER
Windows 10
Driver installation
1. Connect by Remote Desktop to each N -series VM.
2. Download, extract, and install the supported driver for your Windows operating system.
After GRID driver installation on a VM, a restart is required. After CUDA driver installation, a restart is not
required.
To query the GPU device state, run the nvidia-smi command-line utility installed with the driver.
1. Open a command prompt and change to the C:\Program Files\NVIDIA Corporation\NVSMI directory.
2. Run nvidia-smi . If the driver is installed you will see output similar to the following. Note that GPU -Util
shows 0% unless you are currently running a GPU workload on the VM. Your driver version and GPU
details may be different from the ones shown.
RDMA network connectivity
RDMA network connectivity can be enabled on RDMA-capable N -series VMs such as NC24r deployed in the
same availability set or in a single placement group in a VM scale set. The HpcVmDrivers extension must be added
to install Windows network device drivers that enable RDMA connectivity. To add the VM extension to an RDMA-
enabled N -series VM, use Azure PowerShell cmdlets for Azure Resource Manager.
To install the latest version 1.1 HpcVMDrivers extension on an existing RDMA-capable VM named myVM in the
West US region:
For more information, see Virtual machine extensions and features for Windows.
The RDMA network supports Message Passing Interface (MPI) traffic for applications running with Microsoft MPI
or Intel MPI 5.x.
Next steps
Developers building GPU -accelerated applications for the NVIDIA Tesla GPUs can also download and install
the latest CUDA Toolkit. For more information, see the CUDA Installation Guide.
High performance compute VM sizes
10/15/2018 • 6 minutes to read • Edit Online
Azure H-series virtual machines are the latest in high performance computing VMs aimed at handling
workloads like batch processing, analytics, molecular modeling, and fluid dynamics. These 8 and 16 vCPU VMs
are built on the Intel Haswell E5-2667 V3 processor technology featuring DDR4 memory and SSD -based
temporary storage.
In addition to the substantial CPU power, the H-series offers diverse options for low latency RDMA networking
using FDR InfiniBand and several memory configurations to support memory intensive computational
requirements.
H-series
ACU: 290-300
Premium Storage: Not Supported
Premium Storage Caching: Not Supported
1 For MPI applications, dedicated RDMA backend network is enabled by FDR InfiniBand network, which
delivers ultra-low -latency and high bandwidth.
Deployment considerations
Azure subscription – To deploy more than a few compute-intensive instances, consider a pay-as-you-
go subscription or other purchase options. If you're using an Azure free account, you can use only a
limited number of Azure compute cores.
Pricing and availability - These VM sizes are offered only in the Standard pricing tier. Check Products
available by region for availability in Azure regions.
Cores quota – You might need to increase the cores quota in your Azure subscription from the default
value. Your subscription might also limit the number of cores you can deploy in certain VM size families,
including the H-series. To request a quota increase, open an online customer support request at no
charge. (Default limits may vary depending on your subscription category.)
NOTE
Contact Azure Support if you have large-scale capacity needs. Azure quotas are credit limits, not capacity
guarantees. Regardless of your quota, you are only charged for cores that you use.
Virtual network – An Azure virtual network is not required to use the compute-intensive instances.
However, for many deployments you need at least a cloud-based Azure virtual network, or a site-to-site
connection if you need to access on-premises resources. When needed, create a new virtual network to
deploy the instances. Adding compute-intensive VMs to a virtual network in an affinity group is not
supported.
Resizing – Because of their specialized hardware, you can only resize compute-intensive instances within
the same size family (H-series or compute-intensive A-series). For example, you can only resize an H-series
VM from one H-series size to another. In addition, resizing from a non-compute-intensive size to a
compute-intensive size is not supported.
RDMA-capable instances
A subset of the compute-intensive instances (H16r, H16mr, A8, and A9) feature a network interface for remote
direct memory access (RDMA) connectivity. (Selected N -series sizes designated with 'r' such as NC24r are also
RDMA-capable.) This interface is in addition to the standard Azure network interface available to other VM
sizes.
This interface allows the RDMA-capable instances to communicate over an InfiniBand (IB ) network, operating
at FDR rates for H16r, H16mr, and RDMA-capable N -series virtual machines, and QDR rates for A8 and A9
virtual machines. These RDMA capabilities can boost the scalability and performance of certain Message
Passing Interface (MPI) applications.
NOTE
In Azure, IP over IB is not supported. Only RDMA over IB is supported.
Operating system - Windows Server 2016, Windows Server 2012 R2, Windows Server 2012
MPI - Microsoft MPI (MS -MPI) 2012 R2 or later, Intel MPI Library 5.x
Supported MPI implementations use the Microsoft Network Direct interface to communicate between
instances.
RDMA network address space - The RDMA network in Azure reserves the address space
172.16.0.0/16. To run MPI applications on instances deployed in an Azure virtual network, make sure
that the virtual network address space does not overlap the RDMA network.
HpcVmDrivers VM extension - On RDMA-capable VMs, add the HpcVmDrivers extension to install
Windows network device drivers for RDMA connectivity. (In certain deployments of A8 and A9
instances, the HpcVmDrivers extension is added automatically.) To add the VM extension to a VM, you
can use Azure PowerShell cmdlets.
The following command installs the latest version 1.1 HpcVMDrivers extension on an existing RDMA-capable
VM named myVM deployed in the resource group named myResourceGroup in the West US region:
For more information, see Virtual machine extensions and features. You can also work with extensions for VMs
deployed in the classic deployment model.
Cluster configuration options
Azure provides several options to create clusters of Windows HPC VMs that can communicate using the
RDMA network, including:
Virtual machines - Deploy the RDMA-capable HPC VMs in the same availability set (when you use the
Azure Resource Manager deployment model). If you use the classic deployment model, deploy the VMs
in the same cloud service.
Virtual machine scale sets - In a VM scale set, ensure that you limit the deployment to a single
placement group. For example, in a Resource Manager template, set the singlePlacementGroup property
to true .
Azure CycleCloud - Create an HPC cluster in Azure CycleCloud to run MPI jobs on Windows nodes.
Azure Batch - Create an Azure Batch pool to run MPI workloads on Windows Server compute nodes.
For more information, see Use RDMA-capable or GPU -enabled instances in Batch pools. Also see the
Batch Shipyard project, for running container-based workloads on Batch.
Microsoft HPC Pack - HPC Pack includes a runtime environment for MS -MPI that uses the Azure
RDMA network when deployed on RDMA-capable Windows VMs. For example deployments, see Set
up a Windows RDMA cluster with HPC Pack to run MPI applications.
Other sizes
General purpose
Compute optimized
Memory optimized
Storage optimized
GPU optimized
Previous generations
Next steps
For checklists to use the compute-intensive instances with HPC Pack on Windows Server, see Set up a
Windows RDMA cluster with HPC Pack to run MPI applications.
To use compute-intensive instances when running MPI applications with Azure Batch, see Use multi-
instance tasks to run Message Passing Interface (MPI) applications in Azure Batch.
Learn more about how Azure compute units (ACU ) can help you compare compute performance across
Azure SKUs.
Previous generations of virtual machine sizes
7/6/2018 • 6 minutes to read • Edit Online
This article provides information on previous generations of virtual machine sizes. These sizes can still be used,
but there are newer generations available.
DS-series
ACU: 160
Premium Storage: Supported
Premium Storage Caching: Supported
MAX
CACHED
AND TEMP
STORAGE MAX
THROUGHP UNCACHED MAX NICS /
UT: IOPS / DISK EXPECTED
TEMP MBPS THROUGHP NETWORK
MEMORY: STORAGE MAX DATA (CACHE SIZE UT: IOPS / BANDWIDTH
SIZE VCPU GIB (SSD) GIB DISKS IN GIB) MBPS (MBPS)
1 The maximum disk throughput (IOPS or MBps) possible with a DS series VM may be limited by the number, size
and striping of the attached disk(s). For details, see Premium Storage: High-performance storage for Azure virtual
machine workloads.
D-series
ACU: 160
Premium Storage: Not Supported
Premium Storage Caching: Not Supported
MAX TEMP
STORAGE MAX NICS /
THROUGHPUT: MAX DATA EXPECTED
IOPS / READ DISKS / NETWORK
TEMP STORAGE MBPS / WRITE THROUGHPUT: BANDWIDTH
SIZE VCPU MEMORY: GIB (SSD) GIB MBPS IOPS (MBPS)
MAX TEMP
STORAGE MAX NICS /
THROUGHPUT: MAX DATA EXPECTED
IOPS / READ DISKS / NETWORK
TEMP STORAGE MBPS / WRITE THROUGHPUT: BANDWIDTH
SIZE VCPU MEMORY: GIB (SSD) GIB MBPS IOPS (MBPS)
MAX DATA
DISK
TEMP STORAGE MAX DATA THROUGHPUT:
SIZE VCPU MEMORY: GIB (HDD): GIB DISKS IOPS MAX NICS
1For MPI applications, dedicated RDMA backend network is enabled by FDR InfiniBand network, which delivers
ultra-low -latency and high bandwidth.
A-series
ACU: 50-100
Premium Storage: Not Supported
Premium Storage Caching: Not Supported
MAX NICS /
MAX DATA EXPECTED
DISK NETWORK
TEMP STORAGE MAX DATA THROUGHPUT: BANDWIDTH
SIZE VCPU MEMORY: GIB (HDD): GIB DISKS IOPS (MBPS)
1 The A0 size is over-subscribed on the physical hardware. For this specific size only, other customer deployments
may impact the performance of your running workload. The relative performance is outlined below as the
expected baseline, subject to an approximate variability of 15 percent.
Standard A0 - A4 using CLI and PowerShell
In the classic deployment model, some VM size names are slightly different in CLI and PowerShell:
Standard_A0 is ExtraSmall
Standard_A1 is Small
Standard_A2 is Medium
Standard_A3 is Large
Standard_A4 is ExtraLarge
Basic A
Premium Storage: Not Supported
Premium Storage Caching: Not Supported
The basic tier sizes are primarily for development workloads and other applications that don't require load
balancing, auto-scaling, or memory-intensive virtual machines.
Other sizes
General purpose
Compute optimized
Memory optimized
Storage optimized
GPU
High performance compute
Next steps
Learn more about how Azure compute units (ACU ) can help you compare compute performance across Azure
SKUs.
Azure compute unit (ACU)
4/9/2018 • 2 minutes to read • Edit Online
The concept of the Azure Compute Unit (ACU ) provides a way of comparing compute (CPU ) performance
across Azure SKUs. This will help you easily identify which SKU is most likely to satisfy your performance
needs. ACU is currently standardized on a Small (Standard_A1) VM being 100 and all other SKUs then
represent approximately how much faster that SKU can run a standard benchmark.
IMPORTANT
The ACU is only a guideline. The results for your workload may vary.
A0 50 1:1
M 160-180 2:1**
ACUs marked with a * use Intel® Turbo technology to increase CPU frequency and provide a performance
boost. The amount of the boost can vary based on the VM size, workload, and other workloads running on the
same host.
**Hyper-threaded and capable of running nested virtualization
Here are links to more information about the different sizes:
General-purpose
Memory optimized
Compute optimized
GPU optimized
High performance compute
Storage optimized
Compute benchmark scores for Windows VMs
7/13/2018 • 2 minutes to read • Edit Online
The following SPECInt benchmark scores show compute performance for Azure's high-performance VM lineup
running Windows Server. Compute benchmark scores are also available for Linux VMs.
NOTE
The Linux numbers have been recently updated and contain a more comprehensive set of VMs.
A-series - compute-intensive
SIZE VCPUS NUMA NODES CPU RUNS AVG BASE RATE STDDEV
Dv2-series
SIZE VCPUS NUMA NODES CPU RUNS AVG BASE RATE STDDEV
G-series, GS-series
SIZE VCPUS NUMA NODES CPU RUNS AVG BASE RATE STDDEV
H-series
SIZE VCPUS NUMA NODES CPU RUNS AVG BASE RATE STDDEV
About SPECint
Windows numbers were computed by running SPECint 2006 on Windows Server. SPECint was run using the
base rate option (SPECint_rate2006), with one copy per vCPU. SPECint consists of 12 separate tests, each run
three times, taking the median value from each test and weighting them to form a composite score. Those tests
were then run across multiple VMs to provide the average scores shown.
Next steps
For storage capacities, disk details, and additional considerations for choosing among VM sizes, see Sizes for
virtual machines.
Planned maintenance for virtual machines in Azure
3/22/2018 • 4 minutes to read • Edit Online
Azure periodically performs updates to improve the reliability, performance, and security of the host infrastructure
for virtual machines. These updates range from patching software components in the hosting environment (like
operating system, hypervisor, and various agents deployed on the host), upgrading networking components, to
hardware decommissioning. The majority of these updates are performed without any impact to the hosted virtual
machines. However, there are cases where updates do have an impact:
If a reboot-less update is possible, Azure uses memory preserving maintenance to pause the VM while the
host is updated or the VM is moved to an already updated host altogether.
If maintenance requires a reboot, you get a notice of when the maintenance is planned. In these cases, you'll
also be given a time window where you can start the maintenance yourself, at a time that works for you.
This page describes how Microsoft Azure performs both types of maintenance. For more information about
unplanned events (outages), see Manage the availability of virtual machines for Windows or Linux.
Applications running in a virtual machine can gather information about upcoming updates by using the Azure
Metadata Service for Windows or Linux.
For "how -to" information on managing planned maintenance, see "Handling planned maintenance notifications"
for Linux or Windows.
Next steps
For information on managing maintenance requiring a reboot, see Handling planned maintenance notifications.
About disks storage for Azure Windows VMs
9/24/2018 • 10 minutes to read • Edit Online
Just like any other computer, virtual machines in Azure use disks as a place to store an operating system,
applications, and data. All Azure virtual machines have at least two disks – a Windows operating system disk and a
temporary disk. The operating system disk is created from an image, and both the operating system disk and the
image are virtual hard disks (VHDs) stored in an Azure storage account. Virtual machines also can have one or
more data disks, that are also stored as VHDs.
In this article, we will talk about the different uses for the disks, and then discuss the different types of disks you
can create and use. This article is also available for Linux virtual machines.
NOTE
Azure has two different deployment models for creating and working with resources: Resource Manager and classic. This
article covers using both models, but Microsoft recommends that most new deployments use the Resource Manager model.
NOTE
For more information about virtual machines capacities, see Sizes for Windows virtual machines.
Azure creates an operating system disk when you create a virtual machine from an image. If you use an image that
includes data disks, Azure also creates the data disks when it creates the virtual machine. Otherwise, you add data
disks after you create the virtual machine.
You can add data disks to a virtual machine at any time, by attaching the disk to the virtual machine. You can use
a VHD that you've uploaded or copied to your storage account, or use an empty VHD that Azure creates for you.
Attaching a data disk associates the VHD file with the VM by placing a 'lease' on the VHD so it can't be deleted
from storage while it's still attached.
About VHDs
The VHDs used in Azure are .vhd files stored as page blobs in a standard or premium storage account in Azure.
For details about page blobs, see Understanding block blobs and page blobs. For details about premium storage,
see High-performance premium storage and Azure VMs.
Azure supports the fixed disk VHD format. The fixed format lays the logical disk out linearly within the file, so that
disk offset X is stored at blob offset X. A small footer at the end of the blob describes the properties of the VHD.
Often, the fixed-format wastes space because most disks have large unused ranges in them. However, Azure stores
.vhd files in a sparse format, so you receive the benefits of both the fixed and dynamic disks at the same time. For
more information, see Getting started with virtual hard disks .
All VHD files in Azure that you want to use as a source to create disks or images are read-only, except the .vhd files
uploaded or copied to Azure storage by the user (which can be either read-write or read-only). When you create a
disk or image, Azure makes copies of the source .vhd files. These copies can be read-only or read-and-write,
depending on how you use the VHD.
When you create a virtual machine from an image, Azure creates a disk for the virtual machine that is a copy of the
source .vhd file. To protect against accidental deletion, Azure places a lease on any source .vhd file that’s used to
create an image, an operating system disk, or a data disk.
Before you can delete a source .vhd file, you’ll need to remove the lease by deleting the disk or image. To delete a
.vhd file that is being used by a virtual machine as an operating system disk, you can delete the virtual machine,
the operating system disk, and the source .vhd file all at once by deleting the virtual machine and deleting all
associated disks. However, deleting a .vhd file that’s a source for a data disk requires several steps in a set order.
First you detach the disk from the virtual machine, then delete the disk, and then delete the .vhd file.
WARNING
If you delete a source .vhd file from storage, or delete your storage account, Microsoft can't recover that data for you.
Types of disks
Azure Disks are designed for 99.999% availability. Azure Disks have consistently delivered enterprise-grade
durability, with an industry-leading ZERO% Annualized Failure Rate.
There are three performance tiers for storage that you can choose from when creating your disks -- Premium SSD
Disks, Standard SSD, and Standard HDD Storage. Also, there are two types of disks -- unmanaged and managed.
Standard HDD disks
Standard HDD disks are backed by HDDs, and deliver cost-effective storage. Standard HDD storage can be
replicated locally in one datacenter, or be geo-redundant with primary and secondary data centers. For more
information about storage replication, see Azure Storage replication.
For more information about using Standard HDD disks, see Standard Storage and Disks.
Standard SSD disks
Standard SSD disks are designed to address the same kind of workloads as Standard HDD disks, but offer more
consistent performance and reliability than HDD. Standard SSD disks combine elements of Premium SSD disks
and Standard HDD disks to form a cost-effective solution best suited for applications like web servers that do not
need high IOPS on disks. Where available, Standard SSD disks are the recommended deployment option for most
workloads. Standard SSD disks are available as Managed Disks in all regions but are currently only available with
the locally redundant storage (LRS ) resiliency type.
Premium SSD disks
Premium SSD disks are backed by SSDs, and delivers high-performance, low -latency disk support for VMs
running I/O -intensive workloads. Typically you can use Premium SSD disks with sizes that include an "s" in the
series name. For example, there is the Dv3-Series and the Dsv3-series, the Dsv3-series can be used with Premium
SSD disks. For more information, please see Premium Storage.
Unmanaged disks
Unmanaged disks are the traditional type of disks that have been used by VMs. With these disks, you create your
own storage account and specify that storage account when you create the disk. Make sure you don't put too many
disks in the same storage account, because you could exceed the scalability targets of the storage account (20,000
IOPS, for example), resulting in the VMs being throttled. With unmanaged disks, you have to figure out how to
maximize the use of one or more storage accounts to get the best performance out of your VMs.
Managed disks
Managed Disks handles the storage account creation/management in the background for you, and ensures that
you do not have to worry about the scalability limits of the storage account. You simply specify the disk size and
the performance tier (Standard/Premium), and Azure creates and manages the disk for you. As you add disks or
scale the VM up and down, you don't have to worry about the storage being used.
You can also manage your custom images in one storage account per Azure region, and use them to create
hundreds of VMs in the same subscription. For more information about Managed Disks, see the Managed Disks
Overview.
We recommend that you use Azure Managed Disks for new VMs, and that you convert your previous unmanaged
disks to managed disks, to take advantage of the many features available in Managed Disks.
Disk comparison
The following table provides a comparison of Standard HDD, Standard SSD, and Premium SSD for unmanaged
and managed disks to help you decide what to use. Sizes denoted with an asterisk are currently in preview.
AZURE PREMIUM DISK AZURE STANDARD SSD DISK AZURE STANDARD HDD DISK
Disk Type Solid State Drives (SSD) Solid State Drives (SSD) Hard Disk Drives (HDD)
Scenario Production and performance Web servers, lightly used Backup, Non-critical,
sensitive workloads enterprise applications and Infrequent access
Dev/Test
AZURE PREMIUM DISK AZURE STANDARD SSD DISK AZURE STANDARD HDD DISK
Disk Size P4: 32 GiB (Managed Disks Managed Disks only: Unmanaged Disks: 1 GiB – 4
only) E10: 128 GiB TiB (4095 GiB)
P6: 64 GiB (Managed Disks E15: 256 GiB
only) E20: 512 GiB Managed Disks:
P10: 128 GiB E30: 1024 GiB S4: 32 GiB
P15: 256 GiB (Managed E40: 2048 GiB S6: 64 GiB
Disks only) E50: 4095 GiB S10: 128 GiB
P20: 512 GiB E60: 8,192 GiB * (8 TiB) S15: 256 GiB
P30: 1024 GiB E70: 16,384 GiB * (16 TiB) S20: 512 GiB
P40: 2048 GiB E80: 32,767 GiB * (32 TiB) S30: 1024 GiB
P50: 4,095 GiB S40: 2048 GiB
P60: 8,192 GiB * (8 TiB) S50: 4095 GiB
P70: 16,384 GiB * (16 TiB) S60: 8,192 GiB * (8 TiB)
P80: 32,767 GiB * (32 TiB) S70: 16,384 GiB * (16 TiB)
S80: 32,384 GiB * (32 TiB)
Max Throughput per Disk P4: 25 MiB/s E10-E50: Up to 60 MiB/s S4 - S50: Upt o 60 MiB/s
P6: 50 MiB/s E60: Up to 300 MiB/s * S60: Up to 300 MiB/s *
P10: 100 MiB/s E70-E80: 500 MiB/s * S70-S80: Up to 500 MiB/s *
P15: 200 MiB/s
P20: 150 MiB/s
P30: 200 MiB/s
P40-P50: 250 MiB/s
P60: 480 MiB/s
P70-P80: 750 MiB/s
Max IOPS per Disk P4: 120 IOPS E10-E50: Up to 500 IOPS S4-S50: Up to 500 IOPS
P6: 240 IOPS E60: Up to 1300 IOPS * S60: Up to 1300 IOPS *
P10: 500 IOPS E70-E80: Up to 2000 IOPS * S70-S80: Up to 2000 IOPS *
P15: 1100 IOPS
P20: 2300 IOPS
P30: 5000 IOPS
P40-P50: 7500 IOPS
P60: 12,500 IOPS *
P70: 15,000 IOPS *
P80: 20,000 IOPS *
If the command returns 0, TRIM is enabled correctly. If it returns 1, run the following command to enable TRIM:
Next steps
Attach a disk to add additional storage for your VM.
Create a snapshot.
Convert to managed disks.
Azure Managed Disks Overview
8/8/2018 • 9 minutes to read • Edit Online
Azure Managed Disks simplifies disk management for Azure IaaS VMs by managing the storage accounts
associated with the VM disks. You only have to specify the type (Standard HDD, Standard SSD, or Premium SSD )
and the size of disk you need, and Azure creates and manages the disk for you.
PREMI
UM
HDD
MANA
GED
DISK
TYPE P4 P6 P10 P15 P20 P30 P40 P50 P60 P70 P80
Disk 32 64 128 256 512 1,024 2,048 4,095 8,192 16,38 32,76
Size GiB GiB GiB GiB GiB GiB (1 GiB (2 GiB (4 GiB (8 4 GiB 7 GiB
TiB) TiB) TiB) TiB) (16 (TiB)
TiB)
Here are the disk sizes available for a standard SSD managed disk:
STANDA
RD SSD
MANAGE
D
DISK
TYPE E10 E15 E20 E30 E40 E50 E60 E70 E80
Disk Size 128 GiB 256 GiB 512 GiB 1,024 2,048 4,095 8,192 16,384 32,767
GiB (1 GiB (2 GiB (4 GiB (8 GiB (16 GiB (TiB)
TiB) TiB) TiB) TiB) TiB)
Here are the disk sizes available for a standard HDD managed disk:
STAN
DARD
HDD
MANA
GED
DISK
TYPE S4 S6 S10 S15 S20 S30 S40 S50 S60 S70 S80
Disk 32 64 128 256 512 1,024 2,048 4,095 8,192 16,38 32,76
Size GiB GiB GiB GiB GiB GiB (1 GiB (2 GiB (4 GiB (8 4 GiB 7 GiB
TiB) TiB) TiB) TiB) (16 (TiB)
TiB)
Number of transactions: You are billed for the number of transactions that you perform on a standard
managed disk.
Standard SSD Disks use IO Unit size of 256KB. If the data being transferred is less than 256 KB, it is considered 1
I/O unit. Larger I/O sizes are counted as multiple I/Os of size 256 KB. For example, a 1,100 KB I/O is counted as
five I/O units.
There is no cost for transactions for a premium managed disk.
Outbound data transfers: Outbound data transfers (data going out of Azure data centers) incur billing for
bandwidth usage.
For detailed information on pricing for Managed Disks, see Managed Disks Pricing.
Images
Managed Disks also support creating a managed custom image. You can create an image from your custom VHD
in a storage account or directly from a generalized (sys-prepped) VM. This process captures in a single image all
managed disks associated with a VM, including both the OS and data disks. This managed custom image enables
creating hundreds of VMs using your custom image without the need to copy or manage any storage accounts.
For information on creating images, see the following articles:
How to capture a managed image of a generalized VM in Azure
How to generalize and capture a Linux virtual machine using the Azure CLI
Next steps
For more information about Managed Disks, please refer to the following articles.
Get started with Managed Disks
Create a VM using Resource Manager and PowerShell
Create a Linux VM using the Azure CLI
Attach a managed data disk to a Windows VM using PowerShell
Add a managed disk to a Linux VM
Managed Disks PowerShell Sample Scripts
Use Managed Disks in Azure Resource Manager templates
Compare Managed Disks storage options
Premium SSD disks
Standard SSD and HDD disks
Operational guidance
Migrate from AWS and other platforms to Managed Disks in Azure
Convert Azure VMs to managed disks in Azure
High-performance Premium Storage and managed
disks for VMs
8/8/2018 • 22 minutes to read • Edit Online
Azure Premium Storage delivers high-performance, low -latency disk support for virtual machines (VMs) with
input/output (I/O )-intensive workloads. VM disks that use Premium Storage store data on solid-state drives
(SSDs). To take advantage of the speed and performance of premium storage disks, you can migrate existing
VM disks to Premium Storage.
In Azure, you can attach several premium storage disks to a VM. Using multiple disks gives your applications
up to 256 TB of storage per VM, if you use the preview sizes your application can have up to around 2 PiB of
storage per VM. With Premium Storage, your applications can achieve 80,000 I/O operations per second
(IOPS ) per VM, and a disk throughput of up to 2,000 megabytes per second (MB/s) per VM. Read operations
give you very low latencies.
With Premium Storage, Azure offers the ability to truly lift-and-shift demanding enterprise applications like
Dynamics AX, Dynamics CRM, Exchange Server, SAP Business Suite, and SharePoint farms to the cloud. You
can run performance-intensive database workloads in applications like SQL Server, Oracle, MongoDB, MySQL,
and Redis, which require consistent high performance and low latency.
NOTE
For the best performance for your application, we recommend that you migrate any VM disk that requires high IOPS to
Premium Storage. If your disk does not require high IOPS, you can help limit costs by keeping it in standard Azure
Storage. In standard storage, VM disk data is stored on hard disk drives (HDDs) instead of on SSDs.
Azure offers two ways to create premium storage disks for VMs:
Unmanaged disks
The original method is to use unmanaged disks. In an unmanaged disk, you manage the storage
accounts that you use to store the virtual hard disk (VHD ) files that correspond to your VM disks. VHD
files are stored as page blobs in Azure storage accounts.
Managed disks
When you choose Azure Managed Disks, Azure manages the storage accounts that you use for your VM
disks. You specify the disk type (Premium or Standard) and the size of the disk that you need. Azure
creates and manages the disk for you. You don't have to worry about placing the disks in multiple
storage accounts to ensure that you stay within scalability limits for your storage accounts. Azure
handles that for you.
We recommend that you choose managed disks, to take advantage of their many features.
To get started with Premium Storage, create your free Azure account.
For information about migrating your existing VMs to Premium Storage, see Convert a Windows VM from
unmanaged disks to managed disks or Convert a Linux VM from unmanaged disks to managed disks.
NOTE
Premium Storage is available in most regions. For the list of available regions, see the row for Disk Storage in Azure
products available by region.
Features
Here are some of the features of Premium Storage:
Premium storage disks
Premium Storage supports VM disks that can be attached to specific size-series VMs. Premium Storage
supports a wide variety of Azure VMs. You have a choice of eight GA disk sizes: P4 (32 GiB ), P6 (64 GiB ),
P10 (128 GiB ), P15 (256 GiB ), P20 (512 GiB ), P30 (1,024 GiB ), P40 (2,048 GiB ), P50 (4,095 GiB ). As well
as three preview disk sizes: P60 8,192 GiB (8 TiB ), P70 16,348 GiB (16 TiB ), P80 32,767 GiB (32 TiB ). P4,
P6, P15, P60, P70, and P80 disk sizes are currently only supported for Managed Disks. Each disk size
has its own performance specifications. Depending on your application requirements, you can attach one
or more disks to your VM. We describe the specifications in more detail in Premium Storage scalability
and performance targets.
Premium page blobs
Premium Storage supports page blobs. Use page blobs to store persistent, unmanaged disks for VMs in
Premium Storage. Unlike standard Azure Storage, Premium Storage does not support block blobs,
append blobs, files, tables, or queues. Premium page blobs support six sizes from P10 to P50, and P60
(8191GiB ). P60 Premium page blob is not supported to be attached as VM disks.
Any object placed in a premium storage account will be a page blob. The page blob snaps to one of the
supported provisioned sizes. This is why a premium storage account is not intended to be used to store
tiny blobs.
Premium storage account
To start using Premium Storage, create a premium storage account for unmanaged disks. In the Azure
portal, to create a premium storage account, choose the Premium performance tier. Select the Locally-
redundant storage (LRS ) replication option. You also can create a premium storage account by setting
the performance tier to Premium_LRS. To change the performance tier, use one of the following
approaches:
PowerShell for Azure Storage
Azure CLI for Azure Storage
Azure Storage Resource Provider REST API (for Azure Resource Manager deployments) or one
of the Azure Storage resource provider client libraries
To learn about premium storage account limits, see Premium Storage scalability and performance
targets.
Premium locally redundant storage
A premium storage account supports only locally redundant storage as the replication option. Locally
redundant storage keeps three copies of the data within a single region. For regional disaster recovery,
you must back up your VM disks in a different region by using Azure Backup. You also must use a geo-
redundant storage (GRS ) account as the backup vault.
Azure uses your storage account as a container for your unmanaged disks. When you create an Azure
VM that supports Premium Storage with unmanaged disks, and you select a premium storage account,
your operating system and data disks are stored in that storage account.
Supported VMs
Premium Storage is supported on a wide variety of Azure VMs. You can use standard and premium storage
disks with these VM types. You cannot use premium storage disks with VM series that are not Premium
Storage-compatible.
For information about VM types and sizes in Azure for Windows, see Windows VM sizes. For information
about VM types and sizes in Azure for Linux, see Linux VM sizes.
These are some of the features supported on premium storage enabled VMs:
Availability Set
Using the example of a DS -series VMs, you can add a DS -series VM to a cloud service that has only DS -
series VMs. Do not add DS -series VMs to an existing cloud service that has any type other than DS -
series VMs. You can migrate your existing VHDs to a new cloud service that runs only DS -series VMs. If
you want to use the same virtual IP address for the new cloud service that hosts your DS -series VMs,
use reserved IP addresses.
Operating system disk
You can set up your Premium Storage VM to use either a premium or a standard operating system disk.
For the best experience, we recommend using a Premium Storage-based operating system disk.
Data disks
You can use premium and standard disks in the same Premium Storage VM. With Premium Storage,
you can provision a VM and attach several persistent data disks to the VM. If needed, to increase the
capacity and performance of the volume, you can stripe across your disks.
NOTE
If you stripe premium storage data disks by using Storage Spaces, set up Storage Spaces with 1 column for each
disk that you use. Otherwise, overall performance of the striped volume might be lower than expected because of
uneven distribution of traffic across the disks. By default, in Server Manager, you can set up columns for up to 8
disks. If you have more than 8 disks, use PowerShell to create the volume. Specify the number of columns
manually. Otherwise, the Server Manager UI continues to use 8 columns, even if you have more disks. For
example, if you have 32 disks in a single stripe set, specify 32 columns. To specify the number of columns the
virtual disk uses, in the New-VirtualDisk PowerShell cmdlet, use the NumberOfColumns parameter. For more
information, see Storage Spaces Overview and Storage Spaces FAQs.
Cache
Virtual Machines (VMs) that support Premium Storage have a unique caching capability for higher
levels of throughput and reduced latency. Their caching capability exceeds underlying premium storage
disk performance. Not all VMs support caching however, so please review the VM specifications for the
VM sizes you are interested for more information. VMs that do support caching will indicate this in their
spec with a "Max cached and temp storage throughput" measurement. They are also specified directly
under the VM title.
With caching, you can set the disk caching policy on premium storage disks to ReadOnly, ReadWrite,
or None. The default disk caching policy is ReadOnly for all premium data disks, and ReadWrite for
operating system disks. For optimal performance for your application please remember to use the
correct cache setting.
As an example, for read-heavy or read-only data disks, such as SQL Server data files, set the disk
caching policy to ReadOnly. For write-heavy or write-only data disks, such as SQL Server log files, set
the disk caching policy to None.
To learn more about optimizing your design with Premium Storage, see Design for performance with
Premium Storage.
Analytics
To analyze VM performance by using disks in Premium Storage, turn on VM diagnostics in the Azure
portal. For more information, see Azure VM monitoring with Azure Diagnostics Extension.
To see disk performance, use operating system-based tools like Windows Performance Monitor for
Windows VMs and the iostat command for Linux VMs.
VM scale limits and performance
Each Premium Storage-supported VM size has scale limits and performance specifications for IOPS,
bandwidth, and the number of disks that can be attached per VM. When you use premium storage disks
with VMs, make sure that there is sufficient IOPS and bandwidth on your VM to drive disk traffic.
For example, a STANDARD_DS1 VM has a dedicated bandwidth of 32 MB/s for premium storage disk
traffic. A P10 premium storage disk can provide a bandwidth of 100 MB/s. If a P10 premium storage
disk is attached to this VM, it can only go up to 32 MB/s. It cannot use the maximum 100 MB/s that the
P10 disk can provide.
Currently, the largest VM in the DS -series is the Standard_DS15_v2. The Standard_DS15_v2 can
provide up to 960 MB/s across all disks. The largest VM in the GS -series is the Standard_GS5. The
Standard_GS5 can provide up to 2,000 MB/s across all disks.
These limits are for disk traffic only. These limits don't include cache hits and network traffic. A separate
bandwidth is available for VM network traffic. Bandwidth for network traffic is different from the
dedicated bandwidth used by premium storage disks.
For the most up-to-date information about maximum IOPS and throughput (bandwidth) for Premium
Storage-supported VMs, see Windows VM sizes or Linux VM sizes.
For more information about premium storage disks and their IOPS and throughput limits, see the table
in the next section.
PREMI
UM
DISKS
TYPE P4 P6 P10 P15 P20 P30 P40 P50 P60 P70 P80
Disk 32 64 128 256 512 1024 2048 4095 8192 16,38 32,76
size GiB GiB GiB GiB GiB GiB (1 GiB (2 GiB (4 GiB (8 4 GiB 7 GiB
TiB) TiB) TiB) TiB) (16 (32
TiB) TiB)
IOPS 120 240 500 1100 2300 5000 7500 7500 12,50 15,00 20,00
per 0 0 0
disk
Throu 25 50 100 125 150 200 250 250 480 750 750
ghput MB MB MB MB MB MB MB MB MB MB MB
per per per per per per per per per per per per
disk secon secon secon secon secon secon secon secon secon secon secon
d d d d d d d d d d d
NOTE
Make sure sufficient bandwidth is available on your VM to drive disk traffic, as described in Premium Storage-supported
VMs. Otherwise, your disk throughput and IOPS is constrained to lower values. Maximum throughput and IOPS are
based on the VM limits, not on the disk limits described in the preceding table.
Azure has designed Premium Storage platform to be massively parallel. Designing your application to be multi-threaded
will help to achieve the high performance target offered on the larger disk sizes.
Here are some important things to know about Premium Storage scalability and performance targets:
Provisioned capacity and performance
When you provision a premium storage disk, unlike standard storage, you are guaranteed the capacity,
IOPS, and throughput of that disk. For example, if you create a P50 disk, Azure provisions 4,095-GB
storage capacity, 7,500 IOPS, and 250-MB/s throughput for that disk. Your application can use all or
part of the capacity and performance.
Disk size
Azure maps the disk size (rounded up) to the nearest premium storage disk option, as specified in the
table in the preceding section. For example, a disk size of 100 GB is classified as a P10 option. It can
perform up to 500 IOPS, with up to 100-MB/s throughput. Similarly, a disk of size 400 GB is classified
as a P20. It can perform up to 2,300 IOPS, with 150-MB/s throughput.
NOTE
You can easily increase the size of existing disks. For example, you might want to increase the size of a 30-GB disk
to 128 GB, or even to 1 TB. Or, you might want to convert your P20 disk to a P30 disk because you need more
capacity or more IOPS and throughput.
I/O size
The size of an I/O is 256 KB. If the data being transferred is less than 256 KB, it is considered 1 I/O unit.
Larger I/O sizes are counted as multiple I/Os of size 256 KB. For example, 1,100 KB I/O is counted as 5
I/O units.
Throughput
The throughput limit includes writes to the disk, and it includes disk read operations that aren't served
from the cache. For example, a P10 disk has 100-MB/s throughput per disk. Some examples of valid
throughput for a P10 disk are shown in the following table:
MAX THROUGHPUT PER P10 DISK NON-CACHE READS FROM DISK NON-CACHE WRITES TO DISK
Cache hits
Cache hits are not limited by the allocated IOPS or throughput of the disk. For example, when you use a
data disk with a ReadOnly cache setting on a VM that is supported by Premium Storage, reads that are
served from the cache are not subject to the IOPS and throughput caps of the disk. If the workload of a
disk is predominantly reads, you might get very high throughput. The cache is subject to separate IOPS
and throughput limits at the VM level, based on the VM size. DS -series VMs have roughly 4,000 IOPS
and 33-MB/s throughput per core for cache and local SSD I/Os. GS -series VMs have a limit of 5,000
IOPS and 50-MB/s throughput per core for cache and local SSD I/Os.
Throttling
Throttling might occur, if your application IOPS or throughput exceeds the allocated limits for a premium
storage disk. Throttling also might occur if your total disk traffic across all disks on the VM exceeds the disk
bandwidth limit available for the VM. To avoid throttling, we recommend that you limit the number of pending
I/O requests for the disk. Use a limit based on scalability and performance targets for the disk you have
provisioned, and on the disk bandwidth available to the VM.
Your application can achieve the lowest latency when it is designed to avoid throttling. However, if the number
of pending I/O requests for the disk is too small, your application cannot take advantage of the maximum IOPS
and throughput levels that are available to the disk.
The following examples demonstrate how to calculate throttling levels. All calculations are based on an I/O unit
size of 256 KB.
Example 1
Your application has processed 495 I/O units of 16-KB size in one second on a P10 disk. The I/O units are
counted as 495 IOPS. If you try a 2-MB I/O in the same second, the total of I/O units is equal to 495 + 8 IOPS.
This is because 2 MB I/O = 2,048 KB / 256 KB = 8 I/O units, when the I/O unit size is 256 KB. Because the sum
of 495 + 8 exceeds the 500 IOPS limit for the disk, throttling occurs.
Example 2
Your application has processed 400 I/O units of 256-KB size on a P10 disk. The total bandwidth consumed is
(400 × 256) / 1,024 KB = 100 MB/s. A P10 disk has a throughput limit of 100 MB/s. If your application tries to
perform more I/O operations in that second, it is throttled because it exceeds the allocated limit.
Example 3
You have a DS4 VM with two P30 disks attached. Each P30 disk is capable of 200-MB/s throughput. However,
a DS4 VM has a total disk bandwidth capacity of 256 MB/s. You cannot drive both attached disks to the
maximum throughput on this DS4 VM at the same time. To resolve this, you can sustain traffic of 200 MB/s on
one disk and 56 MB/s on the other disk. If the sum of your disk traffic goes over 256 MB/s, disk traffic is
throttled.
NOTE
If your disk traffic mostly consists of small I/O sizes, your application likely will hit the IOPS limit before the throughput
limit. However, if the disk traffic mostly consists of large I/O sizes, your application likely will hit the throughput limit first,
instead of the IOPS limit. You can maximize your application's IOPS and throughput capacity by using optimal I/O sizes.
Also, you can limit the number of pending I/O requests for a disk.
To learn more about designing for high performance by using Premium Storage, see Design for performance
with Premium Storage.
To maintain geo-redundant copies of your snapshots, you can copy snapshots from a premium storage account
to a geo-redundant standard storage account by using AzCopy or Copy Blob. For more information, see
Transfer data with the AzCopy command-line utility and Copy Blob.
For detailed information about performing REST operations against page blobs in a premium storage account,
see Blob service operations with Azure Premium Storage.
Managed disks
A snapshot for a managed disk is a read-only copy of the managed disk. The snapshot is stored as a standard
managed disk. Currently, incremental snapshots are not supported for managed disks. To learn how to take a
snapshot for a managed disk, see Create a copy of a VHD stored as an Azure managed disk by using managed
snapshots in Windows or Create a copy of a VHD stored as an Azure managed disk by using managed
snapshots in Linux.
If a managed disk is attached to a VM, some API operations on the disk are not permitted. For example, you
cannot generate a shared access signature (SAS ) to perform a copy operation while the disk is attached to a
VM. Instead, first create a snapshot of the disk, and then perform the copy of the snapshot. Alternately, you can
detach the disk and then generate an SAS to perform the copy operation.
sudo rpm -e hypervkvpd ## (Might return an error if not installed. That's OK.)
sudo yum install microsoft-hyper-v
Next steps
For more information about Premium Storage, see the following articles.
Design and implement with Premium Storage
Design for performance with Premium Storage
Blob storage operations with Premium Storage
Operational guidance
Migrate to Azure Premium Storage
Blog posts
Azure Premium Storage generally available
Announcing the GS -series: Adding Premium Storage support to the largest VMs in the public cloud
Standard SSD Managed Disks for Azure Virtual
machine workloads
8/20/2018 • 5 minutes to read • Edit Online
Azure Standard Solid State Drives (SSD ) Managed Disks are a cost-effective storage option optimized for
workloads that need consistent performance at lower IOPS levels. Standard SSD offers a good entry level
experience for those who wish to move to the cloud, especially if you experience issues with the variance of
workloads running on your HDD solutions on premises. Standard SSDs deliver better availability, consistency,
reliability and latency compared to HDD Disks, and are suitable for Web servers, low IOPS application servers,
lightly used enterprise applications, and Dev/Test workloads.
STANDARD SSD DISK TYPE DISK SIZE IOPS PER DISK THROUGHPUT PER DISK
Standard SSDs are designed to provide single-digit millisecond latencies for most IO operations, and to deliver the
IOPS and throughput up to the limits described in the above table. Actual IOPS and Throughput may vary
sometimes depending on the traffic patterns. Standard SSDs will provide more consistent performance than the
HDD disks with the lower latency.
Premium SSDs on the other hand, perform better than Standard SSDs, with low latencies, high IOPS/throughput,
and even better consistency with provisioned disk performance. It is the recommended disk type for critical
production workloads. If your workload requires high-performance, low -latency disk support, you should consider
using Premium Storage.
Like the Premium SSDs, Standard SSDs also use IO Unit size of 256 KiB. If the data being transferred is less than
256 KiB, it is considered 1 I/O unit. Larger I/O sizes are counted as multiple I/Os of size 256 KiB. For example, a
1,100 KiB I/O is counted as five I/O units.
Next steps
To learn more about creating standard SSDs, refer to the sample that shows how to create a VM with multiple
standard SSDs.
Create a VM with multiple standard SSDs
To learn how to convert your existing HDD disks to standard SSD disks, refer to our article on the process.
Convert Azure managed disks storage from standard to premium, and vice versa
Ultra SSD (preview) Managed Disks for Azure Virtual
Machine workloads
9/24/2018 • 5 minutes to read • Edit Online
Azure Ultra SSD (preview ) delivers high throughput, high IOPS, and consistent low latency disk storage for Azure
IaaS VMs. This new offering provides top of the line performance at the same availability levels as our existing
disks offerings. Additional benefits of Ultra SSD include the ability to dynamically change the performance of the
disk along with your workloads without the need to restart your virtual machines. Ultra SSD is suited for data-
intensive workloads such as SAP HANA, top tier databases, and transaction-heavy workloads.
4 1,200 300
8 2,400 600
16 4,800 1,200
DISK SIZE (GIB) IOPS CAPS THROUGHPUT CAP (MBPS)
32 9,600 2,000
64 19,200 2,000
Next steps
If you're interested in trying ultra SSDs, see the how to guide on the subject.
How to enable and use Ultra SSDs
Azure Premium Storage: Design for High
Performance
8/8/2018 • 41 minutes to read • Edit Online
This article provides guidelines for building high performance applications using Azure Premium Storage. You can
use the instructions provided in this document combined with performance best practices applicable to
technologies used by your application. To illustrate the guidelines, we have used SQL Server running on Premium
Storage as an example throughout this document.
While we address performance scenarios for the Storage layer in this article, you will need to optimize the
application layer. For example, if you are hosting a SharePoint Farm on Azure Premium Storage, you can use the
SQL Server examples from this article to optimize the database server. Additionally, optimize the SharePoint
Farm's Web server and Application server to get the most performance.
This article will help answer following common questions about optimizing application performance on Azure
Premium Storage,
How to measure your application performance?
Why are you not seeing expected high performance?
Which factors influence your application performance on Premium Storage?
How do these factors influence performance of your application on Premium Storage?
How can you optimize for IOPS, Bandwidth and Latency?
We have provided these guidelines specifically for Premium Storage because workloads running on Premium
Storage are highly performance sensitive. We have provided examples where appropriate. You can also apply
some of these guidelines to applications running on IaaS VMs with Standard Storage disks.
Before you begin, if you are new to Premium Storage, first read the Premium Storage: High-Performance Storage
for Azure Virtual Machine Workloads and Azure Storage Scalability and Performance Targets articles.
IOPS
IOPS is number of requests that your application is sending to the storage disks in one second. An input/output
operation could be read or write, sequential or random. OLTP applications like an online retail website need to
process many concurrent user requests immediately. The user requests are insert and update intensive database
transactions, which the application must process quickly. Therefore, OLTP applications require very high IOPS.
Such applications handle millions of small and random IO requests. If you have such an application, you must
design the application infrastructure to optimize for IOPS. In the later section, Optimizing Application
Performance, we discuss in detail all the factors that you must consider to get high IOPS.
When you attach a premium storage disk to your high scale VM, Azure provisions for you a guaranteed number
of IOPS as per the disk specification. For example, a P50 disk provisions 7500 IOPS. Each high scale VM size also
has a specific IOPS limit that it can sustain. For example, a Standard GS5 VM has 80,000 IOPS limit.
Throughput
Throughput or Bandwidth is the amount of data that your application is sending to the storage disks in a specified
interval. If your application is performing input/output operations with large IO unit sizes, it requires high
Throughput. Data warehouse applications tend to issue scan intensive operations that access large portions of
data at a time and commonly perform bulk operations. In other words, such applications require higher
Throughput. If you have such an application, you must design its infrastructure to optimize for Throughput. In the
next section, we discuss in detail the factors you must tune to achieve this.
When you attach a premium storage disk to a high scale VM, Azure provisions Throughput as per that disk
specification. For example, a P50 disk provisions 250 MB per second disk Throughput. Each high scale VM size
also has as specific Throughput limit that it can sustain. For example, Standard GS5 VM has a maximum
throughput of 2,000 MB per second.
There is a relation between Throughput and IOPS as shown in the formula below.
Therefore, it is important to determine the optimal Throughput and IOPS values that your application requires. As
you try to optimize one, the other also gets affected. In a later section, Optimizing Application Performance, we
will discuss in more details about optimizing IOPS and Throughput.
Latency
Latency is the time it takes an application to receive a single request, send it to the storage disks and send the
response to the client. This is a critical measure of an application's performance in addition to IOPS and
Throughput. The Latency of a premium storage disk is the time it takes to retrieve the information for a request
and communicate it back to your application. Premium Storage provides consistent low latencies. If you enable
ReadOnly host caching on premium storage disks, you can get much lower read latency. We will discuss Disk
Caching in more detail in later section on Optimizing Application Performance.
When you are optimizing your application to get higher IOPS and Throughput, it will affect the Latency of your
application. After tuning the application performance, always evaluate the Latency of the application to avoid
unexpected high latency behavior.
% Read operations
% Write operations
% Random operations
% Sequential operations
IO request size
Average Throughput
Max. Throughput
Min. Latency
Average Latency
Max. CPU
Average CPU
Max. Memory
Average Memory
Queue Depth
NOTE
You should consider scaling these numbers based on expected future growth of your application. It is a good idea to plan for
growth ahead of time, because it could be harder to change the infrastructure for improving performance later.
If you have an existing application and want to move to Premium Storage, first build the checklist above for the
existing application. Then, build a prototype of your application on Premium Storage and design the application
based on guidelines described in Optimizing Application Performance in a later section of this document. The next
section describes the tools you can use to gather the performance measurements.
Create a checklist similar to your existing application for the prototype. Using Benchmarking tools you can
simulate the workloads and measure performance on the prototype application. See the section on Benchmarking
to learn more. By doing so you can determine whether Premium Storage can match or surpass your application
performance requirements. Then you can implement the same guidelines for your production application.
Counters to measure application performance requirements
The best way to measure performance requirements of your application, is to use performance-monitoring tools
provided by the operating system of the server. You can use PerfMon for Windows and iostat for Linux. These
tools capture counters corresponding to each measure explained in the above section. You must capture the values
of these counters when your application is running its normal, peak and off-hours workloads.
The PerfMon counters are available for processor, memory and, each logical disk and physical disk of your server.
When you use premium storage disks with a VM, the physical disk counters are for each premium storage disk,
and logical disk counters are for each volume created on the premium storage disks. You must capture the values
for the disks that host your application workload. If there is a one to one mapping between logical and physical
disks, you can refer to physical disk counters; otherwise refer to the logical disk counters. On Linux, the iostat
command generates a CPU and disk utilization report. The disk utilization report provides statistics per physical
device or partition. If you have a database server with its data and log on separate disks, collect this data for both
disks. Below table describes counters for disks, processor and memory:
Disk Reads and Writes % of Reads and Write % Disk Read Time r/s
operations performed on % Disk Write Time w/s
the disk.
Queue Depth Number of outstanding I/O Current Disk Queue Length avgqu-sz
requests waiting to be read
from or written to the
storage disk.
Example Scenario Enterprise OLTP application Enterprise Data warehousing Near real-time applications
requiring very high application processing large requiring instant responses
transactions per second rate. amounts of data. to user requests, like online
gaming.
Performance factors
VM size Use a VM size that offers Use a VM size with Use a VM size that offers
IOPS greater than your throughput limit greater scale limits greater than
application requirement. than your application your application
requirement. requirement.
Disk size Use a disk size that offers Use a disk size with Use a disk size that offers
IOPS greater than your Throughput limit greater scale limits greater than
application requirement. than your application your application
requirement. requirement.
VM and Disk Scale Limits IOPS limit of the VM size Throughput limit of the VM Scale limits of the VM size
chosen should be greater size chosen should be chosen must be greater
than total IOPS driven by greater than total than total scale limits of
premium storage disks Throughput driven by attached premium storage
attached to it. premium storage disks disks.
attached to it.
Stripe Size Smaller stripe size for Larger stripe size for
random small IO pattern sequential large IO pattern
seen in OLTP applications. seen in Data Warehouse
E.g., use stripe size of 64KB applications. E.g., use 256KB
for SQL Server OLTP stripe size for SQL Server
application. Data warehouse application.
Queue Depth Larger Queue Depth yields Larger Queue Depth yields Smaller Queue Depth yields
higher IOPS. higher Throughput. lower latencies.
Nature of IO Requests
An IO request is a unit of input/output operation that your application will be performing. Identifying the nature of
IO requests, random or sequential, read or write, small or large, will help you determine the performance
requirements of your application. It is very important to understand the nature of IO requests, to make the right
decisions when designing your application infrastructure.
IO size is one of the more important factors. The IO size is the size of the input/output operation request
generated by your application. The IO size has a significant impact on performance especially on the IOPS and
Bandwidth that the application is able to achieve. The following formula shows the relationship between IOPS, IO
size and Bandwidth/Throughput.
Some applications allow you to alter their IO size, while some applications do not. For example, SQL Server
determines the optimal IO size itself, and does not provide users with any knobs to change it. On the other hand,
Oracle provides a parameter called DB_BLOCK_SIZE using which you can configure the I/O request size of the
database.
If you are using an application, which does not allow you to change the IO size, use the guidelines in this article to
optimize the performance KPI that is most relevant to your application. For example,
An OLTP application generates millions of small and random IO requests. To handle these type of IO requests,
you must design your application infrastructure to get higher IOPS.
A data warehousing application generates large and sequential IO requests. To handle these type of IO
requests, you must design your application infrastructure to get higher Bandwidth or Throughput.
If you are using an application, which allows you to change the IO size, use this rule of thumb for the IO size in
addition to other performance guidelines,
Smaller IO size to get higher IOPS. For example, 8 KB for an OLTP application.
Larger IO size to get higher Bandwidth/Throughput. For example, 1024 KB for a data warehouse application.
Here is an example on how you can calculate the IOPS and Throughput/Bandwidth for your application. Consider
an application using a P30 disk. The maximum IOPS and Throughput/Bandwidth a P30 disk can achieve is 5000
IOPS and 200 MB per second respectively. Now, if your application requires the maximum IOPS from the P30
disk and you use a smaller IO size like 8 KB, the resulting Bandwidth you will be able to get is 40 MB per second.
However, if your application requires the maximum Throughput/Bandwidth from P30 disk, and you use a larger
IO size like 1024 KB, the resulting IOPS will be less, 200 IOPS. Therefore, tune the IO size such that it meets both
your application's IOPS and Throughput/Bandwidth requirement. Table below summarizes the different IO sizes
and their corresponding IOPS and Throughput for a P30 disk.
To get IOPS and Bandwidth higher than the maximum value of a single premium storage disk, use multiple
premium disks striped together. For example, stripe two P30 disks to get a combined IOPS of 10,000 IOPS or a
combined Throughput of 400 MB per second. As explained in the next section, you must use a VM size that
supports the combined disk IOPS and Throughput.
NOTE
As you increase either IOPS or Throughput the other also increases, make sure you do not hit throughput or IOPS limits of
the disk or VM when increasing either one.
To witness the effects of IO size on application performance, you can run benchmarking tools on your VM and
disks. Create multiple test runs and use different IO size for each run to see the impact. Refer to the Benchmarking
section at the end of this article for more details.
To view a complete list of all available Azure VM sizes, refer to Windows VM sizes or Linux VM sizes. Choose a
VM size that can meet and scale to your desired application performance requirements. In addition to this, take
into account following important considerations when choosing VM sizes.
Scale Limits
The maximum IOPS limits per VM and per disk are different and independent of each other. Make sure that the
application is driving IOPS within the limits of the VM as well as the premium disks attached to it. Otherwise,
application performance will experience throttling.
As an example, suppose an application requirement is a maximum of 4,000 IOPS. To achieve this, you provision a
P30 disk on a DS1 VM. The P30 disk can deliver up to 5,000 IOPS. However, the DS1 VM is limited to 3,200
IOPS. Consequently, the application performance will be constrained by the VM limit at 3,200 IOPS and there will
be degraded performance. To prevent this situation, choose a VM and disk size that will both meet application
requirements.
Cost of Operation
In many cases, it is possible that your overall cost of operation using Premium Storage is lower than using
Standard Storage.
For example, consider an application requiring 16,000 IOPS. To achieve this performance, you will need a
Standard_D14 Azure IaaS VM, which can give a maximum IOPS of 16,000 using 32 standard storage 1TB disks.
Each 1TB standard storage disk can achieve a maximum of 500 IOPS. The estimated cost of this VM per month
will be $1,570. The monthly cost of 32 standard storage disks will be $1,638. The estimated total monthly cost will
be $3,208.
However, if you hosted the same application on Premium Storage, you will need a smaller VM size and fewer
premium storage disks, thus reducing the overall cost. A Standard_DS13 VM can meet the 16,000 IOPS
requirement using four P30 disks. The DS13 VM has a maximum IOPS of 25,600 and each P30 disk has a
maximum IOPS of 5,000. Overall, this configuration can achieve 5,000 x 4 = 20,000 IOPS. The estimated cost of
this VM per month will be $1,003. The monthly cost of four P30 premium storage disks will be $544.34. The
estimated total monthly cost will be $1,544.
Table below summarizes the cost breakdown of this scenario for Standard and Premium Storage.
STANDARD PREMIUM
Cost of Disks per month $1,638.40 (32 x 1 TB disks) $544.34 (4 x P30 disks)
Linux Distros
With Azure Premium Storage, you get the same level of Performance for VMs running Windows and Linux. We
support many flavors of Linux distros, and you can see the complete list here. It is important to note that different
distros are better suited for different types of workloads. You will see different levels of performance depending on
the distro your workload is running on. Test the Linux distros with your application and choose the one that works
best.
When running Linux with Premium Storage, check the latest updates about required drivers to ensure high
performance.
PREMI
UM
DISKS
TYPE P4 P6 P10 P15 P20 P30 P40 P50 P60 P70 P80
Disk 32 64 128 256 512 1,024 2,048 4,095 8,192 16,38 32,76
size GiB GiB GiB GiB GB GiB (1 GiB (2 GiB (4 GiB (8 4 GiB 7 GiB
TiB) TiB) TiB) TiB) (16 (32
TiB) GiB)
IOPS 120 240 500 1100 2300 5000 7500 7500 12,50 15,00 20,00
per 0 0 0
disk
Throu 25 50 100 125 150 200 250 250 480 750 750
ghput MiB MiB MiB MiB MiB MiB MiB MiB MiB MiB MiB
per per per per per per per per per per per per
disk secon secon secon secon secon secon secon secon secon secon secon
d d d d d d d d d d d
How many disks you choose depends on the disk size chosen. You could use a single P50 disk or multiple P10
disks to meet your application requirement. Take into account considerations listed below when making the
choice.
Scale Limits (IOPS and Throughput)
The IOPS and Throughput limits of each Premium disk size is different and independent from the VM scale limits.
Make sure that the total IOPS and Throughput from the disks are within scale limits of the chosen VM size.
For example, if an application requirement is a maximum of 250 MB/sec Throughput and you are using a DS4
VM with a single P30 disk. The DS4 VM can give up to 256 MB/sec Throughput. However, a single P30 disk has
Throughput limit of 200 MB/sec. Consequently, the application will be constrained at 200 MB/sec due to the disk
limit. To overcome this limit, provision more than one data disks to the VM or resize your disks to P40 or P50.
NOTE
Reads served by the cache are not included in the disk IOPS and Throughput, hence not subject to disk limits. Cache has its
separate IOPS and Throughput limit per VM.
For example, initially your reads and writes are 60MB/sec and 40MB/sec respectively. Over time, the cache warms up and
serves more and more of the reads from the cache. Then, you can get higher write Throughput from the disk.
Number of Disks
Determine the number of disks you will need by assessing application requirements. Each VM size also has a limit
on the number of disks that you can attach to the VM. Typically, this is twice the number of cores. Ensure that the
VM size you choose can support the number of disks needed.
Remember, the Premium Storage disks have higher performance capabilities compared to Standard Storage disks.
Therefore, if you are migrating your application from Azure IaaS VM using Standard Storage to Premium Storage,
you will likely need fewer premium disks to achieve the same or higher performance for your application.
Disk Caching
High Scale VMs that leverage Azure Premium Storage have a multi-tier caching technology called BlobCache.
BlobCache uses a combination of the Virtual Machine RAM and local SSD for caching. This cache is available for
the Premium Storage persistent disks and the VM local disks. By default, this cache setting is set to Read/Write for
OS disks and ReadOnly for data disks hosted on Premium Storage. With disk caching enabled on the Premium
Storage disks, the high scale VMs can achieve extremely high levels of performance that exceed the underlying
disk performance.
WARNING
Disk Caching is only supported for disk sizes up to 4 TiB. Changing the cache setting of an Azure disk detaches and re-
attaches the target disk. If it is the operating system disk, the VM is restarted. Stop all applications/services that might be
affected by this disruption before changing the disk cache setting.
To learn more about how BlobCache works, refer to the Inside Azure Premium Storage blog post.
It is important to enable cache on the right set of disks. Whether you should enable disk caching on a premium
disk or not will depend on the workload pattern that disk will be handling. Table below shows the default cache
settings for OS and Data disks.
OS disk ReadWrite
Following are the recommended disk cache settings for data disks,
ReadOnly
By configuring ReadOnly caching on Premium Storage data disks, you can achieve low Read latency and get very
high Read IOPS and Throughput for your application. This is due two reasons,
1. Reads performed from cache, which is on the VM memory and local SSD, are much faster than reads from the
data disk, which is on the Azure blob storage.
2. Premium Storage does not count the Reads served from cache, towards the disk IOPS and Throughput.
Therefore, your application is able to achieve higher total IOPS and Throughput.
ReadWrite
By default, the OS disks have ReadWrite caching enabled. We have recently added support for ReadWrite caching
on data disks as well. If you are using ReadWrite caching, you must have a proper way to write the data from
cache to persistent disks. For example, SQL Server handles writing cached data to the persistent storage disks on
its own. Using ReadWrite cache with an application that does not handle persisting the required data can lead to
data loss, if the VM crashes.
As an example, you can apply these guidelines to SQL Server running on Premium Storage by doing the
following,
1. Configure "ReadOnly" cache on premium storage disks hosting data files.
a. The fast reads from cache lower the SQL Server query time since data pages are retrieved much faster from
the cache compared to directly from the data disks.
b. Serving reads from cache, means there is additional Throughput available from premium data disks. SQL
Server can use this additional Throughput towards retrieving more data pages and other operations like
backup/restore, batch loads, and index rebuilds.
2. Configure "None" cache on premium storage disks hosting the log files.
a. Log files have primarily write-heavy operations. Therefore, they do not benefit from the ReadOnly cache.
Disk Striping
When a high scale VM is attached with several premium storage persistent disks, the disks can be striped together
to aggregate their IOPs, bandwidth, and storage capacity.
On Windows, you can use Storage Spaces to stripe disks together. You must configure one column for each disk in
a pool. Otherwise, the overall performance of striped volume can be lower than expected, due to uneven
distribution of traffic across the disks.
Important: Using Server Manager UI, you can set the total number of columns up to 8 for a striped volume. When
attaching more than 8 disks, use PowerShell to create the volume. Using PowerShell, you can set the number of
columns equal to the number of disks. For example, if there are 16 disks in a single stripe set; specify 16 columns
in the NumberOfColumns parameter of the New -VirtualDisk PowerShell cmdlet.
On Linux, use the MDADM utility to stripe disks together. For detailed steps on striping disks on Linux refer to
Configure Software RAID on Linux.
Stripe Size
An important configuration in disk striping is the stripe size. The stripe size or block size is the smallest chunk of
data that application can address on a striped volume. The stripe size you configure depends on the type of
application and its request pattern. If you choose the wrong stripe size, it could lead to IO misalignment, which
leads to degraded performance of your application.
For example, if an IO request generated by your application is bigger than the disk stripe size, the storage system
writes it across stripe unit boundaries on more than one disk. When it is time to access that data, it will have to
seek across more than one stripe units to complete the request. The cumulative effect of such behavior can lead to
substantial performance degradation. On the other hand, if the IO request size is smaller than stripe size, and if it
is random in nature, the IO requests may add up on the same disk causing a bottleneck and ultimately degrading
the IO performance.
Depending on the type of workload your application is running, choose an appropriate stripe size. For random
small IO requests, use a smaller stripe size. Whereas, for large sequential IO requests use a larger stripe size. Find
out the stripe size recommendations for the application you will be running on Premium Storage. For SQL Server,
configure stripe size of 64KB for OLTP workloads and 256KB for data warehousing workloads. See Performance
best practices for SQL Server on Azure VMs to learn more.
NOTE
You can stripe together a maximum of 32 premium storage disks on a DS series VM and 64 premium storage disks on a GS
series VM.
Multi-threading
Azure has designed Premium Storage platform to be massively parallel. Therefore, a multi-threaded application
achieves much higher performance than a single-threaded application. A multi-threaded application splits up its
tasks across multiple threads and increases efficiency of its execution by utilizing the VM and disk resources to the
maximum.
For example, if your application is running on a single core VM using two threads, the CPU can switch between
the two threads to achieve efficiency. While one thread is waiting on a disk IO to complete, the CPU can switch to
the other thread. In this way, two threads can accomplish more than a single thread would. If the VM has more
than one core, it further decreases running time since each core can execute tasks in parallel.
You may not be able to change the way an off-the-shelf application implements single threading or multi-
threading. For example, SQL Server is capable of handling multi-CPU and multi-core. However, SQL Server
decides under what conditions it will leverage one or more threads to process a query. It can run queries and build
indexes using multi-threading. For a query that involves joining large tables and sorting data before returning to
the user, SQL Server will likely use multiple threads. However, a user cannot control whether SQL Server executes
a query using a single thread or multiple threads.
There are configuration settings that you can alter to influence this multi-threading or parallel processing of an
application. For example, in case of SQL Server it is the maximum Degree of Parallelism configuration. This
setting called MAXDOP, allows you to configure the maximum number of processors SQL Server can use when
parallel processing. You can configure MAXDOP for individual queries or index operations. This is beneficial when
you want to balance resources of your system for a performance critical application.
For example, say your application using SQL Server is executing a large query and an index operation at the same
time. Let us assume that you wanted the index operation to be more performant compared to the large query. In
such a case, you can set MAXDOP value of the index operation to be higher than the MAXDOP value for the
query. This way, SQL Server has more number of processors that it can leverage for the index operation
compared to the number of processors it can dedicate to the large query. Remember, you do not control the
number of threads SQL Server will use for each operation. You can control the maximum number of processors
being dedicated for multi-threading.
Learn more about Degrees of Parallelism in SQL Server. Find out such settings that influence multi-threading in
your application and their configurations to optimize performance.
Queue Depth
The Queue Depth or Queue Length or Queue Size is the number of pending IO requests in the system. The value
of Queue Depth determines how many IO operations your application can line up, which the storage disks will be
processing. It affects all the three application performance indicators that we discussed in this article viz., IOPS,
Throughput and Latency.
Queue Depth and multi-threading are closely related. The Queue Depth value indicates how much multi-
threading can be achieved by the application. If the Queue Depth is large, application can execute more operations
concurrently, in other words, more multi-threading. If the Queue Depth is small, even though application is multi-
threaded, it will not have enough requests lined up for concurrent execution.
Typically, off the shelf applications do not allow you to change the queue depth, because if set incorrectly it will do
more harm than good. Applications will set the right value of queue depth to get the optimal performance.
However, it is important to understand this concept so that you can troubleshoot performance issues with your
application. You can also observe the effects of queue depth by running benchmarking tools on your system.
Some applications provide settings to influence the Queue Depth. For example, the MAXDOP (maximum degree
of parallelism) setting in SQL Server explained in previous section. MAXDOP is a way to influence Queue Depth
and multi-threading, although it does not directly change the Queue Depth value of SQL Server.
High Queue Depth
A high queue depth lines up more operations on the disk. The disk knows the next request in its queue ahead of
time. Consequently, the disk can schedule operations ahead of time and process them in an optimal sequence.
Since the application is sending more requests to the disk, the disk can process more parallel IOs. Ultimately, the
application will be able to achieve higher IOPS. Since application is processing more requests, the total
Throughput of the application also increases.
Typically, an application can achieve maximum Throughput with 8-16+ outstanding IOs per attached disk. If a
Queue Depth is one, application is not pushing enough IOs to the system, and it will process less amount of in a
given period. In other words, less Throughput.
For example, in SQL Server, setting the MAXDOP value for a query to "4" informs SQL Server that it can use up
to four cores to execute the query. SQL Server will determine what is best queue depth value and the number of
cores for the query execution.
Optimal Queue Depth
Very high queue depth value also has its drawbacks. If queue depth value is too high, the application will try to
drive very high IOPS. Unless application has persistent disks with sufficient provisioned IOPS, this can negatively
affect application latencies. Following formula shows the relationship between IOPS, Latency and Queue Depth.
You should not configure Queue Depth to any high value, but to an optimal value, which can deliver enough IOPS
for the application without affecting latencies. For example, if the application latency needs to be 1 millisecond, the
Queue Depth required to achieve 5,000 IOPS is, QD = 5000 x 0.001 = 5.
Queue Depth for Striped Volume
For a striped volume, maintain a high enough queue depth such that, every disk has a peak queue depth
individually. For example, consider an application that pushes a queue depth of 2 and there are 4 disks in the
stripe. The two IO requests will go to two disks and remaining two disks will be idle. Therefore, configure the
queue depth such that all the disks can be busy. Formula below shows how to determine the queue depth of
striped volumes.
Throttling
Azure Premium Storage provisions specified number of IOPS and Throughput depending on the VM sizes and
disk sizes you choose. Anytime your application tries to drive IOPS or Throughput above these limits of what the
VM or disk can handle, Premium Storage will throttle it. This manifests in the form of degraded performance in
your application. This can mean higher latency, lower Throughput or lower IOPS. If Premium Storage does not
throttle, your application could completely fail by exceeding what its resources are capable of achieving. So, to
avoid performance issues due to throttling, always provision sufficient resources for your application. Take into
consideration what we discussed in the VM sizes and Disk sizes sections above. Benchmarking is the best way to
figure out what resources you will need to host your application.
Benchmarking
Benchmarking is the process of simulating different workloads on your application and measuring the application
performance for each workload. Using the steps described in an earlier section, you have gathered the application
performance requirements. By running benchmarking tools on the VMs hosting the application, you can
determine the performance levels that your application can achieve with Premium Storage. In this section, we
provide you examples of benchmarking a Standard DS14 VM provisioned with Azure Premium Storage disks.
We have used common benchmarking tools Iometer and FIO, for Windows and Linux respectively. These tools
spawn multiple threads simulating a production like workload, and measure the system performance. Using the
tools you can also configure parameters like block size and queue depth, which you normally cannot change for an
application. This gives you more flexibility to drive the maximum performance on a high scale VM provisioned
with premium disks for different types of application workloads. To learn more about each benchmarking tool visit
Iometer and FIO.
To follow the examples below, create a Standard DS14 VM and attach 11 Premium Storage disks to the VM. Of
the 11 disks, configure 10 disks with host caching as "None" and stripe them into a volume called NoCacheWrites.
Configure host caching as "ReadOnly" on the remaining disk and create a volume called CacheReads with this
disk. Using this setup, you will be able to see the maximum Read and Write performance from a Standard DS14
VM. For detailed steps about creating a DS14 VM with premium disks, go to Create and use a Premium Storage
account for a virtual machine data disk.
Warming up the Cache
The disk with ReadOnly host caching will be able to give higher IOPS than the disk limit. To get this maximum
read performance from the host cache, first you must warm up the cache of this disk. This ensures that the Read
IOs which benchmarking tool will drive on CacheReads volume actually hits the cache and not the disk directly.
The cache hits result in additional IOPS from the single cache enabled disk.
Important:
You must warm up the cache before running benchmarking, every time VM is rebooted.
Iometer
Download the Iometer tool on the VM.
Test file
Iometer uses a test file that is stored on the volume on which you will run the benchmarking test. It drives Reads
and Writes on this test file to measure the disk IOPS and Throughput. Iometer creates this test file if you have not
provided one. Create a 200GB test file called iobw.tst on the CacheReads and NoCacheWrites volumes.
Access Specifications
The specifications, request IO size, % read/write, % random/sequential are configured using the "Access
Specifications" tab in Iometer. Create an access specification for each of the scenarios described below. Create the
access specifications and "Save" with an appropriate name like – RandomWrites_8K, RandomReads_8K. Select the
corresponding specification when running the test scenario.
An example of access specifications for maximum Write IOPS scenario is shown below,
Maximum IOPS Test Specifications
To demonstrate maximum IOPs, use smaller request size. Use 8K request size and create specifications for
Random Writes and Reads.
RandomWrites_8K 8K 100 0
3. Run the Iometer test for warming up cache disk with following parameters. Use three worker threads for
the target volume and a queue depth of 128. Set the "Run time" duration of the test to 2hrs on the "Test
Setup" tab.
After cache disk is warmed up, proceed with the test scenarios listed below. To run the Iometer test, use at least
three worker threads for each target volume. For each worker thread, select the target volume, set queue depth
and select one of the saved test specifications, as shown in the table below, to run the corresponding test scenario.
The table also shows expected results for IOPS and Throughput when running these tests. For all scenarios, a
small IO size of 8KB and a high queue depth of 128 is used.
NoCacheWrites RandomReads_8K
NoCacheWrites RandomReads_64K
Below are screenshots of the Iometer test results for combined IOPS and Throughput scenarios.
Combined Reads and Writes Maximum IOPS
Combined Reads and Writes Maximum Throughput
FIO
FIO is a popular tool to benchmark storage on the Linux VMs. It has the flexibility to select different IO sizes,
sequential or random reads and writes. It spawns worker threads or processes to perform the specified I/O
operations. You can specify the type of I/O operations each worker thread must perform using job files. We
created one job file per scenario illustrated in the examples below. You can change the specifications in these job
files to benchmark different workloads running on Premium Storage. In the examples, we are using a Standard DS
14 VM running Ubuntu. Use the same setup described in the beginning of the Benchmarking section and warm
up the cache before running the benchmarking tests.
Before you begin, download FIO and install it on your virtual machine.
Run the following command for Ubuntu,
apt-get install fio
We will use four worker threads for driving Write operations and four worker threads for driving Read operations
on the disks. The Write workers will be driving traffic on the "nocache" volume, which has 10 disks with cache set
to "None". The Read workers will be driving traffic on the "readcache" volume, which has 1 disk with cache set to
"ReadOnly".
Maximum Write IOPS
Create the job file with following specifications to get maximum Write IOPS. Name it "fiowrite.ini".
[global]
size=30g
direct=1
iodepth=256
ioengine=libaio
bs=8k
[writer1]
rw=randwrite
directory=/mnt/nocache
[writer2]
rw=randwrite
directory=/mnt/nocache
[writer3]
rw=randwrite
directory=/mnt/nocache
[writer4]
rw=randwrite
directory=/mnt/nocache
Note the follow key things that are in line with the design guidelines discussed in previous sections. These
specifications are essential to drive maximum IOPS,
A high queue depth of 256.
A small block size of 8KB.
Multiple threads performing random writes.
Run the following command to kick off the FIO test for 30 seconds,
While the test runs, you will be able to see the number of write IOPS the VM and Premium disks are delivering.
As shown in the sample below, the DS14 VM is delivering its maximum write IOPS limit of 50,000 IOPS.
[reader1]
rw=randread
directory=/mnt/readcache
[reader2]
rw=randread
directory=/mnt/readcache
[reader3]
rw=randread
directory=/mnt/readcache
[reader4]
rw=randread
directory=/mnt/readcache
Note the follow key things that are in line with the design guidelines discussed in previous sections. These
specifications are essential to drive maximum IOPS,
A high queue depth of 256.
A small block size of 8KB.
Multiple threads performing random writes.
Run the following command to kick off the FIO test for 30 seconds,
While the test runs, you will be able to see the number of read IOPS the VM and Premium disks are delivering. As
shown in the sample below, the DS14 VM is delivering more than 64,000 Read IOPS. This is a combination of the
disk and the cache performance.
[reader1]
rw=randread
directory=/mnt/readcache
[reader2]
rw=randread
directory=/mnt/readcache
[reader3]
rw=randread
directory=/mnt/readcache
[reader4]
rw=randread
directory=/mnt/readcache
[writer1]
rw=randwrite
directory=/mnt/nocache
rate_iops=12500
[writer2]
rw=randwrite
directory=/mnt/nocache
rate_iops=12500
[writer3]
rw=randwrite
directory=/mnt/nocache
rate_iops=12500
[writer4]
rw=randwrite
directory=/mnt/nocache
rate_iops=12500
Note the follow key things that are in line with the design guidelines discussed in previous sections. These
specifications are essential to drive maximum IOPS,
A high queue depth of 128.
A small block size of 4KB.
Multiple threads performing random reads and writes.
Run the following command to kick off the FIO test for 30 seconds,
While the test runs, you will be able to see the number of combined read and write IOPS the VM and Premium
disks are delivering. As shown in the sample below, the DS14 VM is delivering more than 100,000 combined Read
and Write IOPS. This is a combination of the disk and the cache performance.
Next Steps
Learn more about Azure Premium Storage:
Premium Storage: High-Performance Storage for Azure Virtual Machine Workloads
For SQL Server users, read articles on Performance Best Practices for SQL Server:
Performance Best Practices for SQL Server in Azure Virtual Machines
Azure Premium Storage provides highest performance for SQL Server in Azure VM
Cost-effective Standard Storage and unmanaged and
managed Azure VM disks
8/8/2018 • 8 minutes to read • Edit Online
Azure Standard Storage delivers reliable, low -cost disk support for VMs running latency-insensitive workloads. It
also supports blobs, tables, queues, and files. With Standard Storage, the data is stored on hard disk drives
(HDDs). When working with VMs, you can use standard SSD and HDD disks for Dev/Test scenarios and less
critical workloads, and premium SSD disks for mission-critical production applications. Standard Storage is
available in all Azure regions.
This article focuses on the use of standard SSD and HDD disks. For more information about the use of storage
with blobs, tables, queues, and files, see Introduction to Storage.
Disk types
There are two ways to create standard disks for Azure VMs:
Unmanaged disks: This type of disk is the original method where you manage the storage accounts used to
store the VHD files that correspond to the VM disks. VHD files are stored as page blobs in storage accounts.
Unmanaged disks can be attached to any Azure VM size, including the VMs that primarily use Premium Storage,
such as the DSv2 and GS series. Azure VMs support attaching several standard disks, allowing up to 256 TiB of
storage per VM. If you use the preview disk sizes, you can have up to around 2 PiB of storage per VM.
Azure Managed Disks: This feature manages the storage accounts used for the VM disks for you. You specify
the type (Premium SSD, Standard SSD, or Standard HDD ) and size of disk you need, and Azure creates and
manages the disk for you. You don't have to worry about placing the disks across multiple storage accounts in
order to ensure you stay within the scalability limits for the storage accounts -- Azure handles that for you.
Even though both types of disks are available, we recommend using Managed Disks to take advantage of their
many features.
To get started with Azure Standard Storage, visit Get started for free.
For information on how to create a VM with Managed Disks, see one of the following articles.
Create a VM using Resource Manager and PowerShell
Create a Linux VM using the Azure CLI
Max ingress1 per storage account (US Regions) 10 Gbps if GRS/ZRS enabled, 20 Gbps for LRS
Max egress1 per storage account (US Regions) 20 Gbps if RA-GRS/GRS/ZRS enabled, 30 Gbps for LRS
Max ingress1 per storage account (European and Asian 5 Gbps if GRS/ZRS enabled, 10 Gbps for LRS
Regions)
Max egress1 per storage account (European and Asian 10 Gbps if RA-GRS/GRS/ZRS enabled, 15 Gbps for LRS
Regions)
Total Request Rate (assuming 1 KB object size) per storage Up to 20,000 IOPS, entities per second, or messages per
account second
1 Ingress refers to all data (requests) being sent to a storage account. Egress refers to all data (responses) being
If your workload requires high-performance, low -latency disk support, you should consider using Premium
Storage. To know more benefits of Premium Storage, visit High-Performance Premium Storage and Azure VM
Disks.
STAN
DARD
HDD
MANA
GED
DISK
TYPE S4 S6 S10 S15 S20 S30 S40 S50 S60 S70 S80
Disk 32 64 128 256 512 1,024 2,048 4,095 8,192 16,38 32,76
Size GiB GiB GiB GiB GiB GiB (1 GiB (2 GiB (4 GiB (8 5 GiB 7 GiB
TiB) TiB) TiB) TiB) (16 (32
TiB) TiB)
Snapshots: Snapshots of standard disks are billed for the additional capacity used by the snapshots. For
information on snapshots, see Creating a Snapshot of a Blob.
Outbound data transfers: Outbound data transfers (data going out of Azure data centers) incur billing for
bandwidth usage.
Transaction: Azure charges $0.0036 per 100,000 transactions for standard storage. Transactions include both
read and write operations to storage.
For detailed information on pricing for Standard Storage, Virtual Machines, and Managed Disks, see:
Azure Storage Pricing
Virtual Machines Pricing
Managed Disks Pricing
Next steps
Introduction to Azure Storage
Create a storage account
Managed Disks Overview
Create a VM using Resource Manager and PowerShell
Create a Linux VM using the Azure CLI
Scalability and performance targets for VM disks on
Windows
8/8/2018 • 4 minutes to read • Edit Online
An Azure virtual machine supports attaching a number of data disks. This article describes scalability and
performance targets for a VM's data disks. Use these targets to help decide the number and type of disk that you
need to meet your performance and capacity requirements.
IMPORTANT
For optimal performance, limit the number of highly utilized disks attached to the virtual machine to avoid possible throttling.
If all attached disks are not highly utilized at the same time, then the virtual machine can support a larger number of disks.
For standard storage accounts: A standard storage account has a maximum total request rate of 20,000
IOPS. The total IOPS across all of your virtual machine disks in a standard storage account should not
exceed this limit.
You can roughly calculate the number of highly utilized disks supported by a single standard storage
account based on the request rate limit. For example, for a Basic Tier VM, the maximum number of highly
utilized disks is about 66 (20,000/300 IOPS per disk), and for a Standard Tier VM, it is about 40 (20,000/500
IOPS per disk).
For premium storage accounts: A premium storage account has a maximum total throughput rate of 50
Gbps. The total throughput across all of your VM disks should not exceed this limit.
See Windows VM sizes for additional details.
Disk 32 64 128 256 512 1,024 2,048 4,095 8,192 16,38 32,76
size in 4 7
GiB
IOPS Up to Up to Up to Up to Up to Up to Up to Up to Up to Up to Up to
per 500 500 500 500 500 500 500 500 1,300 2,000 2,000
disk
Throu Up to Up to Up to Up to Up to Up to Up to Up to Up to Up to Up to
ghput 60 60 60 60 60 60 60 60 300 500 500
per MiB/s MiB/s MiB/s MiB/s MiB/s MiB/s MiB/s MiB/s MiB/s MiB/s MiB/s
disk ec ec ec ec ec ec ec ec ec ec ec
STANDA
RD SSD
DISK
TYPE E10 E15 E20 E30 E40 E50 E60 E70 E80
Disk size 128 256 512 1,024 2,048 4,095 8,192 16,384 32,767
in GiB
IOPS per Up to Up to Up to Up to Up to Up to Up to Up to Up to
disk 500 500 500 500 500 500 500 500 1,300
Through Up to Up to Up to Up to Up to Up to Up to Up to 60 Up to
put per 60 60 60 60 60 60 60 MB/sec 300
disk MB/sec MB/sec MB/sec MB/sec MB/sec MB/sec MB/sec MiB/sec
PREMI
UM
DISK
TYPE P4 P6 P10 P15 P20 S30 P40 P50 P60 P70 P80
Disk 32 64 128 256 512 1,024 2,048 4,095 8,192 16,38 32,76
size in 4 7
GiB
IOPS Up to Up to Up to Up to Up to Up to Up to Up to Up to Up to Up to
per 120 240 500 1,100 2,300 5,000 7,500 7,500 12,50 15,00 20,00
disk 0 0 0
Throu Up to Up to Up to Up to Up to Up to Up to Up to Up to Up to Up to
ghput 25 50 100 125 150 200 250 250 480 750 750
per MiB/s MiB/s MiB/s MiB/s MiB/s MiB/s MiB/s MiB/s MiB/s MiB/s MiB/s
disk ec ec ec ec ec ec ec ec ec ec ec
1Ingress refers to all data (requests) being sent to a storage account. Egress refers to all data (responses) being
PREMIUM
STORAGE DISK
TYPE P10 P20 P30 P40 P50
Disk size 128 GiB 512 GiB 1024 GiB (1 TB) 2048 GiB (2 TB) 4095 GiB (4 TB)
Max throughput 100 MB/s 150 MB/s 200 MB/s 250 MB/s 250 MB/s
per disk
See also
Azure subscription and service limits, quotas, and constraints
Backup and disaster recovery for Azure IaaS disks
11/1/2017 • 21 minutes to read • Edit Online
This article explains how to plan for backup and disaster recovery (DR ) of IaaS virtual machines (VMs) and disks in
Azure. This document covers both managed and unmanaged disks.
First, we cover the built-in fault tolerance capabilities in the Azure platform that helps guard against local failures.
We then discuss the disaster scenarios not fully covered by the built-in capabilities. We also show several examples
of workload scenarios where different backup and DR considerations can apply. We then review possible solutions
for the DR of IaaS disks.
Introduction
The Azure platform uses various methods for redundancy and fault tolerance to help protect customers from
localized hardware failures. Local failures can include problems with an Azure Storage server machine that stores
part of the data for a virtual disk or failures of an SSD or HDD on that server. Such isolated hardware component
failures can happen during normal operations.
The Azure platform is designed to be resilient to these failures. Major disasters can result in failures or the
inaccessibility of many storage servers or even a whole datacenter. Although your VMs and disks are normally
protected from localized failures, additional steps are necessary to protect your workload from region-wide
catastrophic failures, such as a major disaster, that can affect your VM and disks.
In addition to the possibility of platform failures, problems with a customer application or data can occur. For
example, a new version of your application might inadvertently make a change to the data that causes it to break.
In that case, you might want to revert the application and the data to a prior version that contains the last known
good state. This requires maintaining regular backups.
For regional disaster recovery, you must back up your IaaS VM disks to a different region.
Before we look at backup and DR options, let’s recap a few methods available for handling localized failures.
Azure IaaS resiliency
Resiliency refers to the tolerance for normal failures that occur in hardware components. Resiliency is the ability to
recover from failures and continue to function. It's not about avoiding failures, but responding to failures in a way
that avoids downtime or data loss. The goal of resiliency is to return the application to a fully functioning state
following a failure. Azure virtual machines and disks are designed to be resilient to common hardware faults. Let's
look at how the Azure IaaS platform provides this resiliency.
A virtual machine consists mainly of two parts: a compute server and the persistent disks. Both affect the fault
tolerance of a virtual machine.
If the Azure compute host server that houses your VM experiences a hardware failure, which is rare, Azure is
designed to automatically restore the VM on another server. If this scenario, your computer reboots, and the VM
comes back up after some time. Azure automatically detects such hardware failures and executes recoveries to help
ensure the customer VM is available as soon as possible.
Regarding IaaS disks, the durability of data is critical for a persistent storage platform. Azure customers have
important business applications running on IaaS, and they depend on the persistence of the data. Azure designs
protection for these IaaS disks, with three redundant copies of the data that is stored locally. These copies provide
for high durability against local failures. If one of the hardware components that holds your disk fails, your VM is
not affected, because there are two additional copies to support disk requests. It works fine, even if two different
hardware components that support a disk fail at the same time (which is rare).
To ensure that you always maintain three replicas, Azure Storage automatically spawns a new copy of the data in
the background if one of the three copies becomes unavailable. Therefore, it should not be necessary to use RAID
with Azure disks for fault tolerance. A simple RAID 0 configuration should be sufficient for striping the disks, if
necessary, to create larger volumes.
Because of this architecture, Azure has consistently delivered enterprise-grade durability for IaaS disks, with an
industry-leading zero percent annualized failure rate.
Localized hardware faults on the compute host or in the Storage platform can sometimes result in of the
temporary unavailability of the VM that is covered by the Azure SLA for VM availability. Azure also provides an
industry-leading SLA for single VM instances that use Azure Premium SSD disks.
To safeguard application workloads from downtime due to the temporary unavailability of a disk or VM, customers
can use availability sets. Two or more virtual machines in an availability set provide redundancy for the application.
Azure then creates these VMs and disks in separate fault domains with different power, network, and server
components.
Because of these separate fault domains, localized hardware failures typically do not affect multiple VMs in the set
at the same time. Having separate fault domains provides high availability for your application. It's considered a
good practice to use availability sets when high availability is required. The next section covers the disaster
recovery aspect.
Backup and disaster recovery
Disaster recovery is the ability to recover from rare, but major, incidents. These incidents include non-transient,
wide-scale failures, such as service disruption that affects an entire region. Disaster recovery includes data backup
and archiving, and might include manual intervention, such as restoring a database from a backup.
The Azure platform’s built-in protection against localized failures might not fully protect the VMs/disks if a major
disaster causes large-scale outages. These large-scale outages include catastrophic events, such as if a datacenter is
hit by a hurricane, earthquake, fire, or if there is a large-scale hardware unit failure. In addition, you might
encounter failures due to application or data issues.
To help protect your IaaS workloads from outages, you should plan for redundancy and have backups to enable
recovery. For disaster recovery, you should back up in a different geographic location away from the primary site.
This approach helps ensure your backup is not affected by the same event that originally affected the VM or disks.
For more information, see Disaster recovery for Azure applications.
Your DR considerations might include the following aspects:
High availability: The ability of the application to continue running in a healthy state, without significant
downtime. By healthy state, this state means that the application is responsive, and users can connect to the
application and interact with it. Certain mission-critical applications and databases might be required to
always be available, even when there are failures in the platform. For these workloads, you might need to
plan redundancy for the application, as well as the data.
Data durability: In some cases, the main consideration is ensuring that the data is preserved if a disaster
happens. Therefore, you might need a backup of your data in a different site. For such workloads, you might
not need full redundancy for the application, but only a regular backup of the disks.
Unmanaged locally redundant storage Local (locally redundant storage) Azure Backup
disks
High availability is best met by using managed disks in an availability set along with Azure Backup. If you use
unmanaged disks, you can still use Azure Backup for DR. If you are unable to use Azure Backup, then taking
consistent snapshots, as described in a later section, is an alternative solution for backup and DR.
Your choices for high availability, backup, and DR at application or infrastructure levels can be represented as
follows:
NOTE
Only having the disks in a geo-redundant storage or read-access geo-redundant storage account does not protect the VM
from disasters. You must also create coordinated snapshots or use Azure Backup. This is required to recover a VM to a
consistent state.
If you use locally redundant storage, you must copy the snapshots to a different storage account immediately after
creating the snapshot. The copy target might be a locally redundant storage account in a different region, resulting
in the copy being in a remote region. You can also copy the snapshot to a read-access geo-redundant storage
account in the same region. In this case, the snapshot is lazily replicated to the remote secondary region. Your
backup is protected from disasters at the primary site after the copying and replication is complete.
To copy your incremental snapshots for DR efficiently, review the instructions in Back up Azure unmanaged VM
disks with incremental snapshots.
Other options
SQL Server
SQL Server running in a VM has its own built-in capabilities to back up your SQL Server database to Azure Blob
storage or a file share. If the storage account is geo-redundant storage or read-access geo-redundant storage, you
can access those backups in the storage account’s secondary datacenter in the event of a disaster, with the same
restrictions as previously discussed. For more information, see Back up and restore for SQL Server in Azure virtual
machines. In addition to back up and restore, SQL Server AlwaysOn availability groups can maintain secondary
replicas of databases. This ability greatly reduces the disaster recovery time.
Other considerations
This article has discussed how to back up or take snapshots of your VMs and their disks to support disaster
recovery and how to use those backups or snapshots to recover your data. With the Azure Resource Manager
model, many people use templates to create their VMs and other infrastructures in Azure. You can use a template
to create a VM that has the same configuration every time. If you use custom images for creating your VMs, you
must also make sure that your images are protected by using a read-access geo-redundant storage account to
store them.
Consequently, your backup process can be a combination of two things:
Back up the data (disks).
Back up the configuration (templates and custom images).
Depending on the backup option you choose, you might have to handle the backup of both the data and the
configuration, or the backup service might handle all of that for you.
NOTE
Microsoft controls whether a failover occurs. Failover is not controlled per storage account, so it's not decided by individual
customers. To implement disaster recovery for specific storage accounts or virtual machine disks, you must use the
techniques described previously in this article.
Virtual networks and virtual machines in Azure
7/9/2018 • 13 minutes to read • Edit Online
When you create an Azure virtual machine (VM ), you must create a virtual network (VNet) or use an existing VNet.
You also need to decide how your VMs are intended to be accessed on the VNet. It is important to plan before
creating resources and make sure that you understand the limits of networking resources.
In the following figure, VMs are represented as web servers and database servers. Each set of VMs are assigned to
separate subnets in the VNet.
You can create a VNet before you create a VM or you can as you create a VM. You create these resources to
support communication with a VM:
Network interfaces
IP addresses
Virtual network and subnets
In addition to those basic resources, you should also consider these optional resources:
Network security groups
Load balancers
Network interfaces
A network interface (NIC ) is the interconnection between a VM and a virtual network (VNet). A VM must have at
least one NIC, but can have more than one, depending on the size of the VM you create. Learn about how many
NICs each VM size supports for Windows or Linux.
You can create a VM with multiple NICs, and add or remove NICs through the lifecycle of a VM. Multiple NICs
allow a VM to connect to different subnets and send or receive traffic over the most appropriate interface.
If the VM is added to an availability set, all VMs within the availability set must have one or multiple NICs. VMs
with more than one NIC aren’t required to have the same number of NICs, but they must all have at least two.
Each NIC attached to a VM must exist in the same location and subscription as the VM. Each NIC must be
connected to a VNet that exists in the same Azure location and subscription as the NIC. You can change the subnet
a VM is connected to after it's created, but you cannot change the VNet. Each NIC attached to a VM is assigned a
MAC address that doesn’t change until the VM is deleted.
This table lists the methods that you can use to create a network interface.
METHOD DESCRIPTION
Azure CLI To provide the identifier of the public IP address that you
previously created, use az network nic create with the --
public-ip-address parameter.
IP addresses
You can assign these types of IP addresses to a NIC in Azure:
Public IP addresses - Used to communicate inbound and outbound (without network address translation
(NAT)) with the Internet and other Azure resources not connected to a VNet. Assigning a public IP address to a
NIC is optional. Public IP addresses have a nominal charge, and there's a maximum number that can be used
per subscription.
Private IP addresses - Used for communication within a VNet, your on-premises network, and the Internet
(with NAT). You must assign at least one private IP address to a VM. To learn more about NAT in Azure, read
Understanding outbound connections in Azure.
You can assign public IP addresses to VMs or internet-facing load balancers. You can assign private IP addresses to
VMs and internal load balancers. You assign IP addresses to a VM using a network interface.
There are two methods in which an IP address is allocated to a resource - dynamic or static. The default allocation
method is dynamic, where an IP address is not allocated when it's created. Instead, the IP address is allocated when
you create a VM or start a stopped VM. The IP address is released when you stop or delete the VM.
To ensure the IP address for the VM remains the same, you can set the allocation method explicitly to static. In this
case, an IP address is assigned immediately. It is released only when you delete the VM or change its allocation
method to dynamic.
This table lists the methods that you can use to create an IP address.
METHOD DESCRIPTION
Azure portal By default, public IP addresses are dynamic and the address
associated to them may change when the VM is stopped or
deleted. To guarantee that the VM always uses the same
public IP address, create a static public IP address. By default,
the portal assigns a dynamic private IP address to a NIC when
creating a VM. You can change this IP address to static after
the VM is created.
Azure CLI You use az network public-ip create with the --allocation-
method parameter as Dynamic or Static.
After you create a public IP address, you can associate it with a VM by assigning it to a NIC.
Azure portal If you let Azure create a VNet when you create a VM, the
name is a combination of the resource group name that
contains the VNet and -vnet. The address space is
10.0.0.0/24, the required subnet name is default, and the
subnet address range is 10.0.0.0/24.
Azure CLI The subnet and the VNet are created at the same time.
Provide a --subnet-name parameter to az network vnet
create with the subnet name.
METHOD DESCRIPTION
Azure CLI Use az network nsg create to initially create the NSG. Use az
network nsg rule create to add rules to the NSG. Use az
network vnet subnet update to add the NSG to the subnet.
Load balancers
Azure Load Balancer delivers high availability and network performance to your applications. A load balancer can
be configured to balance incoming Internet traffic to VMs or balance traffic between VMs in a VNet. A load
balancer can also balance traffic between on-premises computers and VMs in a cross-premises network, or
forward external traffic to a specific VM.
The load balancer maps incoming and outgoing traffic between the public IP address and port on the load balancer
and the private IP address and port of the VM.
When you create a load balancer, you must also consider these configuration elements:
Front-end IP configuration – A load balancer can include one or more front-end IP addresses, otherwise
known as virtual IPs (VIPs). These IP addresses serve as ingress for the traffic.
Back-end address pool – IP addresses that are associated with the NIC to which load is distributed.
NAT rules - Defines how inbound traffic flows through the front-end IP and distributed to the back-end IP.
Load balancer rules - Maps a given front-end IP and port combination to a set of back-end IP addresses and
port combination. A single load balancer can have multiple load balancing rules. Each rule is a combination of a
front-end IP and port and back-end IP and port associated with VMs.
Probes - Monitors the health of VMs. When a probe fails to respond, the load balancer stops sending new
connections to the unhealthy VM. The existing connections are not affected, and new connections are sent to
healthy VMs.
This table lists the methods that you can use to create an internet-facing load balancer.
METHOD DESCRIPTION
Azure PowerShell To provide the identifier of the public IP address that you
previously created, use New-
AzureRmLoadBalancerFrontendIpConfig with the -
PublicIpAddress parameter. Use New-
AzureRmLoadBalancerBackendAddressPoolConfig to create
the configuration of the back-end address pool. Use New-
AzureRmLoadBalancerInboundNatRuleConfig to create
inbound NAT rules associated with the front-end IP
configuration that you created. Use New-
AzureRmLoadBalancerProbeConfig to create the probes that
you need. Use New-AzureRmLoadBalancerRuleConfig to
create the load balancer configuration. Use New-
AzureRmLoadBalancer to create the load balancer.
Azure CLI Use az network lb create to create the initial load balancer
configuration. Use az network lb frontend-ip create to add the
public IP address that you previously created. Use az network
lb address-pool create to add the configuration of the back-
end address pool. Use az network lb inbound-nat-rule create
to add NAT rules. Use az network lb rule create to add the
load balancer rules. Use az network lb probe create to add the
probes.
Template Use 2 VMs in a Load Balancer and configure NAT rules on the
LB as a guide for deploying a load balancer using a template.
This table lists the methods that you can use to create an internal load balancer.
METHOD DESCRIPTION
Azure portal You can't currently create an internal load balancer using the
Azure portal.
Azure CLI Use the az network lb create command to create the initial
load balancer configuration. To define the private IP address,
use az network lb frontend-ip create with the --private-ip-
address parameter. Use az network lb address-pool create to
add the configuration of the back-end address pool. Use az
network lb inbound-nat-rule create to add NAT rules. Use az
network lb rule create to add the load balancer rules. Use az
network lb probe create to add the probes.
Template Use 2 VMs in a Load Balancer and configure NAT rules on the
LB as a guide for deploying a load balancer using a template.
VMs
VMs can be created in the same VNet and they can connect to each other using private IP addresses. They can
connect even if they are in different subnets without the need to configure a gateway or use public IP addresses. To
put VMs into a VNet, you create the VNet and then as you create each VM, you assign it to the VNet and subnet.
VMs acquire their network settings during deployment or startup.
VMs are assigned an IP address when they are deployed. If you deploy multiple VMs into a VNet or subnet, they
are assigned IP addresses as they boot up. A dynamic IP address (DIP ) is the internal IP address associated with a
VM. You can allocate a static DIP to a VM. If you allocate a static DIP, you should consider using a specific subnet
to avoid accidentally reusing a static DIP for another VM.
If you create a VM and later want to migrate it into a VNet, it is not a simple configuration change. You must
redeploy the VM into the VNet. The easiest way to redeploy is to delete the VM, but not any disks attached to it,
and then re-create the VM using the original disks in the VNet.
This table lists the methods that you can use to create a VM in a VNet.
METHOD DESCRIPTION
Azure portal Uses the default network settings that were previously
mentioned to create a VM with a single NIC. To create a VM
with multiple NICs, you must use a different method.
Azure CLI Create and connect a VM to a Vnet, subnet, and NIC that
build as individual steps.
Next steps
For VM -specific steps on how to manage Azure virtual networks for VMs, see the Windows or Linux tutorials.
There are also tutorials on how to load balance VMs and create highly available applications for Windows or Linux.
Learn how to configure user-defined routes and IP forwarding.
Learn how to configure VNet to VNet connections.
Learn how to Troubleshoot routes.
Automatically scale virtual machines in Azure
10/19/2018 • 4 minutes to read • Edit Online
You can easily automatically scale your virtual machines (VMs) when you use virtual machine scale sets and the
autoscaling feature of Azure Monitor. Your VMs need to be members of a scale set to be automatically scaled. This
article provides information that enables you to better understand how to scale your VMs both vertically and
horizontally using automatic and manual methods.
If your application needs to scale based on metrics that are not available through the host, then the VMs in the
scale set need to have either the Linux diagnostic extension or Windows diagnostics extension installed. If you
create a scale set using the Azure portal, you need to also use Azure PowerShell or the Azure CLI to install the
extension with the diagnostics configuration that you need.
Rules
Rules combine a metric with an action to be performed. When rule conditions are met, one or more autoscale
actions are triggered. For example, you might have a rule defined that increases the number of VMs by 1 if the
average CPU usage goes above 85 percent.
Notifications
You can set up triggers so that specific web URLs are called or emails are sent based on the autoscale rules that
you create. Webhooks allow you to route the Azure alert notifications to other systems for post-processing or
custom notifications.
Next steps
Learn more about scale sets in Design Considerations for Scale Sets.
Use infrastructure automation tools with virtual
machines in Azure
10/19/2018 • 7 minutes to read • Edit Online
To create and manage Azure virtual machines (VMs) in a consistent manner at scale, some form of automation is
typically desired. There are many tools and solutions that allow you to automate the complete Azure infrastructure
deployment and management lifecycle. This article introduces some of the infrastructure automation tools that you
can use in Azure. These tools commonly fit in to one of the following approaches:
Automate the configuration of VMs
Tools include Ansible, Chef, and Puppet.
Tools specific to VM customization include cloud-init for Linux VMs, PowerShell Desired State
Configuration (DSC ), and the Azure Custom Script Extension for all Azure VMs.
Automate infrastructure management
Tools include Packer to automate custom VM image builds, and Terraform to automate the infrastructure
build process.
Azure Automation can perform actions across your Azure and on-premises infrastructure.
Automate application deployment and delivery
Examples include Azure DevOps Services and Jenkins.
Ansible
Ansible is an automation engine for configuration management, VM creation, or application deployment. Ansible
uses an agent-less model, typically with SSH keys, to authenticate and manage target machines. Configuration
tasks are defined in playbooks, with a number of Ansible modules available to carry out specific tasks. For more
information, see How Ansible works.
Learn how to:
Install and configure Ansible on Linux for use with Azure.
Create a Linux virtual machine.
Manage a Linux virtual machine.
Chef
Chef is an automation platform that helps define how your infrastructure is configured, deployed, and managed.
Additional components included Chef Habitat for application lifecycle automation rather than the infrastructure,
and Chef InSpec that helps automate compliance with security and policy requirements. Chef Clients are installed
on target machines, with one or more central Chef Servers that store and manage the configurations. For more
information, see An Overview of Chef.
Learn how to:
Deploy Chef Automate from the Azure Marketplace.
Install Chef on Windows and create Azure VMs.
Puppet
Puppet is an enterprise-ready automation platform that handles the application delivery and deployment process.
Agents are installed on target machines to allow Puppet Master to run manifests that define the desired
configuration of the Azure infrastructure and VMs. Puppet can integrate with other solutions such as Jenkins and
GitHub for an improved devops workflow. For more information, see How Puppet works.
Learn how to:
Deploy Puppet from the Azure Marketplace.
Cloud-init
Cloud-init is a widely used approach to customize a Linux VM as it boots for the first time. You can use cloud-init to
install packages and write files, or to configure users and security. Because cloud-init is called during the initial boot
process, there are no additional steps or required agents to apply your configuration. For more information on how
to properly format your #cloud-config files, see the cloud-init documentation site. #cloud-config files are text files
encoded in base64.
Cloud-init also works across distributions. For example, you don't use apt-get install or yum install to install a
package. Instead you can define a list of packages to install. Cloud-init automatically uses the native package
management tool for the distro you select.
We are actively working with our endorsed Linux distro partners in order to have cloud-init enabled images
available in the Azure marketplace. These images make your cloud-init deployments and configurations work
seamlessly with VMs and virtual machine scale sets. The following table outlines the current cloud-init enabled
images availability on the Azure platform:
PowerShell DSC
PowerShell Desired State Configuration (DSC ) is a management platform to define the configuration of target
machines. DSC can also be used on Linux through the Open Management Infrastructure (OMI) server.
DSC configurations define what to install on a machine and how to configure the host. A Local Configuration
Manager (LCM ) engine runs on each target node that processes requested actions based on pushed configurations.
A pull server is a web service that runs on a central host to store the DSC configurations and associated resources.
The pull server communicates with the LCM engine on each target host to provide the required configurations and
report on compliance.
Learn how to:
Create a basic DSC configuration.
Configure a DSC pull server.
Use DSC for Linux.
Packer
Packer automates the build process when you create a custom VM image in Azure. You use Packer to define the
OS and run post-configuration scripts that customize the VM for your specific needs. Once configured, the VM is
then captured as a Managed Disk image. Packer automates the process to create the source VM, network and
storage resources, run configuration scripts, and then create the VM image.
Learn how to:
Use Packer to create a Linux VM image in Azure.
Use Packer to create a Windows VM image in Azure.
Terraform
Terraform is an automation tool that allows you to define and create an entire Azure infrastructure with a single
template format language - the HashiCorp Configuration Language (HCL ). With Terraform, you define templates
that automate the process to create network, storage, and VM resources for a given application solution. You can
use your existing Terraform templates for other platforms with Azure to ensure consistency and simplify the
infrastructure deployment without needing to convert to an Azure Resource Manager template.
Learn how to:
Install and configure Terraform with Azure.
Create an Azure infrastructure with Terraform.
Azure Automation
Azure Automation uses runbooks to process a set of tasks on the VMs you target. Azure Automation is used to
manage existing VMs rather than to create an infrastructure. Azure Automation can run across both Linux and
Windows VMs, as well as on-premises virtual or physical machines with a hybrid runbook worker. Runbooks can
be stored in a source control repository, such as GitHub. These runbooks can then run manually or on a defined
schedule.
Azure Automation also provides a Desired State Configuration (DSC ) service that allows you to create definitions
for how a given set of VMs should be configured. DSC then ensures that the required configuration is applied and
the VM stays consistent. Azure Automation DSC runs on both Windows and Linux machines.
Learn how to:
Create a PowerShell runbook.
Use Hybrid Runbook Worker to manage on-premises resources.
Use Azure Automation DSC.
Jenkins
Jenkins is a continuous integration server that helps deploy and test applications, and create automated pipelines
for code delivery. There are hundreds of plugins to extend the core Jenkins platform, and you can also integrate
with many other products and solutions through webhooks. You can manually install Jenkins on an Azure VM, run
Jenkins from within a Docker container, or use a pre-built Azure Marketplace image.
Learn how to:
Create a development infrastructure on a Linux VM in Azure with Jenkins, GitHub, and Docker.
Next steps
There are many different options to use infrastructure automation tools in Azure. You have the freedom to use the
solution that best fits your needs and environment. To get started and try some of the tools built-in to Azure, see
how to automate the customization of a Linux or Windows VM.
Secure and use policies on virtual machines in Azure
4/17/2018 • 4 minutes to read • Edit Online
It’s important to keep your virtual machine (VM ) secure for the applications that you run. Securing your VMs can
include one or more Azure services and features that cover secure access to your VMs and secure storage of your
data. This article provides information that enables you to keep your VM and applications secure.
Antimalware
The modern threat landscape for cloud environments is dynamic, increasing the pressure to maintain effective
protection in order to meet compliance and security requirements. Microsoft Antimalware for Azure is a free real-
time protection capability that helps identify and remove viruses, spyware, and other malicious software. Alerts can
be configured to notify you when known malicious or unwanted software attempts to install itself or run on your
VM.
Encryption
For enhanced Windows VM and Linux VM security and compliance, virtual disks in Azure can be encrypted.
Virtual disks on Windows VMs are encrypted at rest using Bitlocker. Virtual disks on Linux VMs are encrypted at
rest using dm-crypt.
There is no charge for encrypting virtual disks in Azure. Cryptographic keys are stored in Azure Key Vault using
software-protection, or you can import or generate your keys in Hardware Security Modules (HSMs) certified to
FIPS 140-2 level 2 standards. These cryptographic keys are used to encrypt and decrypt virtual disks attached to
your VM. You retain control of these cryptographic keys and can audit their use. An Azure Active Directory service
principal provides a secure mechanism for issuing these cryptographic keys as VMs are powered on and off.
Policies
Azure policies can be used to define the desired behavior for your organization's Windows VMs and Linux VMs. By
using policies, an organization can enforce various conventions and rules throughout the enterprise. Enforcement
of the desired behavior can help mitigate risk while contributing to the success of the organization.
Next steps
Walk through the steps to monitor virtual machine security by using Azure Security Center for Linux or
Windows.
Virtual machines lifecycle and states
8/10/2018 • 3 minutes to read • Edit Online
Azure Virtual Machines (VMs) go through different states that can be categorized into provisioning and power
states. The purpose of this article is to describe these states and specifically highlight when customers are billed for
instance usage.
Power states
The power state represents the last known state of the VM.
The following table provides a description of each instance state and indicates whether it is billed for instance
usage or not.
*Some Azure resources, such as Disks and Networking, incur charges regardless of the instance's state.
Provisioning states
A provisioning state is the status of a user-initiated, control-plane operation on the VM. These states are separate
from the power state of a VM.
Create – VM creation.
Update – updates the model for an existing VM. Some non-model changes to VM such as Start/Restart
also fall under update.
Delete – VM deletion.
Deallocate – is where a VM is stopped and removed from the host. Deallocating a VM is considered an
update, so it will display provisioning states related to updating.
Here are the transitional operation states after the platform has accepted a user-initiated action:
States Description
Creating "statuses": [
{
"code": "ProvisioningState/creating",
"level": "Info",
"displayStatus": "Creating"
}
Updating "statuses": [
{
"code": "ProvisioningState/updating",
"level": "Info",
"displayStatus": "Updating"
}
]
Deleting "statuses": [
{
"code": "ProvisioningState/deleting",
"level": "Info",
"displayStatus": "Deleting"
}
]
OS provisioning states If a VM is created with an OS image and not with a specialized image, then following
substates can be observed:
1. OSProvisioningInprogress – The VM is running, and installation of guest OS is
in progress.
"statuses": [
{
"code": "ProvisioningState/creating/OSProvisioningInprogress",
"level": "Info",
"displayStatus": "OS Provisioning In progress"
}
]
Once the operation is complete, the VM will transition into one of the following states:
Succeeded – the user-initiated actions have completed.
"statuses": [
{
"code": "ProvisioningState/succeeded",
"level": "Info",
"displayStatus": "Provisioning succeeded",
"time": "time"
}
]
Failed – represents a failed operation. Refer to the error codes to get more information and possible
solutions.
"statuses": [
{
"code": "ProvisioningState/failed/InternalOperationError",
"level": "Error",
"displayStatus": "Provisioning failed",
"message": "Operation abandoned due to internal error. Please try again later.",
"time": "time"
}
]
VM instance view
The instance view API provides VM running-state information. For more information, see the Virtual Machines -
Instance View API documentation.
Azure Resources explorer provides a simple UI for viewing the VM running state: Resource Explorer.
Provisioning states are visible on VM properties and instance view. Power states are available in instance view of
VM.
Next steps
To learn more about monitoring your VM, see How to monitor virtual machines in Azure.
How to monitor virtual machines in Azure
7/9/2018 • 5 minutes to read • Edit Online
You can take advantage of many opportunities to monitor your VMs by collecting, viewing, and analyzing
diagnostic and log data. To do simple monitoring of your VM, you can use the Overview screen for the VM in the
Azure portal. You can use extensions to configure diagnostics on your VMs to collect additional metric data. You
can also use more advanced monitoring options, such as Application Insights and Log Analytics.
Alerts
You can create alerts based on specific performance metrics. Examples of the issues you can be alerted about
include when average CPU usage exceeds a certain threshold, or available free disk space drops below a certain
amount. Alerts can be configured in the Azure portal, using Azure PowerShell, or the Azure CLI.
Logs
The Azure Activity Log is a subscription log that provides insight into subscription-level events that have occurred
in Azure. The log includes a range of data, from Azure Resource Manager operational data to updates on Service
Health events. You can click Activity Log in the Azure portal to view the log for your VM.
Some of the things you can do with the activity log include:
Create an alert on an Activity Log event.
Stream it to an Event Hub for ingestion by a third-party service or custom analytics solution such as PowerBI.
Analyze it in PowerBI using the PowerBI content pack.
Save it to a storage account for archival or manual inspection. You can specify the retention time (in days) using
the Log Profile.
You can also access activity log data by using Azure PowerShell, the Azure CLI, or Monitor REST APIs.
Azure Diagnostic Logs are logs emitted by your VM that provide rich, frequent data about its operation. Diagnostic
logs differ from the activity log by providing insight about operations that were performed within the VM.
Some of the things you can do with diagnostics logs include:
Save them to a storage account for auditing or manual inspection. You can specify the retention time (in days)
using Resource Diagnostic Settings.
Stream them to Event Hubs for ingestion by a third-party service or custom analytics solution such as PowerBI.
Analyze them with OMS Log Analytics.
Advanced monitoring
Operations Management Suite (OMS ) provides monitoring, alerting, and alert remediation capabilities
across cloud and on-premises assets. You can install an extension on a Linux VM or a Windows VM that
installs the OMS agent, and enrolls the VM into an existing OMS workspace.
Log Analytics is a service in OMS that monitors your cloud and on-premises environments to maintain
their availability and performance. It collects data generated by resources in your cloud and on-premises
environments and from other monitoring tools to provide analysis across multiple sources.
For Windows and Linux VMs, the recommended method for collecting logs and metrics is by installing the
Log Analytics agent. The easiest way to install the Log Analytics agent on a VM is through the Log Analytics
VM Extension. Using the extension simplifies the installation process and automatically configures the agent
to send data to the Log Analytics workspace that you specify. The agent is also upgraded automatically,
ensuring that you have the latest features and fixes.
Network Watcher enables you to monitor your VM and its associated resources as they relate to the
network that they are in. You can install the Network Watcher Agent extension on a Linux VM or a Windows
VM.
Next steps
Walk through the steps in Monitor a Windows Virtual Machine with Azure PowerShell or Monitor a Linux
Virtual Machine with the Azure CLI.
Learn more about the best practices around Monitoring and diagnostics.
Backup and restore options for virtual machines in
Azure
4/9/2018 • 2 minutes to read • Edit Online
You can protect your data by taking backups at regular intervals. There are several backup options available for
VMs, depending on your use-case.
Azure Backup
For backing up Azure VMs running production workloads, use Azure Backup. Azure Backup supports application-
consistent backups for both Windows and Linux VMs. Azure Backup creates recovery points that are stored in geo-
redundant recovery vaults. When you restore from a recovery point, you can restore the whole VM or just specific
files.
For a simple, hands-on introduction to Azure Backup for Azure VMs, see the "Back up Azure virtual machines"
tutorial for Linux or Windows.
For more information on how Azure Backup works, see Plan your VM backup infrastructure in Azure
Managed snapshots
In development and test environments, snapshots provide a quick and simple option for backing up VMs that use
Managed Disks. A managed snapshot is a read-only full copy of a managed disk. Snapshots exist independent of
the source disk and can be used to create new managed disks for rebuilding a VM. They are billed based on the
used portion of the disk. For example, if you create a snapshot of a managed disk with provisioned capacity of 64
GB and actual used data size of 10 GB, snapshot will be billed only for the used data size of 10 GB.
For more information on creating snapshots, see:
Create copy of VHD stored as a Managed Disk using Snapshots in Windows
Create copy of VHD stored as a Managed Disk using Snapshots in Linux
Next steps
You can try out Azure Backup by following the "Back up Windows virtual machines tutorial" for Linux or Windows.
HPC, Batch, and Big Compute solutions using Azure
VMs
5/11/2018 • 4 minutes to read • Edit Online
Organizations have large-scale computing needs. These Big Compute workloads include engineering design and
analysis, financial risk calculations, image rendering, complex modeling, Monte Carlo simulations, and more.
Use the Azure cloud to efficiently run compute-intensive Linux and Windows workloads, from parallel batch jobs to
traditional HPC simulations. Run your HPC and batch workloads on Azure infrastructure, with your choice of
compute services, grid managers, Marketplace solutions, and vendor-hosted (SaaS ) applications. Azure provides
flexible solutions to distribute work and scale to thousands of VMs or cores and then scale down when you need
fewer resources.
Solution options
Do-it-yourself solutions
Set up your own cluster environment in Azure virtual machines or virtual machine scale sets.
Lift and shift an on-premises cluster, or deploy a new cluster in Azure for additional capacity.
Use Azure Resource Manager templates to deploy leading workload managers, infrastructure, and
applications.
Choose HPC and GPU VM sizes that include specialized hardware and network connections for MPI or
GPU workloads.
Add high performance storage for I/O -intensive workloads.
Hybrid solutions
Extend your on-premises solution to offload ("burst") peak workloads to Azure infrastructure
Use cloud compute on-demand with your existing workload manager.
Take advantage of HPC and GPU VM sizes for MPI or GPU workloads.
Big Compute solutions as a service
Develop custom Big Compute solutions and workflows using Azure Batch and related Azure services.
Run Azure-enabled engineering and simulation solutions from vendors including Altair, Rescale, and
Cycle Computing (now joined with Microsoft).
Use a Cray supercomputer as a service hosted in Azure.
Marketplace solutions
Use the scale of HPC applications and solutions offered in the Azure Marketplace.
The following sections provide more information about the supporting technologies and links to guidance.
Marketplace solutions
Visit the Azure Marketplace for Linux and Windows VM images and solutions designed for HPC. Examples include:
RogueWave CentOS -based HPC
SUSE Linux Enterprise Server for HPC
TIBCO Grid Server Engine
Azure Data Science VM for Windows and Linux
D3View
UberCloud
Intel Cloud Edition for Lustre
HPC applications
Run custom or commercial HPC applications in Azure. Several examples in this section are benchmarked to scale
efficiently with additional VMs or compute cores. Visit the Azure Marketplace for ready-to-deploy solutions.
NOTE
Check with the vendor of any commercial application for licensing or other restrictions for running in the cloud. Not all
vendors offer pay-as-you-go licensing. You might need a licensing server in the cloud for your solution, or connect to an on-
premises license server.
Engineering applications
Altair RADIOSS
ANSYS CFD
MATLAB Distributed Computing Server
StarCCM+
OpenFOAM
Graphics and rendering
Autodesk Maya, 3ds Max, and Arnold on Azure Batch
AI and deep learning
Batch AI training for deep learning models
Microsoft Cognitive Toolkit
Deep Learning VM
Batch Shipyard recipes for deep learning
Azure Batch
Batch is a platform service for running large-scale parallel and high-performance computing (HPC ) applications
efficiently in the cloud. Azure Batch schedules compute-intensive work to run on a managed pool of virtual
machines, and can automatically scale compute resources to meet the needs of your jobs.
SaaS providers or developers can use the Batch SDKs and tools to integrate HPC applications or container
workloads with Azure, stage data to Azure, and build job execution pipelines.
Learn how to:
Get started developing with Batch
Use Azure Batch code samples
Use low -priority VMs with Batch
Run containerized HPC workloads with Batch Shipyard
Run parallel R workloads on Batch
Run on-demand Spark jobs on Batch
Workload managers
The following are examples of cluster and workload managers that can run in Azure infrastructure. Create stand-
alone clusters in Azure VMs or burst to Azure VMs from an on-premises cluster.
Alces Flight Compute
TIBCO DataSynapse GridServer
Bright Cluster Manager
IBM Spectrum Symphony and Symphony LSF
PBS Pro
Microsoft HPC Pack - see options to run in Windows and Linux VMs
HPC storage
Large-scale Batch and HPC workloads have demands for data storage and access that exceed the capabilities of
traditional cloud file systems. Implement parallel file system solutions in Azure such as Lustre and BeeGFS.
Learn more:
Parallel virtual file systems on Azure
High performance cloud storage solutions from Avere (now joined with Microsoft)
Customer stories
Examples of customers that have solved business problems with Azure HPC solutions:
ANEO
AXA Global P&C
Axioma
d3View
EFS
Hymans Robertson
MetLife
Microsoft Research
Milliman
Mitsubishi UFJ Securities International
NeuroInitiative
Schlumberger
Towers Watson
Next steps
Learn more about Big Compute solutions for engineering simulation, rendering, banking and capital markets,
and genomics.
For the latest announcements, see the Microsoft HPC and Batch team blog and the Azure blog.
Use the managed and scalable Azure Batch service to run compute-intensive workloads, without managing
underlying infrastructure Learn more
Example Azure infrastructure walkthrough for
Windows VMs
7/9/2018 • 3 minutes to read • Edit Online
This article walks through building out an example application infrastructure. We detail designing an infrastructure
for a simple online store that brings together all the guidelines and decisions around naming conventions,
availability sets, virtual networks and load balancers, and actually deploying your virtual machines (VMs).
Example workload
Adventure Works Cycles wants to build an online store application in Azure that consists of:
Two IIS servers running the client front-end in a web tier
Two IIS servers processing data and orders in an application tier
Two Microsoft SQL Server instances with AlwaysOn availability groups (two SQL Servers and a majority node
witness) for storing product data and orders in a database tier
Two Active Directory domain controllers for customer accounts and suppliers in an authentication tier
All the servers are located in two subnets:
a front-end subnet for the web servers
a back-end subnet for the application servers, SQL cluster, and domain controllers
Incoming secure web traffic must be load-balanced among the web servers as customers browse the online store.
Order processing traffic in the form of HTTP requests from the web servers must be balanced among the
application servers. Additionally, the infrastructure must be designed for high availability.
The resulting design must incorporate:
An Azure subscription and account
A single resource group
Azure Managed Disks
A virtual network with two subnets
Availability sets for the VMs with a similar role
Virtual machines
All the above follow these naming conventions:
Adventure Works Cycles uses [IT workload]-[location]-[Azure resource] as a prefix
For this example, "azos" (Azure Online Store) is the IT workload name and "use" (East US 2) is the
location
Virtual networks use AZOS -USE -VN [number]
Availability sets use azos-use-as-[role]
Virtual machine names use azos-use-vm-[vmname]
Storage
Adventure Works Cycles determined that they should use Azure Managed Disks. When creating VMs, both
available storage tiers are used:
Standard storage for the web servers, application servers, and domain controllers and their data disks.
Premium storage for the SQL Server VMs and their data disks.
Availability sets
To maintain high availability of all four tiers of their online store, Adventure Works Cycles decided on four
availability sets:
azos-use-as-web for the web servers
azos-use-as-app for the application servers
azos-use-as-sql for the SQL Servers
azos-use-as-dc for the domain controllers
Virtual machines
Adventure Works Cycles decided on the following names for their Azure VMs:
azos-use-vm -web01 for the first web server
azos-use-vm -web02 for the second web server
azos-use-vm -app01 for the first application server
azos-use-vm -app02 for the second application server
azos-use-vm -sql01 for the first SQL Server server in the cluster
azos-use-vm -sql02 for the second SQL Server server in the cluster
azos-use-vm -dc01 for the first domain controller
azos-use-vm -dc02 for the second domain controller
Here is the resulting configuration.
The vCPU quotas for virtual machines and virtual machine scale sets are arranged in two tiers for each
subscription, in each region. The first tier is the Total Regional vCPUs, and the second tier is the various VM size
family cores such as the D -series vCPUs. Any time a new VM is deployed the vCPUs for the VM must not exceed
the vCPU quota for the VM size family or the total regional vCPU quota. If either of those quotas are exceeded, the
VM deployment will not be allowed. There is also a quota for the overall number of virtual machines in the region.
The details on each of these quotas can be seen in the Usage + quotas section of the Subscription page in the
Azure portal, or you can query for the values using PowerShell.
Check usage
You can use the Get-AzureRmVMUsage cmdlet to check on your quota usage.
Next steps
For more information about billing and quotas, see Azure subscription and service limits, quotas, and constraints.
Create and manage Windows VMs in Azure using C#
10/19/2018 • 7 minutes to read • Edit Online
An Azure Virtual Machine (VM ) needs several supporting Azure resources. This article covers creating, managing,
and deleting VM resources using C#. You learn how to:
Create a Visual Studio project
Install the package
Create credentials
Create resources
Perform management tasks
Delete resources
Run the application
It takes about 20 minutes to do these steps.
Install-Package Microsoft.Azure.Management.Fluent
Create credentials
Before you start this step, make sure that you have access to an Active Directory service principal. You should also
record the application ID, the authentication key, and the tenant ID that you need in a later step.
Create the authorization file
1. In Solution Explorer, right-click myDotnetProject > Add > New Item, and then select Text File in Visual C#
Items. Name the file azureauth.properties, and then click Add.
2. Add these authorization properties:
subscription=<subscription-id>
client=<application-id>
key=<authentication-key>
tenant=<tenant-id>
managementURI=https://management.core.windows.net/
baseURL=https://management.azure.com/
authURL=https://login.windows.net/
graphURL=https://graph.windows.net/
Replace <subscription-id> with your subscription identifier, <application-id> with the Active Directory
application identifier, <authentication-key> with the application key, and <tenant-id> with the tenant
identifier.
3. Save the azureauth.properties file.
4. Set an environment variable in Windows named AZURE_AUTH_LOCATION with the full path to
authorization file that you created. For example, the following PowerShell command can be used:
using Microsoft.Azure.Management.Compute.Fluent;
using Microsoft.Azure.Management.Compute.Fluent.Models;
using Microsoft.Azure.Management.Fluent;
using Microsoft.Azure.Management.ResourceManager.Fluent;
using Microsoft.Azure.Management.ResourceManager.Fluent.Core;
2. To create the management client, add this code to the Main method:
Create resources
Create the resource group
All resources must be contained in a Resource group.
To specify values for the application and create the resource group, add this code to the Main method:
var groupName = "myResourceGroup";
var vmName = "myVM";
var location = Region.USWest;
NOTE
This tutorial creates a virtual machine running a version of the Windows Server operating system. To learn more about
selecting other images, see Navigate and select Azure virtual machine images with Windows PowerShell and the Azure CLI.
If you want to use an existing disk instead of a marketplace image, use this code:
azure.VirtualMachines.Define("myVM")
.WithRegion(location)
.WithExistingResourceGroup(groupName)
.WithExistingPrimaryNetworkInterface(networkInterface)
.WithSpecializedOSDisk(managedDisk, OperatingSystemTypes.Windows)
.WithExistingAvailabilitySet(availabilitySet)
.WithSize(VirtualMachineSizeTypes.StandardDS1)
.Create();
Stop the VM
You can stop a virtual machine and keep all its settings, but continue to be charged for it, or you can stop a virtual
machine and deallocate it. When a virtual machine is deallocated, all resources associated with it are also
deallocated and billing ends for it.
To stop the virtual machine without deallocating it, add this code to the Main method:
Console.WriteLine("Stopping vm...");
vm.PowerOff();
Console.WriteLine("Press enter to continue...");
Console.ReadLine();
If you want to deallocate the virtual machine, change the PowerOff call to this code:
vm.Deallocate();
Start the VM
To start the virtual machine, add this code to the Main method:
Console.WriteLine("Starting vm...");
vm.Start();
Console.WriteLine("Press enter to continue...");
Console.ReadLine();
Resize the VM
Many aspects of deployment should be considered when deciding on a size for your virtual machine. For more
information, see VM sizes.
To change size of the virtual machine, add this code to the Main method:
Console.WriteLine("Resizing vm...");
vm.Update()
.WithSize(VirtualMachineSizeTypes.StandardDS2)
.Apply();
Console.WriteLine("Press enter to continue...");
Console.ReadLine();
Delete resources
Because you are charged for resources used in Azure, it is always good practice to delete resources that are no
longer needed. If you want to delete the virtual machines and all the supporting resources, all you have to do is
delete the resource group.
To delete the resource group, add this code to the Main method:
azure.ResourceGroups.DeleteByName(groupName);
Next steps
Take advantage of using a template to create a virtual machine by using the information in Deploy an Azure
Virtual Machine using C# and a Resource Manager template.
Learn more about using the Azure libraries for .NET.
Create a VM from a VHD by using the Azure portal
10/11/2018 • 3 minutes to read • Edit Online
Copy a disk
Create a snapshot and then create a disk from the snapshot. This strategy allows you to keep the original VHD as a
fallback:
1. From the Azure portal, on the left menu, select All services.
2. In the All services search box, enter disks and then select Disks to display the list of available disks.
3. Select the disk that you would like to use. The Disk page for that disk appears.
4. From the menu at the top, select Create snapshot.
5. Enter a Name for the snapshot.
6. Choose a Resource group for the snapshot. You can use either an existing resource group or create a new one.
7. For Account type, choose either Standard (HDD ) or Premium (SSD ) storage.
8. When you're done, select Create to create the snapshot.
9. After the snapshot has been created, select Create a resource in the left menu.
10. In the search box, enter managed disk and then select Managed Disks from the list.
11. On the Managed Disks page, select Create.
12. Enter a Name for the disk.
13. Choose a Resource group for the disk. You can use either an existing resource group or create a new one. This
selection will also be used as the resource group where you create the VM from the disk.
14. For Account type, choose either Standard (HDD ) or Premium (SSD ) storage.
15. In Source type, ensure Snapshot is selected.
16. In the Source snapshot drop-down, select the snapshot you want to use.
17. Make any other adjustments as needed and then select Create to create the disk.
Next steps
You can also use PowerShell to upload a VHD to Azure and create a specialized VM.
Create a Windows VM from a specialized disk by
using PowerShell
10/18/2018 • 8 minutes to read • Edit Online
Create a new VM by attaching a specialized managed disk as the OS disk. A specialized disk is a copy of a virtual
hard disk (VHD ) from an existing VM that contains the user accounts, applications, and other state data from your
original VM.
When you use a specialized VHD to create a new VM, the new VM retains the computer name of the original VM.
Other computer-specific information is also kept and, in some cases, this duplicate information could cause issues.
When copying a VM, be aware of what types of computer-specific information your applications rely on.
You have several options:
Use an existing managed disk. This option is useful if you have a VM that isn't working correctly. You can delete
the VM and then reuse the managed disk to create a new VM.
Upload a VHD
Copy an existing Azure VM by using snapshots
You can also use the Azure portal to create a new VM from a specialized VHD.
This article shows you how to use managed disks. If you have a legacy deployment that requires using a storage
account, see Create a VM from a specialized VHD in a storage account.
$resourceGroupName = 'myResourceGroup'
$osDiskName = 'myOsDisk'
$osDisk = Get-AzureRmDisk `
-ResourceGroupName $resourceGroupName `
-DiskName $osDiskName
You can now attach this disk as the OS disk to a new VM.
Get-AzureRmStorageAccount
To use an existing storage account, proceed to the Upload the VHD section.
Create a storage account.
1. You'll need the name of the resource group where the storage account will be created. Use Get-
AzureRmResourceGroup see all the resource groups that are in your subscription.
Get-AzureRmResourceGroup
New-AzureRmResourceGroup `
-Name myResourceGroup `
-Location "West US"
2. Create a storage account named mystorageaccount in the new resource group by using the New -
AzureRmStorageAccount cmdlet.
New-AzureRmStorageAccount `
-ResourceGroupName myResourceGroup `
-Name mystorageaccount `
-Location "West US" `
-SkuName "Standard_LRS" `
-Kind "Storage"
$resourceGroupName = "myResourceGroup"
$urlOfUploadedVhd = "https://mystorageaccount.blob.core.windows.net/mycontainer/myUploadedVHD.vhd"
Add-AzureRmVhd -ResourceGroupName $resourceGroupName `
-Destination $urlOfUploadedVhd `
-LocalFilePath "C:\Users\Public\Documents\Virtual hard disks\myVHD.vhd"
If the commands are successful, you'll get a response that looks similar to this:
MD5 hash is being calculated for the file C:\Users\Public\Documents\Virtual hard disks\myVHD.vhd.
MD5 hash calculation is completed.
Elapsed time for the operation: 00:03:35
Creating new page blob of size 53687091712...
Elapsed time for upload: 01:12:49
LocalFilePath DestinationUri
------------- --------------
C:\Users\Public\Doc... https://mystorageaccount.blob.core.windows.net/mycontainer/myUploadedVHD.vhd
This command may take a while to complete, depending on your network connection and the size of your VHD
file.
Create a managed disk from the VHD
Create a managed disk from the specialized VHD in your storage account by using New -AzureRMDisk. This
example uses myOSDisk1 for the disk name, puts the disk in Standard_LRS storage, and uses
https://storageaccount.blob.core.windows.net/vhdcontainer/osdisk.vhd as the URI for the source VHD.
Create a new resource group for the new VM.
$destinationResourceGroup = 'myDestinationResourceGroup'
New-AzureRmResourceGroup -Location $location `
-Name $destinationResourceGroup
$sourceUri = 'https://storageaccount.blob.core.windows.net/vhdcontainer/osdisk.vhd'
$osDiskName = 'myOsDisk'
$osDisk = New-AzureRmDisk -DiskName $osDiskName -Disk `
(New-AzureRmDiskConfig -AccountType Standard_LRS `
-Location $location -CreateOption Import `
-SourceUri $sourceUri) `
-ResourceGroupName $destinationResourceGroup
$resourceGroupName = 'myResourceGroup'
$vmName = 'myVM'
$location = 'westus'
$snapshotName = 'mySnapshot'
$snapshotConfig = New-AzureRmSnapshotConfig `
-SourceUri $disk.Id `
-OsType Windows `
-CreateOption Copy `
-Location $location
$snapShot = New-AzureRmSnapshot `
-Snapshot $snapshotConfig `
-SnapshotName $snapshotName `
-ResourceGroupName $resourceGroupName
To use this snapshot to create a VM that needs to be high-performing, add the parameter
-AccountType Premium_LRS to the New -AzureRmSnapshot command. This parameter creates the snapshot so that
it's stored as a Premium Managed Disk. Premium Managed Disks are more expensive than Standard, so be sure
you'll need Premium before using this parameter.
Create a new disk from the snapshot
Create a managed disk from the snapshot by using New -AzureRMDisk. This example uses myOSDisk for the disk
name.
Create a new resource group for the new VM.
$destinationResourceGroup = 'myDestinationResourceGroup'
New-AzureRmResourceGroup -Location $location `
-Name $destinationResourceGroup
$osDiskName = 'myOsDisk'
$subnetName = 'mySubNet'
$singleSubnet = New-AzureRmVirtualNetworkSubnetConfig `
-Name $subnetName `
-AddressPrefix 10.0.0.0/24
2. Create the virtual network. This example sets the virtual network name to myVnetName, the location to
West US, and the address prefix for the virtual network to 10.0.0.0/16.
$vnetName = "myVnetName"
$vnet = New-AzureRmVirtualNetwork `
-Name $vnetName -ResourceGroupName $destinationResourceGroup `
-Location $location `
-AddressPrefix 10.0.0.0/16 `
-Subnet $singleSubnet
$nsgName = "myNsg"
For more information about endpoints and NSG rules, see Opening ports to a VM in Azure by using PowerShell.
Create a public IP address and NIC
To enable communication with the virtual machine in the virtual network, you'll need a public IP address and a
network interface.
1. Create the public IP. In this example, the public IP address name is set to myIP.
$ipName = "myIP"
$pip = New-AzureRmPublicIpAddress `
-Name $ipName -ResourceGroupName $destinationResourceGroup `
-Location $location `
-AllocationMethod Dynamic
2. Create the NIC. In this example, the NIC name is set to myNicName.
$nicName = "myNicName"
$nic = New-AzureRmNetworkInterface -Name $nicName `
-ResourceGroupName $destinationResourceGroup `
-Location $location -SubnetId $vnet.Subnets[0].Id `
-PublicIpAddressId $pip.Id `
-NetworkSecurityGroupId $nsg.Id
$vmName = "myVM"
$vmConfig = New-AzureRmVMConfig -VMName $vmName -VMSize "Standard_A2"
Complete the VM
Create the VM by using New -AzureRMVM with the configurations that we just created.
Next steps
Sign in to your new virtual machine. For more information, see How to connect and log on to an Azure virtual
machine running Windows.
Deploy an Azure Virtual Machine using C# and a
Resource Manager template
10/19/2018 • 5 minutes to read • Edit Online
This article shows you how to deploy an Azure Resource Manager template using C#. The template that you create
deploys a single virtual machine running Windows Server in a new virtual network with a single subnet.
For a detailed description of the virtual machine resource, see Virtual machines in an Azure Resource Manager
template. For more information about all the resources in a template, see Azure Resource Manager template
walkthrough.
It takes about 10 minutes to do these steps.
Install-Package Microsoft.Azure.Management.Fluent
Install-Package WindowsAzure.Storage
{
"$schema": "https://schema.management.azure.com/schemas/2015-01-01/deploymentTemplate.json#",
"$schema": "https://schema.management.azure.com/schemas/2015-01-01/deploymentTemplate.json#",
"contentVersion": "1.0.0.0",
"parameters": {
"adminUsername": { "type": "string" },
"adminPassword": { "type": "securestring" }
},
"variables": {
"vnetID": "[resourceId('Microsoft.Network/virtualNetworks','myVNet')]",
"subnetRef": "[concat(variables('vnetID'),'/subnets/mySubnet')]",
},
"resources": [
{
"apiVersion": "2016-03-30",
"type": "Microsoft.Network/publicIPAddresses",
"name": "myPublicIPAddress",
"location": "[resourceGroup().location]",
"properties": {
"publicIPAllocationMethod": "Dynamic",
"dnsSettings": {
"domainNameLabel": "myresourcegroupdns1"
}
}
},
{
"apiVersion": "2016-03-30",
"type": "Microsoft.Network/virtualNetworks",
"name": "myVNet",
"location": "[resourceGroup().location]",
"properties": {
"addressSpace": { "addressPrefixes": [ "10.0.0.0/16" ] },
"subnets": [
{
"name": "mySubnet",
"properties": { "addressPrefix": "10.0.0.0/24" }
}
]
}
},
{
"apiVersion": "2016-03-30",
"type": "Microsoft.Network/networkInterfaces",
"name": "myNic",
"location": "[resourceGroup().location]",
"dependsOn": [
"[resourceId('Microsoft.Network/publicIPAddresses/', 'myPublicIPAddress')]",
"[resourceId('Microsoft.Network/virtualNetworks/', 'myVNet')]"
],
"properties": {
"ipConfigurations": [
{
"name": "ipconfig1",
"properties": {
"privateIPAllocationMethod": "Dynamic",
"publicIPAddress": { "id": "
[resourceId('Microsoft.Network/publicIPAddresses','myPublicIPAddress')]" },
"subnet": { "id": "[variables('subnetRef')]" }
}
}
]
}
},
{
"apiVersion": "2016-04-30-preview",
"type": "Microsoft.Compute/virtualMachines",
"name": "myVM",
"location": "[resourceGroup().location]",
"dependsOn": [
"[resourceId('Microsoft.Network/networkInterfaces/', 'myNic')]"
],
"properties": {
"properties": {
"hardwareProfile": { "vmSize": "Standard_DS1" },
"osProfile": {
"computerName": "myVM",
"adminUsername": "[parameters('adminUsername')]",
"adminPassword": "[parameters('adminPassword')]"
},
"storageProfile": {
"imageReference": {
"publisher": "MicrosoftWindowsServer",
"offer": "WindowsServer",
"sku": "2012-R2-Datacenter",
"version": "latest"
},
"osDisk": {
"name": "myManagedOSDisk",
"caching": "ReadWrite",
"createOption": "FromImage"
}
},
"networkProfile": {
"networkInterfaces": [
{
"id": "[resourceId('Microsoft.Network/networkInterfaces','myNic')]"
}
]
}
}
}
]
}
{
"$schema": "https://schema.management.azure.com/schemas/2015-01-01/deploymentTemplate.json",
"contentVersion": "1.0.0.0",
"parameters": {
"adminUserName": { "value": "azureuser" },
"adminPassword": { "value": "Azure12345678" }
}
}
Replace <subscription-id> with your subscription identifier, <application-id> with the Active Directory
application identifier, <authentication-key> with the application key, and <tenant-id> with the tenant
identifier.
3. Save the azureauth.properties file.
4. Set an environment variable in Windows named AZURE_AUTH_LOCATION with the full path to
authorization file that you created, for example the following PowerShell command can be used:
using Microsoft.Azure.Management.Compute.Fluent;
using Microsoft.Azure.Management.Compute.Fluent.Models;
using Microsoft.Azure.Management.Fluent;
using Microsoft.Azure.Management.ResourceManager.Fluent;
using Microsoft.Azure.Management.ResourceManager.Fluent.Core;
using Microsoft.WindowsAzure.Storage;
using Microsoft.WindowsAzure.Storage.Blob;
2. To create the management client, add this code to the Main method:
Console.WriteLine("Creating container...");
var container = serviceClient.GetContainerReference("templates");
container.CreateIfNotExistsAsync().Wait();
var containerPermissions = new BlobContainerPermissions()
{ PublicAccess = BlobContainerPublicAccessType.Container };
container.SetPermissionsAsync(containerPermissions).Wait();
azure.ResourceGroups.DeleteByName(groupName);
Next steps
If there were issues with the deployment, a next step would be to look at Troubleshoot common Azure
deployment errors with Azure Resource Manager.
Learn how to deploy a virtual machine and its supporting resources by reviewing Deploy an Azure Virtual
Machine Using C#.
Automating Azure virtual machine deployment with
Chef
10/1/2018 • 6 minutes to read • Edit Online
NOTE
Azure has two different deployment models for creating and working with resources: Resource Manager and classic. This
article covers using both models, but Microsoft recommends that most new deployments use the Resource Manager model.
Chef is a great tool for delivering automation and desired state configurations.
With the latest cloud API release, Chef provides seamless integration with Azure, giving you the ability to provision
and deploy configuration states through a single command.
In this article, you set up your Chef environment to provision Azure virtual machines and walk through creating a
policy or “CookBook” and then deploying this cookbook to an Azure virtual machine.
Let’s begin!
Chef basics
Before you begin, review the basic concepts of Chef.
The following diagram depicts the high-level Chef architecture.
Chef has three main architectural components: Chef Server, Chef Client (node), and Chef Workstation.
The Chef Server is the management point and there are two options for the Chef Server: a hosted solution or an
on-premises solution. We will be using a hosted solution for this tutorial.
The Chef Client (node) is the agent that sits on the servers you are managing.
The Chef Workstation is the admin workstation where we create policies and execute management commands. We
run the knife command from the Chef Workstation to manage the infrastructure.
There is also the concept of “Cookbooks” and “Recipes”. These are effectively the policies we define and apply to
the servers.
NOTE
If you receive a prompt warning you that your keys will be reset, it’s okay to proceed as we have no existing infrastructure
configured as yet.
This starter kit zip file contains your organization config files and keys.
You should now have four files including the Azure publishing file in the root of c:\chef.
The PEM files contain your organization and admin private keys for communication while the knife.rb file contains
your knife configuration. We will need to edit the knife.rb file.
Open the file in your editor of choice and modify the “cookbook_path” by removing the /../ from the path so it
appears as:
cookbook_path ["#{current_dir}/cookbooks"]
Also add the following line reflecting the name of your Azure publish settings file.
knife[:azure_publish_settings_file] = "yourfilename.publishsettings"
Your knife.rb file should now look similar to the following example.
These lines will ensure that Knife references the cookbooks directory under c:\chef\cookbooks, and also uses our
Azure Publish Settings file during Azure operations.
NOTE
The order of the path is important! If your opscode paths are not in the correct order you will have issues.
NOTE
The –pre argument ensures you are receiving the latest RC version of the Knife Azure Plugin which provides access to the
latest set of APIs.
It’s likely that a number of dependencies will also be installed at the same time.
To ensure everything is configured correctly, run the following command.
If everything is configured correctly, you will see a list of available Azure images scroll through.
Congratulations. The workstation is set up!
Creating a Cookbook
A Cookbook is used by Chef to define a set of commands that you wish to execute on your managed client.
Creating a Cookbook is straightforward and we use the chef generate cookbook command to generate the
Cookbook template. I will be calling my Cookbook web server as I would like a policy that automatically deploys
IIS.
Under your C:\Chef directory run the following command.
This will generate a set of files under the directory C:\Chef\cookbooks\webserver. We now need to define the set of
commands we would like the Chef client to execute on the managed virtual machine.
The commands are stored in the file default.rb. In this file, I’ll be defining a set of commands that installs IIS, starts
IIS and copies a template file to the wwwroot folder.
Modify the C:\chef\cookbooks\webserver\recipes\default.rb file and add the following lines.
service 'w3svc' do
action [ :enable, :start ]
end
template 'c:\inetpub\wwwroot\Default.htm' do
source 'Default.htm.erb'
rights :read, 'Everyone'
end
knife azure server create --azure-dns-name 'diegotest01' --azure-vm-name 'testserver01' --azure-vm-size 'Small'
--azure-storage-account 'portalvhdsxxxx' --bootstrap-protocol 'cloud-api' --azure-source-image
'a699494373c04fc0bc8f2bb1389d6106__Windows-Server-2012-Datacenter-201411.01-en.us-127GB.vhd' --azure-service-
location 'Southeast Asia' --winrm-user azureuser --winrm-password 'myPassword123' --tcp-endpoints 80,3389 --r
'recipe[webserver]'
The parameters are self-explanatory. Substitute your particular variables and run.
NOTE
Through the command line, I’m also automating my endpoint network filter rules by using the –tcp-endpoints parameter. I’ve
opened up ports 80 and 3389 to provide access to my web page and RDP session.
Once you run the command, go to the Azure portal and you will see your machine begin to provision.
An Azure Virtual Machine (VM ) needs several supporting Azure resources. This article covers creating, managing,
and deleting VM resources using Java. You learn how to:
Create a Maven project
Add dependencies
Create credentials
Create resources
Perform management tasks
Delete resources
Run the application
It takes about 20 minutes to do these steps.
mkdir java-azure-test
cd java-azure-test
Add dependencies
1. Under the testAzureApp folder, open the pom.xml file and add the build configuration to <project> to
enable the building of your application:
<build>
<plugins>
<plugin>
<groupId>org.codehaus.mojo</groupId>
<artifactId>exec-maven-plugin</artifactId>
<configuration>
<mainClass>com.fabrikam.testAzureApp.App</mainClass>
</configuration>
</plugin>
</plugins>
</build>
2. Add the dependencies that are needed to access the Azure Java SDK.
<dependency>
<groupId>com.microsoft.azure</groupId>
<artifactId>azure</artifactId>
<version>1.1.0</version>
</dependency>
<dependency>
<groupId>com.microsoft.azure</groupId>
<artifactId>azure-mgmt-compute</artifactId>
<version>1.1.0</version>
</dependency>
<dependency>
<groupId>com.microsoft.azure</groupId>
<artifactId>azure-mgmt-resources</artifactId>
<version>1.1.0</version>
</dependency>
<dependency>
<groupId>com.microsoft.azure</groupId>
<artifactId>azure-mgmt-network</artifactId>
<version>1.1.0</version>
</dependency>
<dependency>
<groupId>com.squareup.okio</groupId>
<artifactId>okio</artifactId>
<version>1.13.0</version>
</dependency>
<dependency>
<groupId>com.nimbusds</groupId>
<artifactId>nimbus-jose-jwt</artifactId>
<version>3.6</version>
</dependency>
<dependency>
<groupId>net.minidev</groupId>
<artifactId>json-smart</artifactId>
<version>1.0.6.3</version>
</dependency>
<dependency>
<groupId>javax.mail</groupId>
<artifactId>mail</artifactId>
<version>1.4.5</version>
</dependency>
Create credentials
Before you start this step, make sure that you have access to an Active Directory service principal. You should also
record the application ID, the authentication key, and the tenant ID that you need in a later step.
Create the authorization file
1. Create a file named azureauth.properties and add these properties to it:
subscription=<subscription-id>
client=<application-id>
key=<authentication-key>
tenant=<tenant-id>
managementURI=https://management.core.windows.net/
baseURL=https://management.azure.com/
authURL=https://login.windows.net/
graphURL=https://graph.windows.net/
Replace <subscription-id> with your subscription identifier, <application-id> with the Active Directory
application identifier, <authentication-key> with the application key, and <tenant-id> with the tenant
identifier.
2. Save the file.
3. Set an environment variable named AZURE_AUTH_LOCATION in your shell with the full path to the
authentication file.
Create the management client
1. Open the App.java file under src\main\java\com\fabrikam and make sure this package statement is at the
top:
package com.fabrikam.testAzureApp;
import com.microsoft.azure.management.Azure;
import com.microsoft.azure.management.compute.AvailabilitySet;
import com.microsoft.azure.management.compute.AvailabilitySetSkuTypes;
import com.microsoft.azure.management.compute.CachingTypes;
import com.microsoft.azure.management.compute.InstanceViewStatus;
import com.microsoft.azure.management.compute.DiskInstanceView;
import com.microsoft.azure.management.compute.VirtualMachine;
import com.microsoft.azure.management.compute.VirtualMachineSizeTypes;
import com.microsoft.azure.management.network.PublicIPAddress;
import com.microsoft.azure.management.network.Network;
import com.microsoft.azure.management.network.NetworkInterface;
import com.microsoft.azure.management.resources.ResourceGroup;
import com.microsoft.azure.management.resources.fluentcore.arm.Region;
import com.microsoft.azure.management.resources.fluentcore.model.Creatable;
import com.microsoft.rest.LogLevel;
import java.io.File;
import java.util.Scanner;
3. To create the Active Directory credentials that you need to make requests, add this code to the main method
of the App class:
try {
final File credFile = new File(System.getenv("AZURE_AUTH_LOCATION"));
Azure azure = Azure.configure()
.withLogLevel(LogLevel.BASIC)
.authenticate(credFile)
.withDefaultSubscription();
} catch (Exception e) {
System.out.println(e.getMessage());
e.printStackTrace();
}
Create resources
Create the resource group
All resources must be contained in a Resource group.
To specify values for the application and create the resource group, add this code to the try block in the main
method:
System.out.println("Creating resource group...");
ResourceGroup resourceGroup = azure.resourceGroups()
.define("myResourceGroup")
.withRegion(Region.US_EAST)
.create();
NOTE
This tutorial creates a virtual machine running a version of the Windows Server operating system. To learn more about
selecting other images, see Navigate and select Azure virtual machine images with Windows PowerShell and the Azure CLI.
If you want to use an existing disk instead of a marketplace image, use this code:
azure.virtualMachines.define("myVM")
.withRegion(Region.US_EAST)
.withExistingResourceGroup("myResourceGroup")
.withExistingPrimaryNetworkInterface(networkInterface)
.withSpecializedOSDisk(managedDisk, OperatingSystemTypes.Windows)
.withExistingAvailabilitySet(availabilitySet)
.withSize(VirtualMachineSizeTypes.StandardDS1)
.create();
System.out.println("hardwareProfile");
System.out.println(" vmSize: " + vm.size());
System.out.println("storageProfile");
System.out.println(" imageReference");
System.out.println(" publisher: " + vm.storageProfile().imageReference().publisher());
System.out.println(" offer: " + vm.storageProfile().imageReference().offer());
System.out.println(" sku: " + vm.storageProfile().imageReference().sku());
System.out.println(" version: " + vm.storageProfile().imageReference().version());
System.out.println(" osDisk");
System.out.println(" osType: " + vm.storageProfile().osDisk().osType());
System.out.println(" name: " + vm.storageProfile().osDisk().name());
System.out.println(" createOption: " + vm.storageProfile().osDisk().createOption());
System.out.println(" caching: " + vm.storageProfile().osDisk().caching());
System.out.println("osProfile");
System.out.println(" computerName: " + vm.osProfile().computerName());
System.out.println(" adminUserName: " + vm.osProfile().adminUsername());
System.out.println(" provisionVMAgent: " + vm.osProfile().windowsConfiguration().provisionVMAgent());
System.out.println(" enableAutomaticUpdates: " +
vm.osProfile().windowsConfiguration().enableAutomaticUpdates());
System.out.println("networkProfile");
System.out.println(" networkInterface: " + vm.primaryNetworkInterfaceId());
System.out.println("vmAgent");
System.out.println(" vmAgentVersion: " + vm.instanceView().vmAgent().vmAgentVersion());
System.out.println(" statuses");
for(InstanceViewStatus status : vm.instanceView().vmAgent().statuses()) {
System.out.println(" code: " + status.code());
System.out.println(" displayStatus: " + status.displayStatus());
System.out.println(" message: " + status.message());
System.out.println(" time: " + status.time());
}
System.out.println("disks");
for(DiskInstanceView disk : vm.instanceView().disks()) {
System.out.println(" name: " + disk.name());
System.out.println(" statuses");
for(InstanceViewStatus status : disk.statuses()) {
System.out.println(" code: " + status.code());
System.out.println(" displayStatus: " + status.displayStatus());
System.out.println(" time: " + status.time());
}
}
System.out.println("VM general status");
System.out.println(" provisioningStatus: " + vm.provisioningState());
System.out.println(" id: " + vm.id());
System.out.println(" name: " + vm.name());
System.out.println(" type: " + vm.type());
System.out.println("VM instance status");
for(InstanceViewStatus status : vm.instanceView().statuses()) {
System.out.println(" code: " + status.code());
System.out.println(" displayStatus: " + status.displayStatus());
}
System.out.println("Press enter to continue...");
input.nextLine();
Stop the VM
You can stop a virtual machine and keep all its settings, but continue to be charged for it, or you can stop a virtual
machine and deallocate it. When a virtual machine is deallocated, all resources associated with it are also
deallocated and billing ends for it.
To stop the virtual machine without deallocating it, add this code to the try block in the main method:
System.out.println("Stopping vm...");
vm.powerOff();
System.out.println("Press enter to continue...");
input.nextLine();
If you want to deallocate the virtual machine, change the PowerOff call to this code:
vm.deallocate();
Start the VM
To start the virtual machine, add this code to the try block in the main method:
System.out.println("Starting vm...");
vm.start();
System.out.println("Press enter to continue...");
input.nextLine();
Resize the VM
Many aspects of deployment should be considered when deciding on a size for your virtual machine. For more
information, see VM sizes.
To change size of the virtual machine, add this code to the try block in the main method:
System.out.println("Resizing vm...");
vm.update()
.withSize(VirtualMachineSizeTypes.STANDARD_DS2)
.apply();
System.out.println("Press enter to continue...");
input.nextLine();
Delete resources
Because you are charged for resources used in Azure, it is always good practice to delete resources that are no
longer needed. If you want to delete the virtual machines and all the supporting resources, all you have to do is
delete the resource group.
1. To delete the resource group, add this code to the try block in the main method:
System.out.println("Deleting resources...");
azure.resourceGroups().deleteByName("myResourceGroup");
2. Before you press Enter to start deleting resources, you could take a few minutes to verify the creation of the
resources in the Azure portal. Click the deployment status to see information about the deployment.
Next steps
Learn more about using the Azure libraries for Java.
Create and manage Windows VMs in Azure using
Python
10/19/2018 • 10 minutes to read • Edit Online
An Azure Virtual Machine (VM ) needs several supporting Azure resources. This article covers creating, managing,
and deleting VM resources using Python. You learn how to:
Create a Visual Studio project
Install packages
Create credentials
Create resources
Perform management tasks
Delete resources
Run the application
It takes about 20 minutes to do these steps.
Install packages
1. In Solution Explorer, under myPythonProject, right-click Python Environments, and then select Add virtual
environment.
2. On the Add Virtual Environment screen, accept the default name of env, make sure that Python 3.6 (64 -bit) is
selected for the base interpreter, and then click Create.
3. Right-click the env environment that you created, click Install Python Package, enter azure in the search box,
and then press Enter.
You should see in the output windows that the azure packages were successfully installed.
Create credentials
Before you start this step, make sure that you have an Active Directory service principal. You should also record the
application ID, the authentication key, and the tenant ID that you need in a later step.
1. Open myPythonProject.py file that was created, and then add this code to enable your application to run:
if __name__ == "__main__":
2. To import the code that is needed, add these statements to the top of the .py file:
from azure.common.credentials import ServicePrincipalCredentials
from azure.mgmt.resource import ResourceManagementClient
from azure.mgmt.compute import ComputeManagementClient
from azure.mgmt.network import NetworkManagementClient
from azure.mgmt.compute.models import DiskCreateOption
3. Next in the .py file, add variables after the import statements to specify common values used in the code:
SUBSCRIPTION_ID = 'subscription-id'
GROUP_NAME = 'myResourceGroup'
LOCATION = 'westus'
VM_NAME = 'myVM'
def get_credentials():
credentials = ServicePrincipalCredentials(
client_id = 'application-id',
secret = 'authentication-key',
tenant = 'tenant-id'
)
return credentials
Replace application-id, authentication-key, and tenant-id with the values that you previously collected
when you created your Azure Active Directory service principal.
5. To call the function that you previously added, add this code under the if statement at the end of the .py file:
credentials = get_credentials()
Create resources
Initialize management clients
Management clients are needed to create and manage resources using the Python SDK in Azure. To create the
management clients, add this code under the if statement at then end of the .py file:
resource_group_client = ResourceManagementClient(
credentials,
SUBSCRIPTION_ID
)
network_client = NetworkManagementClient(
credentials,
SUBSCRIPTION_ID
)
compute_client = ComputeManagementClient(
credentials,
SUBSCRIPTION_ID
)
def create_resource_group(resource_group_client):
resource_group_params = { 'location':LOCATION }
resource_group_result = resource_group_client.resource_groups.create_or_update(
GROUP_NAME,
resource_group_params
)
2. To call the function that you previously added, add this code under the if statement at the end of the .py file:
create_resource_group(resource_group_client)
input('Resource group created. Press enter to continue...')
Availability sets make it easier for you to maintain the virtual machines used by your application.
1. To create an availability set, add this function after the variables in the .py file:
def create_availability_set(compute_client):
avset_params = {
'location': LOCATION,
'sku': { 'name': 'Aligned' },
'platform_fault_domain_count': 3
}
availability_set_result = compute_client.availability_sets.create_or_update(
GROUP_NAME,
'myAVSet',
avset_params
)
2. To call the function that you previously added, add this code under the if statement at the end of the .py file:
create_availability_set(compute_client)
print("------------------------------------------------------")
input('Availability set created. Press enter to continue...')
def create_public_ip_address(network_client):
public_ip_addess_params = {
'location': LOCATION,
'public_ip_allocation_method': 'Dynamic'
}
creation_result = network_client.public_ip_addresses.create_or_update(
GROUP_NAME,
'myIPAddress',
public_ip_addess_params
)
return creation_result.result()
2. To call the function that you previously added, add this code under the if statement at the end of the .py file:
creation_result = create_public_ip_address(network_client)
print("------------------------------------------------------")
print(creation_result)
input('Press enter to continue...')
def create_vnet(network_client):
vnet_params = {
'location': LOCATION,
'address_space': {
'address_prefixes': ['10.0.0.0/16']
}
}
creation_result = network_client.virtual_networks.create_or_update(
GROUP_NAME,
'myVNet',
vnet_params
)
return creation_result.result()
2. To call the function that you previously added, add this code under the if statement at the end of the .py file:
creation_result = create_vnet(network_client)
print("------------------------------------------------------")
print(creation_result)
input('Press enter to continue...')
3. To add a subnet to the virtual network, add this function after the variables in the .py file:
def create_subnet(network_client):
subnet_params = {
'address_prefix': '10.0.0.0/24'
}
creation_result = network_client.subnets.create_or_update(
GROUP_NAME,
'myVNet',
'mySubnet',
subnet_params
)
return creation_result.result()
4. To call the function that you previously added, add this code under the if statement at the end of the .py file:
creation_result = create_subnet(network_client)
print("------------------------------------------------------")
print(creation_result)
input('Press enter to continue...')
return creation_result.result()
2. To call the function that you previously added, add this code under the if statement at the end of the .py file:
creation_result = create_nic(network_client)
print("------------------------------------------------------")
print(creation_result)
input('Press enter to continue...')
Now that you created all the supporting resources, you can create a virtual machine.
1. To create the virtual machine, add this function after the variables in the .py file:
def create_vm(network_client, compute_client):
nic = network_client.network_interfaces.get(
GROUP_NAME,
'myNic'
)
avset = compute_client.availability_sets.get(
GROUP_NAME,
'myAVSet'
)
vm_parameters = {
'location': LOCATION,
'os_profile': {
'computer_name': VM_NAME,
'admin_username': 'azureuser',
'admin_password': 'Azure12345678'
},
'hardware_profile': {
'vm_size': 'Standard_DS1'
},
'storage_profile': {
'image_reference': {
'publisher': 'MicrosoftWindowsServer',
'offer': 'WindowsServer',
'sku': '2012-R2-Datacenter',
'version': 'latest'
}
},
'network_profile': {
'network_interfaces': [{
'id': nic.id
}]
},
'availability_set': {
'id': avset.id
}
}
creation_result = compute_client.virtual_machines.create_or_update(
GROUP_NAME,
VM_NAME,
vm_parameters
)
return creation_result.result()
NOTE
This tutorial creates a virtual machine running a version of the Windows Server operating system. To learn more
about selecting other images, see Navigate and select Azure virtual machine images with Windows PowerShell and
the Azure CLI.
2. To call the function that you previously added, add this code under the if statement at the end of the .py file:
def get_vm(compute_client):
vm = compute_client.virtual_machines.get(GROUP_NAME, VM_NAME, expand='instanceView')
print("hardwareProfile")
print(" vmSize: ", vm.hardware_profile.vm_size)
print("\nstorageProfile")
print(" imageReference")
print(" publisher: ", vm.storage_profile.image_reference.publisher)
print(" offer: ", vm.storage_profile.image_reference.offer)
print(" sku: ", vm.storage_profile.image_reference.sku)
print(" version: ", vm.storage_profile.image_reference.version)
print(" osDisk")
print(" osType: ", vm.storage_profile.os_disk.os_type.value)
print(" name: ", vm.storage_profile.os_disk.name)
print(" createOption: ", vm.storage_profile.os_disk.create_option.value)
print(" caching: ", vm.storage_profile.os_disk.caching.value)
print("\nosProfile")
print(" computerName: ", vm.os_profile.computer_name)
print(" adminUsername: ", vm.os_profile.admin_username)
print(" provisionVMAgent: {0}".format(vm.os_profile.windows_configuration.provision_vm_agent))
print(" enableAutomaticUpdates:
{0}".format(vm.os_profile.windows_configuration.enable_automatic_updates))
print("\nnetworkProfile")
for nic in vm.network_profile.network_interfaces:
print(" networkInterface id: ", nic.id)
print("\nvmAgent")
print(" vmAgentVersion", vm.instance_view.vm_agent.vm_agent_version)
print(" statuses")
for stat in vm_result.instance_view.vm_agent.statuses:
print(" code: ", stat.code)
print(" displayStatus: ", stat.display_status)
print(" message: ", stat.message)
print(" time: ", stat.time)
print("\ndisks");
for disk in vm.instance_view.disks:
print(" name: ", disk.name)
print(" statuses")
for stat in disk.statuses:
print(" code: ", stat.code)
print(" displayStatus: ", stat.display_status)
print(" time: ", stat.time)
print("\nVM general status")
print(" provisioningStatus: ", vm.provisioning_state)
print(" id: ", vm.id)
print(" name: ", vm.name)
print(" type: ", vm.type)
print(" location: ", vm.location)
print("\nVM instance status")
for stat in vm.instance_view.statuses:
print(" code: ", stat.code)
print(" displayStatus: ", stat.display_status)
2. To call the function that you previously added, add this code under the if statement at the end of the .py file:
get_vm(compute_client)
print("------------------------------------------------------")
input('Press enter to continue...')
Stop the VM
You can stop a virtual machine and keep all its settings, but continue to be charged for it, or you can stop a virtual
machine and deallocate it. When a virtual machine is deallocated, all resources associated with it are also
deallocated and billing ends for it.
1. To stop the virtual machine without deallocating it, add this function after the variables in the .py file:
def stop_vm(compute_client):
compute_client.virtual_machines.power_off(GROUP_NAME, VM_NAME)
If you want to deallocate the virtual machine, change the power_off call to this code:
compute_client.virtual_machines.deallocate(GROUP_NAME, VM_NAME)
2. To call the function that you previously added, add this code under the if statement at the end of the .py file:
stop_vm(compute_client)
input('Press enter to continue...')
Start the VM
1. To start the virtual machine, add this function after the variables in the .py file:
def start_vm(compute_client):
compute_client.virtual_machines.start(GROUP_NAME, VM_NAME)
2. To call the function that you previously added, add this code under the if statement at the end of the .py file:
start_vm(compute_client)
input('Press enter to continue...')
Resize the VM
Many aspects of deployment should be considered when deciding on a size for your virtual machine. For more
information, see VM sizes.
1. To change the size of the virtual machine, add this function after the variables in the .py file:
def update_vm(compute_client):
vm = compute_client.virtual_machines.get(GROUP_NAME, VM_NAME)
vm.hardware_profile.vm_size = 'Standard_DS3'
update_result = compute_client.virtual_machines.create_or_update(
GROUP_NAME,
VM_NAME,
vm
)
return update_result.result()
2. To call the function that you previously added, add this code under the if statement at the end of the .py file:
update_result = update_vm(compute_client)
print("------------------------------------------------------")
print(update_result)
input('Press enter to continue...')
def add_datadisk(compute_client):
disk_creation = compute_client.disks.create_or_update(
GROUP_NAME,
'myDataDisk1',
{
'location': LOCATION,
'disk_size_gb': 1,
'creation_data': {
'create_option': DiskCreateOption.empty
}
}
)
data_disk = disk_creation.result()
vm = compute_client.virtual_machines.get(GROUP_NAME, VM_NAME)
add_result = vm.storage_profile.data_disks.append({
'lun': 1,
'name': 'myDataDisk1',
'create_option': DiskCreateOption.attach,
'managed_disk': {
'id': data_disk.id
}
})
add_result = compute_client.virtual_machines.create_or_update(
GROUP_NAME,
VM_NAME,
vm)
return add_result.result()
2. To call the function that you previously added, add this code under the if statement at the end of the .py file:
add_result = add_datadisk(compute_client)
print("------------------------------------------------------")
print(add_result)
input('Press enter to continue...')
Delete resources
Because you are charged for resources used in Azure, it's always a good practice to delete resources that are no
longer needed. If you want to delete the virtual machines and all the supporting resources, all you have to do is
delete the resource group.
1. To delete the resource group and all resources, add this function after the variables in the .py file:
def delete_resources(resource_group_client):
resource_group_client.resource_groups.delete(GROUP_NAME)
2. To call the function that you previously added, add this code under the if statement at the end of the .py file:
delete_resources(resource_group_client)
3. Save myPythonProject.py.
Next steps
If there were issues with the deployment, a next step would be to look at Troubleshooting resource group
deployments with Azure portal
Learn more about the Azure Python Library
Create a Windows virtual machine from a Resource
Manager template
9/28/2018 • 3 minutes to read • Edit Online
This article shows you how to deploy an Azure Resource Manager template using PowerShell. The template that
you create deploys a single virtual machine running Windows Server in a new virtual network with a single subnet.
For a detailed description of the virtual machine resource, see Virtual machines in an Azure Resource Manager
template. For more information about all the resources in a template, see Azure Resource Manager template
walkthrough.
It should take about five minutes to do the steps in this article.
Click the Cloud Shell button on the menu in the upper right
of the Azure portal.
If you choose to install and use the PowerShell locally, this tutorial requires the Azure PowerShell module version
5.3 or later. Run Get-Module -ListAvailable AzureRM to find the version. If you need to upgrade, see Install Azure
PowerShell module. If you are running PowerShell locally, you also need to run Connect-AzureRmAccount to create a
connection with Azure.
2. Create the resource group in the location that you select. This example shows the creation of a resource
group named myResourceGroup in the West US location:
{
"$schema": "https://schema.management.azure.com/schemas/2015-01-01/deploymentTemplate.json#",
"contentVersion": "1.0.0.0",
"parameters": {
"adminUsername": { "type": "string" },
"adminPassword": { "type": "securestring" }
},
"variables": {
"vnetID": "[resourceId('Microsoft.Network/virtualNetworks','myVNet')]",
"subnetRef": "[concat(variables('vnetID'),'/subnets/mySubnet')]"
},
"resources": [
{
"apiVersion": "2016-03-30",
"type": "Microsoft.Network/publicIPAddresses",
"name": "myPublicIPAddress",
"location": "[resourceGroup().location]",
"properties": {
"publicIPAllocationMethod": "Dynamic",
"dnsSettings": {
"domainNameLabel": "myresourcegroupdns1"
}
}
},
{
"apiVersion": "2016-03-30",
"type": "Microsoft.Network/virtualNetworks",
"name": "myVNet",
"location": "[resourceGroup().location]",
"properties": {
"addressSpace": { "addressPrefixes": [ "10.0.0.0/16" ] },
"subnets": [
{
"name": "mySubnet",
"properties": { "addressPrefix": "10.0.0.0/24" }
}
]
}
},
{
"apiVersion": "2016-03-30",
"type": "Microsoft.Network/networkInterfaces",
"name": "myNic",
"location": "[resourceGroup().location]",
"dependsOn": [
"[resourceId('Microsoft.Network/publicIPAddresses/', 'myPublicIPAddress')]",
"[resourceId('Microsoft.Network/virtualNetworks/', 'myVNet')]"
],
"properties": {
"ipConfigurations": [
{
"name": "ipconfig1",
"properties": {
"privateIPAllocationMethod": "Dynamic",
"publicIPAddress": { "id": "
[resourceId('Microsoft.Network/publicIPAddresses','myPublicIPAddress')]" },
"subnet": { "id": "[variables('subnetRef')]" }
}
}
}
]
}
},
{
"apiVersion": "2016-04-30-preview",
"type": "Microsoft.Compute/virtualMachines",
"name": "myVM",
"location": "[resourceGroup().location]",
"dependsOn": [
"[resourceId('Microsoft.Network/networkInterfaces/', 'myNic')]"
],
"properties": {
"hardwareProfile": { "vmSize": "Standard_DS1" },
"osProfile": {
"computerName": "myVM",
"adminUsername": "[parameters('adminUsername')]",
"adminPassword": "[parameters('adminPassword')]"
},
"storageProfile": {
"imageReference": {
"publisher": "MicrosoftWindowsServer",
"offer": "WindowsServer",
"sku": "2012-R2-Datacenter",
"version": "latest"
},
"osDisk": {
"name": "myManagedOSDisk",
"caching": "ReadWrite",
"createOption": "FromImage"
}
},
"networkProfile": {
"networkInterfaces": [
{
"id": "[resourceId('Microsoft.Network/networkInterfaces','myNic')]"
}
]
}
}
}
]
}
2. Create a file named Parameters.json and add this JSON code to it:
{
"$schema": "https://schema.management.azure.com/schemas/2015-01-01/deploymentParameters.json#",
"contentVersion": "1.0.0.0",
"parameters": {
"adminUserName": { "value": "azureuser" },
"adminPassword": { "value": "Azure12345678" }
}
}
Change the -File paths to the location where you stored the files.
NOTE
You can also deploy templates and parameters from local files. To learn more, see Using Azure PowerShell with Azure Storage.
Next Steps
If there were issues with the deployment, you might take a look at Troubleshoot common Azure deployment
errors with Azure Resource Manager.
Learn how to create and manage a virtual machine in Create and manage Windows VMs with the Azure
PowerShell module.
How to connect and log on to an Azure virtual
machine running Windows
9/27/2018 • 2 minutes to read • Edit Online
You'll use the Connect button in the Azure portal to start a Remote Desktop (RDP ) session from a Windows
desktop. First you connect to the virtual machine, and then you log on.
To connect to a Windows VM from a Mac, you will need to install an RDP client for Mac such as Microsoft
Remote Desktop.
8. In the Windows Security window, select More choices and then Use a different account. Enter the
credentials for an account on the virtual machine and then select OK.
Local account: This is usually the local account user name and password that you specified when you
created the virtual machine. In this case, the domain is the name of the virtual machine and it is entered as
vmname\username.
Domain joined VM: If the VM belongs to a domain, enter the user name in the format
Domain\Username. The account also needs to either be in the Administrators group or have been granted
remote access privileges to the VM.
Domain controller: If the VM is a domain controller, enter the user name and password of a domain
administrator account for that domain.
9. Select Yes to verify the identity of the virtual machine and finish logging on.
TIP
If the Connect button in the portal is grayed-out and you are not connected to Azure via an Express Route or Site-to-Site
VPN connection, you will need to create and assign your VM a public IP address before you can use RDP. For more
information, see Public IP addresses in Azure.
Next steps
If you have difficulty connecting, see Troubleshoot Remote Desktop connections.
Azure Hybrid Benefit for Windows Server
9/28/2018 • 5 minutes to read • Edit Online
For customers with Software Assurance, Azure Hybrid Benefit for Windows Server allows you to use your on-
premises Windows Server licenses and run Windows virtual machines on Azure at a reduced cost. You can use
Azure Hybrid Benefit for Windows Server to deploy new virtual machines with Windows OS. This article goes
over the steps on how to deploy new VMs with Azure Hybrid Benefit for Windows Server and how you can update
existing running VMs. For more information about Azure Hybrid Benefit for Windows Server licensing and cost
savings, see the Azure Hybrid Benefit for Windows Server licensing page.
IMPORTANT
Each 2-processor license or each set of 16-core licenses are entitled to two instances of up to 8 cores, or one instance of up
to 16 cores. The Azure Hybrid Benefit for Standard Edition licenses can only be used once either on-premises or in Azure.
Datacenter Edition benefits allow for simultaneous usage both on-premises and in Azure.
IMPORTANT
Using Azure Hybrid Benefit for Windows Server with any VMs running Windows Server OS are now supported in all regions,
including VMs with additional software such as SQL Server or third-party marketplace software.
NOTE
For classic VMs, only deploying new VM from on-prem custom images is supported. To take advantage of the capabilities
supported in this article, you must first migrate classic VMs to Resource Manager model.
CLI
az vm create \
--resource-group myResourceGroup \
--name myVM \
--location eastus \
--license-type Windows_Server
Template
Within your Resource Manager templates, an additional parameter licenseType must be specified. You can read
more about authoring Azure Resource Manager templates
"properties": {
"licenseType": "Windows_Server",
"hardwareProfile": {
"vmSize": "[variables('vmSize')]"
}
NOTE
Changing the license type on the VM does not cause the system to reboot or cause a service interuption. It is simply an
update to a metadata flag.
Portal
From portal VM blade, you can update the VM to use Azure Hybrid Benefit by selecting "Configuration" option
and toggle the "Azure hybrid benefit" option
Powershell
Convert existing Windows Server VMs to Azure Hybrid Benefit for Windows Server
CLI
Convert existing Windows Server VMs to Azure Hybrid Benefit for Windows Server
Output:
Type : Microsoft.Compute/virtualMachines
Location : westus
LicenseType : Windows_Server
This output contrasts with the following VM deployed without Azure Hybrid Benefit for Windows Server licensing:
Type : Microsoft.Compute/virtualMachines
Location : westus
LicenseType :
CLI
NOTE
Changing the license type on the VM does not cause the system to reboot or cause a service interuption. It is a metadata
licensing flag only.
List all VMs with Azure Hybrid Benefit for Windows Server in a
subscription
To see and count all virtual machines deployed with Azure Hybrid Benefit for Windows Server, you can run the
following command from your subscription:
Portal
From the Virtual Machine or Virtual machine scale sets resource blade, you can view a list of all your VM (s) and
licensing type by configuring the table column to include "Azure Hybrid Benefit". The VM setting can either be in
"Enabled", "Not enabled" or "Not supported" state.
Powershell
$vms = Get-AzureRMVM
$vms | ?{$_.LicenseType -like "Windows_Server"} | select ResourceGroupName, Name, LicenseType
CLI
Deploy a Virtual Machine Scale Set with Azure Hybrid Benefit for
Windows Server
Within your virtual machine scale set Resource Manager templates, an additional parameter licenseType must be
specified within your VirtualMachineProfile property. You can do this during create or update for your scale set
through ARM template, Powershell, Azure CLI or REST.
The following example uses ARM template with a Windows Server 2016 Datacenter image:
"virtualMachineProfile": {
"storageProfile": {
"osDisk": {
"createOption": "FromImage"
},
"imageReference": {
"publisher": "MicrosoftWindowsServer",
"offer": "WindowsServer",
"sku": "2016-Datacenter",
"version": "latest"
}
},
"licenseType": "Windows_Server",
"osProfile": {
"computerNamePrefix": "[parameters('vmssName')]",
"adminUsername": "[parameters('adminUsername')]",
"adminPassword": "[parameters('adminPassword')]"
}
You can also learn more about how to Modify a virtual machine scale set for more ways to update your scale set.
Next steps
Read more about How to save money with the Azure Hybrid Benefit
Read more about Frequently asked questions for Azure Hybrid Benefit
Learn more about Azure Hybrid Benefit for Windows Server licensing detailed guidance
Learn more about Azure Hybrid Benefit for Windows Server and Azure Site Recovery make migrating
applications to Azure even more cost-effective
Learn more about Windows 10 on Azure with Multitenant Hosting Right
Learn more about Using Resource Manager templates
How to deploy Windows 10 on Azure with
Multitenant Hosting Rights
4/9/2018 • 3 minutes to read • Edit Online
For customers with Windows 10 Enterprise E3/E5 per user or Windows Virtual Desktop Access per user (User
Subscription Licenses or Add-on User Subscription Licenses), Multitenant Hosting Rights for Windows 10 allows
you to bring your Windows 10 Licenses to the cloud and run Windows 10 Virtual Machines on Azure without
paying for another license. For more information, please see Multitenant Hosting for Windows 10.
NOTE
This article shows you to implement the licensing benefit for Windows 10 Pro Desktop images on Azure Marketplace.
For Windows 7, 8.1, 10 Enterprise (x64) images on Azure Marketplace for MSDN Subscriptions, please refer to Windows
client in Azure for dev/test scenarios
For Windows Server licensing benefits, please refer to Azure Hybrid use benefits for Windows Server images.
The following powershell snippet is to mark all administrator accounts as active, including the built-in
administrator. This example is useful if the built-in administrator username is unknown.
$adminAccount = Get-WmiObject Win32_UserAccount -filter "LocalAccount=True" | ? {$_.SID -Like "S-1-5-21-*-500"}
if($adminAccount.Disabled)
{
$adminAccount.Disabled = $false
$adminAccount.Put()
}
Deploy using Azure Resource Manager Template Deployment Within your Resource Manager templates, an
additional parameter for licenseType can be specified. You can read more about authoring Azure Resource
Manager templates. Once you have your VHD uploaded to Azure, edit you Resource Manager template to include
the license type as part of the compute provider and deploy your template as normal:
"properties": {
"licenseType": "Windows_Client",
"hardwareProfile": {
"vmSize": "[variables('vmSize')]"
}
Deploy via PowerShell When deploying your Windows Server VM via PowerShell, you have an additional
parameter for -LicenseType . Once you have your VHD uploaded to Azure, you create a VM using New-AzureRmVM
and specify the licensing type as follows:
New-AzureRmVM -ResourceGroupName "myResourceGroup" -Location "West US" -VM $vm -LicenseType "Windows_Client"
The output is similar to the following example for Windows 10 with correct license type:
Type : Microsoft.Compute/virtualMachines
Location : westus
LicenseType : Windows_Client
This output contrasts with the following VM deployed without Azure Hybrid Use Benefit licensing, such as a VM
deployed straight from the Azure Gallery:
Type : Microsoft.Compute/virtualMachines
Location : westus
LicenseType :
Next Steps
Learn more about Configuring VDA for Windows 10
Learn more about Multitenant Hosting for Windows 10
How to encrypt virtual disks on a Windows VM
9/24/2018 • 6 minutes to read • Edit Online
For enhanced virtual machine (VM ) security and compliance, virtual disks in Azure can be encrypted. Disks are
encrypted using cryptographic keys that are secured in an Azure Key Vault. You control these cryptographic keys
and can audit their use. This article details how to encrypt virtual disks on a Windows VM using Azure PowerShell.
You can also encrypt a Linux VM using the Azure CLI.
Encryption process
Disk encryption relies on the following additional components:
Azure Key Vault - used to safeguard cryptographic keys and secrets used for the disk encryption/decryption
process.
If one exists, you can use an existing Azure Key Vault. You do not have to dedicate a Key Vault to
encrypting disks.
To separate administrative boundaries and key visibility, you can create a dedicated Key Vault.
Azure Active Directory - handles the secure exchanging of required cryptographic keys and authentication for
requested actions.
You can typically use an existing Azure Active Directory instance for housing your application.
The service principal provides a secure mechanism to request and be issued the appropriate
cryptographic keys. You are not developing an actual application that integrates with Azure Active
Directory.
$rgName = "myResourceGroup"
$location = "East US"
The Azure Key Vault containing the cryptographic keys and associated compute resources such as storage and the
VM itself must reside in the same region. Create an Azure Key Vault with New -AzureRmKeyVault and enable the
Key Vault for use with disk encryption. Specify a unique Key Vault name for keyVaultName as follows:
$keyVaultName = "myUniqueKeyVaultName"
New-AzureRmKeyVault -Location $location `
-ResourceGroupName $rgName `
-VaultName $keyVaultName `
-EnabledForDiskEncryption
You can store cryptographic keys using software or Hardware Security Model (HSM ) protection. Using an HSM
requires a premium Key Vault. There is an additional cost to creating a premium Key Vault rather than standard Key
Vault that stores software-protected keys. To create a premium Key Vault, in the preceding step add the -Sku
"Premium" parameters. The following example uses software-protected keys since we created a standard Key Vault.
For both protection models, the Azure platform needs to be granted access to request the cryptographic keys when
the VM boots to decrypt the virtual disks. Create a cryptographic key in your Key Vault with Add-
AzureKeyVaultKey. The following example creates a key named myKey:
Add-AzureKeyVaultKey -VaultName $keyVaultName `
-Name "myKey" `
-Destination "Software"
To successfully encrypt or decrypt virtual disks, permissions on the cryptographic key stored in Key Vault must be
set to permit the Azure Active Directory service principal to read the keys. Set permissions on your Key Vault with
Set-AzureRmKeyVaultAccessPolicy:
$cred = Get-Credential
New-AzureRmVm `
-ResourceGroupName $rgName `
-Name "myVM" `
-Location $location `
-VirtualNetworkName "myVnet" `
-SubnetName "mySubnet" `
-SecurityGroupName "myNetworkSecurityGroup" `
-PublicIpAddressName "myPublicIpAddress" `
-Credential $cred
Accept the prompt to continue with the VM encryption. The VM restarts during the process. Once the encryption
process completes and the VM has rebooted, review the encryption status with Get-
AzureRmVmDiskEncryptionStatus:
OsVolumeEncrypted : Encrypted
DataVolumesEncrypted : Encrypted
OsVolumeEncryptionSettings : Microsoft.Azure.Management.Compute.Models.DiskEncryptionSettings
ProgressMessage : OsVolume: Encrypted, DataVolumes: Encrypted
Next steps
For more information about managing Azure Key Vault, see Set up Key Vault for virtual machines.
For more information about disk encryption, such as preparing an encrypted custom VM to upload to Azure,
see Azure Disk Encryption.
Setting up WinRM access for Virtual Machines in
Azure Resource Manager
4/9/2018 • 3 minutes to read • Edit Online
For an overview of the Azure Resource Manager, please see this article
For differences between Azure Service Management and Azure Resource Manager, please see this article
The key difference in setting up WinRM configuration between the two stacks is how the certificate gets installed
on the VM. In the Azure Resource Manager stack, the certificates are modeled as resources managed by the Key
Vault Resource Provider. Therefore, the user needs to provide their own certificate and upload it to a Key Vault
before using it in a VM.
Here are the steps you need to take to set up a VM with WinRM connectivity
1. Create a Key Vault
2. Create a self-signed certificate
3. Upload your self-signed certificate to Key Vault
4. Get the URL for your self-signed certificate in the Key Vault
5. Reference your self-signed certificates URL while creating a VM
$certificateName = "somename"
$jsonObject = @"
{
"data": "$filecontentencoded",
"dataType" :"pfx",
"password": "<password>"
}
"@
$jsonObjectBytes = [System.Text.Encoding]::UTF8.GetBytes($jsonObject)
$jsonEncoded = [System.Convert]::ToBase64String($jsonObjectBytes)
Step 4: Get the URL for your self-signed certificate in the Key Vault
The Microsoft.Compute resource provider needs a URL to the secret inside the Key Vault while provisioning the
VM. This enables the Microsoft.Compute resource provider to download the secret and create the equivalent
certificate on the VM.
NOTE
The URL of the secret needs to include the version as well. An example URL looks like below
https://contosovault.vault.azure.net:443/secrets/contososecret/01h9db0df2cd4300a20ence585a6s7ve
Templates
You can get the link to the URL in the template using the below code
PowerShell
You can get this URL using the below PowerShell command
Enable-PSRemoting -Force
NOTE
You might need to make sure the WinRM service is running if the above does not work. You can do that using
Get-Service WinRM
Once the setup is done, you can connect to the VM using the below command
Access management for cloud resources is a critical function for any organization that is using the cloud. Role-
based access control (RBAC ) helps you manage who has access to Azure resources, what they can do with those
resources, and what areas they have access to.
RBAC is an authorization system built on Azure Resource Manager that provides fine-grained access management
of resources in Azure.
Azure includes several built-in roles that you can use. The following lists four fundamental built-in roles. The first
three apply to all resource types.
Owner - Has full access to all resources including the right to delegate access to others.
Contributor - Can create and manage all types of Azure resources but can’t grant access to others.
Reader - Can view existing Azure resources.
User Access Administrator - Lets you manage user access to Azure resources.
The rest of the built-in roles allow management of specific Azure resources. For example, the Virtual Machine
Contributor role allows a user to create and manage virtual machines. If the built-in roles don't meet the specific
needs of your organization, you can create your own custom roles.
Azure has introduced data operations (currently in preview ) that enable you to grant access to data within an
object. For example, if a user has read data access to a storage account, then they can read the blobs or messages
within that storage account. For more information, see Understand role definitions.
Scope
Scope is the boundary that the access applies to. When you assign a role, you can further limit the actions allowed
by defining a scope. This is helpful if you want to make someone a Website Contributor, but only for one resource
group.
In Azure, you can specify a scope at multiple levels: management group, subscription, resource group, or resource.
Scopes are structured in a parent-child relationship.
When you grant access at a parent scope, those permissions are inherited to the child scopes. For example:
If you assign the Owner role to a user at the management group scope, that user can manage everything in all
subscriptions in the management group.
If you assign the Reader role to a group at the subscription scope, the members of that group can view every
resource group and resource in the subscription.
If you assign the Contributor role to an application at the resource group scope, it can manage resources of all
types in that resource group, but not other resource groups in the subscription.
Role assignments
A role assignment is the process of binding a role definition to a user, group, or service principal at a particular
scope for the purpose of granting access. Access is granted by creating a role assignment, and access is revoked by
removing a role assignment.
The following diagram shows an example of a role assignment. In this example, the Marketing group has been
assigned the Contributor role for the pharma-sales resource group. This means that users in the Marketing group
can create or manage any Azure resource in the pharma-sales resource group. Marketing users do not have access
to resources outside the pharma-sales resource group, unless they are part of another role assignment.
You can create role assignments using the Azure portal, Azure CLI, Azure PowerShell, Azure SDKs, or REST APIs.
You can have up to 2000 role assignments in each subscription. To create and remove role assignments, you must
have Microsoft.Authorization/roleAssignments/* permission. This permission is granted through the Owner or
User Access Administrator roles.
Deny assignments
Previously, RBAC was an allow -only model with no deny, but now RBAC supports deny assignments in a limited
way. Similar to a role assignment, a deny assignment binds a set of deny actions to a user, group, or service
principal at a particular scope for the purpose of denying access. A role assignment defines a set of actions that are
allowed, while a deny assignment defines a set of actions that not allowed. In other words, deny assignments block
users from performing specified actions even if a role assignment grants them access. Deny assignments take
precedence over role assignments.
Currently, deny assignments are read-only and can only be set by Azure. Even though you can't create your own
deny assignments, you can list deny assignments because they could impact your effective permissions. To get
information about a deny assignment, you must have the Microsoft.Authorization/denyAssignments/read
permission, which is included in most built-in roles. For more information, see Understand deny assignments.
Next steps
Quickstart: Grant access for a user using RBAC and the Azure portal
Manage access using RBAC and the Azure portal
Understand the different roles in Azure
Apply policies to Windows VMs with Azure Resource
Manager
9/24/2018 • 3 minutes to read • Edit Online
By using policies, an organization can enforce various conventions and rules throughout the enterprise.
Enforcement of the desired behavior can help mitigate risk while contributing to the success of the organization. In
this article, we describe how you can use Azure Resource Manager policies to define the desired behavior for your
organization’s Virtual Machines.
For an introduction to policies, see What is Azure Policy?.
Use a wild card to modify the preceding policy to allow any Windows Server Datacenter image:
{
"field": "Microsoft.Compute/imageSku",
"like": "*Datacenter"
}
Use anyOf to modify the preceding policy to allow any Windows Server 2012 R2 Datacenter or higher image:
{
"anyOf": [
{
"field": "Microsoft.Compute/imageSku",
"like": "2012-R2-Datacenter*"
},
{
"field": "Microsoft.Compute/imageSku",
"like": "2016-Datacenter*"
}
]
}
Managed disks
To require the use of managed disks, use the following policy:
{
"if": {
"anyOf": [
{
"allOf": [
{
"field": "type",
"equals": "Microsoft.Compute/virtualMachines"
},
{
"field": "Microsoft.Compute/virtualMachines/osDisk.uri",
"exists": true
}
]
},
{
"allOf": [
{
"field": "type",
"equals": "Microsoft.Compute/VirtualMachineScaleSets"
},
{
"anyOf": [
{
"field": "Microsoft.Compute/VirtualMachineScaleSets/osDisk.vhdContainers",
"exists": true
},
{
"field": "Microsoft.Compute/VirtualMachineScaleSets/osdisk.imageUrl",
"exists": true
}
]
}
]
}
]
},
"then": {
"effect": "deny"
}
}
{
"if": {
"allOf": [
{
"field": "type",
"in": [
"Microsoft.Compute/virtualMachines",
"Microsoft.Compute/VirtualMachineScaleSets"
]
},
{
"not": {
"field": "Microsoft.Compute/imageId",
"contains": "resourceGroups/CustomImage"
}
}
]
},
"then": {
"effect": "deny"
}
}
{
"field": "Microsoft.Compute/imageId",
"in": ["{imageId1}","{imageId2}"]
}
}
]
},
"then": {
"effect": "deny"
}
}
{
"if": {
"allOf": [
{
"field": "type",
"in":[ "Microsoft.Compute/virtualMachines","Microsoft.Compute/VirtualMachineScaleSets"]
},
{
"field": "Microsoft.Compute/licenseType",
"exists": true
}
]
},
"then": {
"effect": "deny"
}
}
Next steps
After defining a policy rule (as shown in the preceding examples), you need to create the policy definition and
assign it to a scope. The scope can be a subscription, resource group, or resource. To assign policies, see Use
Azure portal to assign and manage resource policies, Use PowerShell to assign policies, or Use Azure CLI to
assign policies.
For an introduction to resource policies, see What is Azure Policy?.
For guidance on how enterprises can use Resource Manager to effectively manage subscriptions, see Azure
enterprise scaffold - prescriptive subscription governance.
Set up Key Vault for virtual machines in Azure
Resource Manager
8/7/2018 • 2 minutes to read • Edit Online
NOTE
Azure has two different deployment models for creating and working with resources: Resource Manager and classic. This
article covers using the Resource Manager deployment model, which Microsoft recommends for new deployments instead of
the classic deployment model.
In Azure Resource Manager stack, secrets/certificates are modeled as resources that are provided by the resource
provider of Key Vault. To learn more about Key Vault, see What is Azure Key Vault?
NOTE
1. In order for Key Vault to be used with Azure Resource Manager virtual machines, the EnabledForDeployment property
on Key Vault must be set to true. You can do this in various clients.
2. The Key Vault needs to be created in the same subscription and location as the Virtual Machine.
For existing key vaults, you can use this PowerShell cmdlet:
For other options that you can configure when you create a key vault by using templates, see Create a key vault.
Overview of the features in Azure Backup
8/2/2018 • 20 minutes to read • Edit Online
Azure Backup is the Azure-based service you can use to back up (or protect) and restore your data in the Microsoft
cloud. Azure Backup replaces your existing on-premises or off-site backup solution with a cloud-based solution
that is reliable, secure, and cost-competitive. Azure Backup offers multiple components that you download and
deploy on the appropriate computer, server, or in the cloud. The component, or agent, that you deploy depends on
what you want to protect. All Azure Backup components (no matter whether you're protecting data on-premises or
in the cloud) can be used to back up data to a Recovery Services vault in Azure. See the Azure Backup components
table (later in this article) for information about which component to use to protect specific data, applications, or
workloads.
Watch a video overview of Azure Backup
Azure Backup (MARS) Back up files and Backup 3x per day Files, Recovery Services
agent folders on physical or Not application Folders, vault
virtual Windows OS aware; file, folder, and System State
(VMs can be on- volume-level restore
premises or in Azure) only,
No separate No support for
backup server Linux.
required.
Hyper-V virtual machine (Windows) Windows Server System Center DPM (+ the Azure
Backup agent),
Azure Backup Server (includes the
Azure Backup agent)
Hyper-V virtual machine (Linux) Windows Server System Center DPM (+ the Azure
Backup agent),
Azure Backup Server (includes the
Azure Backup agent)
VMware virtual machine Windows Server System Center DPM (+ the Azure
Backup agent),
Azure Backup Server (includes the
Azure Backup agent)
Microsoft SQL Server Windows Server System Center DPM (+ the Azure
Backup agent),
Azure Backup Server (includes the
Azure Backup agent)
Azure IaaS VMs (Windows) running in Azure Azure Backup (VM extension)
Azure IaaS VMs (Linux) running in Azure Azure Backup (VM extension)
Linux support
The following table shows the Azure Backup components that have support for Linux.
System Center DPM File-consistent backup of Linux Guest VMs on Hyper-V and
VMWare
VM restore of Hyper-V and VMWare Linux Guest VMs
Azure Backup Server File-consistent backup of Linux Guest VMs on Hyper-V and
VMWare
VM restore of Hyper-V and VMWare Linux Guest VMs
File-consistent backup not available for Azure VM
NOTE
Do not modify or edit the staging location.
Recovery Services
vault
Disk storage
Tape storage
Compression
(in Recovery Services
vault)
Incremental backup
Disk deduplication
The Recovery Services vault is the preferred storage target across all components. System Center DPM and Azure
Backup Server also provide the option to have a local disk copy. However, only System Center DPM provides the
option to write data to a tape storage device.
Compression
Backups are compressed to reduce the required storage space. The only component that does not use compression
is the VM extension. The VM extension copies all backup data from your storage account to the Recovery Services
vault in the same region. No compression is used when transferring the data. Transferring the data without
compression slightly inflates the storage used. However, storing the data without compression allows for faster
restoration, should you need that recovery point.
Disk Deduplication
You can take advantage of deduplication when you deploy System Center DPM or Azure Backup Server on a
Hyper-V virtual machine. Windows Server performs data deduplication (at the host level) on virtual hard disks
(VHDs) that are attached to the virtual machine as backup storage.
NOTE
Deduplication is not available in Azure for any Backup component. When System Center DPM and Backup Server are
deployed in Azure, the storage disks attached to the VM cannot be deduplicated.
With Full Backup, each backup copy contains the entire data source. Full backup consumes a large amount of
network bandwidth and storage, each time a backup copy is transferred.
Differential backup stores only the blocks that changed since the initial full backup, which results in a smaller
amount of network and storage consumption. Differential backups don't retain redundant copies of unchanged
data. However, because the data blocks that remain unchanged between subsequent backups are transferred and
stored, differential backups are inefficient. In the second month, changed blocks A2, A3, A4, and A9 are backed up.
In the third month, these same blocks are backed up again, along with changed block A5. The changed blocks
continue to be backed up until the next full backup happens.
Incremental Backup achieves high storage and network efficiency by storing only the blocks of data that changed
since the previous backup. With incremental backup, there is no need to take regular full backups. In the example,
after taking the full backup in the first month, blocks A2, A3, A4, and A9 are marked as changed, and transferred to
the second month. In the third month, only changed block A5 is marked and transferred. Moving less data saves
storage and network resources, which decreases TCO.
Security
AZURE IAAS VM
BACKUP
FEATURE AZURE BACKUP AGENT SYSTEM CENTER DPM AZURE BACKUP SERVER
Network security
(to Azure)
Data security
(in Azure)
Network security
All backup traffic from your servers to the Recovery Services vault is encrypted using Advanced Encryption
Standard 256. The backup data is sent over a secure HTTPS link. The backup data is also stored in the Recovery
Services vault in encrypted form. Only you, the Azure customer, have the passphrase to unlock this data. Microsoft
cannot decrypt the backup data at any point.
WARNING
Once you establish the Recovery Services vault, only you have access to the encryption key. Microsoft never maintains a copy
of your encryption key, and does not have access to the key. If the key is misplaced, Microsoft cannot recover the backup
data.
Data security
Backing up Azure VMs requires setting up encryption within the virtual machine. Azure Backup supports Azure
Disk Encryption, which uses BitLocker on Windows virtual machines and dm -crypt on Linux virtual machines. On
the back end, Azure Backup uses Azure Storage Service encryption, which protects data at rest.
Network
AZURE IAAS VM
FEATURE AZURE BACKUP AGENT SYSTEM CENTER DPM AZURE BACKUP SERVER BACKUP
Network compression
(to backup server)
Network compression
(to Recovery
Services vault)
The VM extension (on the IaaS VM ) reads the data directly from the Azure storage account over the storage
network, so it is not necessary to compress this traffic.
If you use a System Center DPM server or Azure Backup Server as a secondary backup server, compress the data
going from the primary server to the backup server. Compressing data before back up to DPM or Azure Backup
Server, saves bandwidth.
Network Throttling
The Azure Backup agent offers network throttling, which allows you to control how network bandwidth is used
during data transfer. Throttling can be helpful if you need to back up data during work hours but do not want the
backup process to interfere with other internet traffic. Throttling for data transfer applies to back up and restore
activities.
AZURE IAAS VM
AZURE BACKUP AGENT SYSTEM CENTER DPM AZURE BACKUP SERVER BACKUP
Backup frequency Three backups per Two backups per day Two backups per day One backup per day
(to Recovery Services day
vault)
Backup frequency Not applicable Every 15 minutes Every 15 minutes Not applicable
(to disk) for SQL Server for SQL Server
Every hour for Every hour for
other workloads other workloads
Retention options Daily, weekly, Daily, weekly, Daily, weekly, monthly, Daily, weekly, monthly,
monthly, yearly monthly, yearly yearly yearly
Maximum retention Depends on backup Depends on backup Depends on backup Depends on backup
period frequency frequency frequency frequency
Recovery points on Not applicable 64 for File Servers, 64 for File Servers, Not applicable
local disk 448 for Application 448 for Application
Servers Servers
Recovery point objective The amount of acceptable Backup solutions have wide Disaster recovery solutions
(RPO) data loss if a recovery needs variability in their acceptable have low RPOs. The DR copy
to be done. RPO. Virtual machine can be behind by a few
backups usually have an seconds or a few minutes.
RPO of one day, while
database backups have
RPOs as low as 15 minutes.
CONCEPT DETAILS BACKUP DISASTER RECOVERY (DR)
Recovery time objective The amount of time that it Because of the larger RPO, Disaster recovery solutions
(RTO) takes to complete a recovery the amount of data that a have smaller RTOs because
or restore. backup solution needs to they are more in sync with
process is typically much the source. Fewer changes
higher, which leads to longer need to be processed.
RTOs. For example, it can
take days to restore data
from tapes, depending on
the time it takes to transport
the tape from an off-site
location.
Retention How long data needs to be For scenarios that require Disaster recovery needs only
stored operational recovery (data operational recovery data,
corruption, inadvertent file which typically takes a few
deletion, OS failure), backup hours or up to a day.
data is typically retained for Because of the fine-grained
30 days or less. data capture used in DR
From a compliance solutions, using DR data for
standpoint, data might need long-term retention is not
to be stored for months or recommended.
even years. Backup data is
ideally suited for archiving in
such cases.
Next steps
Use one of the following tutorials for detailed, step-by-step, instructions for protecting data on Windows Server, or
protecting a virtual machine (VM ) in Azure:
Back up Files and Folders
Backup Azure Virtual Machines
For details about protecting other workloads, try one of these articles:
Back up your Windows Server
Back up application workloads
Backup Azure IaaS VMs
Back up a virtual machine in Azure
7/17/2018 • 3 minutes to read • Edit Online
Azure backups can be created through the Azure portal. This method provides a browser-based user interface to
create and configure Azure backups and all related resources. You can protect your data by taking backups at
regular intervals. Azure Backup creates recovery points that can be stored in geo-redundant recovery vaults. This
article details how to back up a virtual machine (VM ) with the Azure portal.
This quickstart enables backup on an existing Azure VM. If you need to create a VM, you can create a VM with the
Azure portal.
Log in to Azure
Log in to the Azure portal at http://portal.azure.com.
Select a VM to back up
Create a simple scheduled daily backup to a Recovery Services Vault.
1. In the menu on the left, select Virtual machines.
2. From the list, choose a VM to back up. If you used the sample VM quickstart commands, the VM is named
myVM in the myResourceGroup resource group.
3. In the Operations section, choose Backup. The Enable backup window opens.
Enable backup on a VM
A Recovery Services vault is a logical container that stores the backup data for each protected resource, such as
Azure VMs. When the backup job for a protected resource runs, it creates a recovery point inside the Recovery
Services vault. You can then use one of these recovery points to restore data to a given point in time.
1. Select Create new and provide a name for the new vault, such as myRecoveryServicesVault.
2. If not already selected, choose Use existing, then select the resource group of your VM from the drop-
down menu.
By default, the vault is set for Geo-Redundant storage. To further protect your data, this storage redundancy
level ensures that your backup data is replicated to a secondary Azure region that is hundreds of miles away
from the primary region.
You create and use policies to define when a backup job runs and how long the recovery points are stored.
The default protection policy runs a backup job each day and retains recovery points for 30 days. You can
use these default policy values to quickly protect your VM.
3. To accept the default backup policy values, select Enable Backup.
It takes a few moments to create the Recovery Services vault.
Clean up deployment
When no longer needed, you can disable protection on the VM, remove the restore points and Recovery Services
vault, then delete the resource group and associated VM resources
If you are going to continue on to a Backup tutorial that explains how to restore data for your VM, skip the steps in
this section and go to Next steps.
1. Select the Backup option for your VM.
2. Select ...More to show additional options, then choose Stop backup.
3. Select Delete Backup Data from the drop-down menu.
4. In the Type the name of the Backup item dialog, enter your VM name, such as myVM. Select Stop
Backup
Once the VM backup has been stopped and recovery points removed, you can delete the resource group. If
you used an existing VM, you may wish to leave the resource group and VM in place.
5. In the menu on the left, select Resource groups.
6. From the list, choose your resource group. If you used the sample VM quickstart commands, the resource
group is named myResourceGroup.
7. Select Delete resource group. To confirm, enter the resource group name, then select Delete.
Next steps
In this quickstart, you created a Recovery Services vault, enabled protection on a VM, and created the initial
recovery point. To learn more about Azure Backup and Recovery Services, continue to the tutorials.
Back up multiple Azure VMs
Back up a virtual machine in Azure with PowerShell
5/25/2018 • 4 minutes to read • Edit Online
The Azure PowerShell module is used to create and manage Azure resources from the command line or in scripts.
You can protect your data by taking backups at regular intervals. Azure Backup creates recovery points that can be
stored in geo-redundant recovery vaults. This article details how to back up a virtual machine (VM ) with the Azure
PowerShell module. You can also perform these steps with the Azure CLI or Azure portal.
This quickstart enables backup on an existing Azure VM. If you need to create a VM, you can create a VM with
Azure PowerShell.
This quickstart requires the Azure PowerShell module version 4.4 or later. Run Get-Module -ListAvailable AzureRM
to find the version. If you need to install or upgrade, see Install Azure PowerShell module.
Log in to Azure
Log in to your Azure subscription with the Connect-AzureRmAccount command and follow the on-screen directions.
Connect-AzureRmAccount
The first time you use Azure Backup, you must register the Azure Recovery Service provider in your subscription
with Register-AzureRmResourceProvider.
New-AzureRmRecoveryServicesVault `
-ResourceGroupName "myResourceGroup" `
-Name "myRecoveryServicesVault" `
-Location "WestEurope"
By default, the vault is set for Geo-Redundant storage. To further protect your data, this storage redundancy level
ensures that your backup data is replicated to a secondary Azure region that is hundreds of miles away from the
primary region.
To use this vault with the remaining steps, set the vault context with Set-AzureRmRecoveryServicesVaultContext
Get-AzureRmRecoveryServicesVault `
-Name "myRecoveryServicesVault" | Set-AzureRmRecoveryServicesVaultContext
Enable backup for an Azure VM
You create and use policies to define when a backup job runs and how long the recovery points are stored. The
default protection policy runs a backup job each day, and retains recovery points for 30 days. You can use these
default policy values to quickly protect your VM. First, set the default policy with Get-
AzureRmRecoveryServicesBackupProtectionPolicy:
To enable backup protection for a VM, use Enable-AzureRmRecoveryServicesBackupProtection. Specify the policy
to use, then the resource group and VM to protect:
Enable-AzureRmRecoveryServicesBackupProtection `
-ResourceGroupName "myResourceGroup" `
-Name "myVM" `
-Policy $policy
$backupcontainer = Get-AzureRmRecoveryServicesBackupContainer `
-ContainerType "AzureVM" `
-FriendlyName "myVM"
$item = Get-AzureRmRecoveryServicesBackupItem `
-Container $backupcontainer `
-WorkloadType "AzureVM"
As this first backup job creates a full recovery point, the process can take up to 20 minutes.
Get-AzureRmRecoveryservicesBackupJob
The output is similar to the following example, which shows the backup job is InProgress:
When the Status of the backup job reports Completed, your VM is protected with Recovery Services and has a full
recovery point stored.
Clean up deployment
When no longer needed, you can disable protection on the VM, remove the restore points and Recovery Services
vault, then delete the resource group and associated VM resources. If you used an existing VM, you can skip the
final Remove-AzureRmResourceGroup cmdlet to leave the resource group and VM in place.
If you are going to continue on to a Backup tutorial that explains how to restore data for your VM, skip the steps in
this section and go to Next steps.
Next steps
In this quickstart, you created a Recovery Services vault, enabled protection on a VM, and created the initial
recovery point. To learn more about Azure Backup and Recovery Services, continue to the tutorials.
Back up multiple Azure VMs
Use Azure portal to back up multiple virtual
machines
9/28/2018 • 6 minutes to read • Edit Online
When you back up data in Azure, you store that data in an Azure resource called a Recovery Services vault. The
Recovery Services vault resource is available from the Settings menu of most Azure services. The benefit of having
the Recovery Services vault integrated into the Settings menu of most Azure services makes it very easy to back
up data. However, individually working with each database or virtual machine in your business is tedious. What if
you want to back up the data for all virtual machines in one department, or in one location? It is easy to back up
multiple virtual machines by creating a backup policy and applying that policy to the desired virtual machines. This
tutorial explains how to:
Create a Recovery Services vault
Define a backup policy
Apply the backup policy to protect multiple virtual machines
Trigger an on-demand backup job for the protected virtual machines
2. In the Recovery Services vaults menu, click Add to open the Recovery Services vault menu.
3. In the Recovery Services vault menu,
Type myRecoveryServicesVault in Name.
The current subscription ID appears in Subscription. If you have additional subscriptions, you could
choose another subscription for the new vault.
For Resource group select Use existing and choose myResourceGroup. If myResourceGroup doesn't
exist, select Create new and type myResourceGroup.
From the Location drop-down menu, choose West Europe.
Click Create to create your Recovery Services vault.
A Recovery Services vault must be in the same location as the virtual machines being protected. If you have virtual
machines in multiple regions, create a Recovery Services vault in each region. This tutorial creates a Recovery
Services vault in West Europe because that is where myVM (the virtual machine created with the quickstart) was
created.
It can take several minutes for the Recovery Services vault to be created. Monitor the status notifications in the
upper right-hand area of the portal. Once your vault is created, it appears in the list of Recovery Services vaults.
When you create a Recovery Services vault, by default the vault has geo-redundant storage. To provide data
resiliency, geo-redundant storage replicates the data multiple times across two Azure regions.
4. To create a new policy, on the Backup policy menu, from the Choose backup policy drop-down menu,
select Create New.
5. In the Backup policy menu, for Policy Name type Finance. Enter the following changes for the Backup
policy:
For Backup frequency set the timezone for Central Time. Since the sports complex is in Texas, the
owner wants the timing to be local. Leave the backup frequency set to Daily at 3:30AM.
For Retention of daily backup point, set the period to 90 days.
For Retention of weekly backup point, use the Monday restore point and retain it for 52 weeks.
For Retention of monthly backup point, use the restore point from First Sunday of the month, and
retain it for 36 months.
Deselect the Retention of yearly backup point option. The leader of Finance doesn't want to keep
data longer than 36 months.
Click OK to create the backup policy.
After creating the backup policy, associate the policy with the virtual machines.
6. In the Select virtual machines dialog select myVM and click OK to deploy the backup policy to the virtual
machines.
All virtual machines that are in the same location, and are not already associated with a backup policy,
appear. myVMH1 and myVMR1 are selected to be associated with the Finance policy.
When the deployment completes, you receive a notification that deployment successfully completed.
Initial backup
You have enabled backup for the Recovery Services vaults, but an initial backup has not been created. It is a
disaster recovery best practice to trigger the first backup, so that your data is protected.
To run an on-demand backup job:
1. On the vault dashboard, click 3 under Backup Items, to open the Backup Items menu.
The Backup Items menu opens.
2. On the Backup Items menu, click Azure Virtual Machine to open the list of virtual machines associated
with the vault.
3. On the Backup Items list, click the ellipses ... to open the Context menu.
4. On the Context menu, select Backup now.
Deployment notifications let you know the backup job has been triggered, and that you can monitor the
progress of the job on the Backup jobs page. Depending on the size of your virtual machine, creating the
initial backup may take a while.
When the initial backup job completes, you can see its status in the Backup job menu. The on-demand
backup job created the initial restore point for myVM. If you want to back up other virtual machines, repeat
these steps for each virtual machine.
Clean up resources
If you plan to continue on to work with subsequent tutorials, do not clean up the resources created in this tutorial.
If you do not plan to continue, use the following steps to delete all resources created by this tutorial in the Azure
portal.
1. On the myRecoveryServicesVault dashboard, click 3 under Backup Items, to open the Backup Items
menu.
2. On the Backup Items menu, click Azure Virtual Machine to open the list of virtual machines associated
with the vault.
5. In the Stop Backup menu, select the upper drop-down menu and choose Delete Backup Data.
6. In the Type the name of the Backup item dialog, type myVM.
7. Once the backup item is verified (a checkmark appears), Stop backup button is enabled. Click Stop
Backup to stop the policy and delete the restore points.
Next steps
In this tutorial you used the Azure portal to:
Create a Recovery Services vault
Set the vault to protect virtual machines
Create a custom backup and retention policy
Assign the policy to protect multiple virtual machines
Trigger an on-demand back up for virtual machines
Continue to the next tutorial to restore an Azure virtual machine from disk.
Restore VMs using CLI
Understanding Azure virtual machine usage
4/13/2018 • 7 minutes to read • Edit Online
By analyzing your Azure usage data, powerful consumption insights can be gained – insights that can enable better
cost management and allocation throughout your organization. This document provides a deep dive into your
Azure Compute consumption details. For more details on general Azure usage, navigate to Understanding your
bill.
Usage Date The date when the resource was used. “11/23/2017”
Meter Name This is specific for each service in Azure. “Compute Hours”
For compute, it is always “Compute
Hours”.
Service Type
The service type field in the Additional Info field corresponds to the exact VM size you deployed. Premium storage
VMs (SSD -based) and non-premium storage VMs (HDD -based) are priced the same. If you deploy an SSD -based
size, like Standard_DS2_v2, you see the non-SSD size (‘Standard_D2_v2 VM’) in the Meter Sub-Category column
and the SSD -size (‘Standard_DS2_v2’) in the Additional Info field.
Region Names
The region name populated in the Resource Location field in the usage details varies from the region name used in
the Azure Resource Manager. Here is a mapping between the region values:
australiaeast AU East
australiasoutheast AU Southeast
brazilsouth BR South
CanadaCentral CA Central
CanadaEast CA East
CentralIndia IN Central
centralus Central US
RESOURCE MANAGER REGION NAME RESOURCE LOCATION IN USAGE DETAILS
eastus East US
eastus2 East US 2
GermanyCentral DE Central
GermanyNortheast DE Northeast
japaneast JA East
japanwest JA West
KoreaCentral KR Central
KoreaSouth KR South
SouthIndia IN South
UKNorth US North
uksouth UK South
UKSouth2 UK South 2
ukwest UK West
WestIndia IN West
westus West US
westus2 US West 2
Next steps
To learn more about your usage details, see Understand your bill for Microsoft Azure.
Common PowerShell commands for creating and
managing Azure Virtual Machines
8/10/2018 • 2 minutes to read • Edit Online
This article covers some of the Azure PowerShell commands that you can use to create and manage virtual
machines in your Azure subscription. For more detailed help with specific command-line switches and options, you
can use the Get-Help command.
See How to install and configure Azure PowerShell for information about installing the latest version of Azure
PowerShell, selecting your subscription, and signing in to your account.
These variables might be useful for you if running more than one of the commands in this article:
$location - The location of the virtual machine. You can use Get-AzureRmLocation to find a geographical region
that works for you.
$myResourceGroup - The name of the resource group that contains the virtual machine.
$myVM - The name of the virtual machine.
Create a VM - simplified
TASK COMMAND
Create a VM configuration
TASK COMMAND
Next steps
See the basic steps for creating a virtual machine in Create a Windows VM using Resource Manager and
PowerShell.
Move a Windows VM to another Azure subscription
or resource group
9/13/2018 • 2 minutes to read • Edit Online
This article walks you through how to move a Windows virtual machine (VM ) between resource groups or
subscriptions. Moving between subscriptions can be handy if you originally created a VM in a personal
subscription and now want to move it to your company's subscription to continue your work.
IMPORTANT
You cannot move Azure Managed Disks at this time.
New resource IDs are created as part of the move. After the VM has been moved, you will need to update your tools and
scripts to use the new resource IDs.
You can use the output of the previous command as a comma-separated list of resource IDs to Move-
AzureRMResource to move each resource to the destination.
When you are asked to confirm that you want to move the specified resources, enter Y to confirm.
Next steps
You can move many different types of resources between resource groups and subscriptions. For more
information, see Move resources to a new resource group or subscription.
Resize a Windows VM
6/13/2018 • 2 minutes to read • Edit Online
This article shows you how to move a VM to a different VM size using Azure Powershell.
After you create a virtual machine (VM ), you can scale the VM up or down by changing the VM size. In some cases,
you must deallocate the VM first. This can happen if the new size is not available on the hardware cluster that is
currently hosting the VM.
If your VM uses Premium Storage, make sure that you choose an s version of the size to get Premium Storage
support. For example, choose Standard_E4s_v3 instead of Standard_E4_v3.
$resourceGroup = "myResourceGroup"
$vmName = "myVM"
List the VM sizes that are available on the hardware cluster where the VM is hosted.
If the size you want is listed, run the following commands to resize the VM. If the desired size is not listed, go on to
step 3.
If the size you want is not listed, run the following commands to deallocate the VM, resize it, and restart the VM.
Replace with the size you want.
WARNING
Deallocating the VM releases any dynamic IP addresses assigned to the VM. The OS and data disks are not affected.
List the VM sizes that are available on the hardware cluster where the VM is hosted.
If the desired size is listed, run the following commands to resize the VM. If it is not listed, go to the next section.
If the size you want is not listed, continue with the following steps to deallocate all VMs in the availability set, resize
VMs, and restart them.
Stop all VMs in the availability set.
$newSize = "<newVmSize>"
$as = Get-AzureRmAvailabilitySet -ResourceGroupName $resourceGroup
$vmIds = $as.VirtualMachinesReferences
foreach ($vmId in $vmIDs){
$string = $vmID.Id.Split("/")
$vmName = $string[8]
$vm = Get-AzureRmVM -ResourceGroupName $resourceGroup -Name $vmName
$vm.HardwareProfile.VmSize = $newSize
Update-AzureRmVM -ResourceGroupName $resourceGroup -VM $vm
Start-AzureRmVM -ResourceGroupName $resourceGroup -Name $vmName
}
Next steps
For additional scalability, run multiple VM instances and scale out. For more information, see Automatically scale
Windows machines in a Virtual Machine Scale Set.
Change the OS disk used by an Azure VM using
PowerShell
4/26/2018 • 2 minutes to read • Edit Online
If you have an existing VM, but you want to swap the disk for a backup disk or another OS disk, you can use Azure
PowerShell to swap the OS disks. You don't have to delete and recreate the VM. You can even use a managed disk
in another resource group, as long as it isn't already in use.
The VM does need to be stopped\deallocated, then the resource ID of the managed disk can be replaced with the
resource ID of a different managed disk.
Make sure that the VM size and storage type are compatible with the disk you want to attach. For example, if the
disk you want to use is in Premium Storage, then the VM needs to be capable of Premium Storage (like a DS -
series size).
Get a list of disks in a resource group using Get-AzureRmDisk
When you have the name of the disk that you would like to use, set that as the OS disk for the VM. This example
stop\deallocates the VM named myVM and assigns the disk named newDisk as the new OS disk.
# Get the VM
$vm = Get-AzureRmVM -ResourceGroupName myResourceGroup -Name myVM
# Start the VM
Start-AzureRmVM -Name $vm.Name -ResourceGroupName myResourceGroup
Next steps
To create a copy of a disk, see Snapshot a disk.
How to tag a Windows virtual machine in Azure
8/10/2018 • 4 minutes to read • Edit Online
This article describes different ways to tag a Windows virtual machine in Azure through the Resource Manager
deployment model. Tags are user-defined key/value pairs which can be placed directly on a resource or a resource
group. Azure currently supports up to 15 tags per resource and resource group. Tags may be placed on a resource
at the time of creation or added to an existing resource. Please note that tags are supported for resources created
via the Resource Manager deployment model only. If you want to tag a Linux virtual machine, see How to tag a
Linux virtual machine in Azure.
This template includes the following tags: Department, Application, and Created By. You can add/edit these tags
directly in the template if you would like different tag names.
As you can see, the tags are defined as key/value pairs, separated by a colon (:). The tags must be defined in this
format:
“tags”: {
“Key1” : ”Value1”,
“Key2” : “Value2”
}
Save the template file after you finish editing it with the tags of your choice.
Next, in the Edit Parameters section, you can fill out the values for your tags.
Click Create to deploy this template with your tag values.
Add a new tag through the portal by defining your own Key/Value pair, and save it.
Your new tag should now appear in the list of tags for your resource.
Tagging with PowerShell
To create, add, and delete tags through PowerShell, you first need to set up your PowerShell environment with
Azure Resource Manager. Once you have completed the setup, you can place tags on Compute, Network, and
Storage resources at creation or after the resource is created via PowerShell. This article will concentrate on
viewing/editing tags placed on Virtual Machines.
First, navigate to a Virtual Machine through the Get-AzureRmVM cmdlet.
If your Virtual Machine already contains tags, you will then see all the tags on your resource:
Tags : {
"Application": "MyApp1",
"Created By": "MyName",
"Department": "MyDepartment",
"Environment": "Production"
}
If you would like to add tags through PowerShell, you can use the Set-AzureRmResource command. Note when
updating tags through PowerShell, tags are updated as a whole. So if you are adding one tag to a resource that
already has tags, you will need to include all the tags that you want to be placed on the resource. Below is an
example of how to add additional tags to a resource through PowerShell Cmdlets.
This first cmdlet sets all of the tags placed on MyTestVM to the $tags variable, using the Get-AzureRmResource and
Tags property.
The second command displays the tags for the given variable.
PS C:\> $tags
Name Value
---- -----
Value MyDepartment
Name Department
Value MyApp1
Name Application
Value MyName
Name Created By
Value Production
Name Environment
The third command adds an additional tag to the $tags variable. Note the use of the += to append the new
key/value pair to the $tags list.
The fourth command sets all of the tags defined in the $tags variable to the given resource. In this case, it is
MyTestVM.
The fifth command displays all of the tags on the resource. As you can see, Location is now defined as a tag with
MyLocation as the value.
Name Value
---- -----
Value MyDepartment
Name Department
Value MyApp1
Name Application
Value MyName
Name Created By
Value Production
Name Environment
Value MyLocation
Name Location
To learn more about tagging through PowerShell, check out the Azure Resource Cmdlets.
From the usage details, you can see all of the tags in the Tags column:
By analyzing these tags along with usage, organizations will be able to gain new insights into their consumption
data.
Next steps
To learn more about tagging your Azure resources, see Azure Resource Manager Overview and Using Tags to
organize your Azure Resources.
To see how tags can help you manage your use of Azure resources, see Understanding your Azure Bill and Gain
insights into your Microsoft Azure resource consumption.
Time sync for Windows VMs in Azure
10/19/2018 • 7 minutes to read • Edit Online
Time sync is important for security and event correlation. Sometimes it is used for distributed transactions
implementation. Time accuracy between multiple computer systems is achieved through synchronization.
Synchronization can be affected by multiple things, including reboots and network traffic between the time source
and the computer fetching the time.
Azure is now backed by infrastructure running Windows Server 2016. Windows Server 2016 has improved
algorithms used to correct time and condition the local clock to synchronize with UTC. Windows Server 2016 also
improved the VMICTimeSync service that governs how VMs sync with the host for accurate time. Improvements
include more accurate initial time on VM start or VM restore and interrupt latency correction for samples provided
to Windows Time (W32time).
NOTE
For a quick overview of Windows Time service, take a look at this high-level overview video.
For more information, see Accurate time for Windows Server 2016.
Overview
Accuracy for a computer clock is gauged on how close the computer clock is to the Coordinated Universal Time
(UTC ) time standard. UTC is defined by a multinational sample of precise atomic clocks that can only be off by one
second in 300 years. But, reading UTC directly requires specialized hardware. Instead, time servers are synced to
UTC and are accessed from other computers to provide scalability and robustness. Every computer has time
synchronization service running that knows what time servers to use and periodically checks if computer clock
needs to be corrected and adjusts time if needed.
Azure hosts are synchronized to internal Microsoft time servers that take their time from Microsoft-owned Stratum
1 devices, with GPS antennas. Virtual machines in Azure can either depend on their host to pass the accurate time
(host time) on to the VM or the VM can directly get time from a time server, or a combination of both.
Virtual machine interactions with the host can also affect the clock. During memory preserving maintenance, VMs
are paused for up to 30 seconds. For example, before maintenance begins the VM clock shows 10:00:00 AM and
lasts 28 seconds. After the VM resumes, the clock on the VM would still show 10:00:00 AM, which would be 28
seconds off. To correct for this, the VMICTimeSync service monitors what is happening on the host and prompts
for changes to happen on the VMs to compensate.
Without time synchronization working, the clock on the VM would accumulate errors. When there is only one VM,
the effect might not be significant unless the workload requires highly accurate timekeeping. But in most cases, we
have multiple, interconnected VMs that use time to track transactions and the time needs to be consistent
throughout the entire deployment. When time between VMs is different, you could see the following effects:
Authentication will fail. Security protocols like Kerberos or certificate-dependent technology rely on time being
consistent across the systems.
It's very hard to figure out what have happened in a system if logs (or other data) don't agree on time. The same
event would look like it occurred at different times, making correlation difficult.
If clock is off, the billing could be calculated incorrectly.
The best results for Windows deployments are achieved by using Windows Server 2016 as the guest operating
system, which ensures you can use the latest improvements in time synchronization.
Configuration options
There are three options for configuring time sync for your Windows VMs hosted in Azure:
Host time and time.windows.com. This is the default configuration used in Azure Marketplace images.
Host-only.
Use another, external time server with or without using host time.
Use the default
By default Windows OS VM images are configured for w32time to sync from two sources:
The NtpClient provider, which gets information from time.windows.com.
The VMICTimeSync service, used to communicate the host time to the VMs and make corrections after the VM
is paused for maintenance. Azure hosts use Microsoft-owned Stratum 1 devices to keep accurate time.
w32time would prefer the time provider in the following order of priority: stratum level, root delay, root dispersion,
time offset. In most cases, w32time would prefer time.windows.com to the host because time.windows.com reports
lower stratum.
For domain joined machines the domain itself establishes time sync hierarchy, but the forest root still needs to take
time from somewhere and the following considerations would still hold true.
Host-only
Because time.windows.com is a public NTP server, syncing time with it requires sending traffic over the internet,
varying packet delays can negatively affect quality of the time sync. Removing time.windows.com by switching to
host-only sync can sometimes improve your time sync results.
Switching to host-only time sync makes sense if you experience time sync issues using the default configuration.
Try out the host-only sync to see if that would improve the time sync on VM.
External time server
If you have specific time sync requirements, there is also an option of using external time servers. External time
servers can provide specific time, which can be useful for test scenarios, ensuring time uniformity with machines
hosted in non-Microsoft datacenters, or handling leap seconds in a special way.
You can combine external servers with the VMICTimeSync service and VMICTimeProvider to provide results
similar to the default configuration.
To see what time server the NtpClient time provider is using, at an elevated command prompt type:
Here is the output you could see and what it would mean:
time.windows.com - in the default configuration, w32time would get time from time.windows.com. The time
sync quality depends on internet connectivity to it and is affected by packet delays. This is the usual output from
the default setup.
VM IC Time Synchronization Provider - the VM is syncing time from the host. This usually is the result if
you opt-in for host-only time sync or the NtpServer is not available at the moment.
Your domain server - the current machine is in a domain and the domain defines the time sync hierarchy.
Some other server - w32time was explicitly configured to get the time from that another server. Time sync
quality depends on this time server quality.
Local CMOS Clock - clock is unsynchronized. You can get this output if w32time hasn't had enough time to
start after a reboot or when all the configured time sources are not available.
For w32time to be able to use the new poll intervals, the NtpServers be marked as using them. If servers are
annotated with 0x1 bitflag mask, that would override this mechanism and w32time would use SpecialPollInterval
instead. Make sure that specified NTP servers are either using 0x8 flag or no flag at all:
Check what flags are being used for the used NTP servers.
Next steps
Below are links to more details about the time sync:
Windows Time Service Tools and Settings
Windows Server 2016 Improvements
Accurate Time for Windows Server 2016
Support boundary to configure the Windows Time service for high-accuracy environments
Run scripts in your Windows VM
6/11/2018 • 2 minutes to read • Edit Online
To automate tasks or troubleshoot issues, you may need to run commands in a VM. The following article gives a
brief overview of the features that are available to run scripts and commands within your VMs.
Run command
The Run Command feature enables virtual machine and application management and troubleshooting using
scripts, and is available even when the machine is not reachable, for example if the guest firewall doesn't have the
RDP or SSH port open.
Run scripts in Azure virtual machines.
Can be run using Azure portal, REST API, Azure CLI, or PowerShell
Quickly run a script and view output and repeat as needed in the Azure portal.
Script can be typed directly or you can run one of the built-in scripts.
Run PowerShell script in Windows machines and Bash script in Linux machines.
Useful for virtual machine and application management and for running scripts in virtual machines that are
unreachable.
Serial console
The Serial console provides direct access to a VM, similar to having a keyboard connected to the VM.
Run commands in Azure virtual machines.
Can be run using a text-based console to the machine in the Azure portal.
Login to the machine with a local user account.
Useful when access to the virtual machine is needed regardless of the machine's network or operating system
state.
Next steps
Learn more about the different features that are available to run scripts and commands within your VMs.
Custom Script Extension
Run Command
Hybrid Runbook Worker
Serial console
Custom Script Extension for Windows
9/28/2018 • 8 minutes to read • Edit Online
The Custom Script Extension downloads and executes scripts on Azure virtual machines. This extension is useful for post deployment configuration, software
installation, or any other configuration / management task. Scripts can be downloaded from Azure storage or GitHub, or provided to the Azure portal at extension run
time. The Custom Script extension integrates with Azure Resource Manager templates, and can also be run using the Azure CLI, PowerShell, Azure portal, or the
Azure Virtual Machine REST API.
This document details how to use the Custom Script Extension using the Azure PowerShell module, Azure Resource Manager templates, and details troubleshooting
steps on Windows systems.
Prerequisites
NOTE
Do not use Custom Script Extension to run Update-AzureRmVM with the same VM as its parameter, since it will wait on itself.
Operating System
The Custom Script Extension for Linux will run on the extension supported extension OS's, for more information, see this article.
Script Location
You can use the extension to use your Azure Blob storage credentials, to access Azure Blob storage. Alternatively, the script location can be any where, as long as the
VM can route to that end point, such as GitHub, internal file server etc.
Internet Connectivity
If you need to download a script externally such as GitHub or Azure Storage, then additional firewall/Network Security Group ports need to be opened. For example if
your script is located in Azure Storage, you can allow access using Azure NSG Service Tags for Storage.
If your script is on a local server, then you may still need additional firewall/Network Security Group ports need to be opened.
Tips and Tricks
The highest failure rate for this extension is due to syntax errors in the script, test the script runs without error, and also put in additional logging into the script to
make it easier to find where it failed.
Write scripts that are idempotent, so if they get run again more than once accidentally, it will not cause system changes.
Ensure the scripts do not require user input when they run.
There is 90 mins allowed for the script to run, anything longer will result in a failed provision of the extension.
Do not put reboots inside the script, this will cause issues with other extensions that are being installed, and post reboot, the extension will not continue after the
restart.
If you have a script that will cause a reboot, then install applications and run scripts etc. You should schedule the reboot using a Windows Scheduled Task, or using
tools such as DSC, or Chef, Puppet extensions.
The extension will only run a script once, if you want to run a script on every boot, then you need to use the extension to create a Windows Scheduled Task.
If you want to schedule when a script will run, you should use the extension to create a Windows Scheduled Task.
When the script is running, you will only see a 'transitioning' extension status from the Azure portal or CLI. If you want more frequent status updates of a running
script, you will need to create your own solution.
Custom Script extension does not natively support proxy servers, however you can use a file transfer tool that supports proxy servers within your script, such as
Curl
Be aware of non default directory locations that your scripts or commands may rely on, have logic to handle this.
Extension schema
The Custom Script Extension configuration specifies things like script location and the command to be run. You can store this configuration in configuration files,
specify it on the command line, or specify it in an Azure Resource Manager template.
You can store sensitive data in a protected configuration, which is encrypted and only decrypted inside the virtual machine. The protected configuration is useful when
the execution command includes secrets such as a password.
These items should be treated as sensitive data and specified in the extensions protected setting configuration. Azure VM extension protected setting data is
encrypted, and only decrypted on the target virtual machine.
{
"apiVersion": "2015-06-15",
"type": "Microsoft.Compute/virtualMachines/extensions",
"name": "config-app",
"location": "[resourceGroup().location]",
"dependsOn": [
"[concat('Microsoft.Compute/virtualMachines/', variables('vmName'),copyindex())]",
"[variables('musicstoresqlName')]"
],
"tags": {
"displayName": "config-app"
},
"properties": {
"publisher": "Microsoft.Compute",
"type": "CustomScriptExtension",
"typeHandlerVersion": "1.9",
"autoUpgradeMinorVersion": true,
"settings": {
"fileUris": [
"script location"
]
},
"protectedSettings": {
"commandToExecute": "myExecutionCommand",
"storageAccountName": "myStorageAccountName",
"storageAccountKey": "myStorageAccountKey"
}
}
}
Note - Only one version of an extension can be installed on a VM at a point in time, specifying custom script twice in the same Resource Manager template for the
same VM will fail.
Property values
NAME VALUE / EXAMPLE DATA TYPE
NOTE
These property names are case-sensitive. To avoid deployment problems, use the names as shown here.
The following values can be set in either public or protected settings, the extension will reject any configuration where the values below are set in both public and
protected settings.
commandToExecute
Using public settings maybe useful for debugging, but it is strongly recommended that you use protected settings.
Public settings are sent in clear text to the VM where the script will be executed. Protected settings are encrypted using a key known only to the Azure and the VM.
The settings are saved to the VM as they were sent, i.e. if the settings were encrypted they are saved encrypted on the VM. The certificate used to decrypt the
encrypted values is stored on the VM, and used to decrypt settings (if necessary) at runtime.
Template deployment
Azure VM extensions can be deployed with Azure Resource Manager templates. The JSON schema detailed in the previous section can be used in an Azure Resource
Manager template to run the Custom Script Extension during an Azure Resource Manager template deployment. A sample template that includes the Custom Script
Extension can be found here, GitHub.
PowerShell deployment
The Set-AzureRmVMCustomScriptExtension command can be used to add the Custom Script extension to an existing virtual machine. For more information, see Set-
AzureRmVMCustomScriptExtension.
Further Examples
Using Multiple Script
In this example, you have three scripts that are used to build your server, the 'commandToExecute' calls the first script, then you have options on how the others are
called, for example, you can have a master script that controls the execution, with the right error handling, logging, and state management.
$fileUri = @("https://xxxxxxx.blob.core.windows.net/buildServer1/1_Add_Tools.ps1",
"https://xxxxxxx.blob.core.windows.net/buildServer1/2_Add_Features.ps1",
"https://xxxxxxx.blob.core.windows.net/buildServer1/3_CompleteInstall.ps1")
$storageaccname = "xxxxxxx"
$storagekey = "1234ABCD"
$ProtectedSettings = @{"storageAccountName" = $storageaccname; "storageAccountKey" = $storagekey; "commandToExecute" = "powershell -ExecutionPolicy Unrestricted
-File 1_Add_Tools.ps1"};
#run command
Set-AzureRmVMExtension -ResourceGroupName myRG `
-Location myLocation `
-VMName myVM `
-Name "buildserver1" `
-Publisher "Microsoft.Compute" `
-ExtensionType "CustomScriptExtension" `
-TypeHandlerVersion "1.9" `
-Settings $Settings `
-ProtectedSettings $ProtectedSettings `
Extension execution output is logged to files found under the following directory on the target virtual machine.
C:\WindowsAzure\Logs\Plugins\Microsoft.Compute.CustomScriptExtension
The specified files are downloaded into the following directory on the target virtual machine.
C:\Packages\Plugins\Microsoft.Compute.CustomScriptExtension\1.*\Downloads\<n>
where <n> is a decimal integer which may change between executions of the extension. The 1.* value matches the actual, current typeHandlerVersion value of the
extension. For example, the actual directory could be C:\Packages\Plugins\Microsoft.Compute.CustomScriptExtension\1.8\Downloads\2 .
When executing the commandToExecute command, the extension sets this directory (e.g., ...\Downloads\2 ) as the current working directory. This enables the use of
relative paths to locate the files downloaded via the fileURIs property. See the table below for examples.
Since the absolute download path may vary over time, it is better to opt for relative script/file paths in the commandToExecute string, whenever possible. For example:
Path information after the first URI segment is retained for files downloaded via the fileUris property list. As shown in the table below, downloaded files are
mapped into download subdirectories to reflect the structure of the fileUris values.
Examples of Downloaded Files
https://someAcct.blob.core.windows.net/aContainer/scripts/myscript.ps1
./scripts/myscript.ps1 C:\Packages\Plugins\Microsoft.Compute.CustomScriptExtension\1.8\Downloa
https://someAcct.blob.core.windows.net/aContainer/topLevel.ps1
./topLevel.ps1 C:\Packages\Plugins\Microsoft.Compute.CustomScriptExtension\1.8\Downloa
* As above, the absolute directory paths change over the lifetime of the VM, but not within a single execution of the CustomScript extension.
Support
If you need more help at any point in this article, you can contact the Azure experts on the MSDN Azure and Stack Overflow forums. Alternatively, you can file an
Azure support incident. Go to the Azure support site and select Get support. For information about using Azure Support, read the Microsoft Azure support FAQ.
Run PowerShell scripts in your Windows VM with
Run Command
10/3/2018 • 3 minutes to read • Edit Online
Run Command uses the VM agent to run PowerShell scripts within an Azure Windows VM. These scripts can be
used for general machine or application management, and can be used to quickly diagnose and remediate VM
access and network issues and get the VM back to a good state.
Benefits
There are multiple options that can be used to access your virtual machines. Run Command can run scripts on
your virtual machines remotely using the VM agent. Run Command can be used through the Azure portal, REST
API, or PowerShell for Windows VMs.
This capability is useful in all scenarios where you want to run a script within a virtual machines, and is one of the
only ways to troubleshoot and remediate a virtual machine that doesn't have the RDP or SSH port open due to
improper network or administrative user configuration.
Restrictions
The following restrictions apply when using Run Command:
Output is limited to last 4096 bytes
The minimum time to run a script is about 20 seconds
Scripts run as System on Windows
One script at a time may run
Scripts that prompt for information (interactive mode) are not supported.
You cannot cancel a running script
The maximum time a script can run is 90 minutes, after which it will time out
Outbound connectivity from the VM is required to return the results of the script.
Run a command
Navigate to a VM in Azure and select Run command under OPERATIONS. You are presented with a list of the
available commands to run on the VM.
Choose a command to run. Some of the commands may have optional or required input parameters. For those
commands the parameters are presented as text fields for you to provide the input values. For each command you
can view the script that is being run by expanding View script. RunPowerShellScript is different from the other
commands as it allows you to provide your own custom script.
NOTE
The built-in commands are not editable.
Once the command is chosen, click Run to run the script. The script runs and when complete, returns the output
and any errors in the output window. The following screenshot shows an example output from running the
RDPSettings command.
Commands
This table shows the list of commands available for Windows VMs. The RunPowerShellScript command can be
used to run any custom script you want.
NAME DESCRIPTION
ResetRDPCert Removes the SSL certificate tied to the RDP listener and
restores the RDP listerner security to default. Use this script if
you see any issues with the certificate.
NAME DESCRIPTION
SetRDPPort Sets the default or user specified port number for Remote
Desktop connections. Enables firewall rule for inbound access
to the port.
PowerShell
The following is an example using the Invoke-AzureRmVMRunCommand cmdlet to run a PowerShell script on an
Azure VM.
Next steps
See, Run scripts in your Windows VM to learn about other ways to run scripts and commands remotely in your
VM.
Use the D: drive as a data drive on a Windows VM
1/3/2018 • 2 minutes to read • Edit Online
If your application needs to use the D drive to store data, follow these instructions to use a different drive letter for
the temporary disk. Never use the temporary disk to store data that you need to keep.
If you resize or Stop (Deallocate) a virtual machine, this may trigger placement of the virtual machine to a new
hypervisor. A planned or unplanned maintenance event may also trigger this placement. In this scenario, the
temporary disk will be reassigned to the first available drive letter. If you have an application that specifically
requires the D: drive, you need to follow these steps to temporarily move the pagefile.sys, attach a new data disk
and assign it the letter D and then move the pagefile.sys back to the temporary drive. Once complete, Azure will
not take back the D: if the VM moves to a different hypervisor.
For more information about how Azure uses the temporary disk, see Understanding the temporary drive on
Microsoft Azure Virtual Machines
Next steps
You can increase the storage available to your virtual machine by attaching a additional data disk.
Change the availability set for a Windows VM
10/19/2018 • 2 minutes to read • Edit Online
The following steps describe how to change the availability set of a VM using Azure PowerShell. A VM can only be
added to an availability set when it is created. To change the availability set, you need to delete and then recreate
the virtual machine.
Set-AzureRmVMOSDisk `
-VM $newVM -CreateOption Attach `
-ManagedDiskId $originalVM.StorageProfile.OsDisk.ManagedDisk.Id `
-Name $originalVM.StorageProfile.OsDisk.Name `
-Windows
# Add NIC(s)
foreach ($nic in $originalVM.NetworkProfile.NetworkInterfaces) {
Add-AzureRmVMNetworkInterface `
-VM $newVM `
-Id $nic.Id
}
# Recreate the VM
New-AzureRmVM `
-ResourceGroupName $resourceGroup `
-Location $originalVM.Location `
-VM $newVM `
-DisableBginfoExtension
Next steps
Add additional storage to your VM by adding an additional data disk.
Download the template for a VM
12/1/2017 • 2 minutes to read • Edit Online
When you create a VM in Azure using the portal or PowerShell, a Resource Manager template is automatically
created for you. You can use this template to quickly duplicate a deployment. The template contains information
about all of the resources in a resource group. For a virtual machine, this means the template contains everything
that is created in support of the VM in that resource group, including the networking resources.
Next steps
To learn more about deploying resources using templates, see Resource Manager template walkthrough.
Azure Virtual Machine Agent overview
10/18/2018 • 2 minutes to read • Edit Online
The Microsoft Azure Virtual Machine Agent (VM Agent) is a secure, lightweight process that manages virtual
machine (VM ) interaction with the Azure Fabric Controller. The VM Agent has a primary role in enabling and
executing Azure virtual machine extensions. VM Extensions enable post-deployment configuration of VM, such as
installing and configuring software. VM extensions also enable recovery features such as resetting the
administrative password of a VM. Without the Azure VM Agent, VM extensions cannot be run.
This article details installation, detection, and removal of the Azure Virtual Machine Agent.
"resources": [{
"name": "[parameters('virtualMachineName')]",
"type": "Microsoft.Compute/virtualMachines",
"apiVersion": "2016-04-30-preview",
"location": "[parameters('location')]",
"dependsOn": ["[concat('Microsoft.Network/networkInterfaces/', parameters('networkInterfaceName'))]"],
"properties": {
"osProfile": {
"computerName": "[parameters('virtualMachineName')]",
"adminUsername": "[parameters('adminUsername')]",
"adminPassword": "[parameters('adminPassword')]",
"windowsConfiguration": {
"provisionVmAgent": "false"
}
If you do not have the Agents installed, you cannot use some Azure services, such as Azure Backup or Azure
Security. These services require an extension to be installed. If you have deployed a VM without the WinGA, you
can install the latest version of the agent later.
Manual installation
The Windows VM agent can be manually installed with a Windows installer package. Manual installation may be
necessary when you create a custom VM image that is deployed to Azure. To manually install the Windows VM
Agent, download the VM Agent installer.
The VM Agent can be installed by double-clicking the Windows installer file. For an automated or unattended
installation of the VM agent, run the following command:
msiexec.exe /i WindowsAzureVmAgent.2.7.1198.778.rd_art_stable.160617-1120.fre /quiet
Get-AzureRmVM
The following condensed example output shows the ProvisionVMAgent property nested inside OSProfile. This
property can be used to determine if the VM agent has been deployed to the VM:
OSProfile :
ComputerName : myVM
AdminUsername : myUserName
WindowsConfiguration :
ProvisionVMAgent : True
EnableAutomaticUpdates : True
The following script can be used to return a concise list of VM names and the state of the VM Agent:
$vms = Get-AzureRmVM
Manual Detection
When logged in to a Windows VM, Task Manager can be used to examine running processes. To check for the
Azure VM Agent, open Task Manager, click the Details tab, and look for a process name
WindowsAzureGuestAgent.exe. The presence of this process indicates that the VM agent is installed.
Next steps
For more information about VM extensions, see Azure virtual machine extensions and features overview .
Handling planned maintenance notifications for
Windows virtual machines
7/16/2018 • 11 minutes to read • Edit Online
Azure periodically performs updates to improve the reliability, performance, and security of the host infrastructure
for virtual machines. Updates are changes like patching the hosting environment or upgrading and
decommissioning hardware. A majority of these updates are performed without any impact to the hosted virtual
machines. However, there are cases where updates do have an impact:
If the maintenance does not require a reboot, Azure uses in-place migration to pause the VM while the host
is updated. These non-rebootful maintenance operations are applied fault domain by fault domain, and
progress is stopped if any warning health signals are received.
If maintenance requires a reboot, you get a notice of when the maintenance is planned. In these cases, you
are given a time window where you can start the maintenance yourself, when it works for you.
Planned maintenance that requires a reboot, is scheduled in waves. Each wave has different scope (regions).
A wave starts with a notification to customers. By default, notification is sent to subscription owner and co-
owners. You can add more recipients and messaging options like email, SMS, and Webhooks, to the
notifications using Azure Activity Log Alerts.
At the time of the notification, a self-service window is made available. During this window, you can find which
of your virtual machines are included in this wave and proactively start maintenance according to your own
scheduling needs.
After the self-service window, a scheduled maintenance window begins. At some point during this window,
Azure schedules and applies the required maintenance to your virtual machine.
The goal in having two windows is to give you enough time to start maintenance and reboot your virtual machine
while knowing when Azure will automatically start maintenance.
You can use the Azure portal, PowerShell, REST API, and CLI to query for the maintenance windows for your VMs
and start self-service maintenance.
NOTE
Self-service maintenance might not be available for all of your VMs. To determine if proactive redeploy is available for your
VM, look for the Start now in the maintenance status. Self-service maintenance is currently not available for Cloud Services
(Web/Worker Role) and Service Fabric.
Self-service maintenance is not recommended for deployments using availability sets since these are highly
available setups, where only one update domain is impacted at any given time.
Let Azure trigger the maintenance. For maintenance that requires reboot, be aware that the maintenance will be
done update domain by update domain, that the update domains do not necessarily receive the maintenance
sequentially, and that there is a 30-minute pause between update domains.
If a temporary loss of some of your capacity (1/update domain count) is a concern, it can easily be compensated
for by allocating additional instances during the maintenance period.
For maintenance that does not require reboot, updates are applied at the fault domain level.
Don't use self-service maintenance in the following scenarios:
If you shut down your VMs frequently, either manually, using DevTest Labs, using auto-shutdown, or following
a schedule, it could revert the maintenance status and therefore cause additional downtime.
On short-lived VMs that you know will be deleted before the end of the maintenance wave.
For workloads with a large state stored in the local (ephemeral) disk that is desired to be maintained upon
update.
For cases where you resize your VM often, as it could revert the maintenance status.
If you have adopted scheduled events that enable proactive failover or graceful shutdown of your workload, 15
minutes before start of maintenance shutdown
Use self-service maintenance, if you are planning to run your VM uninterrupted during the scheduled maintenance
phase and none of the counter-indications mentioned above are applicable.
It is best to use self-service maintenance in the following cases:
You need to communicate an exact maintenance window to your management or end-customer.
You need to complete the maintenance by a given date.
You need to control the sequence of maintenance, for example, multi-tier application to guarantee safe recovery.
You need more than 30 minutes of VM recovery time between two update domains (UDs). To control the time
between update domains, you must trigger maintenance on your VMs one update domain (UD ) at a time.
VALUE DESCRIPTION
Retry later You have initiated maintenance with no success. You will
be able to use the self-service maintenance option at a
later time.
Maintenance - Self-service window: Shows the time window when you can self-start maintenance on your
VMs.
Maintenance - Scheduled window: Shows the time window when Azure will maintain your VM in order to
complete maintenance.
VALUE DESCRIPTION
PreMaintenanceWindowEndTime The end of the maintenance self-service window when you can
initiate maintenance on your VM
You can also get the maintenance status for all VMs in a resource group by using Get-AzureRmVM and not
specifying a VM.
The following PowerShell function takes your subscription ID and prints out a list of VMs that are scheduled for
maintenance.
function MaintenanceIterator
{
Select-AzureRmSubscription -SubscriptionId $args[0]
$rgList= Get-AzureRmResourceGroup
Classic deployments
If you still have legacy VMs that were deployed using the classic deployment model, you can use PowerShell to
query for VMs and initiate maintenance.
To get the maintenance status of a VM, type:
FAQ
Q: Why do you need to reboot my virtual machines now?
A: While the majority of updates and upgrades to the Azure platform do not impact virtual machine's availability,
there are cases where we can't avoid rebooting virtual machines hosted in Azure. We have accumulated several
changes that require us to restart our servers that will result in virtual machines reboot.
Q: If I follow your recommendations for High Availability by using an Availability Set, am I safe?
A: Virtual machines deployed in an availability set or virtual machine scale sets have the notion of Update Domains
(UD ). When performing maintenance, Azure honors the UD constraint and will not reboot virtual machines from
different UD (within the same availability set). Azure also waits for at least 30 minutes before moving to the next
group of virtual machines.
For more information about high availability, see Regions and availability for virtual machines in Azure.
Q: How do I get notified about planned maintenance?
A: A planned maintenance wave starts by setting a schedule to one or more Azure regions. Soon after, an email
notification is sent to the subscription owners (one email per subscription). Additional channels and recipients for
this notification could be configured using Activity Log Alerts. In case you deploy a virtual machine to a region
where planned maintenance is already scheduled, you will not receive the notification but rather need to check the
maintenance state of the VM.
Q: I don't see any indication of planned maintenance in the portal, Powershell, or CLI. What is wrong?
A: Information related to planned maintenance is available during a planned maintenance wave only for the VMs
that are going to be impacted by it. In other words, if you see not data, it could be that the maintenance wave has
already completed (or not started) or that your virtual machine is already hosted in an updated server.
Q: Is there a way to know exactly when my virtual machine will be impacted?
A: When setting the schedule, we define a time window of several days. However, the exact sequencing of servers
(and VMs) within this window is unknown. Customers who would like to know the exact time for their VMs can use
scheduled events and query from within the virtual machine and receive a 15-minute notification before a VM
reboot.
Q: How long will it take you to reboot my virtual machine?
A: Depending on the size of your VM, reboot may take up to several minutes during the self-service maintenance
window. During the Azure initiated reboots in the scheduled maintenance window, the reboot will typically take
about 25 minutes. Note that in case you use Cloud Services (Web/Worker Role), Virtual Machine Scale Sets, or
availability sets, you will be given 30 minutes between each group of VMs (UD ) during the scheduled maintenance
window.
Q: What is the experience in the case of Virtual Machine Scale Sets?
A: Planned maintenance is now available for Virtual Machine Scale Sets. For instructions on how to initiate self-
service maintenance refer planned maintenance for VMSS document.
Q: What is the experience in the case of Cloud Services (Web/Worker Role) and Service Fabric?
A: While these platforms are impacted by planned maintenance, customers using these platforms are considered
safe given that only VMs in a single Upgrade Domain (UD ) will be impacted at any given time. Self-service
maintenance is currently not available for Cloud Services (Web/Worker Role) and Service Fabric.
Q: I don’t see any maintenance information on my VMs. What went wrong?
A: There are several reasons why you’re not seeing any maintenance information on your VMs:
1. You are using a subscription marked as Microsoft internal.
2. Your VMs are not scheduled for maintenance. It could be that the maintenance wave has ended, canceled, or
modified so that your VMs are no longer impacted by it.
3. You don’t have the Maintenance column added to your VM list view. While we have added this column to the
default view, customers who configured to see non-default columns must manually add the Maintenance
column to their VM list view.
Q: My VM is scheduled for maintenance for the second time. Why?
A: There are several use cases where you will see your VM scheduled for maintenance after you have already
completed your maintenance-redeploy:
1. We have canceled the maintenance wave and restarted it with a different payload. It could be that we've
detected faulted payload and we simply need to deploy an additional payload.
2. Your VM was service healed to another node due to a hardware fault
3. You have selected to stop (deallocate) and restart the VM
4. You have auto shutdown turned on for the VM
Next steps
Learn how you can register for maintenance events from within the VM using Scheduled Events.
Guidance for mitigating speculative execution side-
channel vulnerabilities in Azure
8/14/2018 • 4 minutes to read • Edit Online
NOTE
Since this document was first published, multiple variants of this vulnerability class have been disclosed. Microsoft continues
to be heavily invested in protecting our customers and providing guidance. This page will be updated as we continue to
release further fixes.
On August 14, 2018, the industry disclosed a new speculative execution side channel vulnerability known as L1 Terminal Fault
(L1TF) which has been assigned multiple CVEs (CVE-2018-3615, CVE-2018-3620, and CVE-2018-3646). This vulnerability
affects Intel® Core® processors and Intel® Xeon® processors. Microsoft has deployed mitigations across our cloud services
which reinforce the isolation between customers. Please read below for additional guidance to protect against L1TF and
previous vulnerabilities (Spectre Variant 2 CVE-2017-5715 and Meltdown Variant 3 CVE-2017-5754).
Azure Cloud Services Enable auto update or ensure you are running the newest
Guest OS.
Azure Linux Virtual Machines Install updates from your operating system provider. For more
information, see Linux later in this document.
Other Azure PaaS Services There is no action needed for customers using these services.
Azure automatically keeps your OS versions up-to-date.
NOTE
If you previously downloaded this module, you will need to install the newest version.
L1TFWindowsSupportEnabled: True
Linux
Enabling the set of additional security features inside requires that the target operating system be fully up-to-date.
Some mitigations will be enabled by default. The following section describes the features which are off by default
and/or reliant on hardware support (microcode). Enabling these features may cause a performance impact.
Reference your operating system provider’s documentation for further instructions
Step 1: Contact Azure Support to expose updated firmware (microcode) into your Virtual Machines.
Step 2: Enable Branch Target Injection (BTI) OS support to mitigate CVE -2017-5715 (Spectre Variant 2) by
following your operating system provider’s documentation.
Step 3: Enable Kernel Page Table Isolation (KPTI) to mitigate CVE -2017-5754 (Meltdown Variant 3) by following
your operating system provider’s documentation.
More information is available from your operating system’s provider:
Redhat and CentOS
Suse
Ubuntu
Next steps
To learn more, see Securing Azure customers from CPU vulnerability.
Azure Metadata Service: Scheduled Events for
Windows VMs
8/23/2018 • 6 minutes to read • Edit Online
Scheduled Events is an Azure Metadata Service that gives your application time to prepare for virtual machine
maintenance. It provides information about upcoming maintenance events (e.g. reboot) so your application can
prepare for them and limit disruption. It is available for all Azure Virtual Machine types including PaaS and IaaS
on both Windows and Linux.
For information about Scheduled Events on Linux, see Scheduled Events for Linux VMs.
NOTE
Scheduled Events is generally available in all Azure Regions. See Version and Region Availability for latest release information.
The Basics
Azure Metadata service exposes information about running Virtual Machines using a REST Endpoint accessible
from within the VM. The information is available via a non-routable IP so that it is not exposed outside the VM.
Endpoint Discovery
For VNET enabled VMs, the metadata service is available from a static non-routable IP, 169.254.169.254 . The full
endpoint for the latest version of Scheduled Events is:
http://169.254.169.254/metadata/scheduledevents?api-version=2017-08-01
If the Virtual Machine is not created within a Virtual Network, the default cases for cloud services and classic VMs,
additional logic is required to discover the IP address to use. Refer to this sample to learn how to discover the host
endpoint.
Version and Region Availability
The Scheduled Events Service is versioned. Versions are mandatory and the current version is 2017-08-01 .
NOTE
Previous preview releases of scheduled events supported {latest} as the api-version. This format is no longer supported and
will be deprecated in the future.
A response contains an array of scheduled events. An empty array means that there are currently no events
scheduled. In the case where there are scheduled events, the response contains an array of events:
{
"DocumentIncarnation": {IncarnationID},
"Events": [
{
"EventId": {eventID},
"EventType": "Reboot" | "Redeploy" | "Freeze",
"ResourceType": "VirtualMachine",
"Resources": [{resourceName}],
"EventStatus": "Scheduled" | "Started",
"NotBefore": {timeInUTC},
}
]
}
Event Properties
PROPERTY DESCRIPTION
Example:
602d9444-d2cd-49c7-8624-8643e7171297
Values:
Freeze : The Virtual Machine is scheduled to pause
for few seconds. The CPU is suspended, but there is no
impact on memory, open files, or network connections.
Reboot : The Virtual Machine is scheduled for reboot
(non-persistent memory is lost).
Redeploy : The Virtual Machine is scheduled to move
to another node (ephemeral disks are lost).
Values:
VirtualMachine
Example:
["FrontEnd_IN_0", "BackEnd_IN_0"]
Values:
Scheduled : This event is scheduled to start after the
time specified in the NotBefore property.
Started : This event has started.
Example:
Mon, 19 Sep 2016 18:29:47 GMT
Event Scheduling
Each event is scheduled a minimum amount of time in the future based on event type. This time is reflected in an
event's NotBefore property.
Freeze 15 minutes
Reboot 15 minutes
Redeploy 10 minutes
Event Scope
Scheduled events are delivered to:
All Virtual Machines in a Cloud Service
All Virtual Machines in an Availability Set
All Virtual Machines in a Scale Set Placement Group.
As a result, you should check the Resources field in the event to identify which VMs are going to be impacted.
Starting an event
Once you have learned of an upcoming event and completed your logic for graceful shutdown, you can approve
the outstanding event by making a POST call to the metadata service with the EventId . This indicates to Azure
that it can shorten the minimum notification time (when possible).
The following is the json expected in the POST request body. The request should contain a list of StartRequests .
Each StartRequest contains the EventId for the event you want to expedite:
{
"StartRequests" : [
{
"EventId": {EventId}
}
]
}
Powershell
PowerShell sample
The following sample queries the metadata service for scheduled events and approves each outstanding event.
function Handle-ScheduledEvents($scheduledEvents)
{
# Add logic for handling events here
}
# Get events
$scheduledEvents = Get-ScheduledEvents $scheduledEventURI
The Azure Instance Metadata Service provides information about running virtual machine instances that can be
used to manage and configure your virtual machines. This includes information such as SKU, network
configuration, and upcoming maintenance events. For more information on what type of information is available,
see metadata categories.
Azure's Instance Metadata Service is a REST Endpoint accessible to all IaaS VMs created via the Azure Resource
Manager. The endpoint is available at a well-known non-routable IP address ( 169.254.169.254 ) that can be
accessed only from within the VM.
IMPORTANT
This service is generally available in all Azure Regions. It regularly receives updates to expose new information about
virtual machine instances. This page reflects the up-to-date data categories available.
Service availability
The service is available in generally available Azure regions. Not all API version may be available in all Azure
Regions.
All Generally Available Global Azure Generally Available 2017-04-02, 2017-08-01, 2017-12-01,
Regions 2018-02-01, 2018-04-02
This table is updated when there are service updates and or new supported versions are available
To try out the Instance Metadata Service, create a VM from Azure Resource Manager or the Azure portal in the
above regions and follow the examples below.
Usage
Versioning
The Instance Metadata Service is versioned. Versions are mandatory and the current version on Global Azure is
2018-04-02 . Current supported versions are (2017 -04 -02, 2017 -08 -01, 2017 -12 -01, 2018 -02 -01, 2018 -04 -02 )
NOTE
Previous preview releases of scheduled events supported {latest} as the api-version. This format is no longer supported and
will be deprecated in the future.
As newer versions are added, older versions can still be accessed for compatibility if your scripts have
dependencies on specific data formats. However, the previous preview version (2017-03-01) may not be available
once the service is generally available.
Using headers
When you query the Instance Metadata Service, you must provide the header Metadata: true to ensure the
request was not unintentionally redirected.
Retrieving metadata
Instance metadata is available for running VMs created/managed using Azure Resource Manager. Access all data
categories for a virtual machine instance using the following request:
NOTE
All instance metadata queries are case-sensitive.
Data output
By default, the Instance Metadata Service returns data in JSON format ( Content-Type: application/json ).
However, different APIs return data in different formats if requested. The following table is a reference of other
data formats APIs may support.
To access a non-default response format, specify the requested format as a querystring parameter in the request.
For example:
Security
The Instance Metadata Service endpoint is accessible only from within the running virtual machine instance on a
non-routable IP address. In addition, any request with a X-Forwarded-For header is rejected by the service.
Requests must also contain a Metadata: true header to ensure that the actual request was directly intended and
not a part of unintentional redirection.
Error
If there is a data element not found or a malformed request, the Instance Metadata Service returns standard HTTP
errors. For example:
HTTP STATUS CODE REASON
200 OK
405 Method Not Allowed Only GET and POST requests are supported
429 Too Many Requests The API currently supports a maximum of 5 queries per
second
Examples
NOTE
All API responses are JSON strings. All following example responses are pretty-printed for readability.
Response
NOTE
The response is a JSON string. The following example response is pretty-printed for readability.
{
"interface": [
{
"ipv4": {
"ipAddress": [
{
"privateIpAddress": "10.1.0.4",
"publicIpAddress": "X.X.X.X"
}
],
"subnet": [
{
"address": "10.1.0.0",
"prefix": "24"
}
]
},
"ipv6": {
"ipAddress": []
},
"macAddress": "000D3AF806EC"
}
]
}
Retrieving public IP address
curl -H Metadata:true
"http://169.254.169.254/metadata/instance/network/interface/0/ipv4/ipAddress/0/publicIpAddress?api-
version=2017-08-01&format=text"
Response
NOTE
The response is a JSON string. The following example response is pretty-printed for readability.
{
"compute": {
"location": "westus",
"name": "avset2",
"offer": "UbuntuServer",
"osType": "Linux",
"placementGroupId": "",
"platformFaultDomain": "1",
"platformUpdateDomain": "1",
"publisher": "Canonical",
"resourceGroupName": "myrg",
"sku": "16.04-LTS",
"subscriptionId": "xxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxx",
"tags": "",
"version": "16.04.201708030",
"vmId": "13f56399-bd52-4150-9748-7190aae1ff21",
"vmScaleSetName": "",
"vmSize": "Standard_D1",
"zone": "1"
},
"network": {
"interface": [
{
"ipv4": {
"ipAddress": [
{
"privateIpAddress": "10.1.2.5",
"publicIpAddress": "X.X.X.X"
}
],
"subnet": [
{
"address": "10.1.2.0",
"prefix": "24"
}
]
},
"ipv6": {
"ipAddress": []
},
"macAddress": "000D3A36DDED"
}
]
}
}
Response
NOTE
The response is a JSON string. The following example response is pretty-printed for readability.
{
"compute": {
"location": "westus",
"name": "SQLTest",
"offer": "SQL2016SP1-WS2016",
"osType": "Windows",
"platformFaultDomain": "0",
"platformUpdateDomain": "0",
"publisher": "MicrosoftSQLServer",
"sku": "Enterprise",
"version": "13.0.400110",
"vmId": "453945c8-3923-4366-b2d3-ea4c80e9b70e",
"vmSize": "Standard_DS2"
},
"network": {
"interface": [
{
"ipv4": {
"ipAddress": [
{
"privateIpAddress": "10.0.1.4",
"publicIpAddress": "X.X.X.X"
}
],
"subnet": [
{
"address": "10.0.1.0",
"prefix": "24"
}
]
},
"ipv6": {
"ipAddress": [
]
},
"macAddress": "002248020E1E"
}
]
}
}
Response
5c08b38e-4d57-4c23-ac45-aca61037f084
Response
Response
NOTE
The response is a JSON string. The following example response is pretty-printed for readability.
{
"compute": {
"location": "CentralUS",
"name": "IMDSCanary",
"offer": "RHEL",
"osType": "Linux",
"platformFaultDomain": "0",
"platformUpdateDomain": "0",
"publisher": "RedHat",
"sku": "7.2",
"version": "7.2.20161026",
"vmId": "5c08b38e-4d57-4c23-ac45-aca61037f084",
"vmSize": "Standard_DS2"
}
}
$environment = "Unknown"
switch ($cloudName) {
"public" { $environment = "AzureCloud"}
"usGovCloud" { $environment = "AzureUSGovernment"}
"chinaCloud" { $environment = "AzureChinaCloud"}
"germanCloud" { $environment = "AzureGermanCloud"}
}
Write-Host $environment
Ruby https://github.com/Microsoft/azureimds/blob/master/IMDSSa
mple.rb
LANGUAGE EXAMPLE
Go https://github.com/Microsoft/azureimds/blob/master/imdssam
ple.go
Python https://github.com/Microsoft/azureimds/blob/master/IMDSSa
mple.py
C++ https://github.com/Microsoft/azureimds/blob/master/IMDSSa
mple-windows.cpp
C# https://github.com/Microsoft/azureimds/blob/master/IMDSSa
mple.cs
JavaScript https://github.com/Microsoft/azureimds/blob/master/IMDSSa
mple.js
PowerShell https://github.com/Microsoft/azureimds/blob/master/IMDSSa
mple.ps1
Bash https://github.com/Microsoft/azureimds/blob/master/IMDSSa
mple.sh
Perl https://github.com/Microsoft/azureimds/blob/master/IMDSSa
mple.pl
Java https://github.com/Microsoft/azureimds/blob/master/imdssam
ple.java
Puppet https://github.com/keirans/azuremetadata
FAQ
1. I am getting the error 400 Bad Request, Required metadata header not specified . What does this mean?
The Instance Metadata Service requires the header Metadata: true to be passed in the request. Passing
this header in the REST call allows access to the Instance Metadata Service.
2. Why am I not getting compute information for my VM?
Currently the Instance Metadata Service only supports instances created with Azure Resource Manager.
In the future, support for Cloud Service VMs might be added.
3. I created my Virtual Machine through Azure Resource Manager a while back. Why am I not see compute
metadata information?
For any VMs created after Sep 2016, add a Tag to start seeing compute metadata. For older VMs
(created before Sep 2016), add/remove extensions or data disks to the VM to refresh metadata.
4. I am not seeing all data populated for new version
For any VMs created after Sep 2016, add a Tag to start seeing compute metadata. For older VMs
(created before Sep 2016), add/remove extensions or data disks to the VM to refresh metadata.
5. Why am I getting the error 500 Internal Server Error ?
Retry your request based on exponential back off system. If the issue persists contact Azure support.
6. Where do I share additional questions/comments?
Send your comments on http://feedback.azure.com.
7. Would this work for Virtual Machine Scale Set Instance?
Yes Metadata service is available for Scale Set Instances.
8. How do I get support for the service?
To get support for the service, create a support issue in Azure portal for the VM where you are not able
to get metadata response after long retries
9. I get request timed out for my call to the service?
Metadata calls must be made from the primary IP address assigned to the network card of the VM , in
addition in case you have changed your routes there must be a route for 169.254.0.0/16 address out of
your network card.
10. I updated my tags in Virutal Machine Scale set but they dont appear in the instances unlike VMs?
Currently for ScaleSets tags only show to the VM on a reboot/reimage/or a disk change to the instance.
Next steps
Learn more about Scheduled Events
How to enable nested virtualization in an Azure VM
10/19/2018 • 5 minutes to read • Edit Online
Nested virtualization is supported in several Azure virtual machine families. This capability provides great flexibility
in supporting scenarios such as development, testing, training, and demonstration environments.
This article steps through enabling Hyper-V on an Azure VM and configuring Internet connectivity to that guest
virtual machine.
NOTE
For detailed instructions on creating a new virtual machine, see Create and Manage Windows VMs with the Azure PowerShell
module
WARNING
This command restarts the Azure VM. You will lose your RDP connection during the restart process.
3. View the properties of the switch and note the ifIndex for the new adapter.
Get-NetAdapter
NOTE
Take note of the "ifIndex" for the virtual switch you just created.
NOTE
You need installation media for an operating system to install on the VM. In this case we are using Windows 10
Enterprise.
Prepay for virtual machines and save money with Azure Reserved Virtual Machine (VM ) Instances. For more
information, see Azure Reserved VM Instances offering.
You can buy a Reserved VM Instance in the Azure portal. To buy an instance:
You must be in an Owner role for at least one Enterprise or Pay-As-You-Go subscription.
For Enterprise subscriptions, reservation purchases must be enabled in the EA portal.
For the Cloud Solution Provider (CSP ) program, only the admin agents or sales agents can buy reservations.
FIELD DESCRIPTION
5. You can view the cost of the reservation when you select Calculate cost.
6. Select Purchase.
7. Select View this Reservation to see the status of your purchase.
Next steps
The reservation discount is applied automatically to the number of running virtual machines that match the
reservation scope and attributes. You can update the scope of the reservation through Azure portal, PowerShell,
CLI, or through the API.
To learn how to manage a reservation, see Manage Azure Reservations.
To learn more about Azure Reservations, see the following articles:
What are Azure Reservations?
Manage Reservations in Azure
Understand how the reservation discount is applied
Understand reservation usage for your Pay-As-You-Go subscription
Understand reservation usage for your Enterprise enrollment
Windows software costs not included with reservations
Azure Reservations in Partner Center Cloud Solution Provider (CSP ) program
Azure Reservations helps you save money by pre-paying for one-year or three-years of virtual machine, SQL
Database compute capacity, Azure Cosmos DB throughput, or other Azure resources. Pre-paying allows you to get
a discount on the resources you use. Reservations can significantly reduce your virtual machine, SQL database
compute, Azure Cosmos DB, or other resource costs up to 72% on pay-as-you-go prices. Reservations provide a
billing discount and don't affect the runtime state of your resources.
You can buy a reservation in the Azure portal. For more information, see the following topics:
Prepay for Virtual Machines with Azure Reserved VM Instances
Prepay for SQL Database compute resources with Azure SQL Database reserved capacity
Prepay for Azure Cosmos DB resources with Azure Cosmos DB reserved capacity
Next steps
Start saving on your virtual machines by purchasing a Reserved VM Instance, SQL Database reserved capacity, or
Azure Cosmos DB reserved capacity.
To learn more about Azure Reservations, see the following articles:
Manage Azure Reservations
Understand reservation usage for your Pay-As-You-Go subscription
Understand reservation usage for your Enterprise enrollment
Windows software costs not included with reservations
Azure Reservations in Partner Center Cloud Solution Provider (CSP ) program
With a reserved virtual machine instance that's optimized for instance size flexibility, the reservation you buy can
apply to the virtual machines (VMs) sizes in the same size series group. For example, if you buy a reservation for a
VM size that's listed in the DSv2-series table, like Standard_DS5_v2, the reservation discount can apply to the other
four sizes that are listed in that same table:
Standard_DS1_v2
Standard_DS2_v2
Standard_DS3_v2
Standard_DS4_v2
But that reservation discount doesn't apply to VMs sizes that are listed in different tables, like what's in the DSv2-
series high memory table: Standard_DS11_v2, Standard_DS12_v2, and so on.
Within the size series group, the number of VMs the reservation discount applies to depends on the VM size you
pick when you buy a reservation. It also depends on the sizes of the VMs that you have running. The ratio column
that's listed in the following tables compares the relative footprint for each VM size in that group. Use the ratio
value to calculate how the reservation discount applies to the VMs you have running.
Examples
The following examples use the sizes and ratios in the DSv2-series table.
You buy a reserved VM instance with the size Standard_DS4_v2 where the ratio or relative footprint compared to
the other sizes in that series is 8.
Scenario 1: Run eight Standard_DS1_v2 sized VMs with a ratio of 1. Your reservation discount applies to all
eight of those VMs.
Scenario 2: Run two Standard_DS2_v2 sized VMs with a ratio of 2 each. Also run a Standard_DS3_v2 sized VM
with a ratio of 4. The total footprint is 2+2+4=8. So your reservation discount applies to all three of those VMs.
Scenario 3: Run one Standard_DS5_v2 with a ratio of 16. Your reservation discount applies to half that VM's
compute cost.
The following sections show what sizes are in the same size series group when you buy a reserved VM instance
optimized for instance size flexibility.
B-series
SIZE RATIO
Standard_B1s 1
Standard_B2s 4
Standard_B1ms 1
Standard_B2ms 4
Standard_B4ms 8
Standard_B8ms 16
D-series
SIZE RATIO
Standard_D1 1
Standard_D2 2
Standard_D3 4
Standard_D4 8
Standard_D11 1
Standard_D12 2
Standard_D13 4
Standard_D14 8
Ds-series
SIZE RATIO
Standard_DS1 1
Standard_DS2 2
Standard_DS3 4
SIZE RATIO
Standard_DS4 8
Standard_DS11 1
Standard_DS12 2
Standard_DS13 4
Standard_DS14 8
DSv2-series
SIZE RATIO
Standard_DS1_v2 1
Standard_DS2_v2 2
Standard_DS3_v2 4
Standard_DS4_v2 8
Standard_DS5_v2 16
Standard_DS11_v2 1
Standard_DS12_v2 2
Standard_DS13_v2 4
Standard_DS14_v2 8
Standard_DS15_v2 10
Standard_D2s_v3 1
Standard_D4s_v3 2
Standard_D8s_v3 4
Standard_D16s_v3 8
Standard_D32s_v3 16
Standard_D64s_v3 32
Dv2-series
SIZE RATIO
Standard_D1_v2 1
Standard_D2_v2 2
Standard_D3_v2 4
Standard_D4_v2 8
Standard_D5_v2 16
Standard_D11_v2 1
Standard_D12_v2 2
Standard_D13_v2 4
Standard_D14_v2 8
Standard_D15_v2 10
Dv3-series
SIZE RATIO
Standard_D2_v3 1
Standard_D4_v3 2
Standard_D8_v3 4
Standard_D16_v3 8
Standard_D32_v3 16
Standard_D64_v3 32
ESv3-series
SIZE RATIO
Standard_E2s_v3 1
Standard_E4s_v3 2
Standard_E8s_v3 4
Standard_E16s_v3 8
Standard_E32s_v3 16
Standard_E64s_v3 32
Ev3-series
SIZE RATIO
Standard_E2_v3 1
Standard_E4_v3 2
Standard_E8_v3 4
Standard_E16_v3 8
Standard_E32_v3 16
Standard_E64_v3 32
Standard_F1 1
Standard_F2 2
Standard_F4 4
Standard_F8 8
Standard_F16 16
FS-series
SIZE RATIO
Standard_F1s 1
Standard_F2s 2
Standard_F4s 4
Standard_F8s 8
Standard_F16s 16
Fsv2-series
SIZE RATIO
Standard_F2s_v2 1
Standard_F4s_v2 2
Standard_F8s_v2 4
Standard_F16s_v2 8
Standard_F32s_v2 16
Standard_F64s_v2 32
Standard_F72s_v2 36
Standard_H8 1
Standard_H16 2
Standard_H8m 1
Standard_H16m 2
Ls-series
SIZE RATIO
Standard_L4s 1
Standard_L8s 2
Standard_L16s 4
Standard_L32s 8
M-series
SIZE RATIO
Standard_M64s 1
Standard_M128s 2
M-series fractional
SIZE RATIO
Standard_M16s 1
Standard_M32s 2
For more information, see Memory optimized virtual machine sizes.
Standard_M8ms 1
Standard_M16ms 2
Standard_M32ms 4
Standard_M32ls 1
Standard_M64ls 2
Standard_M64ms 1
Standard_M128ms 2
NC-series
SIZE RATIO
Standard_NC6 1
Standard_NC12 2
Standard_NC24 4
NCv2-series
SIZE RATIO
Standard_NC6s_v2 1
SIZE RATIO
Standard_NC12s_v2 2
Standard_NC24s_v2 4
NCv3-series
SIZE RATIO
Standard_NC6s_v3 1
Standard_NC12s_v3 2
Standard_NC24s_v3 4
ND-series
SIZE RATIO
Standard_ND6s 1
Standard_ND12s 2
Standard_ND24s 4
NV-series
SIZE RATIO
Standard_NV6 1
Standard_NV12 2
Standard_NV24 4
Shared Image Gallery is a service that helps you build structure and organization around your custom VM images.
Shared Image Gallery provides three main value propositions
Simple management
Scale your customer images
Share your images - share your images to different users, service principals, or AD groups within your
organization as well as different regions using the multi-region replication
A managed image is a copy of either a full VM (including any attached data disks) or just the OS disk, depending
on how you create the image. When you create a VM from the image, the copy of the VHDs in the image are used
to create the disks for the new VM. The managed image remains in storage and can be used over and over again to
create new VMs.
If you have a large number of managed images that you need to maintain and would like to make them available
throughout your company, you can use a shared image gallery as a repository that makes it easy to update and
share your images. The charges for using a shared image gallery are just the costs for the storage used by the
images, plus any network egress costs for replicating images from the source region to the published regions.
The Shared Image Gallery feature has multiple resource types:
RESOURCE DESCRIPTION
Managed image This is a baseline image that can be used alone or used to
create multiple shared image versions in an image gallery.
Gallery image Images are defined within a gallery and carry information
about the image and requirements for using it internally. This
includes whether the image is Windows or Linux, release
notes, and minimum and maximum memory requirements.
This type of image is a resource within the Resource Manager
deployment model, but it isn't used directly for creating VMs.
It is a definition of a type of image.
Shared image version An image version is what you use to create a VM when
using a gallery. You can have multiple versions of an image as
needed for your environment. Like a managed image, when
you use an image version to create a VM, the image version
is used to create new disks for the VM. Image versions can be
used multiple times.
Regional Support
Regional support for shared image galleries is limited, but will expand over time. For preview, here are the lists of
where you can create galleries and regions where can replicate any gallery:
East US 2 East US
Central US
North Central US
Canada Central
Canada East
North Europe
West Europe
South India
Southeast Asia
Scaling
Shared Image Gallery allows you to specify the number of replicas you want Azure to keep for the images. This
helps in multi-VM deployment scenarios as the VM deployments can be spread to different replicas reducing the
chance of instance creation process being throttled due to overloading of a single replica.
Replication
Shared Image Gallery also allows you to replicate your images to other Azure regions automatically. Each Shared
image version can be replicated to different regions depending on what makes sense for your organization. One
example is to always replicate the latest image in multi-regions while all older versions are only available in 1
region. This can help save on storage costs for Shared image versions. The regions a Shared image version is
replicated to can be updated after creation time. The time it takes to replicate to different regions depends on the
amount of data being copied and the number of regions the version is replicate to. This can take few hours in some
cases. While the replication is happening, you can view the status of replication per region. Once the image
replication is complete in a region, you can then deploy a VM or VMSS using that version in the region.
Access
As the shared image gallery, shared image and shared image version are all resources, they can be shared using
the built-in native Azure RBAC controls. Using RBAC you can share these resources to other users, service
principals, and groups in your organization. The scope of sharing these resources is within the same AD tenant.
Once a user has access to the Shared image version, they can deploy a VM or a virtual machine scale set in any of
the subscriptions they have access to within the same AD tenant as the Shared image version. Here is the sharing
matrix that helps understand what the user gets access to:
SHARED WITH USER SHARED IMAGE GALLERY SHARED IMAGE SHARED IMAGE VERSION
Billing
There is no extra charge for using the Shared Image Gallery service. You will be charged for the following
resources:
Storage costs of storing the Shared image versions. This depends on the number of replicas of the version and
the number of regions the version is replicated to.
Network egress charges for replication from source region of the version to the replicated regions.
PowerShell:
Q. How can I list all the Shared Image Gallery resources across subscriptions?
A. In order to list all the Shared Image Gallery resources across subscriptions that you have access to on the Azure
portal, follow the steps below:
1. Open the Azure portal.
2. Go to All Resources.
3. Select all the subscriptions under which you’d like to list all the resources.
4. Look for resources of type Private gallery.
To see the image definitions and image versions, you should also select Show hidden types.
To list all the shared image gallery resources across subscriptions that you have permissions to, use the
following command in the Azure CLI:
Next steps
Learn how to deploy shared images using Azure CLI.
Preview: Create a shared image gallery with the
Azure CLI
9/24/2018 • 4 minutes to read • Edit Online
The Shared Image Gallery greatly simplifies custom image sharing across your organization. Custom images are
like marketplace images, but you create them yourself. Custom images can be used to bootstrap configurations
such as preloading applications, application configurations, and other OS configurations. The Shared Image
Gallery lets you share your custom VM images with others in your organization, within or across regions, within an
AAD tenant. Choose which images you want to share, which regions you want to make them available in, and who
you want to share them with. You can create multiple galleries so that you can logically group shared images. The
gallery is a top-level resource that provides full role-based access control (RBAC ). Images can be versioned, and
you can choose to replicate each image version to a different set of Azure regions. The gallery only works with
Managed Images.
In this article, you create your own gallery and custom images of an Azure virtual machine. You learn how to:
Create a shared image gallery
Create a shared image definition
Create a shared image version
Create a VM from a shared image
Delete a resources
If you choose to install and use the CLI locally, this article requires that you are running the Azure CLI version
2.0.46 or later. Run az --version to find the version. If you need to install or upgrade, see Install Azure CLI 2.0.
It might take a few minutes to register the feature. You can check the progress using:
Create a VM
Create a VM from the image version using az vm create.
az vm create\
-g myGalleryRG \
-n myVM \
--image "/subscriptions/<subscription-
ID>/resourceGroups/myGalleryRG/providers/Microsoft.Compute/galleries/myGallery/images/myImageDefinition/versio
ns/1.0.0" \
--generate-ssh-keys
List information
Get the location, status and other information about the available image galleries using az sig list.
List the image definitions in a gallery, including information about OS type and status, using az sig image-
definition list.
List the shared image versions in a gallery, using az sig image-version list.
Next steps
For more information about Shared Image Galleries, see the Overview.
Troubleshooting shared image galleries
9/24/2018 • 3 minutes to read • Edit Online
If you run into issues while performing any operations on shared image galleries, image definitions, and image
versions, run the failing command again in debug mode. Debug mode is activated by passing the -debug switch
with CLI and the -Debug switch with PowerShell. Once you’ve located the error, follow this document to
troubleshoot the errors.
South Central US
East US 2
Southeast Asia
West Europe
The target region list must include the source region of the image version. Make sure you have included the source
region in the list of target regions where you want Azure to replicate your image version to.
Replication to all the target regions not completed.
Use the --expand ReplicationStatus flag to check if the replication to all the specified target regions has been
completed. If not, wait up to 6 hours for the job to complete. If it fails, run the command again to create and
replicate the image version. If there are a lot of target regions the image version is being replicated to, consider
doing the replication in phases.
Replication is slow
Use the --expand ReplicationStatus flag to check if the replication to all the specified target regions has been
completed. If not, wait for up to 6 hours for the job to complete. If it fails, trigger the command again to create and
replicate the image version. If there are a lot of target regions the image version is being replicated to, consider
doing the replication in phases.
Next steps
Learn more about shared image galleries.
Find Windows VM images in the Azure Marketplace
with Azure PowerShell
10/18/2018 • 6 minutes to read • Edit Online
This article describes how to use Azure PowerShell to find VM images in the Azure Marketplace. You can then
specify a Marketplace image when you create a VM programmatically with PowerShell, Resource Manager
templates, or other tools.
You can also browse available images and offers using the Azure Marketplace storefront, the Azure portal, or the
Azure CLI.
Make sure that you've installed and configured the latest Azure PowerShell module.
Terminology
A Marketplace image in Azure has the following attributes:
Publisher: The organization that created the image. Examples: Canonical, MicrosoftWindowsServer
Offer: The name of a group of related images created by a publisher. Examples: Ubuntu Server, WindowsServer
SKU: An instance of an offer, such as a major release of a distribution. Examples: 16.04-LTS, 2016-Datacenter
Version: The version number of an image SKU.
To identify a Marketplace image when you deploy a VM programmatically, supply these values individually as
parameters. Some tools accept an image URN, which combines these values, separated by the colon (:) character:
Publisher:Offer:Sku:Version. In a URN, you can replace the version number with "latest", which selects the latest
version of the image.
If the image publisher provides additional license and purchase terms, then you must accept those terms and
enable programmatic deployment. You'll also need to supply purchase plan parameters when deploying a VM
programmatically. See Deploy an image with Marketplace terms.
$pubName="<publisher>"
Get-AzureRMVMImageOffer -Location $locName -Publisher $pubName | Select Offer
$offerName="<offer>"
Get-AzureRMVMImageSku -Location $locName -Publisher $pubName -Offer $offerName | Select Skus
4. Fill in your chosen SKU name and get the image version:
$skuName="<SKU>"
Get-AzureRMVMImage -Location $locName -Publisher $pubName -Offer $offerName -Sku $skuName | Select
Version
From the output of the Get-AzureRMVMImage command, you can select a version image to deploy a new virtual
machine.
The following example shows the full sequence of commands and their outputs:
$locName="West US"
Get-AzureRMVMImagePublisher -Location $locName | Select PublisherName
Partial output:
PublisherName
-------------
...
a10networks
aiscaler-cache-control-ddos-and-url-rewriting-
alertlogic
AlertLogic.Extension
Barracuda.Azure.ConnectivityAgent
barracudanetworks
basho
boxless
bssw
Canonical
...
$pubName="MicrosoftWindowsServer"
Get-AzureRMVMImageOffer -Location $locName -Publisher $pubName | Select Offer
Output:
Offer
-----
Windows-HUB
WindowsServer
WindowsServerSemiAnnual
$offerName="WindowsServer"
Get-AzureRMVMImageSku -Location $locName -Publisher $pubName -Offer $offerName | Select Skus
Output:
Skus
----
2008-R2-SP1
2008-R2-SP1-smalldisk
2012-Datacenter
2012-Datacenter-smalldisk
2012-R2-Datacenter
2012-R2-Datacenter-smalldisk
2016-Datacenter
2016-Datacenter-Server-Core
2016-Datacenter-Server-Core-smalldisk
2016-Datacenter-smalldisk
2016-Datacenter-with-Containers
2016-Datacenter-with-RDSH
$skuName="2016-Datacenter"
Get-AzureRMVMImage -Location $locName -Publisher $pubName -Offer $offerName -Sku $skuName | Select Version
Now you can combine the selected publisher, offer, SKU, and version into a URN (values separated by :). Pass this
URN with the --image parameter when you create a VM with the New -AzureRmVM cmdlet. You can optionally
replace the version number in the URN with "latest" to get the latest version of the image.
If you deploy a VM with a Resource Manager template, then you'll set the image parameters individually in the
imageReference properties. See the template reference.
$version = "2016.127.20170406"
Get-AzureRMVMImage -Location $locName -Publisher $pubName -Offer $offerName -Skus $skuName -Version $version
Output:
Id : /Subscriptions/xxxxxxxx-xxxx-xxxx-xxxx-
xxxxxxxxxxxx/Providers/Microsoft.Compute/Locations/westus/Publishers/MicrosoftWindowsServer/ArtifactTypes/VMIm
age/Offers/WindowsServer/Skus/2016-Datacenter/
Versions/2016.127.20170406
Location : westus
PublisherName : MicrosoftWindowsServer
Offer : WindowsServer
Skus : 2016-Datacenter
Version : 2016.127.20170406
FilterExpression :
Name : 2016.127.20170406
OSDiskImage : {
"operatingSystem": "Windows"
}
PurchasePlan : null
DataDiskImages : []
The example below shows a similar command for the Data Science Virtual Machine - Windows 2016 image, which
has the following PurchasePlan properties: name , product , and publisher . Some images also have a
promotion code property. To deploy this image, see the following sections to accept the terms and to enable
programmatic deployment.
Id : /Subscriptions/xxxxxxxx-xxxx-xxxx-xxxx-
xxxxxxxxxxxx/Providers/Microsoft.Compute/Locations/westus/Publishers/microsoft-ads/ArtifactTypes/VMIma
ge/Offers/windows-data-science-vm/Skus/windows2016/Versions/0.2.02
Location : westus
PublisherName : microsoft-ads
Offer : windows-data-science-vm
Skus : windows2016
Version : 0.2.02
FilterExpression :
Name : 0.2.02
OSDiskImage : {
"operatingSystem": "Windows"
}
PurchasePlan : {
"publisher": "microsoft-ads",
"name": "windows2016",
"product": "windows-data-science-vm"
}
DataDiskImages : []
Output:
Publisher : microsoft-ads
Product : windows-data-science-vm
Plan : windows2016
LicenseTextLink :
https://storelegalterms.blob.core.windows.net/legalterms/3E5ED_legalterms_MICROSOFT%253a2DADS%253a24WINDOWS%25
3a2DDATA%253a2DSCIENCE%253a2DV
M%253a24WINDOWS2016%253a24OC5SKMQOXSED66BBSNTF4XRCS4XLOHP7QMPV54DQU7JCBZWYFP35IDPOWTUKXUC7ZAG7W6ZMDD6NHWNKUIVS
YBZUTZ245F44SU5AD7Q.txt
PrivacyPolicyLink : https://www.microsoft.com/EN-US/privacystatement/OnlineServices/Default.aspx
Signature :
2UMWH6PHSAIM4U22HXPXW25AL2NHUJ7Y7GRV27EBL6SUIDURGMYG6IIDO3P47FFIBBDFHZHSQTR7PNK6VIIRYJRQ3WXSE6BTNUNENXA
Accepted : False
Signdate : 2/23/2018 7:43:00 PM
Use the Set-AzureRmMarketplaceterms cmdlet to accept or reject the terms. You only need to accept terms once
per subscription for the image. Be sure to use all lowercase letters in the parameter values.
Output:
Publisher : microsoft-ads
Product : windows-data-science-vm
Plan : windows2016
LicenseTextLink :
https://storelegalterms.blob.core.windows.net/legalterms/3E5ED_legalterms_MICROSOFT%253a2DADS%253a24WINDOWS%25
3a2DDATA%253a2DSCIENCE%253a2DV
M%253a24WINDOWS2016%253a24OC5SKMQOXSED66BBSNTF4XRCS4XLOHP7QMPV54DQU7JCBZWYFP35IDPOWTUKXUC7ZAG7W6ZMDD6NHWNKUIVS
YBZUTZ245F44SU5AD7Q.txt
PrivacyPolicyLink : https://www.microsoft.com/EN-US/privacystatement/OnlineServices/Default.aspx
Signature :
XXXXXXK3MNJ5SROEG2BYDA2YGECU33GXTD3UFPLPC4BAVKAUL3PDYL3KBKBLG4ZCDJZVNSA7KJWTGMDSYDD6KRLV3LV274DLBXXXXXX
Accepted : True
Signdate : 2/23/2018 7:49:31 PM
...
$publisherName = "microsoft-ads"
$productName = "windows-data-science-vm"
$planName = "windows2016"
$vmConfig = Set-AzureRmVMPlan -VM $vmConfig -Publisher $publisherName -Product $productName -Name $planName
$cred=Get-Credential
$offerName = "windows-data-science-vm"
$skuName = "windows2016"
$version = "0.2.02"
You'll then pass the VM configuration along with network configuration objects to the New-AzureRmVM cmdlet.
Next steps
To create a virtual machine quickly with the New-AzureRmVM cmdlet by using basic image information, see Create a
Windows virtual machine with PowerShell.
See a PowerShell script example to create a fully configured virtual machine.
Prepare a Windows VHD or VHDX to upload to
Azure
10/17/2018 • 15 minutes to read • Edit Online
Before you upload a Windows virtual machines (VM ) from on-premises to Microsoft Azure, you must prepare the
virtual hard disk (VHD or VHDX). Azure supports only generation 1 VMs that are in the VHD file format and
have a fixed sized disk. The maximum size allowed for the VHD is 1,023 GB. You can convert a generation 1 VM
from the VHDX file system to VHD and from a dynamically expanding disk to fixed-sized. But you can't change a
VM's generation. For more information, see Should I create a generation 1 or 2 VM in Hyper-V.
For more information about the support policy for Azure VM, see Microsoft server software support for
Microsoft Azure VMs.
NOTE
The instructions in this article apply to the 64-bit version of Windows Server 2008 R2 and later Windows server operating
system. For information about running 32-bit version of operating system in Azure, see Support for 32-bit operating
systems in Azure virtual machines.
NOTE
The commands in this article must be run on an elevated PowerShell session.
In this command, replace the value for "-Path" with the path to the virtual hard disk that you want to convert and
the value for "-DestinationPath" with the new path and name of the converted disk.
Convert from VMware VMDK disk format
If you have a Windows VM image in the VMDK file format, convert it to a VHD by using the Microsoft VM
Converter. For more information, see the blog article How to Convert a VMware VMDK to Hyper-V VHD.
diskpart
san policy=onlineall
exit
4. Set Coordinated Universal Time (UTC ) time for Windows and the startup type of the Windows Time
(w32time) service to Automatically:
6. Make sure that the environmental variables TEMP and TMP are set to their default values:
Set-ItemProperty -Path 'HKLM:\SYSTEM\CurrentControlSet\Control\Session Manager\Environment' -name
"TEMP" -Value "%SystemRoot%\TEMP" -Type ExpandString -force
NOTE
You may receive an error message when you run the Set-ItemProperty -Path
'HKLM:\SOFTWARE\Policies\Microsoft\Windows NT\Terminal Services -name <object name> -value <value> in
these steps. The error message can be safely ignored. It means only that the domain is not pushing that configuration
through a Group Policy object.
When you deploy a VM, the default rules are created against port 3389. If you want to change the port
number, do that after the VM is deployed in Azure.
3. The listener is listening in every network interface:
Set-ItemProperty -Path 'HKLM:\SYSTEM\CurrentControlSet\Control\Terminal Server\Winstations\RDP-Tcp' -
name "LanAdapter" -Value 0 -Type DWord -force
4. Configure the Network Level Authentication mode for the RDP connections:
6. Reconnect:
8. If there are any self-signed certificates tied to the RDP listener, remove them:
This is to make sure that you can connect at the beginning when you deploy the VM. You can also review
this on a later stage after the VM is deployed in Azure if needed.
9. If the VM will be part of a Domain, check all the following settings to make sure that the former settings
are not reverted. The policies that must be checked are the following:
2. Run the following command in PowerShell to allow WinRM through the three firewall profiles (Domain,
Private, and Public) and enable the PowerShell Remote service:
Enable-PSRemoting -force
4. Enable the File and Printer Sharing rule so that the VM can respond to a ping command inside the Virtual
Network:
Set-NetFirewallRule -DisplayName "File and Printer Sharing (Echo Request - ICMPv4-In)" -Enabled True
5. If the VM will be part of a Domain, check the following settings to make sure that the former settings are
not reverted. The AD policies that must be checked are the following:
Enable the Windows Firewall profiles Computer Protect all network connections
Configuration\Policies\Windows
Settings\Administrative
Templates\Network\Network
Connection\Windows
Firewall\Domain Profile\Windows
Firewall
Chkdsk /f
Make sure that the report shows a clean and healthy disk.
2. Set the Boot Configuration Data (BCD ) settings.
NOTE
Make sure you run these commands on an elevated PowerShell window.
cmd
exit
3. The Dump log can be helpful in troubleshooting Windows crash issues. Enable the Dump log collection:
#Setup the Guest OS to collect user mode dumps on a service crash event
$key = 'HKLM:\SOFTWARE\Microsoft\Windows\Windows Error Reporting\LocalDumps'
if ((Test-Path -Path $key) -eq $false) {(New-Item -Path 'HKLM:\SOFTWARE\Microsoft\Windows\Windows Error
Reporting' -Name LocalDumps)}
New-ItemProperty -Path $key -name DumpFolder -Type ExpandString -force -Value "c:\CrashDumps"
New-ItemProperty -Path $key -name CrashCount -Type DWord -force -Value 10
New-ItemProperty -Path $key -name DumpType -Type DWord -force -Value 2
Set-Service -Name WerSvc -StartupType Manual
4. Verify that the Windows Management Instrumentations repository is consistent. To perform this, run the
following command:
winmgmt /verifyrepository
netstat -anob
6. If the Windows VHD that you want to upload is a domain controller, then follow these steps:
a. Follow these extra steps to prepare the disk.
b. Make sure that you know the DSRM password in case you have to start the VM in DSRM at some
point. You may want to refer to this link to set the DSRM password.
7. Make sure that the Built-in Administrator account and password are known to you. You may want to reset
the current local administrator password and make sure that you can use this account to sign in to
Windows through the RDP connection. This access permission is controlled by the "Allow log on through
Remote Desktop Services" Group Policy object. You can view this object in the Local Group Policy Editor
under:
Computer Configuration\Windows Settings\Security Settings\Local Policies\User Rights Assignment
8. Check the following AD polices to make sure that you are not blocking your RDP access through RDP nor
from the network:
Computer Configuration\Windows Settings\Security Settings\Local Policies\User Rights
Assignment\Deny access to this computer from the network
Computer Configuration\Windows Settings\Security Settings\Local Policies\User Rights
Assignment\Deny log on through Remote Desktop Services
9. Check the following AD policy to make sure that you are not removing any of the following the required
access accounts:
Computer Configuration\Windows Settings\Security Settings\Local Policies\User Rights
Assignment\Access this compute from the network
The following groups should be listed on this policy:
Administrators
Backup Operators
Everyone
Users
10. Restart the VM to make sure that Windows is still healthy can be reached by using the RDP connection. At
this point, you may want to create a VM in your local Hyper-V to make sure the VM is starting completely
and then test whether it is RDP reachable.
11. Remove any extra Transport Driver Interface filters, such as software that analyzes TCP packets or extra
firewalls. You can also review this on a later stage after the VM is deployed in Azure if needed.
12. Uninstall any other third-party software and driver that is related to physical components or any other
virtualization technology.
Install Windows Updates
The ideal configuration is to have the patch level of the machine at the latest. If this is not possible, make
sure that the following updates are installed:
WINDOWS
10 WINDOWS
WINDOWS VERSION WINDOWS 10
7 1607WIND 10 1709 1803WIND
SP1,WIND WINDOWS WINDOWS OWS WINDOWS OWS
OWS 8,WINDO 8.1,WIND SERVER WINDOWS SERVER SERVER
SERVER WS OWS 2016 10 2016 2016
COMPONE 2008 R2 SERVER SERVER VERSION VERSION VERSION VERSION
NT BINARY SP1 2012 2012 R2 1607 1703 1709 1803
WINDOWS
10 WINDOWS
WINDOWS VERSION WINDOWS 10
7 1607WIND 10 1709 1803WIND
SP1,WIND WINDOWS WINDOWS OWS WINDOWS OWS
OWS 8,WINDO 8.1,WIND SERVER WINDOWS SERVER SERVER
SERVER WS OWS 2016 10 2016 2016
COMPONE 2008 R2 SERVER SERVER VERSION VERSION VERSION VERSION
NT BINARY SP1 2012 2012 R2 1607 1703 1709 1803
volmgr.sy 10.0.1506 - -
s 3.0
WINDOWS
10 WINDOWS
WINDOWS VERSION WINDOWS 10
7 1607WIND 10 1709 1803WIND
SP1,WIND WINDOWS WINDOWS OWS WINDOWS OWS
OWS 8,WINDO 8.1,WIND SERVER WINDOWS SERVER SERVER
SERVER WS OWS 2016 10 2016 2016
COMPONE 2008 R2 SERVER SERVER VERSION VERSION VERSION VERSION
NT BINARY SP1 2012 2012 R2 1607 1703 1709 1803
termdd.sy 6.1.7601. - - - - - -
s 23403 -
KB31255
74
rdpdd.dll 6.1.7601. - - - - - -
23403 -
KB31255
74
WINDOWS
10 WINDOWS
WINDOWS VERSION WINDOWS 10
7 1607WIND 10 1709 1803WIND
SP1,WIND WINDOWS WINDOWS OWS WINDOWS OWS
OWS 8,WINDO 8.1,WIND SERVER WINDOWS SERVER SERVER
SERVER WS OWS 2016 10 2016 2016
COMPONE 2008 R2 SERVER SERVER VERSION VERSION VERSION VERSION
NT BINARY SP1 2012 2012 R2 1607 1703 1709 1803
rdpwd.sys 6.1.7601. - - - - - -
23403 -
KB31255
74
If there’s any data disk that is attached to the VM, the Temporal drive volume's drive letter is typically "D."
This designation could be different, depending on the number of available drives and the settings that you
make.
Next steps
Upload a Windows VM image to Azure for Resource Manager deployments
Troubleshoot Azure Windows virtual machine activation problems
Create a managed image of a generalized VM in
Azure
10/3/2018 • 4 minutes to read • Edit Online
A managed image resource can be created from a generalized virtual machine (VM ) that is stored as either a
managed disk or an unmanaged disk in a storage account. The image can then be used to create multiple VMs.
IMPORTANT
After you have run Sysprep on a VM, that VM is considered generalized and cannot be restarted. The process of
generalizing a VM is not reversible. If you need to keep the original VM functioning, you should create a copy of the VM and
generalize its copy.
If you plan to run Sysprep before uploading your virtual hard disk (VHD) to Azure for the first time, make sure you have
prepared your VM.
6. When Sysprep completes, it shuts down the VM. Do not restart the VM.
Create a managed image in the portal
1. Open the Azure portal.
2. In the menu on the left, select Virtual machines and then select the VM from the list.
3. In the Virtual machine page for the VM, on the upper menu, select Capture.
The Create image page appears.
4. For Name, either accept the pre-populated name or enter a name that you would like to use for the image.
5. For Resource group, either select Create new and enter a name, or select Use existing and select a
resource group to use from the drop-down list.
6. If you want to delete the source VM after the image has been created, select Automatically delete this
virtual machine after creating the image.
7. If you want the ability to use the image in any availability zone, select On for Zone resiliency.
8. Select Create to create the image.
9. After the image is created, you can find it as an Image resource in the list of resources in the resource
group.
NOTE
If you would like to store your image in zone-redundant storage, you need to create it in a region that supports availability
zones and include the -ZoneResilient parameter in the image configuration ( New-AzureRmImageConfig command).
$vmName = "myVM"
$rgName = "myResourceGroup"
$location = "EastUS"
$imageName = "myImage"
$vmName = "myVM"
$rgName = "myResourceGroup"
$location = "EastUS"
$snapshotName = "mySnapshot"
$imageName = "myImage"
$diskID = $vm.StorageProfile.OsDisk.ManagedDisk.Id
$vmName = "myVM"
$rgName = "myResourceGroup"
$location = "EastUS"
$imageName = "myImage"
$osVhdUri = "https://mystorageaccount.blob.core.windows.net/vhdcontainer/vhdfilename.vhd"
Next steps
Create a VM from a managed image.
Create a VM from a managed image
9/27/2018 • 2 minutes to read • Edit Online
You can create multiple virtual machines (VMs) from an Azure managed VM image using the Azure portal or
PowerShell. A managed VM image contains the information necessary to create a VM, including the OS and data
disks. The virtual hard disks (VHDs) that make up the image, including both the OS disks and any data disks, are
stored as managed disks.
Before creating a new VM, you'll need to create a managed VM image to use as the source image.
Use PowerShell
You can use PowerShell to create a VM from an image by using the simplified parameter set for the New -
AzureRmVm cmdlet. The image needs to be in the same resource group where you'll create the VM.
This example requires the AzureRM module version 5.6.0 or later. Run Get-Module -ListAvailable AzureRM to find
the version. If you need to upgrade, see Install Azure PowerShell module.
The simplified parameter set for New -AzureRmVm only requires that you provide a name, resource group, and
image name to create a VM from an image. New -AzureRmVm will use the value of the -Name parameter as the
name of all of the resources that it creates automatically. In this example, we provide more detailed names for each
of the resources but let the cmdlet create them automatically. You can also create resources beforehand, such as
the virtual network, and pass the resource name into the cmdlet. New -AzureRmVm will use the existing resources
if it can find them by their name.
The following example creates a VM named myVMFromImage, in the myResourceGroup resource group, from
the image named myImage.
New-AzureRmVm `
-ResourceGroupName "myResourceGroup" `
-Name "myVMfromImage" `
-ImageName "myImage" `
-Location "East US" `
-VirtualNetworkName "myImageVnet" `
-SubnetName "myImageSubnet" `
-SecurityGroupName "myImageNSG" `
-PublicIpAddressName "myImagePIP" `
-OpenPorts 3389
Next steps
Create and manage Windows VMs with the Azure PowerShell module
How to use Packer to create Windows virtual
machine images in Azure
10/18/2018 • 6 minutes to read • Edit Online
Each virtual machine (VM ) in Azure is created from an image that defines the Windows distribution and OS
version. Images can include pre-installed applications and configurations. The Azure Marketplace provides many
first and third-party images for most common OS' and application environments, or you can create your own
custom images tailored to your needs. This article details how to use the open-source tool Packer to define and
build custom images in Azure.
$rgName = "myResourceGroup"
$location = "East US"
New-AzureRmResourceGroup -Name $rgName -Location $location
To authenticate to Azure, you also need to obtain your Azure tenant and subscription IDs with Get-
AzureRmSubscription:
$sub = Get-AzureRmSubscription
$sub.TenantId[0]
$sub.SubscriptionId[0]
"client_id": "0831b578-8ab6-40b9-a581-9a880a94aab1",
"client_secret": "P@ssw0rd!",
"tenant_id": "72f988bf-86f1-41af-91ab-2d7cd011db47",
"subscription_id": "xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxx",
"object_id": "a7dfb070-0d5b-47ac-b9a5-cf214fff0ae2",
"managed_image_resource_group_name": "myResourceGroup",
"managed_image_name": "myPackerImage",
"os_type": "Windows",
"image_publisher": "MicrosoftWindowsServer",
"image_offer": "WindowsServer",
"image_sku": "2016-Datacenter",
"communicator": "winrm",
"winrm_use_ssl": true,
"winrm_insecure": true,
"winrm_timeout": "3m",
"winrm_username": "packer",
"azure_tags": {
"dept": "Engineering",
"task": "Image deployment"
},
This template builds a Windows Server 2016 VM, installs IIS, then generalizes the VM with Sysprep. The IIS install
shows how you can use the PowerShell provisioner to run additional commands. The final Packer image then
includes the required software install and configuration.
ManagedImageResourceGroupName: myResourceGroup
ManagedImageResourceGroupName: myResourceGroup
ManagedImageName: myPackerImage
ManagedImageLocation: eastus
It takes a few minutes for Packer to build the VM, run the provisioners, and clean up the deployment.
New-AzureRmVm `
-ResourceGroupName $rgName `
-Name "myVM" `
-Location $location `
-VirtualNetworkName "myVnet" `
-SubnetName "mySubnet" `
-SecurityGroupName "myNetworkSecurityGroup" `
-PublicIpAddressName "myPublicIpAddress" `
-OpenPorts 80 `
-Image "myPackerImage"
If you wish to create VMs in a different resource group or region than your Packer image, specify the image ID
rather than image name. You can obtain the image ID with Get-AzureRmImage.
It takes a few minutes to create the VM from your Packer image.
Get-AzureRmPublicIPAddress `
-ResourceGroupName $rgName `
-Name "myPublicIPAddress" | select "IpAddress"
To see your VM, that includes the IIS install from the Packer provisioner, in action, enter the public IP address in to
a web browser.
Next steps
In this example, you used Packer to create a VM image with IIS already installed. You can use this VM image
alongside existing deployment workflows, such as to deploy your app to VMs created from the Image with Azure
DevOps Services, Ansible, Chef, or Puppet.
For additional example Packer templates for other Windows distros, see this GitHub repo.
Use Windows client in Azure for dev/test scenarios
10/16/2018 • 2 minutes to read • Edit Online
You can use Windows 7, Windows 8, or Windows 10 Enterprise (x64) in Azure for dev/test scenarios provided you
have an appropriate Visual Studio (formerly MSDN ) subscription. This article outlines the eligibility requirements
for running Windows 7, Windows 8.1, Windows 10 Enterprise in Azure and use of the following Azure Gallery
images.
NOTE
For Windows 10 Pro and Windows 10 Pro N image in Azure Gallery, please refer to How to deploy Windows 10 on Azure
with Multitenant Hosting Rights
Subscription eligibility
Active Visual Studio subscribers (people who have acquired a Visual Studio subscription license) can use Windows
client for development and testing purposes. Windows client can be used on your own hardware and Azure virtual
machines running in any type of Azure subscription. Windows client may not be deployed to or used on Azure for
normal production use, or used by people who are not active Visual Studio subscribers.
For your convenience, certain Windows 10 images are available from the Azure Gallery within eligible dev/test
offers. Visual Studio subscribers within any type of offer can also adequately prepare and create a 64-bit Windows
7, Windows 8, or Windows 10 image and then upload to Azure. The use remains limited to dev/test by active
Visual Studio subscribers.
Eligible offers
The following table details the offer IDs that are eligible to deploy Windows 10 through the Azure Gallery. The
Windows 10 images are only visible to the following offers. Visual Studio subscribers who need to run Windows
client in a different offer type require you to adequately prepare and create a 64-bit Windows 7, Windows 8, or
Windows 10 image and then upload to Azure.
Or, click Billing and then click your subscription ID. The offer ID appears in the Billing window.
You can also view the offer ID from the 'Subscriptions' tab of the Azure Account portal:
Next steps
You can now deploy your VMs using PowerShell, Resource Manager templates, or Visual Studio.
Download a Windows VHD from Azure
6/1/2018 • 2 minutes to read • Edit Online
In this article, you learn how to download a Windows virtual hard disk (VHD ) file from Azure using the Azure
portal.
Stop the VM
A VHD can’t be downloaded from Azure if it's attached to a running VM. You need to stop the VM to download a
VHD. If you want to use a VHD as an image to create other VMs with new disks, you use Sysprep to generalize the
operating system contained in the file and then stop the VM. To use the VHD as a disk for a new instance of an
existing VM or data disk, you only need to stop and deallocate the VM.
To use the VHD as an image to create other VMs, complete these steps:
1. If you haven't already done so, sign in to the Azure portal.
2. Connect to the VM.
3. On the VM, open the Command Prompt window as an administrator.
4. Change the directory to %windir%\system32\sysprep and run sysprep.exe.
5. In the System Preparation Tool dialog box, select Enter System Out-of-Box Experience (OOBE ), and make
sure that Generalize is selected.
6. In Shutdown Options, select Shutdown, and then click OK.
To use the VHD as a disk for a new instance of an existing VM or data disk, complete these steps:
1. On the Hub menu in the Azure portal, click Virtual Machines.
2. Select the VM from the list.
3. On the blade for the VM, click Stop.
Download VHD
1. Under the URL that was generated, click Download the VHD file.
2. You may need to click Save in the browser to start the download. The default name for the VHD file is abcd.
Next steps
Learn how to upload a VHD file to Azure.
Create managed disks from unmanaged disks in a storage account.
Manage Azure disks with PowerShell.
2 minutes to read
Manage the availability of Windows virtual machines
in Azure
10/19/2018 • 8 minutes to read • Edit Online
Learn ways to set up and manage multiple virtual machines to ensure high availability for your Windows
application in Azure. You can also manage the availability of Linux virtual machines.
For instructions on creating and using availability sets when using the classic deployment model, see How to
Configure an Availability Set.
IMPORTANT
Avoid leaving a single instance virtual machine in an availability set by itself. VMs in this configuration do not qualify for a
SLA guarantee and face downtime during Azure planned maintenance events, except when a single VM is using Azure
Premium Storage. For single VMs using premium storage, the Azure SLA applies.
Each virtual machine in your availability set is assigned an update domain and a fault domain by the
underlying Azure platform. For a given availability set, five non-user-configurable update domains are assigned by
default (Resource Manager deployments can then be increased to provide up to 20 update domains) to indicate
groups of virtual machines and underlying physical hardware that can be rebooted at the same time. When more
than five virtual machines are configured within a single availability set, the sixth virtual machine is placed into the
same update domain as the first virtual machine, the seventh in the same update domain as the second virtual
machine, and so on. The order of update domains being rebooted may not proceed sequentially during planned
maintenance, but only one update domain is rebooted at a time. A rebooted update domain is given 30 minutes to
recover before maintenance is initiated on a different update domain.
Fault domains define the group of virtual machines that share a common power source and network switch. By
default, the virtual machines configured within your availability set are separated across up to three fault domains
for Resource Manager deployments (two fault domains for Classic). While placing your virtual machines into an
availability set does not protect your application from operating system or application-specific failures, it does
limit the impact of potential physical hardware failures, network outages, or power interruptions.
Use managed disks for VMs in an availability set
If you are currently using VMs with unmanaged disks, we highly recommend you convert VMs in Availability Set
to use Managed Disks.
Managed disks provide better reliability for Availability Sets by ensuring that the disks of VMs in an Availability
Set are sufficiently isolated from each other to avoid single points of failure. It does this by automatically placing
the disks in different storage fault domains (storage clusters) and aligning them with the VM fault domain. If a
storage fault domain fails due to hardware or software failure, only the VM instance with disks on the storage fault
domain fails.
IMPORTANT
The number of fault domains for managed availability sets varies by region - either two or three per region. The following
table shows the number per region
East US 3
East US 2 3
West US 3
West US 2 2
Central US 3
North Central US 3
South Central US 3
West Central US 2
Canada Central 3
Canada East 2
North Europe 3
West Europe 3
UK South 2
UK West 2
East Asia 2
Japan East 2
Japan West 2
South India 2
Central India 2
West India 2
Korea Central 2
Korea South 2
Australia East 2
REGION MAX # OF FAULT DOMAINS
Australia Southeast 2
Brazil South 2
US Gov Virginia 2
US Gov Texas 2
US Gov Arizona 2
US DoD Central 2
US DoD East 2
If you plan to use VMs with unmanaged disks, follow below best practices for Storage accounts where virtual hard
disks (VHDs) of VMs are stored as page blobs.
1. Keep all disks (OS and data) associated with a VM in the same storage account
2. Review the limits on the number of unmanaged disks in a Storage account before adding more VHDs
to a storage account
3. Use separate storage account for each VM in an Availability Set. Do not share Storage accounts with
multiple VMs in the same Availability Set. It is acceptable for VMs across different Availability Sets to share
storage accounts if above best practices are followed
Next steps
To learn more about load balancing your virtual machines, see Load Balancing virtual machines.
Vertically scale Windows VMs with Azure Automation
4/9/2018 • 2 minutes to read • Edit Online
Vertical scaling is the process of increasing or decreasing the resources of a machine in response to the workload.
In Azure this can be accomplished by changing the size of the Virtual Machine. This can help in the following
scenarios
If the Virtual Machine is not being used frequently, you can resize it down to a smaller size to reduce your
monthly costs
If the Virtual Machine is seeing a peak load, it can be resized to a larger size to increase its capacity
The outline for the steps to accomplish this is as below
1. Setup Azure Automation to access your Virtual Machines
2. Import the Azure Automation Vertical Scale runbooks into your subscription
3. Add a webhook to your runbook
4. Add an alert to your Virtual Machine
NOTE
Because of the size of the first Virtual Machine, the sizes it can be scaled to, may be limited due to the availability of the other
sizes in the cluster current Virtual Machine is deployed in. In the published automation runbooks used in this article we take
care of this case and only scale within the below VM size pairs. This means that a Standard_D1v2 Virtual Machine will not
suddenly be scaled up to Standard_G5 or scaled down to Basic_A0.
Basic_A0 Basic_A4
Standard_A0 Standard_A4
Standard_A5 Standard_A7
Standard_A8 Standard_A9
Standard_A10 Standard_A11
Standard_D1 Standard_D4
Standard_D11 Standard_D14
Standard_DS1 Standard_DS4
Standard_DS11 Standard_DS14
Standard_D1v2 Standard_D5v2
Standard_D11v2 Standard_D14v2
Standard_G1 Standard_G5
Standard_GS1 Standard_GS5
Setup Azure Automation to access your Virtual Machines
The first thing you need to do is create an Azure Automation account that will host the runbooks used to scale a
Virtual Machine. Recently the Automation service introduced the "Run As account" feature which makes setting up
the Service Principal for automatically running the runbooks on the user's behalf very easy. You can read more
about this in the article below:
Authenticate Runbooks with Azure Run As account
This article details using Azure PowerShell to create an Azure virtual machine running Windows Server 2016 in an
Azure availability zone. An availability zone is a physically separate zone in an Azure region. Use availability zones
to protect your apps and data from an unlikely failure or loss of an entire datacenter.
To use an availability zone, create your virtual machine in a supported Azure region.
Make sure that you have installed the latest Azure PowerShell module. If you need to install or upgrade, see Install
Azure PowerShell module.
Log in to Azure
Log in to your Azure subscription with the Connect-AzureRmAccount command and follow the on-screen directions.
Connect-AzureRmAccount
The output is similar to the following condensed example, which shows the Availability Zones in which each VM
size is available:
# Create a virtual network card and associate with public IP address and NSG
$nic = New-AzureRmNetworkInterface -Name myNic -ResourceGroupName myResourceGroup -Location eastus2 `
-SubnetId $vnet.Subnets[0].Id -PublicIpAddressId $pip.Id -NetworkSecurityGroupId $nsg.Id
The output shows that the managed disk is in the same availability zone as the VM:
ResourceGroupName : myResourceGroup
AccountType : PremiumLRS
OwnerId : /subscriptions/xxxxxxxx-xxxx-xxxx-xxxx-
xxxxxxxxxxxx/resourceGroups/myResourceGroup/providers/Microsoft.
Compute/virtualMachines/myVM
ManagedBy : /subscriptions/xxxxxxxx-xxxx-xxxx-xxxx-
xxxxxxxxxxxx//resourceGroups/myResourceGroup/providers/Microsoft.
Compute/virtualMachines/myVM
Sku : Microsoft.Azure.Management.Compute.Models.DiskSku
Zones : {2}
TimeCreated : 9/7/2017 6:57:26 PM
OsType : Windows
CreationData : Microsoft.Azure.Management.Compute.Models.CreationData
DiskSizeGB : 127
EncryptionSettings :
ProvisioningState : Succeeded
Id : /subscriptions/xxxxxxxx-xxxx-xxxx-xxxx-
xxxxxxxxxxxx/resourceGroups/myResourceGroup/providers/Microsoft.
Compute/disks/myVM_OsDisk_1_bd921920bb0a4650becfc2d830000000
Name : myVM_OsDisk_1_bd921920bb0a4650becfc2d830000000
Type : Microsoft.Compute/disks
Location : eastus2
Tags : {}
Next steps
In this article, you learned how to create a VM in an availability zone. Learn more about regions and availability for
Azure VMs.
Create a Windows virtual machine in an availability
zone with the Azure portal
4/9/2018 • 2 minutes to read • Edit Online
This article steps through using the Azure portal to create a virtual machine in an Azure availability zone. An
availability zone is a physically separate zone in an Azure region. Use availability zones to protect your apps and
data from an unlikely failure or loss of an entire datacenter.
To use an availability zone, create your virtual machine in a supported Azure region.
Log in to Azure
Log in to the Azure portal at https://portal.azure.com.
4. Choose a size for the VM. Select a recommended size, or filter based on features. Confirm the size is
available in the zone you want to use.
5. Under Settings > High availability, select one of the numbered zones from the Availability zone
dropdown, keep the remaining defaults, and click OK.
6. On the summary page, click Create to start the virtual machine deployment.
7. The VM will be pinned to the Azure portal dashboard. Once the deployment has completed, the VM
summary automatically opens.
3. Click the name of the Public IP address resource. The Overview page includes details about the location
and availability zone of the resource.
Next steps
In this article, you learned how to create a VM in an availability zone. Learn more about regions and availability for
Azure VMs.
Automating Azure virtual machine deployment with
Chef
10/1/2018 • 6 minutes to read • Edit Online
NOTE
Azure has two different deployment models for creating and working with resources: Resource Manager and classic. This
article covers using both models, but Microsoft recommends that most new deployments use the Resource Manager model.
Chef is a great tool for delivering automation and desired state configurations.
With the latest cloud API release, Chef provides seamless integration with Azure, giving you the ability to provision
and deploy configuration states through a single command.
In this article, you set up your Chef environment to provision Azure virtual machines and walk through creating a
policy or “CookBook” and then deploying this cookbook to an Azure virtual machine.
Let’s begin!
Chef basics
Before you begin, review the basic concepts of Chef.
The following diagram depicts the high-level Chef architecture.
Chef has three main architectural components: Chef Server, Chef Client (node), and Chef Workstation.
The Chef Server is the management point and there are two options for the Chef Server: a hosted solution or an
on-premises solution. We will be using a hosted solution for this tutorial.
The Chef Client (node) is the agent that sits on the servers you are managing.
The Chef Workstation is the admin workstation where we create policies and execute management commands. We
run the knife command from the Chef Workstation to manage the infrastructure.
There is also the concept of “Cookbooks” and “Recipes”. These are effectively the policies we define and apply to
the servers.
NOTE
If you receive a prompt warning you that your keys will be reset, it’s okay to proceed as we have no existing infrastructure
configured as yet.
This starter kit zip file contains your organization config files and keys.
You should now have four files including the Azure publishing file in the root of c:\chef.
The PEM files contain your organization and admin private keys for communication while the knife.rb file contains
your knife configuration. We will need to edit the knife.rb file.
Open the file in your editor of choice and modify the “cookbook_path” by removing the /../ from the path so it
appears as:
cookbook_path ["#{current_dir}/cookbooks"]
Also add the following line reflecting the name of your Azure publish settings file.
knife[:azure_publish_settings_file] = "yourfilename.publishsettings"
Your knife.rb file should now look similar to the following example.
These lines will ensure that Knife references the cookbooks directory under c:\chef\cookbooks, and also uses our
Azure Publish Settings file during Azure operations.
NOTE
The order of the path is important! If your opscode paths are not in the correct order you will have issues.
NOTE
The –pre argument ensures you are receiving the latest RC version of the Knife Azure Plugin which provides access to the
latest set of APIs.
It’s likely that a number of dependencies will also be installed at the same time.
To ensure everything is configured correctly, run the following command.
If everything is configured correctly, you will see a list of available Azure images scroll through.
Congratulations. The workstation is set up!
Creating a Cookbook
A Cookbook is used by Chef to define a set of commands that you wish to execute on your managed client.
Creating a Cookbook is straightforward and we use the chef generate cookbook command to generate the
Cookbook template. I will be calling my Cookbook web server as I would like a policy that automatically deploys
IIS.
Under your C:\Chef directory run the following command.
This will generate a set of files under the directory C:\Chef\cookbooks\webserver. We now need to define the set
of commands we would like the Chef client to execute on the managed virtual machine.
The commands are stored in the file default.rb. In this file, I’ll be defining a set of commands that installs IIS, starts
IIS and copies a template file to the wwwroot folder.
Modify the C:\chef\cookbooks\webserver\recipes\default.rb file and add the following lines.
service 'w3svc' do
action [ :enable, :start ]
end
template 'c:\inetpub\wwwroot\Default.htm' do
source 'Default.htm.erb'
rights :read, 'Everyone'
end
The parameters are self-explanatory. Substitute your particular variables and run.
NOTE
Through the command line, I’m also automating my endpoint network filter rules by using the –tcp-endpoints parameter. I’ve
opened up ports 80 and 3389 to provide access to my web page and RDP session.
Once you run the command, go to the Azure portal and you will see your machine begin to provision.
This document describes how to publish an ASP.NET web application to an Azure virtual machine (VM ) using the
Microsoft Azure Virtual Machines publishing feature in Visual Studio 2017.
Prerequisites
In order to use Visual Studio to publish an ASP.NET project to an Azure VM, the VM must be correctly set up.
Machine must be configured to run an ASP.NET web application and have WebDeploy installed.
The VM must have a DNS name configured. For more information, see Create a fully qualified domain
name in the Azure portal for a Windows VM.
Publish your ASP.NET web app to the Azure VM using Visual Studio
The following section describes how to publish an existing ASP.NET web application to an Azure virtual machine.
1. Open your web app solution in Visual Studio 2017.
2. Right-click the project in Solution Explorer and choose Publish...
3. Use the arrow on the right of the page to scroll through the publishing options until you find Microsoft
Azure Virtual Machines.
4. Select the Microsoft Azure Virtual Machines icon and select Publish.
5. Choose the appropriate account (with Azure subscription connected to your virtual machine).
If you're signed in to Visual Studio, the account list is populated with all your authenticated accounts.
If you are not signed in, or if the account you need is not listed, choose "Add an account..." and follow the
prompts to log in.
NOTE
Populating this list can take some time.
7. Click OK to begin publishing.
8. When prompted for credentials, supply the username and password of a user account on the target VM that
is configured with publishing rights (typically the admin username and password used when creating the
VM ).
10. Watch the Output window to check the progress of the publish operation.
11. If publishing is successful, a browser launches to open the URL of the newly published site.
Success!
You have now successfully published your web app to an Azure virtual machine.
SQL Server on Azure virtual machines enables you to use full versions of SQL Server in the Cloud without having
to manage any on-premises hardware. SQL Server VMs also simplify licensing costs when you pay as you go.
Azure virtual machines run in many different geographic regions around the world. They also offer a variety of
machine sizes. The virtual machine image gallery allows you to create a SQL Server VM with the right version,
edition, and operating system. This makes virtual machines a good option for a many different SQL Server
workloads.
Automated updates
SQL Server Azure VMs can use Automated Patching to schedule a maintenance window for installing important
windows and SQL Server updates automatically.
Automated backups
SQL Server Azure VMs can take advantage of Automated Backup, which regularly creates backups of your
database to blob storage. You can also manually use this technique. For more information, see Use Azure Storage
for SQL Server Backup and Restore.
High availability
If you require high availability, consider configuring SQL Server Availability Groups. This involves multiple SQL
Server Azure VMs in a virtual network. You can configure your high availability solution manually, or you can use
templates in the Azure portal for automatic configuration. For an overview of all high availability options, see High
Availability and Disaster Recovery for SQL Server in Azure Virtual Machines.
Performance
Azure virtual machines offer different machine sizes to meet various workload demands. SQL VMs also provide
automated storage configuration, which is optimized for your performance requirements. For more information
about configuring storage for SQL VMs, see Storage configuration for SQL Server VMs. To fine-tune performance,
see the Performance best practices for SQL Server in Azure Virtual Machines.
TIP
For more information about how to understand pricing for SQL images, see Pricing guidance for SQL Server Azure VMs.
Pay as you go
The following table provides a matrix of pay-as-you-go SQL Server images.
VERSION OPERATING SYSTEM EDITION
SQL Server 2017 Windows Server 2016 Enterprise, Standard, Web, Express,
Developer
SQL Server 2016 SP1 Windows Server 2016 Enterprise, Standard, Web, Express,
Developer
SQL Server 2014 SP2 Windows Server 2012 R2 Enterprise, Standard, Web, Express
SQL Server 2012 SP4 Windows Server 2012 R2 Enterprise, Standard, Web, Express
SQL Server 2008 R2 SP3 Windows Server 2008 R2 Enterprise, Standard, Web, Express
To see the available Linux SQL Server virtual machine images, see Overview of SQL Server on Azure Virtual
Machines (Linux).
Bring your own license
You can also bring your own license (BYOL ). In this scenario, you only pay for the VM without any additional
charges for SQL Server licensing. Bringing your own license can save you money over time for continuous
production workloads. For requirements to use this option, see Pricing guidance for SQL Server Azure VMs.
SQL Server 2017 Windows Server 2016 Enterprise BYOL, Standard BYOL
SQL Server 2016 SP1 Windows Server 2016 Enterprise BYOL, Standard BYOL
SQL Server 2014 SP2 Windows Server 2012 R2 Enterprise BYOL, Standard BYOL
SQL Server 2012 SP4 Windows Server 2012 R2 Enterprise BYOL, Standard BYOL
Next steps
Get started with SQL Server on Azure virtual machines:
Create a SQL Server VM in the Azure portal
Get answers to commonly asked questions about SQL VMs:
SQL Server on Azure Virtual Machines FAQ
Install and configure MongoDB on a Windows VM in
Azure
10/19/2018 • 5 minutes to read • Edit Online
MongoDB is a popular open-source, high-performance NoSQL database. This article guides you through installing
and configuring MongoDB on a Windows Server 2016 virtual machine (VM ) in Azure. You can also install
MongoDB on a Linux VM in Azure.
Prerequisites
Before you install and configure MongoDB, you need to create a VM and, ideally, add a data disk to it. See the
following articles to create a VM and add a data disk:
Create a Windows Server VM using the Azure portal or Azure PowerShell.
Attach a data disk to a Windows Server VM using the Azure portal or Azure PowerShell.
To begin installing and configuring MongoDB, log on to your Windows Server VM by using Remote Desktop.
Install MongoDB
IMPORTANT
MongoDB security features, such as authentication and IP address binding, are not enabled by default. Security features
should be enabled before deploying MongoDB to a production environment. For more information, see MongoDB Security
and Authentication.
1. After you've connected to your VM using Remote Desktop, open Internet Explorer from the taskbar.
2. Select Use recommended security, privacy, and compatibility settings when Internet Explorer first opens,
and click OK.
3. Internet Explorer enhanced security configuration is enabled by default. Add the MongoDB website to the
list of allowed sites:
Select the Tools icon in the upper-right corner.
In Internet Options, select the Security tab, and then select the Trusted Sites icon.
Click the Sites button. Add https://*.mongodb.com to the list of trusted sites, and then close the
dialog box.
4. Browse to the MongoDB - Downloads page (http://www.mongodb.com/downloads).
5. If needed, select the Community Server edition and then select the latest current stable release
forWindows Server 2008 R2 64 -bit and later. To download the installer, click DOWNLOAD (msi).
Add the path to your MongoDB bin folder. MongoDB is typically installed in C:\Program
Files\MongoDB. Verify the installation path on your VM. The following example adds the default
MongoDB install location to the PATH variable:
;C:\Program Files\MongoDB\Server\3.6\bin
NOTE
Be sure to add the leading semicolon ( ; ) to indicate that you are adding a location to your PATH variable.
2. Create MongoDB data and log directories on your data disk. From the Start menu, select Command
Prompt. The following examples create the directories on drive F:
mkdir F:\MongoData
mkdir F:\MongoLogs
3. Start a MongoDB instance with the following command, adjusting the path to your data and log directories
accordingly:
It may take several minutes for MongoDB to allocate the journal files and start listening for connections. All
log messages are directed to the F:\MongoLogs\mongolog.log file as mongod.exe server starts and allocates
journal files.
NOTE
The command prompt stays focused on this task while your MongoDB instance is running. Leave the command
prompt window open to continue running MongoDB. Or, install MongoDB as service, as detailed in the next step.
4. For a more robust MongoDB experience, install the mongod.exe as a service. Creating a service means you
don't need to leave a command prompt running each time you want to use MongoDB. Create the service as
follows, adjusting the path to your data and log directories accordingly:
The preceding command creates a service named MongoDB, with a description of "Mongo DB". The
following parameters are also specified:
The --dbpath option specifies the location of the data directory.
The --logpath option must be used to specify a log file, because the running service does not have a
command window to display output.
The --logappend option specifies that a restart of the service causes output to append to the existing log
file.
To start the MongoDB service, run the following command:
For more information about creating the MongoDB service, see Configure a Windows Service for
MongoDB.
mongo
You can list the databases with the db command. Insert some data as follows:
db.foo.insert( { a : 1 } )
Search for data as follows:
db.foo.find()
exit
New-NetFirewallRule `
-DisplayName "Allow MongoDB" `
-Direction Inbound `
-Protocol TCP `
-LocalPort 27017 `
-Action Allow
You can also create the rule by using the Windows Firewall with Advanced Security graphical management
tool. Create a new inbound rule to allow TCP port 27017.
If needed, create a Network Security Group rule to allow access to MongoDB from outside of the existing Azure
virtual network subnet. You can create the Network Security Group rules by using the Azure portal or Azure
PowerShell. As with the Windows Firewall rules, allow TCP port 27017 to the virtual network interface of your
MongoDB VM.
NOTE
TCP port 27017 is the default port used by MongoDB. You can change this port by using the --port parameter when
starting mongod.exe manually or from a service. If you change the port, make sure to update the Windows Firewall and
Network Security Group rules in the preceding steps.
Next steps
In this tutorial, you learned how to install and configure MongoDB on your Windows VM. You can now access
MongoDB on your Windows VM, by following the advanced topics in the MongoDB documentation.
Using Azure for hosting and running SAP workload
scenarios
9/17/2018 • 5 minutes to read • Edit Online
By choosing Microsoft Azure as your SAP ready cloud partner, you are able to reliably run your mission critical
SAP workloads and scenarios on a scalable, compliant, and enterprise-proven platform. Get the scalability,
flexibility, and cost savings of Azure. With the expanded partnership between Microsoft and SAP, you can run SAP
applications across dev/test and production scenarios in Azure - and be fully supported. From SAP NetWeaver to
SAP S4/HANA, SAP BI, Linux to Windows, SAP HANA to SQL, we have you covered.
Besides hosting SAP NetWeaver scenarios with the different DBMS on Azure, you can host different other SAP
workload scenarios, like SAP BI on Azure. Documentation regarding SAP NetWeaver deployments on Azure
native Virtual Machines can be found in the section "SAP NetWeaver on Azure Virtual Machines."
The uniqueness of Azure for SAP HANA is a unique offer that sets Azure apart from competition. In order to
enable hosting more memory and CPU resource demanding SAP scenarios involving SAP HANA, Azure offers the
usage of customer dedicated bare-metal hardware for the purpose of running SAP HANA deployments that
require up to 20 TB (60 TB scale-out) of memory for S/4HANA or other SAP HANA workload. This unique Azure
solution of SAP HANA on Azure (Large Instances) allows you to run SAP HANA on the dedicated bare-metal
hardware with the SAP application layer or workload middle-ware layer hosted in native Azure Virtual Machines.
This solution is documented in several documents in the section "SAP HANA on Azure (Large Instances)."
Hosting SAP workload scenarios in Azure also can create requirements of Identity integration and Single-Sign-On
using Azure Activity Directory to different SAP components and SAP SaaS or PaaS offers. A list of such integration
and Single-Sign-On scenarios with Azure Active Directory (AAD ) and SAP entities is described and documented in
the section "AAD SAP Identity Integration and Single-Sign-On."
Latest Changes
Documentation around SAP HANA Dynamic Tiering for Azure VMs
SAP HANA infrastructure configurations and operations on Azure
Documentation around SAP HANA Scale-out on Azure VM M128s got added to:
SAP HANA infrastructure configurations and operations on Azure
SAP HANA availability within one Azure region
Use Microsoft Azure virtual machines to create one or more MATLAB Distributed Computing Server clusters to
run your compute-intensive parallel MATLAB workloads. Install your MATLAB Distributed Computing Server
software on a VM to use as a base image and use an Azure quickstart template or Azure PowerShell script
(available on GitHub) to deploy and manage the cluster. After deployment, connect to the cluster to run your
workloads.
Prerequisites
Client computer - You'll need a Windows-based client computer to communicate with Azure and the MATLAB
Distributed Computing Server cluster after deployment.
Azure PowerShell - See How to install and configure Azure PowerShell to install it on your client computer.
Azure subscription - If you don't have a subscription, you can create a free account in just a couple of minutes.
For larger clusters, consider a pay-as-you-go subscription or other purchase options.
vCPUs quota - You might need to increase the vCPU quota to deploy a large cluster or more than one
MATLAB Distributed Computing Server cluster. To increase a quota, open an online customer support request
at no charge.
MATLAB, Parallel Computing Toolbox, and MATLAB Distributed Computing Server licenses - The
scripts assume that the MathWorks Hosted License Manager is used for all licenses.
MATLAB Distributed Computing Server software - Will be installed on a VM that will be used as the base
VM image for the cluster VMs.
NOTE
This process can take a couple of hours, but you only have to do it once for each version of MATLAB you use.
Cluster configurations
Currently, the cluster creation script and template enable you to create a single MATLAB Distributed Computing
Server topology. If you want, create one or more additional clusters, with each cluster having a different number of
worker VMs, using different VM sizes, and so on.
MATLAB client and cluster in Azure
The MATLAB client node, MATLAB Job Scheduler node, and MATLAB Distributed Computing Server "worker"
nodes are all configured as Azure VMs in a virtual network, as shown in the following figure.
To use the cluster, connect by Remote Desktop to the client node. The client node runs the MATLAB client.
The client node has a file share that can be accessed by all workers.
MathWorks Hosted License Manager is used for the license checks for all MATLAB software.
By default, one MATLAB Distributed Computing Server worker per vCPU is created on the worker VMs, but
you can specify any number.
Next steps
For detailed instructions to deploy and manage MATLAB Distributed Computing Server clusters in Azure, see
the GitHub repository containing the templates and scripts.
Go to the MathWorks site for detailed documentation for MATLAB and MATLAB Distributed Computing
Server.
Visual Studio images on Azure
9/13/2018 • 4 minutes to read • Edit Online
Using Visual Studio in a preconfigured Azure virtual machine (VM ) is a quick, easy way to go from nothing to an
up-and-running development environment. System images with different Visual Studio configurations are
available in the Azure Marketplace.
New to Azure? Create a free Azure account.
NOTE
In accordance with Microsoft servicing policy, the originally released (RTW) version of Visual Studio 2015 has expired for
servicing. Visual Studio 2015 Update 3 is the only remaining version offered for the Visual Studio 2015 product line.
If the images don't include a Visual Studio feature that you require, provide feedback through the feedback tool in
the upper-right corner of the page.
IMPORTANT
Don’t forget to use Sysprep to prepare the VM. If you miss that step, Azure can't provision a VM from the image.
NOTE
You still incur some cost for storage of the images, but that incremental cost can be insignificant compared to the overhead
costs to rebuild the VM from scratch for each team member who needs one. For instance, it costs a few dollars to create and
store a 127-GB image for a month that's reusable by your entire team. However, these costs are insignificant compared to
hours each employee invests to build out and validate a properly configured dev box for their individual use.
Additionally, your development tasks or technologies might need more scale, like varieties of development
configurations and multiple machine configurations. You can use Azure DevTest Labs to create recipes that
automate construction of your "golden image." You can also use DevTest Labs to manage policies for your team’s
running VMs. Using Azure DevTest Labs for developers is the best source for more information on DevTest Labs.
Next steps
Now that you know about the preconfigured Visual Studio images, the next step is to create a new VM:
Create a VM through the Azure portal
Windows Virtual Machines overview
Options with HPC Pack to create and manage a
cluster for Windows HPC workloads in Azure
5/21/2018 • 2 minutes to read • Edit Online
Create and manage a cloud-based high-performance computing (HPC ) cluster by taking advantage of Microsoft
HPC Pack and Azure compute and infrastructure services. HPC Pack, available for free download, is built on
Microsoft Azure and Windows Server technologies and supports a wide range of HPC workloads.
Get the latest HPC Pack 2016 Update 1 downloads.
For more HPC options in Azure, see Technical resources for batch and high-performance computing.
This article focuses on Azure options to create HPC Pack clusters to run Windows workloads. There are also
options for creating HPC Pack clusters to run Linux HPC workloads.
Job submission
Submit jobs to an HPC Pack cluster in Azure
Deploy an HPC Pack 2016 cluster in Azure
4/24/2018 • 4 minutes to read • Edit Online
Follow the steps in this article to deploy a Microsoft HPC Pack 2016 Update 1 cluster in Azure virtual machines.
HPC Pack is Microsoft's free HPC solution built on Microsoft Azure and Windows Server technologies and
supports a wide range of HPC workloads.
Use one of the Azure Resource Manager templates to deploy the HPC Pack 2016 cluster. You have several choices
of cluster topology with different numbers and types of cluster head nodes and compute nodes.
Prerequisites
PFX certificate
A Microsoft HPC Pack 2016 cluster requires a Personal Information Exchange (PFX) certificate to secure the
communication between the HPC nodes. The certificate must meet the following requirements:
It must have a private key capable of key exchange
Key usage includes Digital Signature and Key Encipherment
Enhanced key usage includes Client Authentication and Server Authentication
If you don’t already have a certificate that meets these requirements, you can request the certificate from a
certification authority. Alternatively, use the following commands to generate the self-signed certificate based on
the operating system on which you run the command. Then, export the certificate as a password-protected PFX
file with private key.
For Windows 10 or Windows Server 2016, run the built-in New-SelfSignedCertificate PowerShell
cmdlet as follows:
For operating systems earlier than Windows 10 or Windows Server 2016, download the self-signed
certificate generator from the Microsoft Script Center. Extract its contents and run the following commands
at a PowerShell prompt:
After the certificate is created in the Current User store, use the Certificates snap-in to export the certificate as a
password-protected PFX file with private key. You can also export the certificate using the Export-Pfxcertificate
PowerShell cmdlet.
Upload certificate to an Azure key vault
Before deploying the HPC cluster, upload the PFX certificate to an Azure key vault as a secret, and record the
following information for use during the deployment: Vault name, Vault resource group, Certificate URL, and
Certificate thumbprint.
A sample PowerShell script to upload the certificate, create the key vault, and generate the required information
follows. For more information about uploading a certificate to an Azure key vault, see Get started with Azure Key
Vault.
Supported topologies
Choose one of the Azure Resource Manager templates to deploy the HPC Pack 2016 cluster. Following are high-
level architectures of three example cluster topologies. High-availability topologies include multiple cluster head
nodes.
1. High-availability cluster with Active Directory domain
2. High-availability cluster without Active Directory domain
2. Click one head node (in a high-availability cluster, click any of the head nodes). In Overview, you can find
the public IP address or full DNS name of the cluster.
3. Click Connect to log on to any of the head nodes using Remote Desktop with your specified administrator
user name. If the cluster you deployed is in an Active Directory Domain, the user name is of the form
<privateDomainName>\<adminUsername> (for example, hpc.local\hpcadmin).
Next steps
Submit jobs to your cluster. See Submit jobs to HPC an HPC Pack cluster in Azure and Manage an HPC Pack
2016 cluster in Azure using Azure Active Directory.
Manage an HPC Pack cluster in Azure using Azure
Active Directory
11/20/2017 • 7 minutes to read • Edit Online
Microsoft HPC Pack 2016 supports integration with Azure Active Directory (Azure AD ) for administrators who
deploy an HPC Pack cluster in Azure.
Follow the steps in this article for the following high level tasks:
Manually integrate your HPC Pack cluster with your Azure AD tenant
Manage and schedule jobs in your HPC Pack cluster in Azure
Integrating an HPC Pack cluster solution with Azure AD follows standard steps to integrate other applications and
services. This article assumes you are familiar with basic user management in Azure AD. For more information
and background, see the Azure Active Directory documentation and the following section.
Benefits of integration
Azure Active Directory (Azure AD ) is a multi-tenant cloud-based directory and identity management service that
provides single sign-on (SSO ) access to cloud solutions.
Integration of an HPC Pack cluster with Azure AD can help you achieve the following goals:
Remove the traditional Active Directory domain controller from the HPC Pack cluster. This can help reduce the
costs of maintaining the cluster if this is not necessary for your business, and speed-up the deployment
process.
Leverage the following benefits that are brought by Azure AD:
Single sign-on
Using a local AD identity for the HPC Pack cluster in Azure
Prerequisites
HPC Pack 2016 cluster deployed in Azure virtual machines - For steps, see Deploy an HPC Pack 2016
cluster in Azure. You need the DNS name of the head node and the credentials of a cluster administrator to
complete the steps in this article.
NOTE
Azure Active Directory integration is not supported in versions of HPC Pack before HPC Pack 2016.
Client computer - You need a Windows or Windows Server client computer to run HPC Pack client
utilities. If you only want to use the HPC Pack web portal or REST API to submit jobs, you can use any
client computer of your choice.
HPC Pack client utilities - Install the HPC Pack client utilities on the client computer, using the free
installation package available from the Microsoft Download Center.
Step 1: Register the HPC cluster server with your Azure AD tenant
1. Sign in to the Azure portal.
2. If your account gives you access to more than one Azure AD tenant, click your account in the top right corner.
Then set your portal session to the desired tenant. You must have permission to access resources in the
directory.
3. Click Azure Active Directory in the left Services navigation pane, click Users and groups, and make sure
there are user accounts already created or configured.
4. In Azure Active Directory, click App registrations > New application registration. Enter the following
information:
Name - HPCPackClusterServer
Application type - Select Web app / API
Sign-on URL - The base URL for the sample, which is by default https://hpcserver
Click Create.
5. After the app is added, select it in the App registrations list. Then click Settings > Properties. Enter the
following information:
Select Yes for Multi-tenanted.
Change App ID URI to https://<Directory_name>/<application_name> . Replace <Directory_name > with
the full name of your Azure AD tenant, for example, hpclocal.onmicrosoft.com , and replace
<application_name> with the name you chose previously.
6. Click Save. When saving completes, on the app page, click Manifest. Edit the manifest by locating the
appRoles setting and adding the following application role, and then click Save:
"appRoles": [
{
"allowedMemberTypes": [
"User",
"Application"
],
"displayName": "HpcAdminMirror",
"id": "61e10148-16a8-432a-b86d-ef620c3e48ef",
"isEnabled": true,
"description": "HpcAdminMirror",
"value": "HpcAdminMirror"
},
{
"allowedMemberTypes": [
"User",
"Application"
],
"description": "HpcUsers",
"displayName": "HpcUsers",
"id": "91e10148-16a8-432a-b86d-ef620c3e48ef",
"isEnabled": true,
"value": "HpcUsers"
}
],
7. In Azure Active Directory, click Enterprise applications > All applications. Select
HPCPackClusterServer from the list.
8. Click Properties, and change User assignment required to Yes. Click Save.
9. Click Users and groups > Add user. Select a user and select a role, and then click Assign. Assign one of the
available roles (HpcUsers or HpcAdminMirror) to the user. Repeat this step with additional users in the
directory. For background information about cluster users, see Managing Cluster Users.
Step 2: Register the HPC cluster client with your Azure AD tenant
1. Sign in to the Azure portal.
2. If your account gives you access to more than one Azure AD tenant, click your account in the top right corner.
Then set your portal session to the desired tenant. You must have permission to access resources in the
directory.
3. In Azure Active Directory, click App registrations > New application registration. Enter the following
information:
Name - HPCPackClusterClient
Application type - Select Native
Redirect URI - http://hpcclient
Click Create
4. After the app is added, select it in the App registrations list. Copy the Application ID value and save it.
You need this later when configuring your application.
5. Click Settings > Required permissions > Add > Select an API. Search and select the
HpcPackClusterServer application (created in Step 1).
6. In the Enable Access page, select Access HpcClusterServer. Then click Done.
where
AADTenant specifies the Azure AD tenant name, such as hpclocal.onmicrosoft.com
AADClientAppId specifies the Application ID for the app created in Step 2.
4. Do one of the following, depending on the head node configuration:
In a single head node HPC Pack cluster, restart the HpcScheduler service.
In an HPC Pack cluster with multiple head nodes, run the following PowerShell commands on the
head node to restart the HpcSchedulerStateful service:
Connect-ServiceFabricCluster
NOTE
When you try to connect to the HPC Pack cluster in Azure for the first time, a popup windows appears. Enter your Azure AD
credentials to log in. The token is then cached. Later connections to the cluster in Azure use the cached token unless
authentication changes or the cache is cleared.
For example, after completing the previous steps, you can query for jobs from an on-premises client as follows:
Get-HpcJob –State All –Scheduler https://<Azure load balancer DNS name> -Owner <Azure AD account>
Remove-HpcTokenCache
Set the credentials for submitting jobs using the Azure AD account
Sometimes, you may want to run the job under the HPC cluster user (for a domain-joined HPC cluster, run as one
domain user; for a non-domain-joined HPC cluster, run as one local user on the head node).
1. Use the following commands to set the credentials:
$localUser = "<username>"
$localUserPassword="<password>"
2. Then submit the job as follows. The job/task runs under $localUser on the compute nodes.
$emptycreds = New-Object System.Management.Automation.PSCredential ($localUser, (new-object
System.Security.SecureString))
...
$job = New-HpcJob –Scheduler https://<Azure load balancer DNS name>
Add-HpcTask -Job $job -CommandLine "ping localhost" -Scheduler https://<Azure load balancer DNS name>
Submit-HpcJob -Job $job -Scheduler https://<Azure load balancer DNS name> -Credential $emptycreds
If –Credential is not specified with Submit-HpcJob , the job or task runs under a local mapped user as the
Azure AD account. (The HPC cluster creates a local user with the same name as the Azure AD account to
run the task.)
3. Set extended data for the Azure AD account. This is useful when running an MPI job on Linux nodes using
the Azure AD account.
Set extended data for the Azure AD account itself
Use a Microsoft HPC Pack 2012 R2 virtual machine image from the Azure Marketplace and the Azure portal to
create the head node of an HPC cluster. This HPC Pack VM image is based on Windows Server 2012 R2
Datacenter with HPC Pack 2012 R2 Update 3 pre-installed. Use this head node for a proof of concept deployment
of HPC Pack in Azure. You can then add compute nodes to the cluster to run HPC workloads.
TIP
To deploy a complete HPC Pack 2012 R2 cluster in Azure that includes the head node and compute nodes, we recommend
that you use an automated method. Options include the HPC Pack IaaS deployment script and Resource Manager templates
such as the HPC Pack cluster for Windows workloads. Resource Manager templates are also available for Microsoft HPC Pack
2016 clusters.
Planning considerations
As shown in the following figure, you deploy the HPC Pack head node in an Active Directory domain in an Azure
virtual network.
Active Directory domain: The HPC Pack 2012 R2 head node must be joined to an Active Directory
domain in Azure before you start the HPC services on the VM. As shown in this article, for a proof of
concept deployment, you can promote the VM you create for the head node as a domain controller before
starting the HPC services. Another option is to deploy a separate domain controller and forest in Azure to
which you join the head node VM.
Deployment model: For most new deployments, Microsoft recommends that you use the Resource
Manager deployment model. This article assumes that you use this deployment model.
Azure virtual network: When you use the Resource Manager deployment model to deploy the head node,
you specify or create an Azure virtual network. You use the virtual network if you need to join the head node
to an existing Active Directory domain. You also need it later to add compute node VMs to the cluster.
NOTE
If you want to join the head node to an existing Active Directory domain in Azure, make sure you specify the virtual
network for that domain when creating the VM.
5. After you create the VM and the VM is running, connect to the VM by Remote Desktop.
6. Join the VM to an Active Directory domain forest by choosing one of the following options:
If you created the VM in an Azure virtual network with an existing domain forest, join the VM to the
forest by using standard Server Manager or Windows PowerShell tools. Then restart.
If you created the VM in a new virtual network (without an existing domain forest), then promote the VM
as a domain controller. Use standard steps to install and configure the Active Directory Domain Services
role on the head node. For detailed steps, see Install a New Windows Server 2012 Active Directory
Forest.
7. After the VM is running and is joined to an Active Directory forest, start the HPC Pack services as follows:
a. Connect to the head node VM using a domain account that is a member of the local Administrators
group. For example, use the administrator account you set up when you created the head node VM.
b. For a default head node configuration, start Windows PowerShell as an administrator and type the
following:
It can take several minutes for the HPC Pack services to start.
For additional head node configuration options, type get-help HPCHNPrepare.ps1 .
Next steps
You can now work with the head node of your HPC Pack cluster. For example, start HPC Cluster Manager, and
complete the Deployment To-do List.
If you want to increase the cluster compute capacity on-demand, add Azure burst nodes in a cloud service.
Try running a test workload on the cluster. For an example, see the HPC Pack getting started guide.
Submit HPC jobs from an on-premises computer to
an HPC Pack cluster deployed in Azure
8/2/2018 • 7 minutes to read • Edit Online
NOTE
Azure has two different deployment models for creating and working with resources: Resource Manager and classic. This
article covers using both models, but Microsoft recommends that most new deployments use the Resource Manager model.
Configure an on-premises client computer to submit jobs to a Microsoft HPC Pack cluster in Azure. This article
shows you how to set up a local computer with client tools to submit job over HTTPS to the cluster in Azure. In
this way, several cluster users can submit jobs to a cloud-based HPC Pack cluster, but without connecting directly
to the head node VM or accessing an Azure subscription.
Prerequisites
HPC Pack head node deployed in an Azure VM - We recommend that you use automated tools such as an
Azure quickstart template to deploy the head node and cluster. You need the DNS name of the head node and
the credentials of a cluster administrator to complete the steps in this article.
Client computer - You need a Windows or Windows Server client computer that can run HPC Pack client
utilities (see system requirements). If you only want to use the HPC Pack web portal or REST API to submit
jobs, you can use any client computer of your choice.
HPC Pack installation media - To install the HPC Pack client utilities, the free installation package for the
latest version of HPC Pack is available from the Microsoft Download Center. Make sure that you download the
same version of HPC Pack that is installed on the head node VM.
Step 1: Install and configure the web components on the head node
To enable a REST interface to submit jobs to the cluster over HTTPS, ensure that the HPC Pack web components
are configured on the HPC Pack head node. If they aren't already installed, first install the web components by
running the HpcWebComponents.msi installation file. Then, configure the components by running the HPC
PowerShell script Set-HPCWebComponents.ps1.
For detailed procedures, see Install the Microsoft HPC Pack Web Components.
TIP
Certain Azure quickstart templates for HPC Pack clusters install and configure the web components automatically.
cd $env:CCP_HOME\bin
3. To configure the REST interface and start the HPC Web Service, type the following command:
4. When prompted to select a certificate, choose the certificate that corresponds to the public DNS name of
the head node. For example, if you deploy the head node VM using the classic deployment model, the
certificate name looks like CN=<HeadNodeDnsName>.cloudapp.net. If you use the Resource Manager
deployment model, the certificate name looks like CN=<HeadNodeDnsName>.
<region>.cloudapp.azure.com.
NOTE
You select this certificate later when you submit jobs to the head node from an on-premises computer. Don't select
or configure a certificate that corresponds to the computer name of the head node in the Active Directory domain
(for example, CN=MyHPCHeadNode.HpcAzure.local).
5. To configure the web portal for job submission, type the following command:
6. After the script completes, stop and restart the HPC Job Scheduler Service by typing the following
commands:
TIP
You might see a security warning, because the certification authority on the head node isn't recognized by the client
computer. For testing purposes, you can ignore this warning and complete the certificate import.
or
TIP
Use the full DNS name of the head node, not the IP address, in the scheduler URL. If you specify the IP address, an
error appears similar to "The server certificate needs to either have a valid chain of trust or to be placed in the
trusted root store."
3. When prompted, type the user name (in the form <DomainName>\<UserName>) and password of the
HPC cluster administrator or another cluster user that you configured. You can choose to store the
credentials locally for more job operations.
A list of jobs appears.
To use HPC Job Manager on the client computer
1. If you didn't previously store domain credentials for a cluster user when submitting a job, you can add the
credentials in Credential Manager.
a. In Control Panel on the client computer, start Credential Manager.
b. Click Windows Credentials > Add a generic credential.
c. Specify the Internet address (for example, https://<HeadNodeDnsName>.cloudapp.net/HpcScheduler or
https://<HeadNodeDnsName>.<region>.cloudapp.azure.com/HpcScheduler), and the user name
(<DomainName>\<UserName>) and password of the cluster administrator or another cluster user that
you configured.
2. On the client computer, start HPC Job Manager.
3. In the Select Head Node dialog box, type the URL to the head node in Azure (for example,
https://<HeadNodeDnsName>.cloudapp.net or https://<HeadNodeDnsName>.
<region>.cloudapp.azure.com).
HPC Job Manager opens and shows a list of jobs on the head node.
To use the web portal running on the head node
1. Start a web browser on the client computer, and enter one of the following addresses, depending on the full
DNS name of the head node:
https://<HeadNodeDnsName>.cloudapp.net/HpcPortal
or
https://<HeadNodeDnsName>.<region>.cloudapp.azure.com/HpcPortal
2. In the security dialog box that appears, type the domain credentials of the HPC cluster administrator. (You
can also add other cluster users in different roles. See Managing Cluster Users.)
The web portal opens to the job list view.
3. To submit a sample job that returns the string “Hello World” from the cluster, click New job in the left-hand
navigation.
4. On the New Job page, under From submission pages, click HelloWorld. The job submission page appears.
5. Click Submit. If prompted, provide the domain credentials of the HPC cluster administrator. The job is
submitted, and the job ID appears on the My Jobs page.
6. To view the results of the job that you submitted, click the job ID, and then click View Tasks to view the
command output (under Output).
Next steps
You can also submit jobs to the Azure cluster with the HPC Pack REST API.
If you want to submit cluster jobs from a Linux client, see the Python sample in the HPC Pack 2012 R2 SDK
and Sample Code.
Get started running Excel and SOA workloads on an
HPC Pack cluster in Azure
8/2/2018 • 14 minutes to read • Edit Online
This article shows you how to deploy a Microsoft HPC Pack 2012 R2 cluster on Azure virtual machines by using
an Azure quickstart template, or optionally an Azure PowerShell deployment script. The cluster uses Azure
Marketplace VM images designed to run Microsoft Excel or service-oriented architecture (SOA) workloads with
HPC Pack. You can use the cluster to run Excel HPC and SOA services from an on-premises client computer. The
Excel HPC services include Excel workbook offloading and Excel user-defined functions, or UDFs.
IMPORTANT
This article is based on features, templates, and scripts for HPC Pack 2012 R2. This scenario is not currently supported in
HPC Pack 2016.
NOTE
Azure has two different deployment models for creating and working with resources: Resource Manager and classic. This
article covers using both models, but Microsoft recommends that most new deployments use the Resource Manager model.
At a high level, the following diagram shows the HPC Pack cluster you create.
Prerequisites
Client computer - You need a Windows-based client computer to submit sample Excel and SOA jobs to the
cluster. You also need a Windows computer to run the Azure PowerShell cluster deployment script (if you
choose that deployment method).
Azure subscription - If you don't have an Azure subscription, you can create a free account in just a couple of
minutes.
Cores quota - You might need to increase the quota of cores, especially if you deploy several cluster nodes
with multicore VM sizes. If you are using an Azure quickstart template, the cores quota in Resource Manager is
per Azure region. In that case, you might need to increase the quota in a specific region. See Azure subscription
limits, quotas, and constraints. To increase a quota, open an online customer support request at no charge.
Microsoft Office license - If you deploy compute nodes using a Marketplace HPC Pack 2012 R2 VM image
with Microsoft Excel, a 30-day evaluation version of Microsoft Excel Professional Plus 2013 is installed. After
the evaluation period, you need to provide a valid Microsoft Office license to activate Excel to continue to run
workloads. See Excel activation later in this article.
Step 1. Set up an HPC Pack cluster in Azure
We show two options to set up the HPC Pack 2012 R2 cluster: first, using an Azure quickstart template and the
Azure portal; and second, using an Azure PowerShell deployment script.
Option 1. Use a quickstart template
Use an Azure quickstart template to quickly deploy an HPC Pack cluster in the Azure portal. When you open the
template in the portal, you get a simple UI where you enter the settings for your cluster. Here are the steps.
TIP
If you want, use an Azure Marketplace template that creates a similar cluster specifically for Excel workloads. The steps differ
slightly from the following.
1. Visit the Create HPC Cluster template page on GitHub. If you want, review information about the template and
the source code.
2. Click Deploy to Azure to start a deployment with the template in the Azure portal.
3. In the portal, follow these steps to enter the parameters for the HPC cluster template.
a. On the Parameters page, enter or modify values for the template parameters. (Click the icon next to each
setting for help information.) Sample values are shown in the following screen. This example creates a
cluster named hpc01 in the hpc.local domain consisting of a head node and 2 compute nodes. The compute
nodes are created from an HPC Pack VM image that includes Microsoft Excel.
NOTE
The head node VM is created automatically from the latest Marketplace image of HPC Pack 2012 R2 on Windows
Server 2012 R2. Currently the image is based on HPC Pack 2012 R2 Update 3.
Compute node VMs are created from the latest image of the selected compute node family. Select the
ComputeNodeWithExcel option for the latest HPC Pack compute node image that includes an evaluation version of
Microsoft Excel Professional Plus 2013. To deploy a cluster for general SOA sessions or for Excel UDF offloading,
choose the ComputeNode option (without Excel installed).
# remove the compute node role for head node to make sure the Excel workbook won’t run on head node
Get-HpcNode -GroupName HeadNodes | Set-HpcNodeState -State offline | Set-HpcNode -Role BrokerNode
# total number of nodes in the deployment including the head node and compute nodes, which should match
the number specified in the XML configuration file
$TotalNumOfNodes = 19
$ErrorActionPreference = 'SilentlyContinue'
# bring nodes online when they are deployed until all nodes are online
while ($true)
{
Get-HpcNode -State Offline | Set-HpcNodeState -State Online -Confirm:$false
$OnlineNodes = @(Get-HpcNode -State Online)
if ($OnlineNodes.Count -eq $TotalNumOfNodes)
{
break
}
sleep 60
}
cd E:\IaaSClusterScript
3. To deploy the HPC Pack cluster, run the following command. This example assumes that the configuration
file is located in E:\HPCDemoConfig.xml.
The HPC Pack deployment script runs for some time. One thing the script does is to export and download the
cluster certificate and save it in the current user’s Documents folder on the client computer. The script generates a
message similar to the following. In a following step, you import the certificate in the appropriate certificate store.
You have enabled REST API or web portal on HPC Pack head node. Please import the following certificate in the
Trusted Root Certification Authorities certificate store on the computer where you are submitting job or
accessing the HPC web portal:
C:\Users\hpcuser\Documents\HPCWebComponent_HPCExcelHN004_20150707162011.cer
* To use KMS/AD-BA, use an existing KMS server or set up a new one by using the Microsoft Office 2013 Volume
License Pack. (If you want to, set up the server on the head node.) Then, activate the KMS host key via the
Internet or telephone. Then clusrun `ospp.vbs` to set the KMS server and port and activate Office on all the
Excel compute nodes.
* To use MAK, first clusrun `ospp.vbs` to input the key and then activate all the Excel compute nodes via the
Internet or telephone.
NOTE
Retail product keys for Office Professional Plus 2013 cannot be used with this VM image. If you have valid keys and
installation media for Office or Excel editions other than this Office Professional Plus 2013 volume edition, you can use them
instead. First uninstall this volume edition and install the edition that you have. The reinstalled Excel compute node can be
captured as a customized VM image to use in a deployment at scale.
<?xml version="1.0"?>
<configuration>
<startup useLegacyV2RuntimeActivationPolicy="true">
<supportedRuntime version="v4.0" sku=".NETFramework,Version=v4.0"/>
</startup>
</configuration>
4. Set up the client to submit jobs to the HPC Pack cluster. One option is to download the full HPC Pack 2012 R2
Update 3 installation and install the HPC Pack client. Alternatively, download and install the HPC Pack 2012 R2
Update 3 client utilities and the appropriate Visual C++ 2010 redistributable for your computer (x64, x86).
5. In this example, we use a sample Excel workbook named ConvertiblePricing_Complete.xlsb. You can download
it here.
6. Copy the Excel workbook to a working folder such as D:\Excel\Run.
7. Open the Excel workbook. On the Develop ribbon, click COM Add-Ins and confirm that the HPC Pack
Excel COM add-in is loaded successfully.
8. Edit the VBA macro HPCControlMacros in Excel by changing the commented lines as shown in the
following script. Substitute appropriate values for your environment.
'HPCExcelClient.Initialize ActiveWorkbook
HPCExcelClient.Initialize ActiveWorkbook, HPC_DependFiles
9. Copy the Excel workbook to an upload directory such as D:\Excel\Upload. This directory is specified in the
HPC_DependsFiles constant in the VBA macro.
10. To run the workbook on the cluster in Azure, click the Cluster button on the worksheet.
Run Excel UDFs
To run Excel UDFs, follow the preceding steps 1 – 3 to set up the client computer. For Excel UDFs, you don't need
to have the Excel application installed on compute nodes. So, when creating your cluster compute nodes, you could
choose a normal compute node image instead of the compute node image with Excel.
NOTE
There is a 34 character limit in the Excel 2010 and 2013 cluster connector dialog box. You use this dialog box to specify the
cluster that runs the UDFs. If the full cluster name is longer (for example, hpcexcelhn01.southeastasia.cloudapp.azure.com), it
does not fit in the dialog box. The workaround is to set a machine-wide variable such as CCP_IAASHN with the value of the
long cluster name. Then, enter %CCP_IAASHN% in the dialog box as the cluster head node name.
After the cluster is successfully deployed, continue with the following steps to run a sample built-in Excel UDF. For
customized Excel UDFs, see these resources to build the XLLs and deploy them on the IaaS cluster.
1. Open a new Excel workbook. On the Develop ribbon, click Add-Ins. Then, in the dialog box, click Browse,
navigate to the %CCP_HOME%Bin\XLL32 folder, and select the sample ClusterUDF32.xll. If the
ClusterUDF32 doesn't exist on the client machine, copy it from the %CCP_HOME%Bin\XLL32 folder on the
head node.
2. Click File > Options > Advanced. Under Formulas, check Allow user-defined XLL functions to run a
compute cluster. Then click Options and enter the full cluster name in Cluster head node name. (As
noted previously this input box is limited to 34 characters, so a long cluster name may not fit. You may use a
machine-wide variable here for a long cluster name.)
3. To run the UDF calculation on the cluster, click the cell with value =XllGetComputerNameC () and press
Enter. The function simply retrieves the name of the compute node on which the UDF runs. For the first run,
a credentials dialog box prompts for the username and password to connect to the IaaS cluster.
When there are many cells to calculate, press Alt-Shift-Ctrl + F9 to run the calculation on all cells.
// Before
const string headnode = "[headnode]";
// After e.g.
const string headnode = "hpc01.eastus.cloudapp.azure.com";
or
const string headnode = "hpc01.cloudapp.net";
info.TransportScheme = TransportScheme.Http;
Optionally, set the UseAzureQueue flag to true in SessionStartInfo. If not set, it will be set to true by default
when the cluster name has Azure domain suffixes and the TransportScheme is Http.
info.UseAzureQueue = true;
info.UseAzureQueue = false;
Next steps
See these resources for more information about running Excel workloads with HPC Pack.
See Managing SOA Services in Microsoft HPC Pack for more about deploying and managing SOA services
with HPC Pack.
Frequently asked questions about Azure IaaS VM
disks and managed and unmanaged premium disks
4/9/2018 • 14 minutes to read • Edit Online
This article answers some frequently asked questions about Azure Managed Disks and Azure Premium SSD disks.
Managed Disks
What is Azure Managed Disks?
Managed Disks is a feature that simplifies disk management for Azure IaaS VMs by handling storage account
management for you. For more information, see the Managed Disks overview.
If I create a standard managed disk from an existing VHD that's 80 GB, how much will that cost me?
A standard managed disk created from an 80-GB VHD is treated as the next available standard disk size, which is
an S10 disk. You're charged according to the S10 disk pricing. For more information, see the pricing page.
Are there any transaction costs for standard managed disks?
Yes. You're charged for each transaction. For more information, see the pricing page.
For a standard managed disk, will I be charged for the actual size of the data on the disk or for the
provisioned capacity of the disk?
You're charged based on the provisioned capacity of the disk. For more information, see the pricing page.
How is pricing of premium managed disks different from unmanaged disks?
The pricing of premium managed disks is the same as unmanaged premium disks.
Can I change the storage account type (Standard or Premium ) of my managed disks?
Yes. You can change the storage account type of your managed disks by using the Azure portal, PowerShell, or the
Azure CLI.
Can I use a VHD file in an Azure storage account to create a managed disk with a different subscription?
Yes.
Can I use a VHD file in an Azure storage account to create a managed disk in a different region?
No.
Are there any scale limitations for customers that use managed disks?
Managed Disks eliminates the limits associated with storage accounts. However, the maximum limit is 50,000
managed disks per region and per disk type for a subscription.
Can I take an incremental snapshot of a managed disk?
No. The current snapshot capability makes a full copy of a managed disk.
Can VMs in an availability set consist of a combination of managed and unmanaged disks?
No. The VMs in an availability set must use either all managed disks or all unmanaged disks. When you create an
availability set, you can choose which type of disks you want to use.
Is Managed Disks the default option in the Azure portal?
Yes.
Can I create an empty managed disk?
Yes. You can create an empty disk. A managed disk can be created independently of a VM, for example, without
attaching it to a VM.
What is the supported fault domain count for an availability set that uses Managed Disks?
Depending on the region where the availability set that uses Managed Disks is located, the supported fault domain
count is 2 or 3.
How is the standard storage account for diagnostics set up?
You set up a private storage account for VM diagnostics.
What kind of Role-Based Access Control support is available for Managed Disks?
Managed Disks supports three key default roles:
Owner: Can manage everything, including access
Contributor: Can manage everything except access
Reader: Can view everything, but can't make changes
Is there a way that I can copy or export a managed disk to a private storage account?
You can generate a read-only shared access signature (SAS ) URI for the managed disk and use it to copy the
contents to a private storage account or on-premises storage. You can use the SAS URI using the Azure portal,
Azure PowerShell, the Azure CLI, or AzCopy
Can I create a copy of my managed disk?
Customers can take a snapshot of their managed disks and then use the snapshot to create another managed disk.
Are unmanaged disks still supported?
Yes, both unmanaged and managed disks are supported. We recommend that you use managed disks for new
workloads and migrate your current workloads to managed disks.
If I create a 128-GB disk and then increase the size to 130 GiB, will I be charged for the next disk size
(256 GiB )?
Yes.
Can I create locally redundant storage, geo-redundant storage, and zone-redundant storage managed
disks?
Azure Managed Disks currently supports only locally redundant storage managed disks.
Can I shrink or downsize my managed disks?
No. This feature is not supported currently.
Can I break a lease on my disk?
No. This is not supported currently as a lease is present to prevent accidental deletion when the disk is being used.
Can I change the computer name property when a specialized (not created by using the System
Preparation tool or generalized) operating system disk is used to provision a VM?
No. You can't update the computer name property. The new VM inherits it from the parent VM, which was used to
create the operating system disk.
Where can I find sample Azure Resource Manager templates to create VMs with managed disks?
List of templates using Managed Disks
https://github.com/chagarw/MDPP
Can I co-locate unmanaged and managed disks on the same VM?
No.
When creating a disk from a blob, is there any continually existing relationship with that source blob?
No, when the new disk is created it is a full standalone copy of that blob at that time and there is no connection
between the two. If you like, once you've created the disk, the source blob may be deleted without affecting the
newly created disk in any way.
Can I rename a managed or unmanaged disk after it has been created?
For managed disks you cannot rename them. However, you may rename an unmanaged disk as long as it is not
currently attached to a VHD or VM.
"osDisk": {
"osType": "Windows",
"name": "myOsDisk",
"caching": "ReadWrite",
"createOption": "FromImage",
"managedDisk": {
"storageAccountType": "StandardSSD_LRS"
}
}
For a complete template example of how to create a Standard SSD disk with a template, see Create a VM from a
Windows Image with Standard SSD Data Disks.
Can I convert my existing disks to Standard SSD? Yes, you can. Refer to Convert Azure managed disks storage
from standard to premium, and vice versa for the general guidelines for converting Managed Disks. And, use the
following value to update the disk type to Standard SSD. -AccountType StandardSSD_LRS
What is the benefit of using Standard SSD disks instead of HDD? Standard SSD disks deliver better latency,
consistency, availability and reliability compared to HDD disks. Application workloads run a lot more smoothly on
Standard SSD because of that. Note, Premium SSD disks are the recommended solution for most IO -intensive
production workloads.
Can I use Standard SSDs as Unmanaged Disks? No, Standard SSDs disks are only available as Managed Disks.
Do Standard SSD Disks support "single instance VM SLA"? No, Standard SSDs do not have single instance
VM SLA. Use Premium SSD disks for single instance VM SLA.
Are P4 and P6 disk sizes supported for unmanaged disks or page blobs?
P4 (32 GiB ) and P6 (64 GiB ) disk sizes are not supported as the default disk tiers for unmanaged disks and page
blobs. You need to explicitly set the Blob Tier to P4 and P6 to have your disk mapped to these tiers. If you deploy a
unmanaged disk or page blob with the disk size or content length less than 32 GiB or between 32 GiB to 64 GiB
without setting the Blob Tier, you will continue to land on P10 with 500 IOPS and 100 MiB/s and the mapped
pricing tier.
If my existing premium managed disk less than 64 GiB was created before the small disk was enabled
(around June 15, 2017), how is it billed?
Existing small premium disks less than 64 GiB continue to be billed according to the P10 pricing tier.
How can I switch the disk tier of small premium disks less than 64 GiB from P10 to P4 or P6?
You can take a snapshot of your small disks and then create a disk to automatically switch the pricing tier to P4 or
P6 based on the provisioned size.
Can you resize existing Managed Disks from sizes less than 4 TiB to new newly introduced disk sizes up
to 32 TiB?
New Managed Disk sizes 8 TiB, 16 TiB, and 32 TiB are currently in Preview. We don’t yet support resizing existing
disk sizes to the new disk sizes.
What is the largest disk sizes supported by Azure Backup and Azure Site Recovery service?
The largest disk size supported by Azure Backup and Azure Site Recovery service is 4 TiB.
What are the recommended VM sizes for large disk sizes (>4TiB ) for Standard SSD and Standard HDD
disks to achieve optimized disk IOPS and Bandwidth?
To achieve the disk throughput of Standard SSD and Standard HDD large disk sizes (>4TB ) beyond 500 IOPS and
60 MiB/s, you should use one of the following VM sizes to optimize your performance: B -series, DSv2-series,
Dsv3-Series, ESv3-Series, Fs-series, Fsv2-series, M -series, GS -series, NCv2-series, NCv3-series, or Ls-Series VMs.
What regions are the managed disk sizes larger than 4 TiB supported in?
At this time in the preview, the managed disk sizes are supported in West US Central only.
Do we support enabling Host Caching on the newer disk sizes?
We support Host Caching of ReadOnly and Read/Write on disk sizes less than 4TiB. For disk sizes more than 4 TiB,
we don’t support setting caching option other than None. We recommend leveraging caching for smaller disk sizes
where you can expect to observe better performance boost with data cached to the VM.
This article shows you how to attach both new and existing disks to a Windows virtual machine by using
PowerShell.
First, review these tips:
The size of the virtual machine controls how many data disks you can attach. For more information, see Sizes
for virtual machines.
To use Premium storage, you'll need a Premium Storage-enabled VM type like the DS -series or GS -series
virtual machine. For more information, see Premium Storage: High-Performance Storage for Azure Virtual
Machine Workloads.
Click the Cloud Shell button on the menu in the upper right
of the Azure portal.
To install and use the PowerShell locally, this tutorial requires the Azure PowerShell module version 6.0.0 or later.
Run Get-Module -ListAvailable AzureRM to find the version. If you need to upgrade, see Install Azure PowerShell
module. If you are running PowerShell locally, you'll also need to run Connect-AzureRmAccount to create a
connection with Azure.
$rgName = 'myResourceGroup'
$vmName = 'myVM'
$location = 'East US 2'
$storageType = 'Premium_LRS'
$dataDiskName = $vmName + '_datadisk1'
$location = "location-name"
$scriptName = "script-name"
$fileName = "script-file-name"
Set-AzureRmVMCustomScriptExtension -ResourceGroupName $rgName -Location $locName -VMName $vmName -Name
$scriptName -TypeHandlerVersion "1.4" -StorageAccountName "mystore1" -StorageAccountKey "primary-key" -
FileName $fileName -ContainerName "scripts"
The script file can contain code to initialize the disks, for example:
$disks = Get-Disk | Where partitionstyle -eq 'raw' | sort number
$rgName = "myResourceGroup"
$vmName = "myVM"
$location = "East US"
$dataDiskName = "myDisk"
$disk = Get-AzureRmDisk -ResourceGroupName $rgName -DiskName $dataDiskName
Next steps
Create a snapshot.
Attach a managed data disk to a Windows VM by
using the Azure portal
10/11/2018 • 2 minutes to read • Edit Online
This article shows you how to attach a new managed data disk to a Windows virtual machine (VM ) by using the
Azure portal. The size of the VM determines how many data disks you can attach. For more information, see Sizes
for virtual machines.
If the command returns 0, TRIM is enabled correctly. Otherwise, if it returns 1, run the following command to
enable TRIM:
After you delete data from your disk, you can ensure the TRIM operations flush properly by running defrag with
TRIM:
defrag.exe <volume:> -l
You can also format the volume to ensure the entire volume is trimmed.
Next steps
You can also attach a data disk by using PowerShell.
If your application needs to use the D: drive to store data, you can change the drive letter of the Windows
temporary disk.
How to detach a data disk from a Windows virtual
machine
7/19/2018 • 2 minutes to read • Edit Online
When you no longer need a data disk that's attached to a virtual machine, you can easily detach it. This removes
the disk from the virtual machine, but doesn't remove it from storage.
WARNING
If you detach a disk it is not automatically deleted. If you have subscribed to Premium storage, you will continue to incur
storage charges for the disk. For more information, see Pricing and Billing when using Premium Storage.
If you want to use the existing data on the disk again, you can reattach it to the same virtual machine, or another
one.
Next steps
If you want to reuse the data disk, you can just attach it to another VM
How to expand the OS drive of a virtual machine
10/15/2018 • 4 minutes to read • Edit Online
When you create a new virtual machine (VM ) in a Resource Group by deploying an image from Azure
Marketplace, the default OS drive is often 127 GB (some images have smaller OS disk sizes by default). Even
though it’s possible to add data disks to the VM (how many depending upon the SKU you’ve chosen) and
moreover it’s recommended to install applications and CPU intensive workloads on these addendum disks,
oftentimes customers need to expand the OS drive to support certain scenarios such as following:
Support legacy applications that install components on OS drive.
Migrate a physical PC or virtual machine from on-premises with a larger OS drive.
IMPORTANT
Resizing the OS Disk of an Azure Virtual Machine will cause it to restart.
After expanding the disks, you need to expand the volume within the OS to take advantage of the larger disk.
Connect-AzureRmAccount
Select-AzureRmSubscription –SubscriptionName 'my-subscription-name'
$rgName = 'my-resource-group-name'
$vmName = 'my-vm-name'
5. Obtain a reference to the managed OS disk. Set the size of the managed OS disk to the desired value and
update the Disk as follows:
6. Updating the VM may take a few seconds. Once the command finishes executing, restart the VM as follows:
And that’s it! Now RDP into the VM, open Computer Management (or Disk Management) and expand the drive
using the newly allocated space.
Connect-AzureRmAccount
Select-AzureRmSubscription –SubscriptionName 'my-subscription-name'
$rgName = 'my-resource-group-name'
$vmName = 'my-vm-name'
5. Set the size of the unmanaged OS disk to the desired value and update the VM as follows:
$vm.StorageProfile.OSDisk.DiskSizeGB = 1023
Update-AzureRmVM -ResourceGroupName $rgName -VM $vm
WARNING
The new size should be greater than the existing disk size. The maximum allowed is 2048 GB for OS disks. (It is
possible to expand the VHD blob beyond that size, but the OS will only be able to work with the first 2048 GB of
space.)
6. Updating the VM may take a few seconds. Once the command finishes executing, restart the VM as follows:
Start-AzureRmVM -ResourceGroupName $rgName -Name $vmName
Connect-AzureRmAccount
Select-AzureRmSubscription -SubscriptionName 'my-subscription-name'
$rgName = 'my-resource-group-name'
$vmName = 'my-vm-name'
$vm = Get-AzureRmVM -ResourceGroupName $rgName -Name $vmName
Stop-AzureRmVM -ResourceGroupName $rgName -Name $vmName
$disk= Get-AzureRmDisk -ResourceGroupName $rgName -DiskName $vm.StorageProfile.OsDisk.Name
$disk.DiskSizeGB = 1023
Update-AzureRmDisk -ResourceGroupName $rgName -Disk $disk -DiskName $disk.Name
Start-AzureRmVM -ResourceGroupName $rgName -Name $vmName
Unmanaged disks
Connect-AzureRmAccount
Select-AzureRmSubscription -SubscriptionName 'my-subscription-name'
$rgName = 'my-resource-group-name'
$vmName = 'my-vm-name'
$vm = Get-AzureRmVM -ResourceGroupName $rgName -Name $vmName
Stop-AzureRmVM -ResourceGroupName $rgName -Name $vmName
$vm.StorageProfile.OSDisk.DiskSizeGB = 1023
Update-AzureRmVM -ResourceGroupName $rgName -VM $vm
Start-AzureRmVM -ResourceGroupName $rgName -Name $vmName
Unmanaged disk
$vm.StorageProfile.DataDisks[0].DiskSizeGB = 1023
Similarly you may reference other data disks attached to the VM, either by using an index as shown above or the
Name property of the disk:
Managed disk
Next steps
You can also attach disks using the Azure portal.
Create a snapshot
10/11/2018 • 2 minutes to read • Edit Online
A snapshot is a full, read-only copy of a virtual hard drive (VHD ). You can take a snapshot of an OS or data disk
VHD to use as a backup, or to troubleshoot virtual machine (VM ) issues.
Use PowerShell
The following steps show how to copy the VHD disk, create the snapshot configuration, and take a snapshot of the
disk by using the New -AzureRmSnapshot cmdlet.
Before you begin, ensure you have the latest version of the AzureRM.Compute PowerShell module, which must
be version 5.7.0 or later. Run Get-Module -ListAvailable AzureRM to find the version. If you need to upgrade, see
Install Azure PowerShell module. If you're running PowerShell locally, run Connect-AzureRmAccount to create a
connection with Azure.
1. Set some parameters:
$resourceGroupName = 'myResourceGroup'
$location = 'eastus'
$vmName = 'myVM'
$snapshotName = 'mySnapshot'
$vm = get-azurermvm `
-ResourceGroupName $resourceGroupName
-Name $vmName
3. Create the snapshot configuration. For this example, the snapshot is of the OS disk:
$snapshot = New-AzureRmSnapshotConfig
-SourceUri $vm.StorageProfile.OsDisk.ManagedDisk.Id
-Location $location
-CreateOption copy
NOTE
If you would like to store your snapshot in zone-resilient storage, create it in a region that supports availability zones
and include the -SkuName Standard_ZRS parameter.
New-AzureRmSnapshot
-Snapshot $snapshot
-SnapshotName $snapshotName
-ResourceGroupName $resourceGroupName
Next steps
Create a virtual machine from a snapshot by creating a managed disk from a snapshot and then attaching the new
managed disk as the OS disk. For more information, see the sample in Create a VM from a snapshot with
PowerShell.
Back up Azure unmanaged VM disks with incremental
snapshots
8/21/2017 • 7 minutes to read • Edit Online
Overview
Azure Storage provides the capability to take snapshots of blobs. Snapshots capture the blob state at that point in
time. In this article, we describe a scenario in which you can maintain backups of virtual machine disks using
snapshots. You can use this methodology when you choose not to use Azure Backup and Recovery Service, and
wish to create a custom backup strategy for your virtual machine disks.
Azure virtual machine disks are stored as page blobs in Azure Storage. Since we are describing a backup strategy
for virtual machine disks in this article, we refer to snapshots in the context of page blobs. To learn more about
snapshots, refer to Creating a Snapshot of a Blob.
What is a snapshot?
A blob snapshot is a read-only version of a blob that is captured at a point in time. Once a snapshot has been
created, it can be read, copied, or deleted, but not modified. Snapshots provide a way to back up a blob as it
appears at a moment in time. Until REST version 2015-04-05, you had the ability to copy full snapshots. With the
REST version 2015-07-08 and above, you can also copy incremental snapshots.
NOTE
If you copy the base blob to another destination, the snapshots of the blob are not copied along with it. Similarly, if you
overwrite a base blob with a copy, snapshots associated with the base blob are not affected and stay intact under the base
blob name.
Scenario
In this section, we describe a scenario that involves a custom backup strategy for virtual machine disks using
snapshots.
Consider a DS -series Azure VM with a premium storage P30 disk attached. The P30 disk called mypremiumdisk is
stored in a premium storage account called mypremiumaccount. A standard storage account called
mybackupstdaccount is used for storing the backup of mypremiumdisk. We would like to keep a snapshot of
mypremiumdisk every 12 hours.
To learn about creating a storage account, see Create a storage account.
To learn about backing up Azure VMs, refer to Plan Azure VM backups.
Next Steps
Use the following links to learn more about creating snapshots of a blob and planning your VM backup
infrastructure.
Creating a Snapshot of a Blob
Plan your VM Backup Infrastructure
Update the storage type of a managed disk
10/11/2018 • 3 minutes to read • Edit Online
Azure Managed Disks offers three storage type options: Premium SSD, Standard SSD, and Standard HDD. You
can switch a managed disk between storage types with minimal downtime, based on your performance needs.
Switching between storage types is not supported for an unmanaged disk; however, you can easily convert an
unmanaged disk to a managed disk.
This article shows how to convert a managed disk from standard to premium, and vice versa, by using Azure
PowerShell. If you need to install or upgrade PowerShell, see Install and configure Azure PowerShell.
Prerequisites
Because the conversion requires a restart of the virtual machine (VM ), you should schedule the migration of
your disks storage during a pre-existing maintenance window.
If you're using an unmanaged disk, first convert it to a managed disk to allow you to switch it between the
storage types.
The examples in this article require the Azure PowerShell module version 6.0.0 or later. Run
Get-Module -ListAvailable AzureRM to find the version. If you need to upgrade, see Install Azure PowerShell
module. Run Connect-AzureRmAccount to create a connection with Azure.
# For disks that belong to the selected VM, convert to premium storage
foreach ($disk in $vmDisks)
{
if ($disk.ManagedBy -eq $vm.Id)
{
$diskUpdateConfig = New-AzureRmDiskUpdateConfig –AccountType $storageType
Update-AzureRmDisk -DiskUpdate $diskUpdateConfig -ResourceGroupName $rgName `
-DiskName $disk.Name
}
}
$diskName = 'yourDiskName'
# resource group that contains the managed disk
$rgName = 'yourResourceGroupName'
# Choose between Standard_LRS and StandardSSD_LRS based on your scenario
$storageType = 'StandardSSD_LRS'
Next steps
Make a read-only copy of a VM by using a snapshot.
Migrate to Premium Storage by using Azure Site
Recovery
10/18/2018 • 11 minutes to read • Edit Online
Azure Premium Storage delivers high-performance, low -latency disk support for virtual machines (VMs) that are
running I/O -intensive workloads. This guide helps you migrate your VM disks from a standard storage account to
a premium storage account by using Azure Site Recovery.
Site Recovery is an Azure service that contributes to your strategy for business continuity and disaster recovery by
orchestrating the replication of on-premises physical servers and VMs to the cloud (Azure) or to a secondary
datacenter. When outages occur in your primary location, you fail over to the secondary location to keep
applications and workloads available. You fail back to your primary location when it returns to normal operation.
Site Recovery provides test failovers to support disaster recovery drills without affecting production environments.
You can run failovers with minimal data loss (depending on replication frequency) for unexpected disasters. In the
scenario of migrating to Premium Storage, you can use the failover in Site Recovery to migrate target disks to a
premium storage account.
We recommend migrating to Premium Storage by using Site Recovery because this option provides minimal
downtime. This option also avoids the manual execution of copying disks and creating new VMs. Site Recovery will
systematically copy your disks and create new VMs during failover.
Site Recovery supports a number of types of failover with minimal or no downtime. To plan your downtime and
estimate data loss, see the types of failover in Site Recovery. If you prepare to connect to Azure VMs after failover,
you should be able to connect to the Azure VM by using RDP after failover.
NOTE
Site Recovery does not support the migration of Storage Spaces disks.
Azure essentials
These are the Azure requirements for this migration scenario:
An Azure subscription.
An Azure premium storage account to store replicated data.
An Azure virtual network to which VMs will connect when they're created at failover. The Azure virtual network
must be in the same region as the one in which Site Recovery runs.
An Azure standard storage account to store replication logs. This can be the same storage account for the VM
disks that are being migrated.
Prerequisites
Understand the relevant migration scenario components in the preceding section.
Plan your downtime by learning about failover in Site Recovery.
3. Under Protection goal, in the first drop-down list, select To Azure. In the second drop-down list, select
Not virtualized / Other, and then select OK.
Step 3: Set up the source environment (configuration server)
1. Download Azure Site Recovery Unified Setup and the vault registration key by going to the Prepare
infrastructure > Prepare source > Add Server panes.
You will need the vault registration key to run the unified setup. The key is valid for five days after you
generate it.
c. In Environment Details, select whether you're going to replicate VMware VMs. For this migration
scenario, choose No.
4. After the installation is complete, do the following in the Microsoft Azure Site Recovery Configuration
Server window:
a. Use the Manage Accounts tab to create the account that Site Recovery can use for automatic discovery.
(In the scenario about protecting physical machines, setting up the account isn't relevant, but you need at
least one account to enable one of the following steps. In this case, you can name the account and
password as any.)
b. Use the Vault Registration tab to upload the vault credential file.
NOTE
If you're using a premium storage account for replicated data, you need to set up an additional standard storage account to
store replication logs.
The failed-over VM will have two temporary disks: one from the primary VM and the other created during
the provisioning of the VM in the recovery region. To exclude the temporary disk before replication, install
the mobility service before you enable replication. To learn more about how to exclude the temporary disk,
see Exclude disks from replication.
2. Enable replication as follows:
a. Select Replicate Application > Source. After you've enabled replication for the first time, select
+Replicate in the vault to enable replication for additional machines.
b. In step 1, set up Source as your process server.
c. In step 2, specify the post-failover deployment model, a premium storage account to migrate to, a
standard storage account to save logs, and a virtual network to fail to.
d. In step 3, add protected VMs by IP address. (You might need an internal IP address to find them.)
e. In step 4, configure the properties by selecting the accounts that you set up previously on the process
server.
f. In step 5, choose the replication policy that you created previously in "Step 5: Set up replication settings."
g. Select OK.
NOTE
When an Azure VM is deallocated and started again, there is no guarantee that it will get the same IP address. If the
IP address of the configuration server/process server or the protected Azure VMs changes, the replication in this
scenario might not work correctly.
When you design your Azure Storage environment, we recommend that you use separate storage accounts for
each VM in an availability set. We recommend that you follow the best practice in the storage layer to use multiple
storage accounts for each availability set. Distributing VM disks to multiple storage accounts helps to improve
storage availability and distributes the I/O across the Azure storage infrastructure.
If your VMs are in an availability set, instead of replicating disks of all VMs into one storage account, we highly
recommend migrating multiple VMs multiple times. That way, the VMs in the same availability set do not share a
single storage account. Use the Enable Replication pane to set up a destination storage account for each VM, one
at a time.
You can choose a post-failover deployment model according to your need. If you choose Azure Resource Manager
as your post-failover deployment model, you can fail over a VM (Resource Manager) to a VM (Resource Manager),
or you can fail over a VM (classic) to a VM (Resource Manager).
Step 8: Run a test failover
To check whether your replication is complete, select your Site Recovery instance and then select Settings >
Replicated Items. You will see the status and percentage of your replication process.
After initial replication is complete, run a test failover to validate your replication strategy. For detailed steps of a
test failover, see Run a test failover in Site Recovery.
NOTE
Before you run any failover, make sure that your VMs and replication strategy meet the requirements. For more information
about running a test failover, see Test failover to Azure in Site Recovery.
You can see the status of your test failover in Settings > Jobs > YOUR_FAILOVER_PLAN_NAME. In the pane, you
can see a breakdown of the steps and success/failure results. If the test failover fails at any step, select the step to
check the error message.
Step 9: Run a failover
After the test failover is completed, run a failover to migrate your disks to Premium Storage and replicate the VM
instances. Follow the detailed steps in Run a failover.
Be sure to select Shut down VMs and synchronize the latest data. This option specifies that Site Recovery
should try to shut down the protected VMs and synchronize the data so that the latest version of the data will be
failed over. If you don't select this option or the attempt doesn't succeed, the failover will be from the latest
available recovery point for the VM.
Site Recovery will create a VM instance whose type is the same as or similar to a Premium Storage-capable VM.
You can check the performance and price of various VM instances by going to Windows Virtual Machines Pricing
or Linux Virtual Machines Pricing.
Post-migration steps
1. Configure replicated VMs to the availability set if applicable. Site Recovery does not support
migrating VMs along with the availability set. Depending on the deployment of your replicated VM, do one
of the following:
For a VM created through the classic deployment model: Add the VM to the availability set in the Azure
portal. For detailed steps, go to Add an existing virtual machine to an availability set.
For a VM created through the Resource Manager deployment model: Save your configuration of the VM
and then delete and re-create the VMs in the availability set. To do so, use the script at Set Azure
Resource Manager VM Availability Set. Before you run this script, check its limitations and plan your
downtime.
2. Delete old VMs and disks. Make sure that the Premium disks are consistent with source disks and that the
new VMs perform the same function as the source VMs. Delete the VM and delete the disks from your
source storage accounts in the Azure portal. If there's a problem in which the disk is not deleted even though
you deleted the VM, see Troubleshoot storage resource deletion errors.
3. Clean the Azure Site Recovery infrastructure. If Site Recovery is no longer needed, you can clean its
infrastructure. Delete replicated items, the configuration server, and the recovery policy, and then delete the
Azure Site Recovery vault.
Troubleshooting
Monitor and troubleshoot protection for virtual machines and physical servers
Microsoft Azure Site Recovery forum
Next steps
For specific scenarios for migrating virtual machines, see the following resources:
Migrate Azure Virtual Machines between Storage Accounts
Create and upload a Windows Server VHD to Azure
Migrating Virtual Machines from Amazon AWS to Microsoft Azure
Also, see the following resources to learn more about Azure Storage and Azure Virtual Machines:
Azure Storage
Azure Virtual Machines
Premium Storage: High-performance storage for Azure virtual machine workloads
Find and delete unattached Azure managed and
unmanaged disks
6/4/2018 • 3 minutes to read • Edit Online
When you delete a virtual machine (VM ) in Azure, by default, any disks that are attached to the VM aren't deleted.
This feature helps to prevent data loss due to the unintentional deletion of VMs. After a VM is deleted, you will
continue to pay for unattached disks. This article shows you how to find and delete any unattached disks and
reduce unnecessary costs.
IMPORTANT
First, run the script by setting the deleteUnattachedDisks variable to 0. This action lets you find and view all the unattached
managed disks.
After you review all the unattached disks, run the script again and set the deleteUnattachedDisks variable to 1. This action
lets you delete all the unattached managed disks.
# Set deleteUnattachedDisks=1 if you want to delete unattached Managed Disks
# Set deleteUnattachedDisks=0 if you want to see the Id of the unattached Managed Disks
$deleteUnattachedDisks=0
$managedDisks = Get-AzureRmDisk
}else{
$md.Id
IMPORTANT
First, run the script by setting the deleteUnattachedVHDs variable to 0. This action lets you find and view all the unattached
unmanaged VHDs.
After you review all the unattached disks, run the script again and set the deleteUnattachedVHDs variable to 1. This action
lets you delete all the unattached unmanaged VHDs.
# Set deleteUnattachedVHDs=1 if you want to delete unattached VHDs
# Set deleteUnattachedVHDs=0 if you want to see the Uri of the unattached VHDs
$deleteUnattachedVHDs=0
$storageAccounts = Get-AzureRmStorageAccount
foreach($storageAccount in $storageAccounts){
foreach($container in $containers){
#Fetch all the Page blobs with extension .vhd as only Page blobs can be attached as disk to Azure VMs
$blobs | Where-Object {$_.BlobType -eq 'PageBlob' -and $_.Name.EndsWith('.vhd')} | ForEach-Object {
#If a Page blob is not attached as disk then LeaseStatus will be unlocked
if($_.ICloudBlob.Properties.LeaseStatus -eq 'Unlocked'){
$_ | Remove-AzureStorageBlob -Force
$_.ICloudBlob.Uri.AbsoluteUri
Next steps
For more information, see Delete storage account and Identify Orphaned Disks Using PowerShell
Use Azure file shares with Windows VMs
1/3/2018 • 2 minutes to read • Edit Online
You can use Azure file shares as a way to store and access files from your VM. For example, you can store a script
or an application configuration file that you want all your VMs to share. In this article, we show you how to create
and mount an Azure file share, and how to upload and download files.
Upload files
1. Sign in to the Azure portal.
2. On the left menu, click Storage accounts.
3. Choose your storage account.
4. In the Overview page, under Services, select Files.
5. Select a file share.
6. Click Upload to open the Upload files page.
7. Click on the folder icon to browse your local file system for a file to upload.
8. Click Upload to upload the file to the file share.
Download files
1. Sign in to the Azure portal.
2. On the left menu, click Storage accounts.
3. Choose your storage account.
4. In the Overview page, under Services, select Files.
5. Select a file share.
6. Right-click on the file and choose Download to download it to your local machine.
Next steps
You can also create and manage file shares using PowerShell. For more information, see Get started with Azure
File storage on Windows.
Using Managed Disks in Azure Resource Manager
Templates
8/21/2017 • 5 minutes to read • Edit Online
This document walks through the differences between managed and unmanaged disks when using Azure Resource
Manager templates to provision virtual machines. The examples help you to update existing templates that are
using unmanaged Disks to managed disks. For reference, we are using the 101-vm-simple-windows template as a
guide. You can see the template using both managed Disks and a prior version using unmanaged disks if you'd like
to directly compare them.
{
"type": "Microsoft.Storage/storageAccounts",
"name": "[variables('storageAccountName')]",
"apiVersion": "2016-01-01",
"location": "[resourceGroup().location]",
"sku": {
"name": "Standard_LRS"
},
"kind": "Storage",
"properties": {}
}
Within the virtual machine object, add a dependency on the storage account to ensure that it's created before the
virtual machine. Within the storageProfile section, specify the full URI of the VHD location, which references the
storage account and is needed for the OS disk and any data disks.
{
"apiVersion": "2015-06-15",
"type": "Microsoft.Compute/virtualMachines",
"name": "[variables('vmName')]",
"location": "[resourceGroup().location]",
"dependsOn": [
"[resourceId('Microsoft.Storage/storageAccounts/', variables('storageAccountName'))]",
"[resourceId('Microsoft.Network/networkInterfaces/', variables('nicName'))]"
],
"properties": {
"hardwareProfile": {...},
"osProfile": {...},
"storageProfile": {
"imageReference": {
"publisher": "MicrosoftWindowsServer",
"offer": "WindowsServer",
"sku": "[parameters('windowsOSVersion')]",
"version": "latest"
},
"osDisk": {
"name": "osdisk",
"vhd": {
"uri": "[concat(reference(resourceId('Microsoft.Storage/storageAccounts/',
variables('storageAccountName'))).primaryEndpoints.blob, 'vhds/osdisk.vhd')]"
},
"caching": "ReadWrite",
"createOption": "FromImage"
},
"dataDisks": [
{
"name": "datadisk1",
"diskSizeGB": 1023,
"lun": 0,
"vhd": {
"uri": "[concat(reference(resourceId('Microsoft.Storage/storageAccounts/',
variables('storageAccountName'))).primaryEndpoints.blob, 'vhds/datadisk1.vhd')]"
},
"createOption": "Empty"
}
]
},
"networkProfile": {...},
"diagnosticsProfile": {...}
}
}
NOTE
It is recommended to use an API version later than 2016-04-30-preview as there were breaking changes between
2016-04-30-preview and 2017-03-30 .
{
"apiVersion": "2017-03-30",
"type": "Microsoft.Compute/virtualMachines",
"name": "[variables('vmName')]",
"location": "[resourceGroup().location]",
"dependsOn": [
"[resourceId('Microsoft.Storage/storageAccounts/', variables('storageAccountName'))]",
"[resourceId('Microsoft.Network/networkInterfaces/', variables('nicName'))]"
],
"properties": {
"hardwareProfile": {...},
"osProfile": {...},
"storageProfile": {
"imageReference": {
"publisher": "MicrosoftWindowsServer",
"offer": "WindowsServer",
"sku": "[parameters('windowsOSVersion')]",
"version": "latest"
},
"osDisk": {
"createOption": "FromImage"
},
"dataDisks": [
{
"diskSizeGB": 1023,
"lun": 0,
"createOption": "Empty"
}
]
},
"networkProfile": {...},
"diagnosticsProfile": {...}
}
}
Within the VM object, reference the disk object to be attached. Specifying the resource ID of the managed disk
created in the managedDisk property allows the attachment of the disk as the VM is created. The apiVersion for
the VM resource is set to 2017-03-30 . A dependency on the disk resource is added to ensure it's successfully
created before VM creation.
{
"apiVersion": "2017-03-30",
"type": "Microsoft.Compute/virtualMachines",
"name": "[variables('vmName')]",
"location": "[resourceGroup().location]",
"dependsOn": [
"[resourceId('Microsoft.Storage/storageAccounts/', variables('storageAccountName'))]",
"[resourceId('Microsoft.Network/networkInterfaces/', variables('nicName'))]",
"[resourceId('Microsoft.Compute/disks/', concat(variables('vmName'),'-datadisk1'))]"
],
"properties": {
"hardwareProfile": {...},
"osProfile": {...},
"storageProfile": {
"imageReference": {
"publisher": "MicrosoftWindowsServer",
"offer": "WindowsServer",
"sku": "[parameters('windowsOSVersion')]",
"version": "latest"
},
"osDisk": {
"createOption": "FromImage"
},
"dataDisks": [
{
"lun": 0,
"name": "[concat(variables('vmName'),'-datadisk1')]",
"createOption": "attach",
"managedDisk": {
"id": "[resourceId('Microsoft.Compute/disks/', concat(variables('vmName'),'-
datadisk1'))]"
}
}
]
},
"networkProfile": {...},
"diagnosticsProfile": {...}
}
}
{
"apiVersion": "2017-03-30",
"type": "Microsoft.Compute/availabilitySets",
"location": "[resourceGroup().location]",
"name": "[variables('avSetName')]",
"properties": {
"PlatformUpdateDomainCount": 3,
"PlatformFaultDomainCount": 2
},
"sku": {
"name": "Aligned"
}
}
The following example shows the properties.storageProfile.osDisk section for a VM that uses Standard SSD Disks:
"osDisk": {
"osType": "Windows",
"name": "myOsDisk",
"caching": "ReadWrite",
"createOption": "FromImage",
"managedDisk": {
"storageAccountType": "StandardSSD_LRS"
}
}
For a complete template example of how to create a Standard SSD disk with a template, see Create a VM from a
Windows Image with Standard SSD Data Disks.
Additional scenarios and customizations
To find full information on the REST API specifications, please review the create a managed disk REST API
documentation. You will find additional scenarios, as well as default and acceptable values that can be submitted to
the API through template deployments.
Next steps
For full templates that use managed disks visit the following Azure Quickstart Repo links.
Windows VM with managed disk
Linux VM with managed disk
Full list of managed disk templates
Visit the Azure Managed Disks Overview document to learn more about managed disks.
Review the template reference documentation for virtual machine resources by visiting the
Microsoft.Compute/virtualMachines template reference document.
Review the template reference documentation for disk resources by visiting the Microsoft.Compute/disks
template reference document.
For information on how to use managed disks in Azure virtual machine scale sets, visit the Use data disks with
scale sets document.
Enable Write Accelerator
5/10/2018 • 8 minutes to read • Edit Online
Write Accelerator is a disk capability for M -Series Virtual Machines (VMs) on Premium Storage with Azure
Managed Disks exclusively. As the name states, the purpose of the functionality is to improve the I/O latency of
writes against Azure Premium Storage. Write Accelerator is ideally suited where log file updates are required to
persist to disk in a highly performant manner for modern databases.
Write Accelerator is generally available for M -series VMs in the Public Cloud.
IMPORTANT
Enabling Write Accelerator for the operating system disk of the VM will reboot the VM.
To enable Write Accelerator to an existing Azure disk that is NOT part of a volume build out of multiple disks with Windows
disk or volume managers, Windows Storage Spaces, Windows Scale-out file server (SOFS), Linux LVM, or MDADM, the
workload accessing the Azure disk needs to be shut down. Database applications using the Azure disk MUST be shut down.
If you want to enable or disable Write Accelerator for an existing volume that is built out of multiple Azure Premium Storage
disks and striped using Windows disk or volume managers, Windows Storage Spaces, Windows Scale-out file server (SOFS),
Linux LVM or MDADM, all disks building the volume must be enabled or disabled for Write Accelerator in separate steps.
Before enabling or disabling Write Accelerator in such a configuration, shut down the Azure VM.
Enabling Write Accelerator for OS disks should not be necessary for SAP -related VM configurations.
Restrictions when using Write Accelerator
When using Write Accelerator for an Azure disk/VHD, these restrictions apply:
The Premium disk caching must be set to 'None' or 'Read Only'. All other caching modes are not supported.
Snapshots on a Write Accelerator enabled disk is not supported yet. This restriction blocks Azure Backup
Service ability to perform an application consistent snapshot of all disks of the virtual machine.
Only smaller I/O sizes (<=32 KiB ) are taking the accelerated path. In workload situations where data is getting
bulk loaded or where the transaction log buffers of the different DBMS are filled to a larger degree before
getting persisted to the storage, chances are that the I/O written to disk is not taking the accelerated path.
There are limits of Azure Premium Storage VHDs per VM that can be supported by Write Accelerator. The current
limits are:
VM SKU NUMBER OF WRITE ACCELERATOR DISKS WRITE ACCELERATOR DISK IOPS PER VM
The IOPS limits are per VM and not per disk. All Write Accelerator disks share the same IOPS limit per VM.
To attach a disk with Write Accelerator enabled use az vm disk attach, you may use the following example if you
substitute in your own values: az vm disk attach -g group1 -vm-name vm1 -disk d1 --enable-write-accelerator
To disable Write Accelerator, use az vm update, setting the properties to false:
az vm update -g group1 -n vm1 -write-accelerator 0=false 1=false
Now you can install the armclient by using the following command in either cmd.exe or PowerShell
choco install armclient
Replace the terms within '<< >>' with your data, including the file name the JSON file should have.
The output could look like:
{
"properties": {
"vmId": "2444c93e-f8bb-4a20-af2d-1658d9dbbbcb",
"hardwareProfile": {
"vmSize": "Standard_M64s"
},
"storageProfile": {
"imageReference": {
"publisher": "SUSE",
"offer": "SLES-SAP",
"sku": "12-SP3",
"version": "latest"
},
"osDisk": {
"osType": "Linux",
"name": "mylittlesap_OsDisk_1_754a1b8bb390468e9b4c429b81cc5f5a",
"createOption": "FromImage",
"caching": "ReadWrite",
"managedDisk": {
"storageAccountType": "Premium_LRS",
"id":
"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/mylittlesap/providers/Microsoft.Compute/dis
ks/mylittlesap_OsDisk_1_754a1b8bb390468e9b4c429b81cc5f5a"
},
"diskSizeGB": 30
},
"dataDisks": [
{
"lun": 0,
"name": "data1",
"createOption": "Attach",
"caching": "None",
"managedDisk": {
"storageAccountType": "Premium_LRS",
"id":
"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/mylittlesap/providers/Microsoft.Compute/dis
ks/data1"
},
"diskSizeGB": 1023
},
{
"lun": 1,
"name": "log1",
"createOption": "Attach",
"caching": "None",
"managedDisk": {
"storageAccountType": "Premium_LRS",
"id":
"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/mylittlesap/providers/Microsoft.Compute/dis
ks/data2"
ks/data2"
},
"diskSizeGB": 1023
}
]
},
"osProfile": {
"computerName": "mylittlesapVM",
"adminUsername": "pl",
"linuxConfiguration": {
"disablePasswordAuthentication": false
},
"secrets": []
},
"networkProfile": {
"networkInterfaces": [
{
"id":
"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/mylittlesap/providers/Microsoft.Network/net
workInterfaces/mylittlesap518"
}
]
},
"diagnosticsProfile": {
"bootDiagnostics": {
"enabled": true,
"storageUri": "https://mylittlesapdiag895.blob.core.windows.net/"
}
},
"provisioningState": "Succeeded"
},
"type": "Microsoft.Compute/virtualMachines",
"location": "westeurope",
"id":
"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/mylittlesap/providers/Microsoft.Compute/vir
tualMachines/mylittlesapVM",
"name": "mylittlesapVM"
Next, update the JSON file and to enable Write Accelerator on the disk called 'log1'. This can be accomplished by
adding this attribute into the JSON file after the cache entry of the disk.
{
"lun": 1,
"name": "log1",
"createOption": "Attach",
"caching": "None",
"writeAcceleratorEnabled": true,
"managedDisk": {
"storageAccountType": "Premium_LRS",
"id":
"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/mylittlesap/providers/Microsoft.Compute/dis
ks/data2"
},
"diskSizeGB": 1023
}
The output should look like the one below. You can see that Write Accelerator enabled for one disk.
{
"properties": {
"vmId": "2444c93e-f8bb-4a20-af2d-1658d9dbbbcb",
"vmId": "2444c93e-f8bb-4a20-af2d-1658d9dbbbcb",
"hardwareProfile": {
"vmSize": "Standard_M64s"
},
"storageProfile": {
"imageReference": {
"publisher": "SUSE",
"offer": "SLES-SAP",
"sku": "12-SP3",
"version": "latest"
},
"osDisk": {
"osType": "Linux",
"name": "mylittlesap_OsDisk_1_754a1b8bb390468e9b4c429b81cc5f5a",
"createOption": "FromImage",
"caching": "ReadWrite",
"managedDisk": {
"storageAccountType": "Premium_LRS",
"id":
"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/mylittlesap/providers/Microsoft.Compute/dis
ks/mylittlesap_OsDisk_1_754a1b8bb390468e9b4c429b81cc5f5a"
},
"diskSizeGB": 30
},
"dataDisks": [
{
"lun": 0,
"name": "data1",
"createOption": "Attach",
"caching": "None",
"managedDisk": {
"storageAccountType": "Premium_LRS",
"id":
"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/mylittlesap/providers/Microsoft.Compute/dis
ks/data1"
},
"diskSizeGB": 1023
},
{
"lun": 1,
"name": "log1",
"createOption": "Attach",
"caching": "None",
"writeAcceleratorEnabled": true,
"managedDisk": {
"storageAccountType": "Premium_LRS",
"id":
"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/mylittlesap/providers/Microsoft.Compute/dis
ks/data2"
},
"diskSizeGB": 1023
}
]
},
"osProfile": {
"computerName": "mylittlesapVM",
"adminUsername": "pl",
"linuxConfiguration": {
"disablePasswordAuthentication": false
},
"secrets": []
},
"networkProfile": {
"networkInterfaces": [
{
"id":
"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/mylittlesap/providers/Microsoft.Network/net
workInterfaces/mylittlesap518"
}
]
]
},
"diagnosticsProfile": {
"bootDiagnostics": {
"enabled": true,
"storageUri": "https://mylittlesapdiag895.blob.core.windows.net/"
}
},
"provisioningState": "Succeeded"
},
"type": "Microsoft.Compute/virtualMachines",
"location": "westeurope",
"id":
"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/mylittlesap/providers/Microsoft.Compute/vir
tualMachines/mylittlesapVM",
"name": "mylittlesapVM"
Once you've made this change, the drive should be supported by Write Accelerator.
Enabling Azure Ultra SSDs
9/24/2018 • 2 minutes to read • Edit Online
Azure Ultra SSD delivers high throughput, high IOPS, and consistent low latency disk storage for Azure IaaS VMs.
This new offering provides top of the line performance at the same availability levels as our existing disks offerings.
Additional benefits of Ultra SSD include the ability to dynamically change the performance of the disk along with
your workloads without the need to restart your virtual machines. Ultra SSD is suited for data-intensive workloads
such as SAP HANA, top tier databases, and transaction-heavy workloads.
Currently, Ultra SSds are in preview and you must enroll in the preview in order to access them.
Once approved, run one of the following commands to determine which zone in East US 2 to deploy your Ultra
SSD to:
PowerShell:
Get-AzureRmComputeResourceSku | where {$_.ResourceType -eq "disks" -and $_.Name -eq "UltraSSD_LRS" }
The response will be similar to the form below, where X is the Zone to use for deploying in East US 2. X could be
either 1, 2, or 3.
If there was no response from the command, that means your registration to the feature is either still pending, or
not approved yet.
Now that you know which zone to deploy to, follow the deployment steps in this article to get your first VMs
deployed with Ultra SSD disks.
Specify Disk Sku UltraSSD_LRS, disk capacity, IOPS, and throughput in MBps to create an Ultra SSD disk. The
following is an example that creates a disk with 1,024 GiB (GiB = 2^30 Bytes), 80,000 IOPS, and 1,200 MBps
(MBps = 10^6 Bytes per second):
"properties": {
"creationData": {
"createOption": "Empty"
},
"diskSizeGB": 1024,
"diskIOPSReadWrite": 80000,
"diskMBpsReadWrite": 1200,
}
Add an additional capability on the properties of the VM to indicate its Ultra SSD Enabled (refer to the sample for
the full Resource Manager template):
{
"apiVersion": "2018-06-01",
"type": "Microsoft.Compute/virtualMachines",
"properties": {
"hardwareProfile": {},
"additionalCapabilities" : {
"ultraSSDEnabled" : "true"
},
"osProfile": {},
"storageProfile": {},
"networkProfile": {}
}
}
Once the VM is provisioned, you can partition and format the data disks and configure them for your workloads.
Next steps
If you would like to try the new disk type and haven't signed up for the preview yet, request access through this
survey.
Migrate Azure VMs to Managed Disks in Azure
5/7/2018 • 3 minutes to read • Edit Online
Azure Managed Disks simplifies your storage management by removing the need to separately manage storage
accounts. You can also migrate your existing Azure VMs to Managed Disks to benefit from better reliability of VMs
in an Availability Set. It ensures that the disks of different VMs in an Availability Set is sufficiently isolated from
each other to avoid single point of failures. It automatically places disks of different VMs in an Availability Set in
different Storage scale units (stamps) which limits the impact of single Storage scale unit failures caused due to
hardware and software failures. Based on your needs, you can choose from two types of storage options:
Premium Managed Disks are Solid State Drive (SSD ) based storage media which delivers high
performance, low -latency disk support for virtual machines running I/O -intensive workloads. You can take
advantage of the speed and performance of these disks by migrating to Premium Managed Disks.
Standard Managed Disks use Hard Disk Drive (HDD ) based storage media and are best suited for Dev/Test
and other infrequent access workloads that are less sensitive to performance variability.
You can migrate to Managed Disks in following scenarios:
Convert stand alone VMs and VMs in an availability set to Convert VMs to use managed disks
managed disks
All the VMs in a vNet from classic to Resource Manager on Migrate IaaS resources from classic to Resource Manager and
managed disks then Convert a VM from unmanaged disks to managed disks
Location
Pick a location where Azure Managed Disks are available. If you are moving to Premium Managed Disks, also
ensure that Premium storage is available in the region where you are planning to move to. See Azure Services by
Region for up-to-date information on available locations.
VM sizes
If you are migrating to Premium Managed Disks, you have to update the size of the VM to Premium Storage
capable size available in the region where VM is located. Review the VM sizes that are Premium Storage capable.
The Azure VM size specifications are listed in Sizes for virtual machines. Review the performance characteristics of
virtual machines that work with Premium Storage and choose the most appropriate VM size that best suits your
workload. Make sure that there is sufficient bandwidth available on your VM to drive the disk traffic.
Disk sizes
Premium Managed Disks
There are seven types of premium managed disks that can be used with your VM and each has specific IOPs and
throughput limits. Take into consideration these limits when choosing the Premium disk type for your VM based
on the needs of your application in terms of capacity, performance, scalability, and peak loads.
PREMIUM
DISKS
TYPE P4 P6 P10 P15 P20 P30 P40 P50
IOPS per 120 240 500 1100 2300 5000 7500 7500
disk
STANDAR
D DISK
TYPE S4 S6 S10 S15 S20 S30 S40 S50
IOPS per 500 500 500 500 500 500 500 500
disk
Throughp 60 MB 60 MB 60 MB 60 MB 60 MB 60 MB 60 MB 60 MB
ut per per per per per per per per per
disk second second second second second second second second
Pricing
Review the pricing for Managed Disks. Pricing of Premium Managed Disks is same as the Premium Unmanaged
Disks. But pricing for Standard Managed Disks is different than Standard Unmanaged Disks.
Next steps
Learn more about Managed Disks
Convert a Windows virtual machine from
unmanaged disks to managed disks
7/12/2018 • 4 minutes to read • Edit Online
If you have existing Windows virtual machines (VMs) that use unmanaged disks, you can convert the VMs to use
managed disks through the Azure Managed Disks service. This process converts both the OS disk and any
attached data disks.
This article shows you how to convert VMs by using Azure PowerShell. If you need to install or upgrade it, see
Install and configure Azure PowerShell.
$rgName = "myResourceGroup"
$vmName = "myVM"
Stop-AzureRmVM -ResourceGroupName $rgName -Name $vmName -Force
2. Convert the VM to managed disks by using the ConvertTo-AzureRmVMManagedDisk cmdlet. The
following process converts the previous VM, including the OS disk and any data disks, and starts the
Virtual Machine:
$rgName = 'myResourceGroup'
$avSetName = 'myAvailabilitySet'
If the region where your availability set is located has only 2 managed fault domains but the number of
unmanaged fault domains is 3, this command shows an error similar to "The specified fault domain count
3 must fall in the range 1 to 2." To resolve the error, update the fault domain to 2 and update Sku to
Aligned as follows:
$avSet.PlatformFaultDomainCount = 2
Update-AzureRmAvailabilitySet -AvailabilitySet $avSet -Sku Aligned
2. Deallocate and convert the VMs in the availability set. The following script deallocates each VM by using
the Stop-AzureRmVM cmdlet, converts it by using ConvertTo-AzureRmVMManagedDisk, and restarts it
automatically as apart of the conversion process:
foreach($vmInfo in $avSet.VirtualMachinesReferences)
{
$vm = Get-AzureRmVM -ResourceGroupName $rgName | Where-Object {$_.Id -eq $vmInfo.id}
Stop-AzureRmVM -ResourceGroupName $rgName -Name $vm.Name -Force
ConvertTo-AzureRmVMManagedDisk -ResourceGroupName $rgName -VMName $vm.Name
}
Troubleshooting
If there is an error during conversion, or if a VM is in a failed state because of issues in a previous conversion, run
the ConvertTo-AzureRmVMManagedDisk cmdlet again. A simple retry usually unblocks the situation. Before
converting, make sure all the VM extensions are in the 'Provisioning succeeded' state or the conversion will fail
with the error code 409.
Next steps
Convert standard managed disks to premium
Take a read-only copy of a VM by using snapshots.
Manually migrate a Classic VM to a new ARM
Managed Disk VM from the VHD
5/8/2018 • 5 minutes to read • Edit Online
This section helps you to migrate your existing Azure VMs from the classic deployment model to Managed Disks
in the Resource Manager deployment model.
PREMIUM
DISKS TYPE P4 P6 P10 P20 P30 P40 P50
Throughput 25 MB per 50 MB per 100 MB per 150 MB per 200 MB per 250 MB per 250 MB per
per disk second second second second second second second
Checklist
1. If you are migrating to Premium Managed Disks, make sure it is available in the region you are migrating
to.
2. Decide the new VM series you will be using. It should be a Premium Storage capable if you are migrating to
Premium Managed Disks.
3. Decide the exact VM size you will use which are available in the region you are migrating to. VM size needs
to be large enough to support the number of data disks you have. For example, if you have four data disks,
the VM must have two or more cores. Also, consider processing power, memory and network bandwidth
needs.
4. Have the current VM details handy, including the list of disks and corresponding VHD blobs.
Prepare your application for downtime. To do a clean migration, you have to stop all the processing in the current
system. Only then you can get it to consistent state which you can migrate to the new platform. Downtime
duration depends on the amount of data in the disks to migrate.
Migrate the VM
Prepare your application for downtime. To do a clean migration, you have to stop all the processing in the current
system. Only then you can get it to consistent state which you can migrate to the new platform. Downtime
duration depends the amount of data in the disks to migrate.
This part requires the Azure PowerShell module version 6.0.0 or later. Run Get-Module -ListAvailable AzureRM to
find the version. If you need to upgrade, see Install Azure PowerShell module. You also need to run
Connect-AzureRmAccount to create a connection with Azure.
$virtualNetworkName = 'yourExistingVirtualNetworkName'
$virtualMachineName = 'yourVMName'
$virtualMachineSize = 'Standard_DS3'
$adminUserName = "youradminusername"
$imageName = 'yourImageName'
$osVhdUri = 'https://storageaccount.blob.core.windows.net/vhdcontainer/osdisk.vhd'
$dataVhdUri = 'https://storageaccount.blob.core.windows.net/vhdcontainer/datadisk1.vhd'
$dataDiskName = 'dataDisk1'
2. Create a managed OS disk using the VHD from the classic VM.
Ensure that you have provided the complete URI of the OS VHD to the $osVhdUri parameter. Also, enter -
AccountType as Premium_LRS or Standard_LRS based on type of disks (Premium or Standard) you are
migrating to.
4. Create a managed data disk from the data VHD file and add it to the new VM.
5. Create the new VM by setting public IP, Virtual Network and NIC.
$publicIp = New-AzureRmPublicIpAddress -Name ($VirtualMachineName.ToLower()+'_ip') '
-ResourceGroupName $resourceGroupName -Location $location -AllocationMethod Dynamic
NOTE
There may be additional steps necessary to support your application that is not be covered by this guide.
Next steps
Connect to the virtual machine. For instructions, see How to connect and log on to an Azure virtual machine
running Windows.
Common PowerShell commands for Azure Virtual
Networks
4/17/2018 • 4 minutes to read • Edit Online
If you want to create a virtual machine, you need to create a virtual network or know about an existing virtual
network in which the VM can be added. Typically, when you create a VM, you also need to consider creating the
resources described in this article.
See How to install and configure Azure PowerShell for information about installing the latest version of Azure
PowerShell, selecting your subscription, and signing in to your account.
Some variables might be useful for you if running more than one of the commands in this article:
$location - The location of the network resources. You can use Get-AzureRmLocation to find a geographical
region that works for you.
$myResourceGroup - The name of the resource group where the network resources are located.
Next Steps
Use the network interface that you just created when you create a VM.
Learn about how you can create a VM with multiple network interfaces.
2 minutes to read
How to open ports to a virtual machine with the
Azure portal
10/9/2018 • 2 minutes to read • Edit Online
You open a port, or create an endpoint, to a virtual machine (VM ) in Azure by creating a network filter on a subnet
or a VM network interface. You place these filters, which control both inbound and outbound traffic, on a network
security group attached to the resource that receives the traffic.
The example in this article demonstrates how to create a network filter that uses the standard TCP port 80 (it's
assumed you've already started the appropriate services and opened any OS firewall rules on the VM ).
After you've created a VM that's configured to serve web requests on the standard TCP port 80, you can:
1. Create a network security group.
2. Create an inbound security rule allowing traffic and assign values to the following settings:
Destination port ranges: 80
Source port ranges: * (allows any source port)
Priority value: Enter a value that is less than 65,500 and higher in priority than the default catch-all
deny inbound rule.
3. Associate the network security group with the VM network interface or subnet.
Although this example uses a simple rule to allow HTTP traffic, you can also use network security groups and rules
to create more complex network configurations.
Sign in to Azure
Sign in to the Azure portal at https://portal.azure.com.
3. Select Advanced.
4. Choose a common Service from the drop-down menu, such as HTTP. You can also select Custom if you
want to provide a specific port to use.
5. Optionally, change the Priority or Name. The priority affects the order in which rules are applied: the lower
the numerical value, the earlier the rule is applied.
6. Select Add to create the rule.
2. Select your virtual network, and then select the appropriate subnet.
Any VMs you connect to that subnet are now reachable on port 80.
Additional information
You can also perform the steps in this article by using Azure PowerShell.
The commands described in this article allow you to quickly get traffic flowing to your VM. Network security
groups provide many great features and granularity for controlling access to your resources. For more
information, see Filter network traffic with a network security group.
For highly available web applications, consider placing your VMs behind an Azure load balancer. The load balancer
distributes traffic to VMs, with a network security group that provides traffic filtering. For more information, see
Load balance Windows virtual machines in Azure to create a highly available application.
Next steps
In this article, you created a network security group, created an inbound rule that allows HTTP traffic on port 80,
and then associated that rule with a subnet.
You can find information on creating more detailed environments in the following articles:
Azure Resource Manager overview
Security groups
How to open ports and endpoints to a VM in Azure
using PowerShell
7/9/2018 • 2 minutes to read • Edit Online
You open a port, or create an endpoint, to a virtual machine (VM ) in Azure by creating a network filter on a subnet
or a VM network interface. You place these filters, which control both inbound and outbound traffic, on a network
security group attached to the resource that receives the traffic.
The example in this article demonstrates how to create a network filter that uses the standard TCP port 80 (it's
assumed you've already started the appropriate services and opened any OS firewall rules on the VM ).
After you've created a VM that's configured to serve web requests on the standard TCP port 80, you can:
1. Create a network security group.
2. Create an inbound security rule allowing traffic and assign values to the following settings:
Destination port ranges: 80
Source port ranges: * (allows any source port)
Priority value: Enter a value that is less than 65,500 and higher in priority than the default catch-all
deny inbound rule.
3. Associate the network security group with the VM network interface or subnet.
Although this example uses a simple rule to allow HTTP traffic, you can also use network security groups and
rules to create more complex network configurations.
Quick commands
To create a Network Security Group and ACL rules you need the latest version of Azure PowerShell installed. You
can also perform these steps using the Azure portal.
Log in to your Azure account:
Connect-AzureRmAccount
In the following examples, replace parameter names with your own values. Example parameter names included
myResourceGroup, myNetworkSecurityGroup, and myVnet.
Create a rule with New -AzureRmNetworkSecurityRuleConfig. The following example creates a rule named
myNetworkSecurityGroupRule to allow tcp traffic on port 80:
$httprule = New-AzureRmNetworkSecurityRuleConfig `
-Name "myNetworkSecurityGroupRule" `
-Description "Allow HTTP" `
-Access "Allow" `
-Protocol "Tcp" `
-Direction "Inbound" `
-Priority "100" `
-SourceAddressPrefix "Internet" `
-SourcePortRange * `
-DestinationAddressPrefix * `
-DestinationPortRange 80
Next, create your Network Security group with New -AzureRmNetworkSecurityGroup and assign the HTTP rule
you just created as follows. The following example creates a Network Security Group named
myNetworkSecurityGroup:
$nsg = New-AzureRmNetworkSecurityGroup `
-ResourceGroupName "myResourceGroup" `
-Location "EastUS" `
-Name "myNetworkSecurityGroup" `
-SecurityRules $httprule
Now let's assign your Network Security Group to a subnet. The following example assigns an existing virtual
network named myVnet to the variable $vnet with Get-AzureRmVirtualNetwork:
$vnet = Get-AzureRmVirtualNetwork `
-ResourceGroupName "myResourceGroup" `
-Name "myVnet"
Associate your Network Security Group with your subnet with Set-AzureRmVirtualNetworkSubnetConfig. The
following example associates the subnet named mySubnet with your Network Security Group:
Set-AzureRmVirtualNetworkSubnetConfig `
-VirtualNetwork $vnet `
-Name "mySubnet" `
-AddressPrefix $subnetPrefix.AddressPrefix `
-NetworkSecurityGroup $nsg
Finally, update your virtual network with Set-AzureRmVirtualNetwork in order for your changes to take effect:
You can create a virtual machine with a static public IP address. A public IP address enables you to communicate to
a virtual machine from the internet. Assign a static public IP address, rather than a dynamic address, to ensure that
the address never changes. Learn more about static public IP addresses. To change a public IP address assigned to
an existing virtual machine from dynamic to static, or to work with private IP addresses, see Add, change, or
remove IP addresses. Public IP addresses have a nominal charge, and there is a limit to the number of public IP
addresses that you can use per subscription.
Sign in to Azure
Sign in to the Azure portal at https://portal.azure.com.
SETTING VALUE
Name myVM
Azure assigned a public IP address from addresses used in the region you created the virtual machine in.
You can download the list of ranges (prefixes) for the Azure Public, US government, China, and Germany
clouds.
12. Select Configuration to confirm that the assignment is Static.
WARNING
Do not modify the IP address settings within the virtual machine's operating system. The operating system is unaware of
Azure public IP addresses. Though you can add private IP address settings to the operating system, we recommend not
doing so unless necessary, and not until after reading Add a private IP address to an operating system.
Clean up resources
When no longer needed, delete the resource group and all of the resources it contains:
1. Enter myResourceGroup in the Search box at the top of the portal. When you see myResourceGroup in the
search results, select it.
2. Select Delete resource group.
3. Enter myResourceGroup for TYPE THE RESOURCE GROUP NAME: and select Delete.
Next steps
Learn more about public IP addresses in Azure
Learn more about all public IP address settings
Learn more about private IP addresses and assigning a static private IP address to an Azure virtual machine
Learn more about creating Linux and Windows virtual machines
Create and manage a Windows virtual machine that
has multiple NICs
8/16/2018 • 8 minutes to read • Edit Online
Virtual machines (VMs) in Azure can have multiple virtual network interface cards (NICs) attached to them. A
common scenario is to have different subnets for front-end and back-end connectivity. You can associate multiple
NICs on a VM to multiple subnets, but those subnets must all reside in the same virtual network (vNet). This article
details how to create a VM that has multiple NICs attached to it. You also learn how to add or remove NICs from
an existing VM. Different VM sizes support a varying number of NICs, so size your VM accordingly.
Prerequisites
Make sure that you have the latest Azure PowerShell version installed and configured.
In the following examples, replace example parameter names with your own values. Example parameter names
include myResourceGroup, myVnet, and myVM.
2. Create your virtual network and subnets with New -AzureRmVirtualNetwork. The following example creates
a virtual network named myVnet:
Typically you also create a network security group to filter network traffic to the VM and a load balancer to
distribute traffic across multiple VMs.
Create the virtual machine
Now start to build your VM configuration. Each VM size has a limit for the total number of NICs that you can add
to a VM. For more information, see Windows VM sizes.
1. Set your VM credentials to the $cred variable as follows:
$cred = Get-Credential
2. Define your VM with New -AzureRmVMConfig. The following example defines a VM named myVM and
uses a VM size that supports more than two NICs (Standard_DS3_v2):
4. Attach the two NICs that you previously created with Add-AzureRmVMNetworkInterface:
6. Add routes for secondary NICs to the OS by completing the steps in Configure the operating system for
multiple NICs.
Add a NIC to an existing VM
To add a virtual NIC to an existing VM, you deallocate the VM, add the virtual NIC, then start the VM. Different
VM sizes support a varying number of NICs, so size your VM accordingly. If needed, you can resize a VM.
1. Deallocate the VM with Stop-AzureRmVM. The following example deallocates the VM named myVM in
myResourceGroup:
2. Get the existing configuration of the VM with Get-AzureRmVm. The following example gets information for
the VM named myVM in myResourceGroup:
3. The following example creates a virtual NIC with New -AzureRmNetworkInterface named myNic3 that is
attached to mySubnetBackEnd. The virtual NIC is then attached to the VM named myVM in
myResourceGroup with Add-AzureRmVMNetworkInterface:
5. Add routes for secondary NICs to the OS by completing the steps in Configure the operating system for
multiple NICs.
Remove a NIC from an existing VM
To remove a virtual NIC from an existing VM, you deallocate the VM, remove the virtual NIC, then start the VM.
1. Deallocate the VM with Stop-AzureRmVM. The following example deallocates the VM named myVM in
myResourceGroup:
2. Get the existing configuration of the VM with Get-AzureRmVm. The following example gets information for
the VM named myVM in myResourceGroup:
3. Get information about the NIC remove with Get-AzureRmNetworkInterface. The following example gets
information about myNic3:
4. Remove the NIC with Remove-AzureRmVMNetworkInterface and then update the VM with Update-
AzureRmVm. The following example removes myNic3 as obtained by $nicId in the preceding step:
"copy": {
"name": "multiplenics",
"count": "[parameters('count')]"
}
===========================================================================
Interface List
3...00 0d 3a 10 92 ce ......Microsoft Hyper-V Network Adapter #3
7...00 0d 3a 10 9b 2a ......Microsoft Hyper-V Network Adapter #4
===========================================================================
In this example, Microsoft Hyper-V Network Adapter #4 (interface 7) is the secondary network interface
that doesn't have a default gateway assigned to it.
2. From a command prompt, run the ipconfig command to see which IP address is assigned to the secondary
network interface. In this example, 192.168.2.4 is assigned to interface 7. No default gateway address is
returned for the secondary network interface.
3. To route all traffic destined for addresses outside the subnet of the secondary network interface to the
gateway for the subnet, run the following command:
The gateway address for the subnet is the first IP address (ending in .1) in the address range defined for the
subnet. If you don't want to route all traffic outside the subnet, you could add individual routes to specific
destinations, instead. For example, if you only wanted to route traffic from the secondary network interface
to the 192.168.3.0 network, you enter the command:
4. To confirm successful communication with a resource on the 192.168.3.0 network, for example, enter the
following command to ping 192.168.3.4 using interface 7 (192.168.2.4):
You may need to open ICMP through the Windows firewall of the device you're pinging with the following
command:
5. To confirm the added route is in the route table, enter the route print command, which returns output
similar to the following text:
===========================================================================
Active Routes:
Network Destination Netmask Gateway Interface Metric
0.0.0.0 0.0.0.0 192.168.1.1 192.168.1.4 15
0.0.0.0 0.0.0.0 192.168.2.1 192.168.2.4 5015
The route listed with 192.168.1.1 under Gateway, is the route that is there by default for the primary
network interface. The route with 192.168.2.1 under Gateway, is the route you added.
Next steps
Review Windows VM sizes when you're trying to create a VM that has multiple NICs. Pay attention to the
maximum number of NICs that each VM size supports.
Create a Windows virtual machine with Accelerated
Networking
5/7/2018 • 9 minutes to read • Edit Online
In this tutorial, you learn how to create a Windows virtual machine (VM ) with Accelerated Networking. To create a
Linux VM with Accelerated Networking, see Create a Linux VM with Accelerated Networking. Accelerated
networking enables single root I/O virtualization (SR -IOV ) to a VM, greatly improving its networking performance.
This high-performance path bypasses the host from the datapath, reducing latency, jitter, and CPU utilization, for
use with the most demanding network workloads on supported VM types. The following picture shows
communication between two VMs with and without accelerated networking:
Without accelerated networking, all networking traffic in and out of the VM must traverse the host and the virtual
switch. The virtual switch provides all policy enforcement, such as network security groups, access control lists,
isolation, and other network virtualized services to network traffic. To learn more about virtual switches, read the
Hyper-V network virtualization and virtual switch article.
With accelerated networking, network traffic arrives at the VM's network interface (NIC ), and is then forwarded to
the VM. All network policies that the virtual switch applies are now offloaded and applied in hardware. Applying
policy in hardware enables the NIC to forward network traffic directly to the VM, bypassing the host and the
virtual switch, while maintaining all the policy it applied in the host.
The benefits of accelerated networking only apply to the VM that it is enabled on. For the best results, it is ideal to
enable this feature on at least two VMs connected to the same Azure Virtual Network (VNet). When
communicating across VNets or connecting on-premises, this feature has minimal impact to overall latency.
Benefits
Lower Latency / Higher packets per second (pps): Removing the virtual switch from the datapath removes
the time packets spend in the host for policy processing and increases the number of packets that can be
processed inside the VM.
Reduced jitter: Virtual switch processing depends on the amount of policy that needs to be applied and the
workload of the CPU that is doing the processing. Offloading the policy enforcement to the hardware removes
that variability by delivering packets directly to the VM, removing the host to VM communication and all
software interrupts and context switches.
Decreased CPU utilization: Bypassing the virtual switch in the host leads to less CPU utilization for
processing network traffic.
First, create a subnet configuration with New -AzureRmVirtualNetworkSubnetConfig. The following example
creates a subnet named mySubnet:
$subnet = New-AzureRmVirtualNetworkSubnetConfig `
-Name "mySubnet" `
-AddressPrefix "192.168.1.0/24"
Create a virtual network with New -AzureRmVirtualNetwork, with the mySubnet subnet.
$rdp = New-AzureRmNetworkSecurityRuleConfig `
-Name 'Allow-RDP-All' `
-Description 'Allow RDP' `
-Access Allow `
-Protocol Tcp `
-Direction Inbound `
-Priority 100 `
-SourceAddressPrefix * `
-SourcePortRange * `
-DestinationAddressPrefix * `
-DestinationPortRange 3389
Create a network security group with New -AzureRmNetworkSecurityGroup and assign the Allow -RDP -All
security rule to it. In addition to the Allow -RDP -All rule, the network security group contains several default rules.
One default rule disables all inbound access from the Internet, which is why the Allow -RDP -All rule is assigned to
the network security group so that you can remotely connect to the virtual machine, once it's created.
$nsg = New-AzureRmNetworkSecurityGroup `
-ResourceGroupName myResourceGroup `
-Location centralus `
-Name "myNsg" `
-SecurityRules $rdp
Associate the network security group to the mySubnet subnet with Set-AzureRmVirtualNetworkSubnetConfig.
The rule in the network security group is effective for all resources deployed in the subnet.
Set-AzureRmVirtualNetworkSubnetConfig `
-VirtualNetwork $vnet `
-Name 'mySubnet' `
-AddressPrefix "192.168.1.0/24" `
-NetworkSecurityGroup $nsg
Create a network interface with New -AzureRmNetworkInterface with accelerated networking enabled and assign
the public IP address to the network interface. The following example creates a network interface named myNic in
the mySubnet subnet of the myVnet virtual network and assigns the myPublicIp public IP address to it:
$nic = New-AzureRmNetworkInterface `
-ResourceGroupName "myResourceGroup" `
-Name "myNic" `
-Location "centralus" `
-SubnetId $vnet.Subnets[0].Id `
-PublicIpAddressId $publicIp.Id `
-EnableAcceleratedNetworking
$cred = Get-Credential
First, define your VM with New -AzureRmVMConfig. The following example defines a VM named myVM with a
VM size that supports Accelerated Networking (Standard_DS4_v2):
Attach the network interface that you previously created with Add-AzureRmVMNetworkInterface:
Important, please note, if your VM was created individually, without an availability set, you only need to
stop/deallocate the individual VM to enable Accelerated Networking. If your VM was created with an availability
set, all VMs contained in the availability set will need to be stopped/deallocated before enabling Accelerated
Networking on any of the NICs.
Once stopped, enable Accelerated Networking on the NIC of your VM:
$nic.EnableAcceleratedNetworking = $true
$nic | Set-AzureRmNetworkInterface
Restart your VM or, if in an Availability Set, all the VMs in the Set and confirm that Accelerated Networking is
enabled:
VMSS
VMSS is slightly different but follows the same workflow. First, stop the VMs:
Once the VMs are stopped, update the Accelerated Networking property under the network interface:
$vmss.VirtualMachineProfile.NetworkProfile.NetworkInterfaceConfigurations[0].EnableAcceleratedNetworking =
$true
Please note, a VMSS has VM upgrades that apply updates using three different settings, automatic, rolling and
manual. In these instructions the policy is set to automatic so that the VMSS will pick up the changes immediately
after restarting. To set it to automatic so that the changes are immediately picked up:
$vmss.UpgradePolicy.AutomaticOSUpgrade = $true
Once you restart, wait for the upgrades to finish but once completed, the VF will appear inside the VM. (Please
make sure you are using a supported OS and VM size)
Resizing existing VMs with Accelerated Networking
VMs with Accelerated Networking enabled can only be resized to VMs that support Accelerated Networking.
A VM with Accelerated Networking enabled cannot be resized to a VM instance that does not support Accelerated
Networking using the resize operation. Instead, to resize one of these VMs:
Stop/Deallocate the VM or if in an availability set/VMSS, stop/deallocate all the VMs in the set/VMSS.
Accelerated Networking must be disabled on the NIC of the VM or if in an availability set/VMSS, all VMs in the
set/VMSS.
Once Accelerated Networking is disabled, the VM/availability set/VMSS can be moved to a new size that does
not support Accelerated Networking and restarted.
Create a fully qualified domain name in the Azure
portal for a Windows VM
8/16/2018 • 2 minutes to read • Edit Online
When you create a virtual machine (VM ) in the Azure portal, a public IP resource for the virtual machine is
automatically created. You use this IP address to remotely access the VM. Although the portal does not create a
fully qualified domain name, or FQDN, you can create one once the VM is created. This article demonstrates the
steps to create a DNS name or FQDN.
Create a FQDN
This article assumes that you have already created a VM. If needed, you can create a VM in the portal or with
Azure PowerShell. Follow these steps once your VM is up and running:
1. Select your VM in the portal. Under DNS name, click Configure.
Next steps
Now that your VM has a public IP and DNS name, you can deploy common application frameworks or services
such as IIS, SQL, or SharePoint.
You can also read more about using Resource Manager for tips on building your Azure deployments.
How Azure DNS works with other Azure services
9/24/2018 • 2 minutes to read • Edit Online
Azure DNS is a hosted DNS management and name resolution service. This allows you to create public DNS
names for the other applications and services you have deployed in Azure. Creating a name for an Azure service in
your custom domain is as simple as adding a record of the correct type for your service.
For dynamically allocated IP addresses, you can create a DNS CNAME record that maps to the DNS name that
Azure created for your service. DNS standards prevent you from using a CNAME record for the zone apex, but
you can use an alias record instead. For more information, see Tutorial: Configure an alias record to refer to an
Azure Public IP address.
For statically allocated IP addresses, you can create a DNS A record using any name, including a naked domain
name at the zone apex.
The following table outlines the supported record types that can be used for various Azure services. As you can see
from this table, Azure DNS only supports DNS records for Internet-facing network resources. Azure DNS cannot
be used for name resolution of internal, private addresses.
Traffic Manager Public name You can create an alias record that
maps to the trafficmanager.net name
assigned to your Traffic Manager profile.
For more information, see Tutorial:
Configure an alias record to support
apex domain names with Traffic
Manager.
Resource Manager VMs Public IP Resource Manager VMs can have Public
IP addresses. A VM with a Public IP
address may also be behind a load
balancer. You can create a DNS A,
CNAME, or alias record for the Public
address. This custom name can be used
to bypass the VIP on the load balancer.
Azure virtual machine (VM ) extensions are small applications that provide post-deployment configuration and
automation tasks on Azure VMs, you can use existing images and then customize them as part of your
deployments, getting you out of the business of custom image building.
The Azure platform hosts many extensions that range from VM configuration, monitoring, security, and utility
applications. Publishers take an application, then wrap it into an extension, and simplify the installation, so all you
need to do is provide mandatory parameters.
There is a large choice of first and third party extensions, if the application in the extension repository does not
exist, then you can use the Custom Script extension and configure your VM with your own scripts and commands.
Examples of key scenarios that extensions are used for:
VM configuration, you can use Powershell DSC (Desired State Configuration), Chef, Puppet and Custom Script
Extensions to install VM configuration agents and configure your VM.
AV products, such as Symantec, ESET.
VM vulnerability tool, such as Qualys, Rapid7, HPE.
VM and App monitoring tooling, such as DynaTrace, Azure Network Watcher, Site24x7, and Stackify.
Extensions can be bundled with a new VM deployment. For example, they can be part of a larger deployment,
configuring applications on VM provision, or run against any supported extension operated systems post
deployment.
Next steps
For more information about how the Linux Agent and Extensions work, see Azure VM extensions and features
for Linux.
For more information about how the Windows Guest Agent and Extensions work, see Azure VM extensions
and features for Windows.
To install the Windows Guest Agent, see Azure Windows Virtual Machine Agent Overview .
To install the Linux Agent, see Azure Linux Virtual Machine Agent Overview .
Migrate from Amazon Web Services (AWS) and other
platforms to Managed Disks in Azure
4/25/2018 • 4 minutes to read • Edit Online
You can upload VHD files from AWS or on-premises virtualization solutions to Azure to create VMs that take
advantage of Managed Disks. Azure Managed Disks removes the need to manage storage accounts for Azure IaaS
VMs. You have to only specify the type (Premium or Standard) and size of disk you need, and Azure creates and
manages the disk for you.
You can upload either generalized and specialized VHDs.
Generalized VHD - has had all of your personal account information removed using Sysprep.
Specialized VHD - maintains the user accounts, applications, and other state data from your original VM.
IMPORTANT
Before uploading any VHD to Azure, you should follow Prepare a Windows VHD or VHDX to upload to Azure
SCENARIO DOCUMENTATION
You have existing AWS EC2 instances that you would like to Move a VM from Amazon Web Services (AWS) to Azure
migrate to Azure VMs using managed disks
You have a VM from another virtualization platform that you Upload a generalized VHD and use it to create a new VM in
would like to use as an image to create multiple Azure VMs. Azure
You have a uniquely customized VM that you would like to Upload a specialized VHD to Azure and create a new VM
recreate in Azure.
Throughput per disk 100 MB per second 150 MB per second 200 MB per second
STANDARD DISK
TYPE S4 S6 S10 S20 S30
Next Steps
Before uploading any VHD to Azure, you should follow Prepare a Windows VHD or VHDX to upload to Azure
Upload a generalized VHD and use it to create new
VMs in Azure
10/11/2018 • 4 minutes to read • Edit Online
This article walks you through using PowerShell to upload a VHD of a generalized VM to Azure, create an image
from the VHD, and create a new VM from that image. You can upload a VHD exported from an on-premises
virtualization tool or from another cloud. Using Managed Disks for the new VM simplifies the VM management
and provides better availability when the VM is placed in an availability set.
For a sample script, see Sample script to upload a VHD to Azure and create a new VM.
IMPORTANT
If you plan to run Sysprep before uploading your VHD to Azure for the first time, make sure you have prepared your VM.
Get-AzureRmStorageAccount | Format-Table
$rgName = "myResourceGroup"
$urlOfUploadedImageVhd = "https://mystorageaccount.blob.core.windows.net/mycontainer/myUploadedVHD.vhd"
Add-AzureRmVhd -ResourceGroupName $rgName -Destination $urlOfUploadedImageVhd `
-LocalFilePath "C:\Users\Public\Documents\Virtual hard disks\myVHD.vhd"
MD5 hash is being calculated for the file C:\Users\Public\Documents\Virtual hard disks\myVHD.vhd.
MD5 hash calculation is completed.
Elapsed time for the operation: 00:03:35
Creating new page blob of size 53687091712...
Elapsed time for upload: 01:12:49
LocalFilePath DestinationUri
------------- --------------
C:\Users\Public\Doc... https://mystorageaccount.blob.core.windows.net/mycontainer/myUploadedVHD.vhd
Depending on your network connection and the size of your VHD file, this command may take a while to
complete.
Other options for uploading a VHD
You can also upload a VHD to your storage account using one of the following:
AzCopy
Azure Storage Copy Blob API
Azure Storage Explorer Uploading Blobs
Storage Import/Export Service REST API Reference
We recommend using the Import/Export Service if estimated uploading time is longer than seven days. You
can use DataTransferSpeedCalculator to estimate the time from data size and transfer unit. Import/Export can
be used to copy to a standard storage account. You'll need to copy from standard storage to premium storage
account by using a tool like AzCopy.
IMPORTANT
If you are using AzCopy to upload your VHD to Azure, make sure you have set /BlobType:page before running your
upload script. If the destination is a blob and this option is not specified, by default AzCopy creates a block blob.
$imageConfig = New-AzureRmImageConfig `
-Location $location
$imageConfig = Set-AzureRmImageOsDisk `
-Image $imageConfig `
-OsType Windows `
-OsState Generalized `
-BlobUri $urlOfUploadedImageVhd `
-DiskSizeGB 20
New-AzureRmImage `
-ImageName $imageName `
-ResourceGroupName $rgName `
-Image $imageConfig
Create the VM
Now that you have an image, you can create one or more new VMs from the image. This example creates a VM
named myVM from myImage, in myResourceGroup.
New-AzureRmVm `
-ResourceGroupName $rgName `
-Name "myVM" `
-ImageName $imageName `
-Location $location `
-VirtualNetworkName "myVnet" `
-SubnetName "mySubnet" `
-SecurityGroupName "myNSG" `
-PublicIpAddressName "myPIP" `
-OpenPorts 3389
Next steps
Sign in to your new virtual machine. For more information, see How to connect and log on to an Azure virtual
machine running Windows.
Move a Windows VM from Amazon Web Services
(AWS) to Azure using PowerShell
6/1/2018 • 2 minutes to read • Edit Online
If you are evaluating Azure virtual machines for hosting your workloads, you can export an existing Amazon Web
Services (AWS ) EC2 Windows VM instance then upload the virtual hard disk (VHD ) to Azure. Once the VHD is
uploaded, you can create a new VM in Azure from the VHD.
This article covers moving a single VM from AWS to Azure. If you want to move VMs from AWS to Azure at scale,
see Migrate virtual machines in Amazon Web Services (AWS ) to Azure with Azure Site Recovery.
Prepare the VM
You can upload both generalized and specialized VHDs to Azure. Each type requires that you prepare the VM
before exporting from AWS.
Generalized VHD - a generalized VHD has had all of your personal account information removed using
Sysprep. If you intend to use the VHD as an image to create new VMs from, you should:
Prepare a Windows VM.
Generalize the virtual machine using Sysprep.
Specialized VHD - a specialized VHD maintains the user accounts, applications and other state data from
your original VM. If you intend to use the VHD as-is to create a new VM, ensure the following steps are
completed.
Prepare a Windows VHD to upload to Azure. Do not generalize the VM using Sysprep.
Remove any guest virtualization tools and agents that are installed on the VM (i.e. VMware tools).
Ensure the VM is configured to pull its IP address and DNS settings via DHCP. This ensures that the
server obtains an IP address within the VNet when it starts up.
Once the VHD has been exported, follow the instructions in How Do I Download an Object from an S3 Bucket? to
download the VHD file from the S3 bucket.
IMPORTANT
AWS charges data transfer fees for downloading the VHD. See Amazon S3 Pricing for more information.
Next steps
Now you can upload the VHD to Azure and create a new VM.
If you ran Sysprep on your source to generalize it before exporting, see Upload a generalized VHD and use it
to create a new VMs in Azure
If you did not run Sysprep before exporting, the VHD is considered specialized, see Upload a specialized VHD
to Azure and create a new VM
2 minutes to read
Platform-supported migration of IaaS resources from
classic to Azure Resource Manager
9/13/2018 • 7 minutes to read • Edit Online
This article describes how to migrate infrastructure as a service (IaaS ) resources from the Classic to Resource
Manager deployment models and details how to connect resources from the two deployment models that coexist
in your subscription by using virtual network site-to-site gateways. You can read more about Azure Resource
Manager features and benefits.
NOTE
In this migration scope, both the management-plane operations and the data-plane operations may not be allowed for a
period of time during the migration.
NOTE
In this migration scope, the management plane may not be allowed for a period of time during the migration. For certain
configurations as described earlier, data-plane downtime occurs.
NOTE
The Resource Manager deployment model doesn't have the concept of Classic images and disks. When the storage account
is migrated, Classic images and disks are not visible in the Resource Manager stack but the backing VHDs remain in the
storage account.
Compute Unassociated virtual machine disks. The VHD blobs behind these disks will
get migrated when the Storage
Account is migrated
Compute Virtual machine images. The VHD blobs behind these disks will
get migrated when the Storage
Account is migrated
Network Virtual networks using VNet Peering. Migrate Virtual Network to Resource
Manager, then peer. Learn more about
VNet Peering.
Unsupported configurations
The following configurations are not currently supported.
Resource Manager Role Based Access Control (RBAC) for Because the URI of the resources is
classic resources modified after migration, it is
recommended that you plan the RBAC
policy updates that need to happen
after migration.
Compute Virtual machines that belong to a You can optionally delete the VM.
virtual network but don't have an
explicit subnet assigned
SERVICE CONFIGURATION RECOMMENDATION
Compute Virtual machines that have alerts, The migration goes through and these
Autoscale policies settings are dropped. It is highly
recommended that you evaluate your
environment before you do the
migration. Alternatively, you can
reconfigure the alert settings after
migration is complete.
Compute Boot diagnostics with Premium storage Disable Boot Diagnostics feature for the
VMs before continuing with migration.
You can re-enable boot diagnostics in
the Resource Manager stack after the
migration is complete. Additionally,
blobs that are being used for
screenshot and serial logs should be
deleted so you are no longer charged
for those blobs.
Compute Cloud services that contain web/worker This is currently not supported.
roles
Compute Cloud services that contain more than This is currently not supported. Please
one availability set or multiple move the Virtual Machines to the same
availability sets. availability set before migrating.
Network Virtual networks that contain virtual This is currently not supported. Please
machines and web/worker roles move the Web/Worker roles to their
own Virtual Network before migrating.
Once the classic Virtual Network is
migrated, the migrated Azure Resource
Manager Virtual Network can be
peered with the classic Virtual Network
to achieve similar configuration as
before.
Network Classic Express Route circuits This is currently not supported. These
circuits need to be migrated to Azure
Resource Manager before beginning
IaaS migration. To learn more, see
Moving ExpressRoute circuits from the
classic to the Resource Manager
deployment model.
Azure App Service Virtual networks that contain App This is currently not supported.
Service environments
Azure HDInsight Virtual networks that contain This is currently not supported.
HDInsight services
Microsoft Dynamics Lifecycle Services Virtual networks that contain virtual This is currently not supported.
machines that are managed by
Dynamics Lifecycle Services
Azure AD Domain Services Virtual networks that contain Azure AD This is currently not supported.
Domain services
Azure RemoteApp Virtual networks that contain Azure This is currently not supported.
RemoteApp deployments
Azure API Management Virtual networks that contain Azure API This is currently not supported. To
Management deployments migrate the IaaS VNET, change the
VNET of the API Management
deployment, which is a no downtime
operation.
Next steps
Technical deep dive on platform-supported migration from classic to Azure Resource Manager
Planning for migration of IaaS resources from classic to Azure Resource Manager
Use PowerShell to migrate IaaS resources from classic to Azure Resource Manager
Use CLI to migrate IaaS resources from classic to Azure Resource Manager
VPN Gateway classic to Resource Manager migration
Migrate ExpressRoute circuits and associated virtual networks from the classic to the Resource Manager
deployment model
Community tools for assisting with migration of IaaS resources from classic to Azure Resource Manager
Review most common migration errors
Review the most frequently asked questions about migrating IaaS resources from classic to Azure Resource
Manager
Technical deep dive on platform-supported
migration from classic to Azure Resource Manager
9/13/2018 • 13 minutes to read • Edit Online
Let's take a deep-dive on migrating from the Azure classic deployment model to the Azure Resource Manager
deployment model. We look at resources at a resource and feature level to help you understand how the Azure
platform migrates resources between the two deployment models. For more information, please read the service
announcement article: Platform-supported migration of IaaS resources from classic to Azure Resource Manager.
NOTE
The operations described in the following sections are all idempotent. If you have a problem other than an unsupported
feature or a configuration error, retry the prepare, abort, or commit operation. Azure tries the action again.
Validate
The validate operation is the first step in the migration process. The goal of this step is to analyze the state of the
resources you want to migrate in the classic deployment model. The operation evaluates whether the resources
are capable of migration (success or failure).
You select the virtual network or a cloud service (if it’s not in a virtual network) that you want to validate for
migration. If the resource is not capable of migration, Azure lists the reasons why.
Checks not done in the validate operation
The validate operation only analyzes the state of the resources in the classic deployment model. It can check for all
failures and unsupported scenarios due to various configurations in the classic deployment model. It is not
possible to check for all issues that the Azure Resource Manager stack might impose on the resources during
migration. These issues are only checked when the resources undergo transformation in the next step of
migration (the prepare operation). The following table lists all the issues not checked in the validate operation:
NETWORKING CHECKS NOT IN THE VALIDATE OPERATION
Azure Resource Manager quota checks for networking resources. For example: static public IP, dynamic public IPs, load balancer,
network security groups, route tables, and network interfaces.
All load balancer rules are valid across deployment and the virtual network.
Conflicting private IPs between stop-deallocated VMs in the same virtual network.
Prepare
The prepare operation is the second step in the migration process. The goal of this step is to simulate the
transformation of the IaaS resources from the classic deployment model to Resource Manager resources. Further,
the prepare operation presents this side-by-side for you to visualize.
NOTE
Your resources in the classic deployment model are not modified during this step. It's a safe step to run if you're trying out
migration.
You select the virtual network or the cloud service (if it’s not a virtual network) that you want to prepare for
migration.
If the resource is not capable of migration, Azure stops the migration process and lists the reason why the
prepare operation failed.
If the resource is capable of migration, Azure locks down the management-plane operations for the resources
under migration. For example, you are not able to add a data disk to a VM under migration.
Azure then starts the migration of metadata from the classic deployment model to Resource Manager for the
migrating resources.
After the prepare operation is complete, you have the option of visualizing the resources in both the classic
deployment model and Resource Manager. For every cloud service in the classic deployment model, the Azure
platform creates a resource group name that has the pattern cloud-service-name>-Migrated .
NOTE
It is not possible to select the name of a resource group created for migrated resources (that is, "-Migrated"). After
migration is complete, however, you can use the move feature of Azure Resource Manager to move resources to any
resource group you want. For more information, see Move resources to new resource group or subscription.
The following two screenshots show the result after a succesful prepare operation. The first one shows a resource
group that contains the original cloud service. The second one shows the new "-Migrated" resource group that
contains the equivalent Azure Resource Manager resources.
Here is a behind-the-scenes look at your resources after the completion of the prepare phase. Note that the
resource in the data plane is the same. It's represented in both the management plane (classic deployment model)
and the control plane (Resource Manager).
NOTE
VMs that are not in a virtual network in the classic deployment model are stopped and deallocated in this phase of
migration.
Commit
After you finish the validation, you can commit the migration. Resources do not appear anymore in the classic
deployment model, and are available only in the Resource Manager deployment model. The migrated resources
can be managed only in the new portal.
NOTE
This is an idempotent operation. If it fails, retry the operation. If it continues to fail, create a support ticket or create a forum
post with a "ClassicIaaSMigration" tag on our VM forum.
Migration flowchart
Here is a flowchart that shows how to proceed with migration:
Disk resources attached to VM Implicit disks attached to VM Disks are not modeled as top-level
resources in the Resource Manager
deployment model. They are migrated
as implicit disks under the VM. Only
disks that are attached to a VM are
currently supported. Resource Manager
VMs can now use storage accounts in
the classic deployment model, which
allows the disks to be easily migrated
without any updates.
Virtual machine certificates Certificates in Azure Key Vault If a cloud service contains service
certificates, the migration creates a new
Azure key vault per cloud service, and
moves the certificates into the key
vault. The VMs are updated to
reference the certificates from the key
vault.
Load-balanced endpoint set Load balancer In the classic deployment model, the
platform assigned an implicit load
balancer for every cloud service. During
migration, a new load-balancer
resource is created, and the load-
balancing endpoint set becomes load-
balancer rules.
Inbound NAT rules Inbound NAT rules Input endpoints defined on the VM are
converted to inbound network address
translation rules under the load
balancer during the migration.
VIP address Public IP address with DNS name The virtual IP address becomes a public
IP address, and is associated with the
load balancer. A virtual IP can only be
migrated if there is an input endpoint
assigned to it.
Virtual network Virtual network The virtual network is migrated, with all
its properties, to the Resource Manager
deployment model. A new resource
group is created with the name
-migrated .
Reserved IPs Public IP address with static allocation Reserved IPs associated with the load
method balancer are migrated, along with the
migration of the cloud service or the
virtual machine. Unassociated reserved
IP migration is not currently supported.
Public IP address per VM Public IP address with dynamic The public IP address associated with
allocation method the VM is converted as a public IP
address resource, with the allocation
method set to static.
IP forwarding property on a VM's IP forwarding property on the NIC The IP forwarding property on a VM is
network configuration converted to a property on the
network interface during the migration.
Load balancer with multiple IPs Load balancer with multiple public IP Every public IP associated with the load
resources balancer is converted to a public IP
resource, and associated with the load
balancer after migration.
Internal DNS names on the VM Internal DNS names on the NIC During migration, the internal DNS
suffixes for the VMs are migrated to a
read-only property named
“InternalDomainNameSuffix” on the
NIC. The suffix remains unchanged after
migration, and VM resolution should
continue to work as previously.
Virtual network gateway Virtual network gateway Virtual network gateway properties are
migrated unchanged. The VIP
associated with the gateway does not
change either.
Local network site Local network gateway Local network site properties are
migrated unchanged to a new resource
called a local network gateway. This
represents on-premises address
prefixes and the remote gateway IP.
Next steps
Overview of platform-supported migration of IaaS resources from classic to Azure Resource Manager
Planning for migration of IaaS resources from classic to Azure Resource Manager
Use PowerShell to migrate IaaS resources from classic to Azure Resource Manager
Use CLI to migrate IaaS resources from classic to Azure Resource Manager
VPN Gateway classic to Resource Manager migration
Migrate ExpressRoute circuits and associated virtual networks from the classic to the Resource Manager
deployment model
Community tools for assisting with migration of IaaS resources from classic to Azure Resource Manager
Review most common migration errors
Review the most frequently asked questions about migrating IaaS resources from classic to Azure Resource
Manager
Planning for migration of IaaS resources from classic
to Azure Resource Manager
9/13/2018 • 13 minutes to read • Edit Online
While Azure Resource Manager offers many amazing features, it is critical to plan out your migration journey to
make sure things go smoothly. Spending time on planning will ensure that you do not encounter issues while
executing migration activities.
NOTE
The following guidance was heavily contributed to by the Azure Customer Advisory team and Cloud Solution architects
working with customers on migrating large environments. As such this document will continue to get updated as new
patterns of success emerge, so check back from time to time to see if there are any new recommendations.
Plan
Technical considerations and tradeoffs
Depending on your technical requirements size, geographies and operational practices, you might want to
consider:
1. Why is Azure Resource Manager desired for your organization? What are the business reasons for a
migration?
2. What are the technical reasons for Azure Resource Manager? What (if any) additional Azure services would
you like to leverage?
3. Which application (or sets of virtual machines) is included in the migration?
4. Which scenarios are supported with the migration API? Review the unsupported features and configurations.
5. Will your operational teams now support applications/VMs in both Classic and Azure Resource Manager?
6. How (if at all) does Azure Resource Manager change your VM deployment, management, monitoring, and
reporting processes? Do your deployment scripts need to be updated?
7. What is the communications plan to alert stakeholders (end users, application owners, and infrastructure
owners)?
8. Depending on the complexity of the environment, should there be a maintenance period where the application
is unavailable to end users and to application owners? If so, for how long?
9. What is the training plan to ensure stakeholders are knowledgeable and proficient in Azure Resource
Manager?
10. What is the program management or project management plan for the migration?
11. What are the timelines for the Azure Resource Manager migration and other related technology road maps?
Are they optimally aligned?
Patterns of success
Successful customers have detailed plans where the preceding questions are discussed, documented and
governed. Ensure the migration plans are broadly communicated to sponsors and stakeholders. Equip yourself
with knowledge about your migration options; reading through this migration document set below is highly
recommended.
Overview of platform-supported migration of IaaS resources from classic to Azure Resource Manager
Technical deep dive on platform-supported migration from classic to Azure Resource Manager
Planning for migration of IaaS resources from classic to Azure Resource Manager
Use PowerShell to migrate IaaS resources from classic to Azure Resource Manager
Use CLI to migrate IaaS resources from classic to Azure Resource Manager
Community tools for assisting with migration of IaaS resources from classic to Azure Resource Manager
Review most common migration errors
Review the most frequently asked questions about migrating IaaS resources from classic to Azure Resource
Manager
Pitfalls to avoid
Failure to plan. The technology steps of this migration are proven and the outcome is predictable.
Assumption that the platform supported migration API will account for all scenarios. Read the unsupported
features and configurations to understand what scenarios are supported.
Not planning potential application outage for end users. Plan enough buffer to adequately warn end users of
potentially unavailable application time.
Lab Test
Replicate your environment and do a test migration
NOTE
Exact replication of your existing environment is executed by using a community-contributed tool which is not officially
supported by Microsoft Support. Therefore, it is an optional step but it is the best way to find out issues without touching
your production environments. If using a community-contributed tool is not an option, then read about the
Validate/Prepare/Abort Dry Run recommendation below.
Conducting a lab test of your exact scenario (compute, networking, and storage) is the best way to ensure a
smooth migration. This will help ensure:
A wholly separate lab or an existing non-production environment to test. We recommend a wholly separate lab
that can be migrated repeatedly and can be destructively modified. Scripts to collect/hydrate metadata from
the real subscriptions are listed below.
It's a good idea to create the lab in a separate subscription. The reason is that the lab will be torn down
repeatedly, and having a separate, isolated subscription will reduce the chance that something real will get
accidentally deleted.
This can be accomplished by using the AsmMetadataParser tool. Read more about this tool here
Patterns of success
The following were issues discovered in many of the larger migrations. This is not an exhaustive list and you
should refer to the unsupported features and configurations for more detail. You may or may not encounter these
technical issues but if you do solving these before attempting migration will ensure a smoother experience.
Do a Validate/Prepare/Abort Dry Run - This is perhaps the most important step to ensure Classic to
Azure Resource Manager migration success. The migration API has three main steps: Validate, Prepare and
Commit. Validate will read the state of your classic environment and return a result of all issues. However,
because some issues might exist in the Azure Resource Manager stack, Validate will not catch everything.
The next step in migration process, Prepare will help expose those issues. Prepare will move the metadata
from Classic to Azure Resource Manager, but will not commit the move, and will not remove or change
anything on the Classic side. The dry run involves preparing the migration, then aborting (not
committing) the migration prepare. The goal of validate/prepare/abort dry run is to see all of the
metadata in the Azure Resource Manager stack, examine it (programmatically or in Portal), and verify that
everything migrates correctly, and work through technical issues. It will also give you a sense of migration
duration so you can plan for downtime accordingly. A validate/prepare/abort does not cause any user
downtime; therefore, it is non-disruptive to application usage.
The items below will need to be solved before the dry run, but a dry run test will also safely flush out
these preparation steps if they are missed. During enterprise migration, we've found the dry run to be a
safe and invaluable way to ensure migration readiness.
When prepare is running, the control plane (Azure management operations) will be locked for the whole
virtual network, so no changes can be made to VM metadata during validate/prepare/abort. But
otherwise any application function (RD, VM usage, etc.) will be unaffected. Users of the VMs will not
know that the dry run is being executed.
Express Route Circuits and VPN. Currently Express Route Gateways with authorization links cannot be
migrated without downtime. For the workaround, see Migrate ExpressRoute circuits and associated virtual
networks from the classic to the Resource Manager deployment model.
VM Extensions - Virtual Machine extensions are potentially one of the biggest roadblocks to migrating
running VMs. Remediation of VM Extensions could take upwards of 1-2 days, so plan accordingly. A
working Azure agent is needed to report back VM Extension status of running VMs. If the status comes
back as bad for a running VM, this will halt migration. The agent itself does not need to be in working order
to enable migration, but if extensions exist on the VM, then both a working agent AND outbound internet
connectivity (with DNS ) will be needed for migration to move forward.
If connectivity to a DNS server is lost during migration, all VM Extensions except BGInfo version 1.*
need to first be removed from every VM before migration prepare, and subsequently re-added back to
the VM after Azure Resource Manager migration. This is only for VMs that are running. If the VMs
are stopped deallocated, VM Extensions do not need to be removed.
NOTE
Many extensions like Azure diagnostics and security center monitoring will reinstall themselves after migration, so
removing them is not a problem.
In addition, make sure Network Security Groups are not restricting outbound internet access. This can
happen with some Network Security Groups configurations. Outbound internet access (and DNS ) is
needed for VM Extensions to be migrated to Azure Resource Manager.
Two versions of the BGInfo extension exist and are called versions 1 and 2.
If the VM is using the BGInfo version 1 extension, you can leave this extension as is. The
migration API skips this extension. The BGInfo extension can be added after migration.
If the VM is using the JSON -based BGInfo version 2 extension, the VM was created using the
Azure portal. The migration API includes this extension in the migration to Azure Resource
Manager, provided the agent is working and has outbound internet access (and DNS ).
Remediation Option 1. If you know your VMs will not have outbound internet access, a working
DNS service, and working Azure agents on the VMs, then uninstall all VM extensions as part of the
migration before Prepare, then reinstall the VM Extensions after migration.
Remediation Option 2. If VM extensions are too big of a hurdle, another option is to
shutdown/deallocate all VMs before migration. Migrate the deallocated VMs, then restart them on
the Azure Resource Manager side. The benefit here is that VM extensions will migrate. The
downside is that all public facing Virtual IPs will be lost (this may be a non-starter), and obviously
the VMs will shut down causing a much greater impact on working applications.
NOTE
If an Azure Security Center policy is configured against the running VMs being migrated, the security policy
needs to be stopped before removing extensions, otherwise the security monitoring extension will be
reinstalled automatically on the VM after removing it.
Availability Sets - For a virtual network (vNet) to be migrated to Azure Resource Manager, the Classic
deployment (i.e. cloud service) contained VMs must all be in one availability set, or the VMs must all not be
in any availability set. Having more than one availability set in the cloud service is not compatible with
Azure Resource Manager and will halt migration. Additionally, there cannot be some VMs in an availability
set, and some VMs not in an availability set. To resolve this, you will need to remediate or reshuffle your
cloud service. Plan accordingly as this might be time consuming.
Web/Worker Role Deployments - Cloud Services containing web and worker roles cannot migrate to
Azure Resource Manager. The web/worker roles must first be removed from the virtual network before
migration can start. A typical solution is to just move web/worker role instances to a separate Classic
virtual network that is also linked to an ExpressRoute circuit, or to migrate the code to newer PaaS App
Services (this discussion is beyond the scope of this document). In the former redeploy case, create a new
Classic virtual network, move/redeploy the web/worker roles to that new virtual network, then delete the
deployments from the virtual network being moved. No code changes required. The new Virtual Network
Peering capability can be used to peer together the classic virtual network containing the web/worker roles
and other virtual networks in the same Azure region such as the virtual network being migrated (after
virtual network migration is completed as peered virtual networks cannot be migrated), hence
providing the same capabilities with no performance loss and no latency/bandwidth penalties. Given the
addition of Virtual Network Peering, web/worker role deployments can now easily be mitigated and not
block the migration to Azure Resource Manager.
Azure Resource Manager Quotas - Azure regions have separate quotas/limits for both Classic and Azure
Resource Manager. Even though in a migration scenario new hardware isn't being consumed (we're
swapping existing VMs from Classic to Azure Resource Manager ), Azure Resource Manager quotas still
need to be in place with enough capacity before migration can start. Listed below are the major limits we've
seen cause problems. Open a quota support ticket to raise the limits.
NOTE
These limits need to be raised in the same region as your current environment to be migrated.
Network Interfaces
Load Balancers
Public IPs
Static Public IPs
Cores
Network Security Groups
Route Tables
You can check your current Azure Resource Manager quotas using the following commands with the
latest version of Azure PowerShell.
Compute (Cores, Availability Sets)
Get-AzureRmVMUsage -Location <azure-region>
Network (Virtual Networks, Static Public IPs, Public IPs, Network Security Groups, Network
Interfaces, Load Balancers, Route Tables)
Get-AzureRmUsage /subscriptions/<subscription-id>/providers/Microsoft.Network/locations/<azure-
region> -ApiVersion 2016-03-30 | Format-Table
Get-AzureRmStorageUsage
Azure Resource Manager API throttling limits - If you have a large enough environment (eg. > 400
VMs in a VNET), you might hit the default API throttling limits for writes (currently 1200 writes/hour ) in
Azure Resource Manager. Before starting migration, you should raise a support ticket to increase this limit
for your subscription.
Provisioning Timed Out VM Status - If any VM has the status of provisioning timed out , this needs to
be resolved pre-migration. The only way to do this is with downtime by deprovisioning/reprovisioning the
VM (delete it, keep the disk, and recreate the VM ).
RoleStateUnknown VM Status - If migration halts due to a role state unknown error message, inspect
the VM using the portal and ensure it is running. This error will typically go away on its own (no
remediation required) after a few minutes and is often a transient type often seen during a Virtual Machine
start , stop , restart operations. Recommended practice: re-try migration again after a few minutes.
Fabric Cluster does not exist - In some cases, certain VMs cannot be migrated for various odd reasons.
One of these known cases is if the VM was recently created (within the last week or so) and happened to
land an Azure cluster that is not yet equipped for Azure Resource Manager workloads. You will get an error
that says fabric cluster does not exist and the VM cannot be migrated. Waiting a couple of days will
usually resolve this particular problem as the cluster will soon get Azure Resource Manager enabled.
However, one immediate workaround is to stop-deallocate the VM, then continue forward with
migration, and start the VM back up in Azure Resource Manager after migrating.
Pitfalls to avoid
Do not take shortcuts and omit the validate/prepare/abort dry run migrations.
Most, if not all, of your potential issues will surface during the validate/prepare/abort steps.
Migration
Technical considerations and tradeoffs
Now you are ready because you have worked through the known issues with your environment.
For the real migrations, you might want to consider:
1. Plan and schedule the virtual network (smallest unit of migration) with increasing priority. Do the simple
virtual networks first, and progress with the more complicated virtual networks.
2. Most customers will have non-production and production environments. Schedule production last.
3. (OPTIONAL ) Schedule a maintenance downtime with plenty of buffer in case unexpected issues arise.
4. Communicate with and align with your support teams in case issues arise.
Patterns of success
The technical guidance from the Lab Test section should be considered and mitigated prior to a real migration.
With adequate testing, the migration is actually a non-event. For production environments, it might be helpful to
have additional support, such as a trusted Microsoft partner or Microsoft Premier services.
Pitfalls to avoid
Not fully testing may cause issues and delay in the migration.
Beyond Migration
Technical considerations and tradeoffs
Now that you are in Azure Resource Manager, maximize the platform. Read the overview of Azure Resource
Manager to find out about additional benefits.
Things to consider:
Bundling the migration with other activities. Most customers opt for an application maintenance window. If so,
you might want to use this downtime to enable other Azure Resource Manager capabilities like encryption and
migration to Managed Disks.
Revisit the technical and business reasons for Azure Resource Manager; enable the additional services
available only on Azure Resource Manager that apply to your environment.
Modernize your environment with PaaS services.
Patterns of success
Be purposeful on what services you now want to enable in Azure Resource Manager. Many customers find the
below compelling for their Azure environments:
Role Based Access Control.
Azure Resource Manager templates for easier and more controlled deployment.
Tags.
Activity Control
Azure Policies
Pitfalls to avoid
Remember why you started this Classic to Azure Resource Manager migration journey. What were the original
business reasons? Did you achieve the business reason?
Next steps
Overview of platform-supported migration of IaaS resources from classic to Azure Resource Manager
Technical deep dive on platform-supported migration from classic to Azure Resource Manager
Use PowerShell to migrate IaaS resources from classic to Azure Resource Manager
Use CLI to migrate IaaS resources from classic to Azure Resource Manager
VPN Gateway classic to Resource Manager migration
Migrate ExpressRoute circuits and associated virtual networks from the classic to the Resource Manager
deployment model
Community tools for assisting with migration of IaaS resources from classic to Azure Resource Manager
Review most common migration errors
Review the most frequently asked questions about migrating IaaS resources from classic to Azure Resource
Manager
Migrate IaaS resources from classic to Azure
Resource Manager by using Azure PowerShell
6/20/2018 • 10 minutes to read • Edit Online
These steps show you how to use Azure PowerShell commands to migrate infrastructure as a service (IaaS )
resources from the classic deployment model to the Azure Resource Manager deployment model.
If you want, you can also migrate resources by using the Azure Command Line Interface (Azure CLI).
For background on supported migration scenarios, see Platform-supported migration of IaaS resources from
classic to Azure Resource Manager.
For detailed guidance and a migration walkthrough, see Technical deep dive on platform-supported migration
from classic to Azure Resource Manager.
Review most common migration errors
Here is a flowchart to identify the order in which steps need to be executed during a migration process
Connect-AzureRmAccount
Set your Azure subscription for the current session. This example sets the default subscription name to My
Azure Subscription. Replace the example subscription name with your own.
Register with the migration resource provider by using the following command:
Please wait five minutes for the registration to finish. You can check the status of the approval by using the
following command:
Add-AzureAccount
Set your Azure subscription for the current session. This example sets the default subscription to My Azure
Subscription. Replace the example subscription name with your own.
Step 5: Make sure you have enough Azure Resource Manager Virtual
Machine vCPUs in the Azure region of your current deployment or
VNET
You can use the following PowerShell command to check the current number of vCPUs you have in Azure
Resource Manager. To learn more about vCPU quotas, see Limits and the Azure Resource Manager.
This example checks the availability in the West US region. Replace the example region name with your own.
Step 6.1: Option 1 - Migrate virtual machines in a cloud service (not in a virtual network)
Get the list of cloud services by using the following command, and then pick the cloud service that you want to
migrate. If the VMs in the cloud service are in a virtual network or if they have web or worker roles, the command
returns an error message.
Get-AzureService | ft Servicename
Get the deployment name for the cloud service. In this example, the service name is My Service. Replace the
example service name with your own service name.
Prepare the virtual machines in the cloud service for migration. You have two options to choose from.
Option 1. Migrate the VMs to a platform -created virtual network
First, validate if you can migrate the cloud service using the following commands:
The following command displays any warnings and errors that block migration. If validation is successful,
then you can move on to the Prepare step:
Option 2. Migrate to an existing virtual network in the Resource Manager deployment model
This example sets the resource group name to myResourceGroup, the virtual network name to
myVirtualNetwork and the subnet name to mySubNet. Replace the names in the example with the
names of your own resources.
$existingVnetRGName = "myResourceGroup"
$vnetName = "myVirtualNetwork"
$subnetName = "mySubNet"
First, validate if you can migrate the virtual network using the following command:
After the Prepare operation succeeds with either of the preceding options, query the migration state of the VMs.
Ensure that they are in the Prepared state.
This example sets the VM name to myVM. Replace the example name with your own VM name.
$vmName = "myVM"
$vm = Get-AzureVM -ServiceName $serviceName -Name $vmName
$vm.VM.MigrationState
Check the configuration for the prepared resources by using either PowerShell or the Azure portal. If you are not
ready for migration and you want to go back to the old state, use the following command:
If the prepared configuration looks good, you can move forward and commit the resources by using the
following command:
NOTE
Migrate single classic virtual machine by creating a new Resource Manager virtual machine with Managed Disks using the
VHD (OS and data) files of the virtual machine.
NOTE
The virtual network name might be different from what is shown in the new Portal. The new Azure Portal displays the name
as [vnet-name] but the actual virtual network name is of type Group [resource-group-name] [vnet-name] . Before
migrating, lookup the actual virtual network name using the command Get-AzureVnetSite | Select -Property Name or
view it in the old Azure Portal.
This example sets the virtual network name to myVnet. Replace the example virtual network name with your
own.
$vnetName = "myVnet"
NOTE
If the virtual network contains web or worker roles, or VMs with unsupported configurations, you get a validation error
message.
First, validate if you can migrate the virtual network by using the following command:
The following command displays any warnings and errors that block migration. If validation is successful, then
you can proceed with the following Prepare step:
Check the configuration for the prepared virtual machines by using either Azure PowerShell or the Azure portal.
If you are not ready for migration and you want to go back to the old state, use the following command:
If the prepared configuration looks good, you can move forward and commit the resources by using the
following command:
NOTE
If your storage account had no associated disks or VM data, you can skip directly to the Validate Storage Account and
Start Migration section.
Prerequisite checks if you migrated any VMs or your storage account has Disk resources
Migrate classic virtual machines whose disks are stored in the storage account
The following command returns RoleName and DiskName properties of all the classic VM disks in
the storage account. RoleName is the name of the virtual machine to which a disk is attached. If this
command returns disks then ensure that virtual machines to which these disks are attached are
migrated before migrating the storage account.
$storageAccountName = 'yourStorageAccountName'
Get-AzureDisk | where-Object {$_.MediaLink.Host.Contains($storageAccountName)} | Select-Object
-ExpandProperty AttachedTo -Property `
DiskName | Format-List -Property RoleName, DiskName
If above command returns disks then delete these disks using following command:
The following command returns all the VM images with data disks stored in the storage account.
Delete all the VM images returned by above commands using this command:
$storageAccountName = "myStorageAccount"
Move-AzureStorageAccount -Validate -StorageAccountName $storageAccountName
$storageAccountName = "myStorageAccount"
Move-AzureStorageAccount -Prepare -StorageAccountName $storageAccountName
Check the configuration for the prepared storage account by using either Azure PowerShell or the Azure
portal. If you are not ready for migration and you want to go back to the old state, use the following
command:
If the prepared configuration looks good, you can move forward and commit the resources by using the
following command:
Move-AzureStorageAccount -Commit -StorageAccountName $storageAccountName
Next steps
Overview of platform-supported migration of IaaS resources from classic to Azure Resource Manager
Technical deep dive on platform-supported migration from classic to Azure Resource Manager
Planning for migration of IaaS resources from classic to Azure Resource Manager
Use CLI to migrate IaaS resources from classic to Azure Resource Manager
Community tools for assisting with migration of IaaS resources from classic to Azure Resource Manager
Review most common migration errors
Review the most frequently asked questions about migrating IaaS resources from classic to Azure Resource
Manager
Common errors during Classic to Azure Resource
Manager migration
4/9/2018 • 9 minutes to read • Edit Online
This article catalogs the most common errors and mitigations during the migration of IaaS resources from Azure
classic deployment model to the Azure Resource Manager stack.
List of errors
ERROR STRING MITIGATION
Internal server error In some cases, this is a transient error that goes away with a
retry. If it continues to persist, contact Azure support as it
needs investigation of platform logs.
Migration is not supported for Deployment {deployment- This happens when a deployment contains a web/worker role.
name} in HostedService {hosted-service-name} because it is a Since migration is only supported for Virtual Machines, please
PaaS deployment (Web/Worker). remove the web/worker role from the deployment and try
migration again.
Template {template-name} deployment failed. CorrelationId= In the backend of migration service, we use Azure Resource
{guid} Manager templates to create resources in the Azure Resource
Manager stack. Since templates are idempotent, usually you
can safely retry the migration operation to get past this error.
If this error continues to persist, please contact Azure
support and give them the CorrelationId.
The virtual network {virtual-network-name} does not exist. This can happen if you created the Virtual Network in the
new Azure portal. The actual Virtual Network name follows
the pattern "Group * "
VM {vm-name} in HostedService {hosted-service-name} XML extensions such as BGInfo 1.* are not supported in
contains Extension {extension-name} which is not supported Azure Resource Manager. Therefore, these extensions cannot
in Azure Resource Manager. It is recommended to uninstall it be migrated. If these extensions are left installed on the
from the VM before continuing with migration. virtual machine, they are automatically uninstalled before
completing the migration.
VM {vm-name} in HostedService {hosted-service-name} This is the scenario where the virtual machine is configured
contains Extension VMSnapshot/VMSnapshotLinux, which is for Azure Backup. Since this is currently an unsupported
currently not supported for Migration. Uninstall it from the scenario, please follow the workaround at
VM and add it back using Azure Resource Manager after the https://aka.ms/vmbackupmigration
Migration is Complete
ERROR STRING MITIGATION
VM {vm-name} in HostedService {hosted-service-name} Azure guest agent & VM Extensions need outbound internet
contains Extension {extension-name} whose Status is not access to the VM storage account to populate their status.
being reported from the VM. Hence, this VM cannot be Common causes of status failure include
migrated. Ensure that the Extension status is being reported a Network Security Group that blocks outbound access to
or uninstall the extension from the VM and retry migration. the internet
If the VNET has on-prem DNS servers and DNS
VM {vm-name} in HostedService {hosted-service-name} connectivity is lost
contains Extension {extension-name} reporting Handler
Status: {handler-status}. Hence, the VM cannot be migrated. If you continue to see an unsupported status, you can
Ensure that the Extension handler status being reported is uninstall the extensions to skip this check and move forward
{handler-status} or uninstall it from the VM and retry with migration.
migration.
Migration is not supported for Deployment {deployment- Currently, only hosted services that have 1 or less Availability
name} in HostedService {hosted-service-name} because it has sets can be migrated. To work around this problem, please
multiple Availability Sets. move the additional Availability sets and Virtual machines in
those Availability sets to a different hosted service.
Migration is not supported for Deployment {deployment- The workaround for this scenario is to either move all the
name} in HostedService {hosted-service-name because it has virtual machines into a single Availability set or remove all
VMs that are not part of the Availability Set even though the Virtual machines from the Availability set in the hosted
HostedService contains one. service.
Storage account/HostedService/Virtual Network {virtual- This error happens when the "Prepare" migration operation
network-name} is in the process of being migrated and hence has been completed on the resource and an operation that
cannot be changed would make a change to the resource is triggered. Because of
the lock on the management plane after "Prepare" operation,
any changes to the resource are blocked. To unlock the
management plane, you can run the "Commit" migration
operation to complete migration or the "Abort" migration
operation to roll back the "Prepare" operation.
Migration is not allowed for HostedService {hosted-service- The VM might be undergoing through a state transition,
name} because it has VM {vm-name} in State: which usually happens when during an update operation on
RoleStateUnknown. Migration is allowed only when the VM is the HostedService such as a reboot, extension installation etc.
in one of the following states - Running, Stopped, Stopped It is recommended for the update operation to complete on
Deallocated. the HostedService before trying migration.
Deployment {deployment-name} in HostedService {hosted- This error happens if you've resized the VHD blob without
service-name} contains a VM {vm-name} with Data Disk updating the size in the VM API model. Detailed mitigation
{data-disk-name} whose physical blob size {size-of-the-vhd- steps are outlined below.
blob-backing-the-data-disk} bytes does not match the VM
Data Disk logical size {size-of-the-data-disk-specified-in-the-
vm-api} bytes. Migration will proceed without specifying a
size for the data disk for the Azure Resource Manager VM.
A storage exception occurred while validating data disk {data This error can happen if the disks of the VM have been
disk name} with media link {data disk Uri} for VM {VM name} deleted or are not accessible anymore. Please make sure the
in Cloud Service {Cloud Service name}. Please ensure that the disks for the VM exist.
VHD media link is accessible for this virtual machine
ERROR STRING MITIGATION
VM {vm-name} in HostedService {cloud-service-name} This error occurs when the name of the blob has a "/" in it
contains Disk with MediaLink {vhd-uri} which has blob name which is not supported in Compute Resource Provider
{vhd-blob-name} that is not supported in Azure Resource currently.
Manager.
Migration is not allowed for Deployment {deployment-name} In 2014, Azure announced that networking resources will
in HostedService {cloud-service-name} as it is not in the move from a cluster level scope to regional scope. See
regional scope. Please refer to http://aka.ms/regionalscope for http://aka.ms/regionalscope for more details. This error
moving this deployment to regional scope. happens when the deployment being migrated has not had
an update operation, which automatically moves it to a
regional scope. Best workaround is to either add an endpoint
to a VM or a data disk to the VM and then retry migration.
See How to set up endpoints on a classic Windows virtual
machine in Azure or Attach a data disk to a Windows virtual
machine created with the classic deployment model
Migration is not supported for Virtual Network {vnet-name} This error occurs when you have non-gateway PaaS
because it has non-gateway PaaS deployments. deployments such as Application Gateway or API
Management services that are connected to the Virtual
Network.
Detailed mitigations
VM with Data Disk whose physical blob size bytes does not match the VM Data Disk logical size bytes.
This happens when the Data disk logical size can get out of sync with the actual VHD blob size. This can be easily
verified using the following commands:
Verifying the issue
# Store the VM details in the VM object
$vm = Get-AzureVM -ServiceName $servicename -Name $vmname
HostCaching : None
DiskLabel :
DiskName : coreosvm-coreosvm-0-201611230636240687
Lun : 0
LogicalDiskSizeInGB : 11
MediaLink : https://contosostorage.blob.core.windows.net/vhds/coreosvm-dd1.vhd
SourceMediaLink :
IOType : Standard
ExtensionData :
# Now get the properties of the blob backing the data disk above
# NOTE the size of the blob is about 15 GB which is different from LogicalDiskSizeInGB above
$blob = Get-AzureStorageblob -Blob "coreosvm-dd1.vhd" -Container vhds
$blob
ICloudBlob : Microsoft.WindowsAzure.Storage.Blob.CloudPageBlob
BlobType : PageBlob
Length : 16106127872
ContentType : application/octet-stream
LastModified : 11/23/2016 7:16:22 AM +00:00
SnapshotTime :
ContinuationToken :
Context : Microsoft.WindowsAzure.Commands.Common.Storage.AzureStorageContext
Name : coreosvm-dd1.vhd
# Convert the blob size in bytes to GB into a variable which we'll use later
$newSize = [int]($blob.Length / 1GB)
15
# Store the disk name of the data disk as we'll use this to identify the disk to be updated
$diskName = $vm.VM.DataVirtualHardDisks[0].DiskName
# Now remove the data disk from the VM so that the disk isn't leased by the VM and it's size can be updated
Remove-AzureDataDisk -LUN $lunToRemove -VM $vm | Update-AzureVm -Name $vmname -ServiceName $servicename
AffinityGroup :
AttachedTo :
IsCorrupted : False
Label :
Location : East US
DiskSizeInGB : 11
DiskSizeInGB : 11
MediaLink : https://contosostorage.blob.core.windows.net/vhds/coreosvm-dd1.vhd
DiskName : coreosvm-coreosvm-0-201611230636240687
SourceImageName :
OS :
IOType : Standard
OperationDescription : Get-AzureDisk
OperationId : 0c56a2b7-a325-123b-7043-74c27d5a61fd
OperationStatus : Succeeded
# Now verify that the "DiskSizeInGB" property of the disk matches the size of the blob
Get-AzureDisk -DiskName $diskName
AffinityGroup :
AttachedTo :
IsCorrupted : False
Label : coreosvm-coreosvm-0-201611230636240687
Location : East US
DiskSizeInGB : 15
MediaLink : https://contosostorage.blob.core.windows.net/vhds/coreosvm-dd1.vhd
DiskName : coreosvm-coreosvm-0-201611230636240687
SourceImageName :
OS :
IOType : Standard
OperationDescription : Get-AzureDisk
OperationId : 1v53bde5-cv56-5621-9078-16b9c8a0bad2
OperationStatus : Succeeded
# Now we'll add the disk back to the VM as a data disk. First we need to get an updated VM object
$vm = Get-AzureVM -ServiceName $servicename -Name $vmname
Add-AzureDataDisk -Import -DiskName $diskName -LUN 0 -VM $vm -HostCaching ReadWrite | Update-AzureVm -Name
$vmname -ServiceName $servicename
Azure CLI
Next steps
Overview of platform-supported migration of IaaS resources from classic to Azure Resource Manager
Technical deep dive on platform-supported migration from classic to Azure Resource Manager
Planning for migration of IaaS resources from classic to Azure Resource Manager
Use PowerShell to migrate IaaS resources from classic to Azure Resource Manager
Use CLI to migrate IaaS resources from classic to Azure Resource Manager
Community tools for assisting with migration of IaaS resources from classic to Azure Resource Manager
Review the most frequently asked questions about migrating IaaS resources from classic to Azure Resource
Manager
Community tools to migrate IaaS resources from
classic to Azure Resource Manager
4/9/2018 • 2 minutes to read • Edit Online
This article catalogs the tools that have been provided by the community to assist with migration of IaaS
resources from classic to the Azure Resource Manager deployment model.
NOTE
These tools are not officially supported by Microsoft Support. Therefore they are open sourced on GitHub and we're happy
to accept PRs for fixes or additional scenarios. To report an issue, use the GitHub issues feature.
Migrating with these tools will cause downtime for your classic Virtual Machine. If you're looking for platform supported
migration, visit
Platform supported migration of IaaS resources from Classic to Azure Resource Manager stack
Technical Deep Dive on Platform supported migration from Classic to Azure Resource Manager
Migrate IaaS resources from Classic to Azure Resource Manager using Azure PowerShell
AsmMetadataParser
This is a collection of helper tools created as part of enterprise migrations from Azure Service Management to
Azure Resource Manager. This tool allows you to replicate your infrastructure into another subscription which
can be used for testing migration and iron out any issues before running the migration on your Production
subscription.
Link to the tool documentation
migAz
migAz is an additional option to migrate a complete set of classic IaaS resources to Azure Resource Manager
IaaS resources. The migration can occur within the same subscription or between different subscriptions and
subscription types (ex: CSP subscriptions).
Link to the tool documentation
Next Steps
Overview of platform-supported migration of IaaS resources from classic to Azure Resource Manager
Technical deep dive on platform-supported migration from classic to Azure Resource Manager
Planning for migration of IaaS resources from classic to Azure Resource Manager
Use PowerShell to migrate IaaS resources from classic to Azure Resource Manager
Use CLI to migrate IaaS resources from classic to Azure Resource Manager
Review most common migration errors
Review the most frequently asked questions about migrating IaaS resources from classic to Azure Resource
Manager
Frequently asked questions about classic to Azure
Resource Manager migration
4/9/2018 • 5 minutes to read • Edit Online
newly migrated Resource Manager VM. However, if you wish to keep your backups of classic VMs, follow these
steps before the migration.
1. In the Recovery Services vault, go to the Protected Items tab and select the VM.
2. Click Stop Protection. Leave Delete associated backup data option unchecked.
NOTE
You will be charged backup instance cost till you retain data. Backup copies will be pruned as per retention range. However,
last backup copy is always kept until you explicitly delete backup data. It is advised to check your retention range of the
Virtual machine and trigger "Delete Backup Data" on the protected item in the vault once the retention range is over.
What happens if I run into a quota error while preparing the IaaS
resources for migration?
We recommend that you abort your migration and then log a support request to increase the quotas in the
region where you are migrating the VMs. After the quota request is approved, you can start executing the
migration steps again.
What if I don't like the names of the resources that the platform chose
during migration?
All the resources that you explicitly provide names for in the classic deployment model are retained during
migration. In some cases, new resources are created. For example: a network interface is created for every VM.
We currently don't support the ability to control the names of these new resources created during migration. Log
your votes for this feature on the Azure feedback forum.
I got the message "VM is reporting the overall agent status as Not
Ready. Hence, the VM cannot be migrated. Ensure that the VM Agent is
reporting overall agent status as Ready" or "VM contains Extension
whose Status is not being reported from the VM. Hence, this VM cannot
be migrated."
This message is received when the VM does not have outbound connectivity to the internet. The VM agent uses
outbound connectivity to reach the Azure storage account for updating the agent status every five minutes.
Next steps
Overview of platform-supported migration of IaaS resources from classic to Azure Resource Manager
Technical deep dive on platform-supported migration from classic to Azure Resource Manager
Planning for migration of IaaS resources from classic to Azure Resource Manager
Use PowerShell to migrate IaaS resources from classic to Azure Resource Manager
Use CLI to migrate IaaS resources from classic to Azure Resource Manager
Community tools for assisting with migration of IaaS resources from classic to Azure Resource Manager
Review most common migration errors
Allocation failures
Allocation failures
Allocation failures for classic deployments
Boot diagnostics
RDP
Reset RDP
RDP troubleshooting
Detailed RDP troubleshooting
Troubleshoot specific errors
SSH
SSH troubleshooting
Detailed SSH troubleshooting
Common error messages
Performance issues with Windows VMs
How to use PerfInsights
Performance diagnostics extension
Install Windows VM agent offline
Redeploy a VM
Linux
Windows
Reset VM password
Windows
Linux
Reset NIC
Restarting or resizing a VM
Use the serial console
Linux VM
Serial Console GRUB/Single user mode
Serial Console NMI/SysRq
Windows VM
CMD and PowerShell commands
Errors when deleting storage resources
Unexpected reboots of VMs with attached VHDs
Windows activation problems
Application access issues
Troubleshoot deployments
Linux
Windows
Device names are changed
VM recovery access
Windows
PowerShell
Azure portal
Linux
CLI
Azure portal
Boot errors
BitLocker errors
Checking file system errors
Blue screen errors
Throttling errors
Use nested virtualization
Understand a system reboot
Understand the structure and syntax of Azure
Resource Manager Templates
10/18/2018 • 7 minutes to read • Edit Online
This article describes the structure of an Azure Resource Manager template. It presents the different sections of a
template and the properties that are available in those sections. The template consists of JSON and expressions
that you can use to construct values for your deployment. For a step-by-step tutorial on creating a template, see
Create your first Azure Resource Manager template.
TITLE DESCRIPTION
Use the Azure portal Generate a template using the portal, and the process of
editing and deploying the template.
Use Visual Studio Code Use Visual Studio Code to create and edit templates, and
how to use the Azure Cloud shell to deploy templates.
Use Visual Studio Use Visual Studio to create, edit, and deploy templates.
Tutorials
TITLE DESCRIPTION
Set resource deployment order Define resource dependencies. In the tutorial, you create a
virtual network, a virtual machine, and the dependent
Azure resources. You learn how the dependencies are
defined.
Integrate key vault Retrieve secrets/passwords from Azure Key Vault. In the
tutorial, you create a virtual machine. The virtual machine
administrator password is retrieved from a Key Vault.
TITLE DESCRIPTION
Create linked templates Modularize templates, and call other templates from a
template. In the tutorial, you create a virtual network, a
virtual machine, and the dependent resources. The
dependent storage account is defined in a linked template.
Template format
In its simplest structure, a template has the following elements:
{
"$schema": "http://schema.management.azure.com/schemas/2015-01-01/deploymentTemplate.json#",
"contentVersion": "",
"parameters": { },
"variables": { },
"functions": [ ],
"resources": [ ],
"outputs": { }
}
Each element has properties you can set. The following example shows the full syntax for a template:
{
"$schema": "http://schema.management.azure.com/schemas/2015-01-01/deploymentTemplate.json#",
"contentVersion": "",
"parameters": {
"<parameter-name>" : {
"type" : "<type-of-parameter-value>",
"defaultValue": "<default-value-of-parameter>",
"allowedValues": [ "<array-of-allowed-values>" ],
"minValue": <minimum-value-for-int>,
"maxValue": <maximum-value-for-int>,
"minLength": <minimum-length-for-string-or-array>,
"maxLength": <maximum-length-for-string-or-array-parameters>,
"metadata": {
"description": "<description-of-the parameter>"
}
}
},
"variables": {
"<variable-name>": "<variable-value>",
"<variable-object-name>": {
<variable-complex-type-value>
},
"<variable-object-name>": {
"copy": [
{
"name": "<name-of-array-property>",
"count": <number-of-iterations>,
"input": {
<properties-to-repeat>
}
}
]
},
"copy": [
{
"name": "<variable-array-name>",
"count": <number-of-iterations>,
"input": {
<properties-to-repeat>
}
}
]
},
"functions": [
{
"namespace": "<namespace-for-your-function>",
"members": {
"<function-name>": {
"parameters": [
{
"name": "<parameter-name>",
"type": "<type-of-parameter-value>"
}
],
"output": {
"type": "<type-of-output-value>",
"value": "<function-expression>"
}
}
}
}
],
"resources": [
{
"condition": "<boolean-value-whether-to-deploy>",
"apiVersion": "<api-version-of-resource>",
"type": "<resource-provider-namespace/resource-type-name>",
"name": "<name-of-the-resource>",
"name": "<name-of-the-resource>",
"location": "<location-of-resource>",
"tags": {
"<tag-name1>": "<tag-value1>",
"<tag-name2>": "<tag-value2>"
},
"comments": "<your-reference-notes>",
"copy": {
"name": "<name-of-copy-loop>",
"count": "<number-of-iterations>",
"mode": "<serial-or-parallel>",
"batchSize": "<number-to-deploy-serially>"
},
"dependsOn": [
"<array-of-related-resource-names>"
],
"properties": {
"<settings-for-the-resource>",
"copy": [
{
"name": ,
"count": ,
"input": {}
}
]
},
"resources": [
"<array-of-child-resources>"
]
}
],
"outputs": {
"<outputName>" : {
"type" : "<type-of-output-value>",
"value": "<output-value-expression>"
}
}
}
Syntax
The basic syntax of the template is JSON. However, expressions and functions extend the JSON values available
within the template. Expressions are written within JSON string literals whose first and last characters are the
brackets: [ and ] , respectively. The value of the expression is evaluated when the template is deployed. While
written as a string literal, the result of evaluating the expression can be of a different JSON type, such as an array
or integer, depending on the actual expression. To have a literal string start with a bracket [ , but not have it
interpreted as an expression, add an extra bracket to start the string with [[ .
Typically, you use expressions with functions to perform operations for configuring the deployment. Just like in
JavaScript, function calls are formatted as functionName(arg1,arg2,arg3) . You reference properties by using the dot
and [index] operators.
The following example shows how to use several functions when constructing a value:
"variables": {
"storageName": "[concat(toLower(parameters('storageNamePrefix')), uniqueString(resourceGroup().id))]"
}
For the full list of template functions, see Azure Resource Manager template functions.
Parameters
In the parameters section of the template, you specify which values you can input when deploying the resources.
These parameter values enable you to customize the deployment by providing values that are tailored for a
particular environment (such as dev, test, and production). You don't have to provide parameters in your template,
but without parameters your template would always deploy the same resources with the same names, locations,
and properties.
The following example shows a simple parameter definition:
"parameters": {
"siteNamePrefix": {
"type": "string",
"metadata": {
"description": "The name prefix of the web app that you wish to create."
}
},
},
For information about defining parameters, see Parameters section of Azure Resource Manager templates.
Variables
In the variables section, you construct values that can be used throughout your template. You don't need to define
variables, but they often simplify your template by reducing complex expressions.
The following example shows a simple variable definition:
"variables": {
"webSiteName": "[concat(parameters('siteNamePrefix'), uniqueString(resourceGroup().id))]",
},
For information about defining variables, see Variables section of Azure Resource Manager templates.
Functions
Within your template, you can create your own functions. These functions are available for use in your template.
Typically, you define complicated expression that you don't want to repeat throughout your template. You create
the user-defined functions from expressions and functions that are supported in templates.
When defining a user function, there are some restrictions:
The function can't access variables.
The function can't access template parameters. That is, the parameters function is restricted to function
parameters.
The function can't call other user-defined functions.
The function can't use the reference function.
Parameters for the function can't have default values.
Your functions require a namespace value to avoid naming conflicts with template functions. The following
example shows a function that returns a storage account name:
"functions": [
{
"namespace": "contoso",
"members": {
"uniqueName": {
"parameters": [
{
"name": "namePrefix",
"type": "string"
}
],
"output": {
"type": "string",
"value": "[concat(toLower(parameters('namePrefix')), uniqueString(resourceGroup().id))]"
}
}
}
}
],
"resources": [
{
"name": "[contoso.uniqueName(parameters('storageNamePrefix'))]",
"type": "Microsoft.Storage/storageAccounts",
"apiVersion": "2016-01-01",
"sku": {
"name": "Standard_LRS"
},
"kind": "Storage",
"location": "South Central US",
"tags": {},
"properties": {}
}
]
Resources
In the resources section, you define the resources that are deployed or updated. This section can get complicated
because you must understand the types you're deploying to provide the right values.
"resources": [
{
"apiVersion": "2016-08-01",
"name": "[variables('webSiteName')]",
"type": "Microsoft.Web/sites",
"location": "[resourceGroup().location]",
"properties": {
"serverFarmId": "/subscriptions/<subscription-id>/resourcegroups/<resource-group-
name>/providers/Microsoft.Web/serverFarms/<plan-name>"
}
}
],
For more information, see Resources section of Azure Resource Manager templates.
Outputs
In the Outputs section, you specify values that are returned from deployment. For example, you could return the
URI to access a deployed resource.
"outputs": {
"newHostName": {
"type": "string",
"value": "[reference(variables('webSiteName')).defaultHostName]"
}
}
For more information, see Outputs section of Azure Resource Manager templates.
Template limits
Limit the size of your template to 1 MB, and each parameter file to 64 KB. The 1-MB limit applies to the final state
of the template after it has been expanded with iterative resource definitions, and values for variables and
parameters.
You're also limited to:
256 parameters
256 variables
800 resources (including copy count)
64 output values
24,576 characters in a template expression
You can exceed some template limits by using a nested template. For more information, see Using linked templates
when deploying Azure resources. To reduce the number of parameters, variables, or outputs, you can combine
several values into an object. For more information, see Objects as parameters.
Next steps
To view complete templates for many different types of solutions, see the Azure Quickstart Templates.
For details about the functions you can use from within a template, see Azure Resource Manager Template
Functions.
To combine multiple templates during deployment, see Using linked templates with Azure Resource Manager.
For recommendations on creating Resource Manager templates that you can use across global Azure, Azure
sovereign clouds, and Azure Stack, see Develop Azure Resource Manager templates for cloud consistency.
Frequently asked question about Windows Virtual
Machines
5/10/2018 • 4 minutes to read • Edit Online
This article addresses some common questions about Windows virtual machines created in Azure using the
Resource Manager deployment model. For the Linux version of this topic, see Frequently asked question about
Linux Virtual Machines
Can I use the temporary disk (the D: drive by default) to store data?
Don’t use the temporary disk to store data. It is only temporary storage, so you would risk losing data that can’t be
recovered. Data loss can occur when the virtual machine moves to a different host. Resizing a virtual machine,
updating the host, or a hardware failure on the host are some of the reasons a virtual machine might move.
If you have an application that needs to use the D: drive letter, you can reassign drive letters so that the temporary
disk uses something other than D:. For instructions, see Change the drive letter of the Windows temporary disk.
How can I change the drive letter of the temporary disk?
You can change the drive letter by moving the page file and reassigning drive letters, but you need to make sure
you do the steps in a specific order. For instructions, see Change the drive letter of the Windows temporary disk.
Why am I not seeing Canada Central and Canada East regions through
Azure Resource Manager?
The two new regions of Canada Central and Canada East are not automatically registered for virtual machine
creation for existing Azure subscriptions. This registration is done automatically when a virtual machine is
deployed through the Azure portal to any other region using Azure Resource Manager. After a virtual machine is
deployed to any other Azure region, the new regions should be available for subsequent virtual machines.
1 123 a actuser