Deploying VVols on NTAP

VVolsEven before the release of vSphere 6, the hype for VVols has been in the upswing, and for a good reason. VVols allow for a granular management of VM objects within one or more datastores based on policies. I have written a few blogs about VVols, and also the requirements within NetApp here. I tend to write about the integration between the two vendors as I really like, and believe on their technology, and I am an advocate for both.

Anyway, deploying VVols on NetApp requires to first understand how this all works. So, with that in mind, don’t forget that this a software solution that relies on policies from both the VMware side and the NetApp side. As I explained on previous posts, deploying VVols on NetApp has certain requirements, but the one I’ll focus on is the VASA provider (VP). The VP acts as the translator between the VMware world and the storage array world, regardless of the storage vendor. Some storage vendors integrate the VP within the array others come as an OVA.

So, from the storage side, you first need to deploy the VP, and also in this case VSC, which is NetApp’s storage console within VMware. After all components have been installed, VASA will become your best friend as it will provision not only VVol datastores, but will also provision the volumes within NetApp, automatically create exports with proper permissions, and create the PE among others. The PE is a logical I/O proxy that the host sees and utilizes to talk to VVols on the storage side. In the case of an NFS (NAS) volume, the PE is nothing more than a mount point, in the case of iSCSI (SAN), the PE is a lun. Again, the VASA provider will automatically create the PE for you when you provision a VVol datastore.

Let’s start the roll out. Assumptions here are that you have already deployed VSC 6.0, VASA 6.0, and currently have vSphere 6.0 or later. On the NetApp side it is assumed that you have at least ONTAP 8.2.1 or later, and that you have already created an SVM of the protocol of preference whether it is iSCSI, FCP/FCoE or NFS, up to you.

The first thing you should do if you have both NetApp and VMware, or FlexPod for that matter, is to make sure your VMware hosts have the recommended settings from NetApp. To do this, go to VSC within the VMware Web Client, click summary, and click on the settings that are not green. VSC will open a new window and allow you to deploy those settings to the hosts. You should do this regardless if you are deploying VVols or not.

VSC_settings

 

The next step is to create a Storage Capability Profile within VSC/VASA. Within the VSC, go to VASA Provider for cDOT, and select Storage Capability Profiles (SCP). Here you will create your own profile of how you would like to group your storage, based on a specific criteria. For example, if you want a criteria for high performance, you may select a specific storage protocol, SSD drives, dedupe options, replication options, etc. This is the criteria that VASA will use to create your storage volumes when deploying VVol datastores, and if you already created a volume, this is also the criteria that will be qualified as compliant for the desired VVol storage.

I created an SCP that required the protocol to be iSCSI and SAS drives, the rest was set to any. This will result in VVol creation on the SAS drives only, and under the SVM that has iSCSI protocol and LIFs configured. If there are no iSCSI SVMs this would not work. Pretty self explanatory, I hope.

SCP_iSCSI

Now that the SCP is created, we can provision a VVol Datastore. Right click on the cluster or host and select “VASA Provider for clustered Date ONTAP”, then Provision VVol datastore.

Provision_VVol

Start the wizard and type the name of the VVol datastore, and select the desired protocol. Select the SCP that you want to include within the VVol, the qualified SVM(s) will be available if it matches the SCP you selected. For example, if you selected the SCP/protocol that calls for iSCSI and you only have one iSCSI SVM, that will be the only one that you will have as an option, and the NFS or FCP/FCoE SVMs will not appear. If there is a qualified volume, you may select to use it, or you may select none to create a new. If creating a new vol, choose the name, SCP, and other options just like you would from NetApp’s System Manager. You will also have the capability to add/create more volumes to the VVol datastore. The last step is to select a default SCP the VMs will use if the do not have a VMware profile assigned to them.

VVol_Complete

This will cause VASA to talk to your NetApp array and create a volume based on the SCP specified, at the same time, VASA will create the PE, which in this case is a lun.  You can add/remove storage to the VVol datastore you created at a later time simply by right-clicking the VVol and go to the VASA settings. Below you can see the PE that the VP created within the volume that was created during the VVol deployment process.

VVol_PE

 

The next step is to create a VM Storage Policy that points to the SCP. Once this policy is attached to a VM, it will “tell” the VM which datastore it is supposed to be on. So if you have a SQL VM on a high performance policy, you know that as long as the VM is in compliance, it will run in the high performance profile you created.  To create the VM policy within the Web Client, click on VM Storage Policies, select new (scroll with green + sign), give it a name and select the vCenter. For the rule set, select the VP from the drop-down box for “Rules based on data services” and add a rule based on profile name. For the profile name option, select the SCP you created initially under VASA. This will show you what storage is compatible with this rule. Since I selected the iSCSI SCP, it will show me the iSCSI VVol I have already created. This creates the VM policy that you can assign to individual VMs.

VSP_Rule1

VVol_Complete

 

You can also have different storage policies for the Home folder and VMDK.

VM_Policy

 

VM_Storage_Policy

 

Pretty cool, right?!?

I hope this helps you get started with VVols.

Get your NetApp – VVols while they are HOT

pistonToday, the long awaited NetApp VASA Provider (VP) and the new shiny VSC console have been released to general availability.

So what does VASA and VSC have to do with VVols? Everything. In previous posts I talked about both NetApp’s VSC and VASA provider for VMware here. These offerings along with VAAI provide a tight integration between VMware and NetApp. Given the transition from VMware’s C# Client (fat) to Web Client, it resulted in the need of updated versions, and this is how VSC 6.0 and VASA Provider 6.0 were born.

Now to VVols. In order to be able to deploy VVols with NetApp there are a few requirements.

  • vSphere 6.0 (or later)
  • NetApp Clustered Data ONTAP 8.2.1 or later (thanks Nick for the clarification)
  • VSC 6.0
  • NetApp VASA Provider 6.0

You can see now why this announcement is such a big deal, both VSC and VP make up the engine that powers up the VVols machine. Both vSphere and cDOT 8.2.1 have been out for a while, but those that wanted to test drive VVols with GA code could not do that until today except by using beta code.

VSC brings and additional enhancement with its new version and that is the addition of PowerShell cmdlets for most VSC features. These cmdlets along with PowerCLI and NetApp’s PowerShell Tool Kit can provide tighter integration and automation between NetApp and VMware.

 

You can download VSC and VP from the links below:

VSC_6.0_Download

NetApp_cDOT_VASA_Provider_6.0

VVols: All Systems Go

After a long wait and development/marketing effort from VMware, VVols are finally ready to take over your datacenter(s).

VVols are the next generation, integration between vSphere and storage arrays. VVols leverage a new set of APIs (VASA) that allows vSphere to communicate with the array and provide additional features at the VM level. VVols are based on storage policies, which in turn allows for further automation between products.

This storage abstraction provided by VVols, allows for the control of storage, not only at the VM level but also at the VDMK level. This is a great feature, as now you can control VMDKs as separate entities. The connections between the hosts and VVols are done through an abstraction layer known as Protocol Endpoints, which provides the user the freedom to use several protocols at once such as FC, iSCSI, or NFS.

There are a few requirements for VVols. One of them is that the array vendor can support VVols. The APIs from the vendor (VASA), as well as other vendor requirements. In the case of a storage array vendor such as NetApp, VSC is also required.

The Policy-Based Provisioning provided by VVols brings us even closer to the Software Defined Data Center (SDDC)

 

VVOLS

Deploying NetApp VASA Provider for VMware vSphere

As I mentioned in previous posts, NetApp’s VASA Provider for VMware vSphere allows for the management of storage through profiles, and gears towards the Software Defined Data Center (SDDC) approach.

In order to deploy VASA provider, you will need to download the NetApp VASA provider for vSphere from NetApp’s support site. There is an ONTAP 7-Mode flavor and also an ONTAP C-Mode flavor, so choose the one that matches your environment. Deploy the virtual appliance (OVA) using VMware’s client and provide the necessary information for the virtual appliance. You will also need VSC already installed in order to register the VASA provider after installation and configuration.

VASA_Settings

During the first boot, VMware Tools installation prompt appears. Mount the VMware Tools and hit enter to install VMware tools and continue installation. Change the CD/DVD configuration on the virtual appliance to “Client Device”. Provide passwords for maintenance account (maint) and vpserver account when prompted. Use the vpserver account to register VASA with VSC from the VSC configuration page by providing the IP address of the VASA provider.

VASA_Tools   VASA_Tools2

Configuration settings will appear after installation. Use the Web UI for normal use and the maintenance console (CLI) when the Web UI is not accessible. Note that the Web Console utilizes port 9083, so make sure to enter the correct TCP/IP socket when using the WEB UI.

VASA_Config

At this point, VASA has been deployed and configured. All that is left to do is register the VASA Provider with vSphere via VSC, and enjoy the benefits of NetApp and VMware integration.

VASA_Registration

 

NetApp VSC, VASA, VAAI for VMware vSphere: Why do I need this?

In most software meetings, round tables, and customer reviews and councils I have been part of, the feedback has been about a common topic the majority of the time. Customers want to have a single location/interface to manage multiple products. Fortunately, some aspects of NetApp storage can be managed through VMware’s WEB UI by leveraging Virtual Storage Console (VSC), VASA provider, and VAAI for VMware.

VSC is a vCenter plug-in that delivers VM management for environments running NetApp storage. VSC allows for storage configuration and monitoring, datastore provisioning and VM cloning, online VM optimization as well as backup and recovery of VMs and datastores. VSC is a very useful and convenient tool that will give you a glance of your storage status and also allow you to optimize your VMs that have not been properly aligned by migrating them to another storage target and aligning the VMDKs properly.

VSC_Main

 VSC Main Page

 

VSC_Align

VMDK alignment using VSC

 

The VASA provider for NetApp ONTAP is a virtual appliance that supports VMware’s VASA (vStorage APIs for Storage Awareness). It leverages VSC as the console and provides information to the vCenter about NetApp Storage that has been associated with VSC. VASA allows for the management of storage profiles defined as Service Level Objectives (SLO) as well as alarms to monitor the NetApp environment when aggregates and volumes are nearing their storage capacity.

The last piece of the puzzle is VAAI. VMware VAAI (vSphere Storage APIs – Array Integration) allows for hardware acceleration and offload certain operations that originally occurs at the host level, to the storage system. This reduces the overhead and consumption of resources on the ESXi host and improves performance. VAAI is great for speeding up I/O operations on the VMware side.

You could pick and choose which of these components to install as you see fit, but ideally you would want to deploy all three to take advantage of these enhancements and integration. The VSC software is installed on a server and associated with a specific vCenter. The NFS plug-in for VMware VAAI is installed on each VMware host and the VASA provider is deployed as a virtual appliance. It is important to point out that VSC  can also be utilized to set NetApp’s recommended values on ESXi hosts for better performance.

 

VSC_Logo

VSC_HostOptions

 VSC ESXi Host Options

 

VSC_VM_Options

VSC VM Options