Tagged: CE

How to create a nested virtual NutanixCE cluster

In my last post, I configured a Nutanix CE cluster node running on a single nested VM on Workstation. My intention was to create a 3 node cluster but unfortunately I was unable to because I built the single node cluster and then extra nodes separately.

NUTANIXCLUSTERIt appears that CE behaves the same way as the full version in that if you are adding extra nodes to a cluster (expansion), the default behavior is to automatically check for an Intelligent Platform Management Interface (IPMI) that is usually built into the main board of your Nutanix Supermicro hardware. Given that my nodes were all virtual, it was a little hard to work around this issue! (I did search long and hard!).

I spoke to @Joep and took his advice on posting on the excellent Nutanix Forum. AdamF helped me out and suggested that I tear down the cluster and start again, but this time – build the cluster at the start with all nodes present. So, here is how I did it in my environment:

NutanixCE Cluster node – build and configuration

1) Quite simple, follow my previous post up to step 10. Ensure that your VM has been built, configured with networking and running KVM and CVM. Then repeat and build three other nodes.


2) Once they are powered up, check that everything is running by using the following command on each node:


3) At this stage, I performed a little maintenance and reduced the overhead that the CVM would have on my limited resources, I shutdown the CVM’s on each KVM host by doing the following:

4) Once the VM was shutdown I modified the settings of the VM to only use 6GB RAM instead of 12GB:

Using VI editor, amend the memory sections to reflect the new allocation:

5) Ensure that the configuration is saved (:w!) and then you can start the VM, repeat these steps for all three CVM virtual machines:

6) Now it is time to create the cluster, login to one of the CVM machines via SSH and enter in the following:












7) Now the cluster is built and running enter in the ncli prompt to setup a few things:



8)  As the cluster is started and configured, I then logged in to the master node (Zeus Leader) via the Web Gui. (Step 13 onwards in my previous blog post).



Safely shutdown and start up cluster nodes

I found out that it is not wise to just shutdown your KVM nodes through VMware Workstation, it can have pretty disastrous consequences! Therefore I’m just going to quickly run through shutting down the cluster when you are finished.

1) Using Prism, make sure you have any non-system VM’s shutdown across the cluster.

2) Login to any CVM node that is part of the cluster (I logged into the master, I do not believe it matters). Stop the cluster:



3) At this stage, it is safe to log in to each CVM node and run a shutdown command.


4) When all of the CVMs are shut down, it is safe to shut down the guest O/S through Workstation (Shutdown the KVM hosts).

5) Starting the cluster is easier. Power on each KVM virtual host and wait a few minutes for the CVM and services to start. Once services are up, start the cluster!


That is it really, I hope to post further articles about running some nested VMs within the nested environment and more about the Nutanix platform and how to use it! Hopefully that will come in time as I gain more exposure to it.

How to Setup NutanixCE on VMware Workstation 11

Since a visit last week from Nutanix to my place of work, I must say I’ve suffered from a technological itch that I’ve needed to scratch!!

The twittersphere has recently gone mad with #NEXTConf and the buzz around this hyper-converged superpower is loud! Investigation had to be done…


At this point, I’d like to thank @dawoo for his presentation and for providing a NutanixCE Beta Key (Apply here) all of which was found through his blog post.

I also need to mention @jpiscaer and his superb post about nested NutanixCE. That helped (a novice like me) get going! A fair bit of what you are about to read has been taken from his blog but I’ve dumbed it down to my level as it took me a while to get it all working. Hopefully it will help someone else out there who is interested in the product!

With the honorable mentions out of the way, here’s what I did:

Prepare You Environment

As Joep mentions, you need to meet specific requirements for the CE. You can run a single node in a nested environment. I wanted to build a “proper” 3 node cluster but it couldn’t be done as you need an IPMI. This is what I’m building my node on:

– 250GB SSD (Samsung Evo 840)
– 32GB RAM
– Intel i7-3770 @ 3.4 GHz
– VMware Workstation 11

When you deploy the VM, you are deploying a Linux KVM Hypervisor with a nested “control” VM (CVM) inside that. The recommended minimum spec for this is 4vCPU, 16GB RAM and 200GB+500GB Disks.

1) Make sure you have signed up with Nutanix for the CE beta and downloaded the software (and unzipped the .IMG).
2) Renamed the .IMG to a .VMDK
3) Downloaded Joep’s disk descriptor file, renamed that too a .vmdk and store it with step 2. (As documented in Step 1 of his blog post).

Build A Nutanix Node

1) First thing to do is create a VMware Workstation 11 VM with custom properties. I’m not going to list this off in detail, I’m just going to spam some pictures here as they’ll speak 1000 words.











2) The important part here is that for the first disk of the VM, attach an existing SATA disk. Select the image/disk descriptor file created in the above section.



3) At this stage, I powered on the VM to check that the NutanixCE boot screen appeared. Once it did, I shutdown the VM and set the following up.


4) I also noticed this prompt, I selected “Yes”.


5) When booted, follow the instructions and type install at the login.


6) Select the language and proceed on the setup screen


7) The system then checks your disks for performance. I passed all the tests because everything is virtualised on an SSD!


8) At the prompt, enter two static IP addresses from your subnet. One for your KVM host, one for your CVM. Read/accept the EULA and Start.


9) Allow the system to build out the hypervisor and CVM.


10) When complete, you should see Success! Press Enter and get to the KVM login prompt.


11) You can then SSH to the CVM that has been created (U: nutanix P: nutanix/4u). Create a cluster by running the following command.


12) Then setup Google as a name server for DNS.(This is for later when you have to validate your Nutanix account).


13) You can then navigate to your CVM via IP address provided in step 8. The first PRISM prompt is to change your admin password.


14) After this, login to PRISM using the new details. Then login with your NEXT Account credentials with which you signed up for the BETA.


15) You are then into PRISM, controlling your single KVM host and single VM.


Once you are logged in you can see the HTML5 GUI and drive the console around and create a VM if you so wish. Pretty cool stuff! It turns out I can’t create a cluster because I don’t have an IPMI address which is sought after when you try adding extra nodes!

I have now made a new post about building a nested virtual cluster which elaborates on this one!