Virtualization, Cloud, Infrastructure and all that stuff in-between
My ramblings on the stuff that holds it all together
Monthly Archives: January 2011
Building a Fast and Cheap NAS for your vSphere Home Lab with Nexentastor
My home lab is always expanding and evolving – no sooner have I started writing up the vTARDIS.cloud configuration than something shiny and new catches my eye! fear not I will be publishing the vTARDIS configuration notes over the next 2 months, however in the meantime I have noticed that my IX4-200d NAS has been bogging down performance a bit recently – I attribute this to the number of VMs I am running across the 5 physical (and up to 50) vESXi hosts.
The IX4 is great and very useful for protecting my photos and providing general media storage but I suspect it also uses 5.4k RPM disks and in a RAID5 configuration it performs /ok/ but I feel the need, the need for speed ![]()
With the sub-£100 HP MicroServer deal that is on at the moment I spotted an opportunity to combine it with some recycled hardware into a fast NAS box, using some new software – the NexentaStor Community Edition, I’ve used OpenFiler and the Celerra VSA a lot in the past but this has some pretty intriguing features.
Nexentastor allows you to use SSD as a cache and provides a type of software RAID using Sun’s ZFS technology – you can read a good guide to configuring it inside a VM on this excellent post
I already have a number of ML115 and ML110 servers, which all boot from 160Gb 7.2k RPM SATA disks; most of the time they do nothing so an idea was born, I will switch my home lab to boot from 2Gb USB sticks (of which I have a plentiful supply) and re-use those fast SATA disks in the HP MicroServer for shared, fast VM storage
I also have a spare 64Gb SSD from my orginal vTARDIS experiments which I am planning to re-use as the cache within the MicroServer
So, the configuration looks is like this;
Because I want maximum performance and I don’t care particularly about data protection for this NAS I’m just going to try striping data across all the SATA disks for best performance and I hope the SSD will provide a highly performant front-end cache for VMs stored in it (if I understand how it works correctly).
Most of the VMs it will be storing are disposable or easily re-buildable but I can configure RSYNC copies between it and my IX4 for anything I want to keep safe (or maybe just use one of the handy NFR licenses Veeam are giving out)
I did consider putting ESXi on the HP MicroServer and running Nexentastor as a VM (which is supported) but I haven’t yet put any more RAM in the MicroServer, although I may do this in future and add it to my existing management cluster.
I’ll post up some benchmarks when I’m done.
New Storage Benchmarking Tool from VMware Labs
To quote the site..
IOBlazer is a multi-platform storage stack micro-benchmark. IOBlazer runs on Linux, Windows and OSX and it is capable of generating a highly customizable workload. Parameters like IO size and pattern, burstiness (number of outstanding IOs), burst interarrival time, read vs. write mix, buffered vs. direct IO, etc., can be configured independently. IOBlazer is also capable of playing back VSCSI traces captured using vscsiStats. The performance metrics reported are throughput (in terms of both IOPS and bytes/s) and IO latency.
IOBlazer evolved from a minimalist MS SQL Server emulator which focused solely on the IO component of said workload. The original tool had limited capabilities as it was able to generate a very specific workload based on the MS SQL Server IO model (Asynchronous, Un-buffered, Gather/Scatter). IOBlazer has now a far more generic IO model, but two limitations still remain:
The alignment of memory accesses on 4 KB boundaries (i.e., a memory page)
The alignment of disk accesses on 512 B boundaries (i.e., a disk sector).
Both limitations are required by the gather/scatter and un-buffered IO models.A very useful new feature is the capability to playback VSCSI traces captured on VMware ESX through the vscsiStats utility. This allows IOBlazer to generate a synthetic workload absolutely identical to the disk activity of a Virtual Machine, ensuring 100% experiment repeatability.
You can download it and find more information here – I’m going to try and use this in my upcoming NexentaStor NAS project.
New year, New Look for vinf.net
This blog is hosted on WordPress.com, rather than a dedicated WordPress instance – there are a number of reasons for this, but the main one is that it’s free. I also wanted to keep this site to do with content, being on wordpress.com limits what you can do in terms of plug-ins, themes etc. but that simplicity means less temptation to fiddle with things rather than write content and it means that someone else has to keep up with patching wordpress.
Anyway – I finally found some time to update the look and feel of the site, I quite like the new theme, it’s a bit sparse – but that’s not a bad thing, I even managed to knock up a logo of sorts… I did A-Level art you know*
Anyways, hope you like it – if not comments are below, feel free ![]()
* “did A-Level art” does not imply that Simon passed with a good grade or possesses any artistic talent at all, but he did attend most of the lessons.
That was 2010 so what next
I’m a bit late to the Internets with this post but happy new year to all my readers – and judging by my WordPress stats there are a lot of you! over 400k visitors this year!
So – what happened in 2010? for me, it was a strange year, I knew from the start of the year that I had chosen to leave the relative comfort of the position that I had held at ioko for the previous 10 years to do “something new” – and that it was that stark, a long notice period and nothing definite lined up so I took a bit of a leap of faith and it worked out as I joined VMware the day after I left.
However, there were plenty of projects to complete before I left ioko and I also cracked on with my blog in my limited spare time whilst also juggling a new-born baby and assortment of home DIY projects
- Presented several times at the London VMware User Group (VMUG) ok – I presented at *all* of the London VMUG’s in 2010

- Took the VMware Enterprise Administrator (VI3) Exam
- Took the VMware Design (VI3 Exam)
- Submitted my VCDX application package (fingers crossed)
- undertook lots of late-night development work on the vTARDIS
- The vTARDIS won the best of show award at VMworld Europe
- The vTARDIS travelled to BriForum and a bit of a US-tour
- I bemoaned the end of SpinVox and started using voxsci – which is almost exactly the same and slightly more accurate.
- I worked on a reasonably big vSphere 4 design for a customer project using HP’s new Flex10 technology – mostly went ok in the end and I posted the resources here
- I mused about the usefulness of vApps and some management problems they could pose if you take the traditional approach to guest management and don’t adapt your processes.
- I used an iPad to solve all my domestic scheduling problems
- I really wanted emulators for everything (come on vendors, get with the programme!)
- I complained about VMware’s licensing if you want to do “cloud”, some of these complaints still stand today (watch this space!)
- I wrote about how the computing super-powers were plotting to take over the world
- I did some interesting experiments with some solid-state storage for VMs
- I swapped from a Windows laptop to a Mac with OS X and quickly uninstalled Office 2011 and am using Office 2010 in a Fusion VM; heretic? meh.
So, what’s next…?
This year I would like to focus on the following;
- New layout and look for vinf.net – the default WP theme is getting a bit tired.
- Spend more time bridging development and infrastructure; these are two traditionally separate camps, and particularly with “cloud” there needs to be a much better integration across the two, devops is particularly of interest to me.
- Working with an “upcoming product” to unify the two camps for the cloud (see what I did there?
). - Learn to program again, it’s been a long time since I did any real hands-on development and its going to be very helpful in enabling this inf/dev bridge.
- Keep developing the vTARDIS and do not talk about fight-club
- Keep up with the presenting at user groups, conferences etc.
- Learn to play bass guitar properly at least a little bit
- Complete my VCDX on VI3 or VI4.
- Blog at least once a week, I’ve found twitter has replaced some of my “look at this, this is cool” type blog posts that I used to enjoy writing – but it’s hard to get any kind of objective opinion into 140 chars – so I’m going back to blog basics.
- Manage twitter distractions better, i.e close TweetDeck.
- London – Brighton bike ride with a better time than the heavily jet-lagged one I put in this year, and not to walk the beacon.
- London – Paris bike ride (either the 24hr race or 3 day ride)
- At least 1,500 miles cycled (oh and upgrade my road-bike, again..)
- Spend less of my own money on my home lab (donations accepted
)…
Have a good one!
BriForum comes to London in 2011
Brian Madden’s popular BriForum event is making a welcome return to Europe in 2011, and specifically to my home town of London
If you are in the server based computing space (Citrix, Terminal Services, VDI) then this is the place to be for no-vendor bull5h1t real-world information.
I’ve been to 2 previous BriForum events (2007 in Amsterdam in 2010 in Chicago, where I had the honour of presenting my vTARDIS).
there is currently a discount code available that will save you £200
