Archive for the ‘VMWare’ Category

h1

Cloud Wars: VMWare vs Microsoft vs Google vs Amazon Clouds

October 1, 2008

 

A short time ago in a data centre, far far away…..

All the big players are setting out their cloud pitches, Microsoft are set to make some big announcements at their Professional Developer Conference at the end of October and VMWare made their VDC-OS announcements at VMWorld a couple of weeks ago, Google have had their App Engine in beta for a while and Amazon AWS is pretty well established.

With this post I hope to give a quick overview of each, I’ll freely admit I’m more knowledgeable on the VMWare/Microsoft offerings… and I stand to be corrected on any assumptions I’ve made on Google/AWS based on my web reading.

So, What’s the difference between them…?

VMWare vCloud - infrastructure led play

VMWare come from the infrastructure space, to-date they have dominated the x86 virtualization market, they have some key strategic partnerships with storage and network vendors to deliver integrated solutions.

The VMWare VDC-OS pitch is about providing a flexible underlying architecture through servers, network and storage virtualisation. why? because making everything ‘virtual’ makes for quick reconfiguration - reallocating resource from one service to another is a configuration/allocation change rather than requiring an engineer visit (see my other post on this for more info)

because VMWare’s pitch is infrastructure led it has a significant practical advantage in that it’s essentially technology agnostic (as long as it’s x86 based) you, or a service provider have the ability to build and maintain an automated birth–>death bare ‘virtual metal’ provisioning and lifecycle system for application servers/services as there is no longer a tight dependency for everything on physical hardware, cabling etc

There is no one size fits all product in this space so a bespoke solution based around a standard framework tool like Tivoli, SMS, etc. is typically required depending on organisational/service requirements.

No re-development is necessarily required to move your applications into a vCloud (hosted or internal) you just move your VMWare virtual machines to a different underlying VDC-OS infrastructure, or you use P2V, X2V tools like Platespin to migrate to a VDC-OS infrastructure.

In terms of limitations - apps can’t necessarily scale horizontally (yet) as they are constrained by their traditional server based roots. The ability to add a 2nd node doesn’t necessarily make your app scale - there are all kinds of issues around state, concurrency etc. that the application framework needs to manage.

VMWare are building frameworks to build scale-out provisioning tools - but this would only work for certain types of applications and is currently reactive unless you build some intelligence into the provisioning system.

Scott Lowe has a good round-up of VDC-OS information here & VMWare’s official page is online here

Google AppEngine- pure app framework play

An application framework for you to develop your apps within - it provides a vastly parallel application and storage framework - excellent for developing large applications (i.e Google’s bread & butter)

Disadvantage is it’s a complete redevelopment of you applications into Google compatible code, services & frameworks. You are tied into Google services - you can’t (as I understand it) take your developed applications elsewhere without significant re-development/porting.

The Google AppEngine blog is here

Microsoft Cloud Services Hosted Application stack & Infrastructure play

An interesting offering, they will technically have the ability to host .net applications from a shared hosting service, as well as integrating future versions of their traditional and well established office/productivity applications into their cloud platform; almost offering the subscription based/Software+Services model they’ve been mooting for a long time.

Given Microsoft’s market current dominance, they are very well positioned to make this successful as large shops will be able to modify existing internal .net services and applications to leverage portions of their cloud offering.

With the future developments of Hyper-V Microsoft will be well positioned to offer an infrastructure driven equivalent of VMWare’s VDC-OS proposition to service and support migration from existing dedicated Windows and Linux servers to an internal or externally hosted cloud type platform.

David Chou at Microsoft has a good post on Microsoft and clouds here

Amazon Web Services - established app framework with canned virtualization

the AWS platform provides a range of the same sort of functionality as Google AppEngine with SimpleDB,  SQS and S3 but with the recently announced ability to run Windows within their EC2 cloud makes for an interesting offering with the existing ability to pick & choose from Linux based virtual machine instances.

I believe EC2 makes heavy use of Xen under the hood; which I assume is how they are going to be delivering the Windows based services, EC2 also allows you to choose from a number of standard Linux virtual machine offerings (Amazon Machine Image, AMI).

This is an interesting offering, allowing you to develop your applications into their framework and possibly port or build your Linux/Windows application services into their managed EC2 service.

Same caveat applies though, your apps and virtual machines could be tied to the AWS framework - so you loose your portability without significant re-engineering. on the flip-side they do seem to have the best defined commercial and support models and have been well established for a while with the S3 service.

Amazon’s AWS blog is available here

Conclusion

Microsoft & VMWare are best positioned to pick up businesses from the corporate’s who will likely have a large existing investment in code and infrastructure but are looking to take advantage of reduced cost and complexity by hosting portions of their app/infrastructure with a service-provider.

Microsoft & VMWare offerings easily lend themselves to this internal/external cloud architecture as you can build your own internal cloud using their off-the-shelf technology, something that isn’t possible with AWS or Google. This is likely to be the preferred model for most large businesses who need to retain ownership of data and certain systems for legal/compliance reasons.

leveraging virtualization and commercial X2V or X2X conversion tools will make transition between internal and external clouds simple and quick - which gives organisations a lot of flexibility to operate their systems in the most cost/load-effective manner as well as retain detailed control of the application/server infrastructure but freed up from the day-day hardware/capacity management roles.

AWS/Google are ideal for Web 2.0 ,start-ups and the SME sector where there is typically no existing or large code-base investment that would need to be leveraged. For a greenfield implementation these services offer low start-up cost and simple development tools to build applications that would be complicated & expensive to build if you had to worry about and develop supporting infrastructure without significant up-front capital backing.

AWS/Google are also great for people wanting to build applications that need to scale to lots of users, but without a deep understanding of the required underlying infrastructure, whilst this is appealing to corporate’s  I think the cost of porting and data ownership/risk issues will be a blocker for a significant amount of time.

Google Apps are a good entry point for the SME/start-up sector and startups, and could well draw people into building AppEngine services as the business grows in size and complexity, so we may see a drift towards this over time. Microsoft have a competing model and could leverage their established brand to win over customers if they can make the entry point free/cheap and cross-platform compatible, lots of those SME/start-ups are using Mac’s or Netbooks for example.

h1

Workstation VMs loose network connectivity

October 1, 2008

 

I’ve had a problem recently with VM Workstation on my laptop, both with previous beta versions and the current RTM build. My Windows XP Virtual machine that I use to run Outlook via Unity (and indeed all VM’s on my laptop) loose network connectivity via the host occasionally, this seems to affect VM’s configured for both Bridged and NAT mode - they just can’t ping anything. I do suspend/resume my Vista laptop quite a lot throughout the day, often with VM’s running so I guess this is one of the main reasons it gets upset.

The only fix I’ve found so far is to restart the VMWare NAT Service a couple of times, and sometimes it won’t stop so I have to kill the vmnat process via Task Manager (show processes for all users) and then restart the VMNat service via services under ‘Administrative Tools’ in control panel.

image 

I’ve not managed to isolate this to a problem with specific VMWare or one of my 3rd party tools (AV/SSLVPN) yet, but will keep digging; let me know if you have similar problems.

I know of a similar, but different problem with the Trend OfficeScan Personal firewall service - but the workaround doesn’t resolve the problem and seems independent of it.

h1

VMWare Workstation 6.5 Release

September 30, 2008

 

I’ve been running the beta versions for a while and have been impressed with the new Unity feature; finally matching what Parallels for the Mac has had for ages.

my previous posts here and here and how it is particularly useful for running more than one version of Outlook.

As ever, clean uninstall of the beta and reinstall of the RTM code, performance is excellent now, and Unity seems to work very well.

Quick (content obscured) screen shot below of how well it integrates into the desktop, even works with the Flip-3D feature in Vista

image

Unity icon colour is configurable image and I notice there are a load of per-VM configuration settings for how you can mark Unity presented windows.

image

Good stuff - Unity is definitely the killer feature that allows you to seamlessly run apps on a single desktop, wonder is this available in ACE/Player and would be good if you could do this in future with Linux apps onto a Windows desktop.

h1

VMWare vCloud

September 15, 2008

 

The news is out, VMWare are building some very interesting technology frameworks to enable you to build your own cloud architectures, but also to be able to transition VMs from your environment to a service provider offering a hosted service and mix & match as required.

All very clever stuff, I’ve been working with VMWare on this for the last couple of weeks and it all links in nicely to an article I wrote a couple of months back on how VMWare can deliver this type of infrastructure now. nice to see it’s being “productized” and being explained as a concept to the world, I see Scott’s point and I also hope that people do realise it’s the underlying virtualization tech they are focusing on not some overarching end-end GoogleOS that does everything - although the clever bit is building management frameworks to allow another vendor to do this type of integration.

Read the vCloud page here and overview of the virtual data centre stuff here

h1

VMWorld Week

September 15, 2008

 

Well, it starts a bit later today in the US, I went last year and it was a very useful and educational week, my only gripe was about scale - there were too many people and the place was too small, crazy queues for every session.

It seems they’ve moved to somewhere much bigger this year and I hear the attendance is up on 14k people from 10k last year.

I couldn’t make it this year, but I am going to Microsoft Tech-Ed - I’ve been to both of these a couple of times in the last few years and in my opinion they’re brilliant value for money. It costs about £1.5k GBP +expenses to go for a week.

Yes, it’s away from home and there plenty of opportunities to jolly it up after work hours but, to put it in context a normal 1 week technical training course on VMWare or Microsoft stuff in the UK costs upwards of £2-3k. I find most courses frustratingly slow and plodding and they focus in a narrow set of a products functionality and only ever at a high level, never really drilling down into the intimate details of a product as courses are delivered by trainers who are divorced from the technology and delivering a training package.

Whereas with VMWorld or Tech-Ed you can drive your own schedule; you can pick from various deep technical or high-level sessions across a wide range of products and tech.

There is always a good attendance from technical members of the product and engineering teams and partners, over the years I’ve had lots of in-depth discussions with the people who wrote the code and have gained far more understanding than I could ever get from a training course.

Tech-Ed, VMWorld are the only way to get up to speed with their current products, if I were to put it into numbers I’d say a training course could give you maybe 5% of what you would get out of Tech-Ed/VMWorld - unless your day job has a very narrow focus to one task and one product which has been around for a while. If you’re a consultant or Architect tasked with making and implementing technology decisions there is no argument - best money you (or your employer) will ever spend.

So, for those of us that couldn’t be here tonight :) here are my round up of links to the best “virtual event” coverage

Eric Sloof http://www.ntpro.nl/blog/

Scott Lowe http://blog.scottlowe.org/

VMWorld site http://vmworld.com/vmworld/index.jspa

Enjoy!

Edited for appalling spelling!

h1

Mapping a drive to a VSS Snapshot & General DFS-R woes

September 14, 2008

 

Microsoft’s volume snapshot service is pretty handy right? quick hardware independent snaps of a file system - all free and out of the box, well it’s now officially saved my bacon…. whilst it’s a bit klunky (more on this in a bit) it was damned useful.

I had a pain of a problem to deal with this weekend, helping out a friend doing some server re-organising (plan was to migrate these guys from VMWare Server 1.x to ESXi - but didn’t get that far due to some other Windows issues that took all of our time as we checked everything was ok before the move)

Firstly, if you use DFS-R (as comes with Win2003 R2) never, ever, ever, ever use the “distributed file system” applet to administer DFS, we needed to add a new replica of a large DFS-R set to another server and because (in our defence) the server was a fresh R2 install, we forgot to install the newer DFS-R components via control panel, but original DFS was still installed by default and we were in a hurry (read: not paying attention) we used the “Distributed File System” applet to add a new target, and followed the wizard which actually re-created the DFS volume (note to self - pay more attention when clicking!) from scratch.

It proceeded to delete all the contents of all the DFS shares and moved them to a folder called NtFrs_PreExisting___See_EventLog and started afresh, that wouldn’t be so bad except for some inexplicable reason it then purged the contents of that folder from all replicas so we had no quick cut & paste file copy solution.

This was not going to be a fun weekend.

Don’t use this one image

 imageimage 

use this one!image

 image image

 

So, basically it was our (my) fault - but it was compounded by some weird corruption in one of the directories that looked like it had been there a while that meant recovery wasn’t going to be straightforward.

The data Backup was about 24hrs older than the last VSS snapshot on the central file server (hub & spoke replication topology) so as we now had a flat, deleted DFS volume with no data (thanks!) we decided to try and revert to the most recent VSS snapshot for the relevant directories.

But no dice, it just threw an error - can’t copy, I can view the files and see the contents and can drag and drop one or two a time, but any more and it would throw an error.

Not good, I can only assume that this was because of some logical corruption within the file system as there was one whole directory tree I couldn’t access (more on how I recovered this later).. there were over 60k files so I wasn’t going to do that by hand - so a command line was in order as at least XCopy can ignore errors etc. and just pull out the good data.

I found these excellent articles here and here and documentation here but some of them were more geared towards taking a snapshot and extracting data in-situ rather than from a persistent snapshot like you get with VSS.

so, none of them worked for me ; and even a lot of hacking with Vshadow and MOUNTVOL I couldn’t get the VSS Snap to mount at all and time was short

I did discover the following though, if you view a snapshot using the Previous Versions tab (remember this only works if you browse for files to restore via UNC path) it opens the snap in Explorer, but you can’t map a drive to it or run a command line copy against it…. or can’t you :)

When you open it in explorer this way it does create a sort of hidden temporary share - easiest way I found to expose the name of the share was to try and zip a file in the explorer session that is looking at the snapshot using WinZip, if you follow the wizard at some point it will expose a UNC path like \\SERVERNAME@GMT-DD-MM-YY-{GUID} if you can cut & paste that you can then map a network drive to it

NET USE * \\servername@gmt-dd-mm-yy-{guid}

And you can then run xcopy etc against that mapped drive to copy out all the good data - in reality we used SyncBackSE - which is great for complex file copies and we already had it installed.

All of these Windows servers were installed as VM’s in VMWare Server(s), so it actually made our lives a lot easier as we could quickly clone a known-broken server as-is (do no further harm) and then spin it up disconnected from the network to recover data using this method and also undeleted files using Get Data Back NTFS etc. and then use that data to re-seed the DFS-R volume - but much easier than if it were a physical box and at no real risk of making things worse.

So, in conclusion this was human error, rather than a 100% technical problem and should have been better planned and prevented by maintenance and a better recovery plan- but here it is, with the solution we found to get things back in all its gory details… and mainly as a footnote so I don’t make the DFS mistake again and in my defence this is a shoe-string charity operation rather than a blue-chip org with significant money and time to invest in such efforts.

This solution worked for us, but you need to have your own tried & tested solution - don’t rely on this as far as I can tell it’s unsupported, use at your own risk!

h1

Microsoft now Officially support many of their products under ESX 3.5u2

September 5, 2008

 

As noted here and here, VMWare have had ESX 3.5u2 certified under Microsoft’s SVVP programme, this is excellent news and will knock down one of the long standing barriers to greater adoption of virtualisation as I wrote about here - support.

Most notably for me this means blessed support of Exchange 2007sp1 running under ESX!

Excellent work to get this done so quickly - MS only announced the SVVP programme a short while ago.

Official list of MS products supported under VMWare is here.

h1

Free VMWare Disaster Recovery Solution Book

August 31, 2008

 

VMWare have made an excellent free book available online here. it goes into a lot of detail around the various DR scenarios that you can use VMWare for; even P2V DR and has lots of example configurations with various vendor’s server & storage equipment.

Some really good technical documentation coming out of VMWare & it’s partners recently like the Cisco doc.

h1

VMWare Workstation 6.5 Release Candidate Build 110068

August 28, 2008

 

There is a new build available for VMWare Workstation, I’ve installed it on my Vista laptop; definitley seems a lot faster and unity is pretty slick now at screen refreshes.

Flawless uninstall/reinstall as per usual VMWare standards… it’s almost there!

Unity icon has now changed to a rather nasty pinkish colour :)

image

and

image

h1

VMWare aims for the Clouds

July 26, 2008

 

Interesting post by Dave Ohara here; looks like VMWare are gearing up for some big cloud-related product announcements at VMWorld in September.

This folds nicely into my previous post about how VMWare can enable you to build your own clouds

Looking forward to September.

h1

ESX3i for Free

July 24, 2008

 

VMWare ESXi (aka ESX 3i) is about to be available free, pricing kicks in 28th July and the attached doc shows an overview of the features in each edition as you step up.

Basic principal is you can start with ESX3i for free (rather than full ESX @$1k), then add licence keys to enable production features like VMotion, HA etc.

It’s useful for dev/PoC projects which could then move to production later on by adding licences but with a reduced upfront cost. It avoids having to use and migrate from the free Windows/Linux version of VMWare Server when moving into a production class system and this gives a further one-up on Microsoft’s Hyper-V release a couple of weeks ago.

You should note that ESX3i is currently a bit more limited than the normal base ESX installation as there is no service console so no ability to install host based HPSIM/backup/etc. agents. That said, it’s been speculated that the next major release of full–blown ESX (4.x) will move to this model as well.

ESX3i is available from some HW manufacturers as embedded boot from flash in specific server models or is a downloadable installer with a small disk footprint (c.32Mb).

I have to wonder if the name change is a bit OTT - VMWare ESXi said fast in an English accent is“VMWaresexy”? :)

h1

Excellent Set of Resources for VMWare HA

July 15, 2008

 

Scott and Chad have a good set of consolidated notes here if you find yourself needing to configure VMWare HA, with all the gotcha’s etc.

h1

Free EMC Celerra for your Home/Lab

July 9, 2008

 

Virtualgeek has an interesting post here about a freely downloadable VM version of their Celerra product, including an HA version. This is an excellent idea for testing and lab setups, and a powerful tool in your VM Lab arsenal alongside other offerings like Xtravirt Virtual SAN and OpenFiler.

I’ve been saying for a while that companies that make embedded h/w devices and appliances should try to offer versions of the software running their devices as VM’s so people can get them into lab/test environments quickly, most tech folk would rather download and play with something now, rather than have to book and take delivery of an eval with sales drones (apologies to any readers who work in sales) and pre-sales professional services, evaluation criteria etc. if your product is good it’s going to get recommended, no smoke and mirrors required.

As such VM appliances are an excellent pre-sales/eval tool, rather than stopping people buying products. Heck, they could even licence the VM versions directly for production use (as Zeus do with their ZXTM products); this is a very flexible approach and something that is important if you get into clouds as an internal or external service provider - the more you standardise on commodity hardware with a clever software layer the more you can recycle, reuse and redeploy without being tied into specific vendor hardware etc.

Most “appliances” in-use today are actually low-end PC motherboards with some clever software in a sealed box - for example I really like the Juniper SA range of SSL VPN appliances, I recently helped out with a problem on one which was caused by a failed HDD - if  you hook up the console interface its a commodity PC motherboard in a sealed case running a proprietary secure OS - as it’s all intel based, no reason it couldn’t also run as a VM (SLL accelerator h/w can be turned off in the software so there can’t be any hard dependency on any SSL accelerator cards inside the sealed box) - adopting VM’s for these appliances provides the same (maybe even better) level of standard {virtual} hardware that appliance vendors need to make their devices reliable/serviceable.

Another example, the firmware that is embedded in the HP Virtual Connect modules I wrote about a while back runs under VMWare Workstation, HP have an internal use version for engineers to do some development and testing against, sadly they won’t redistribute it as far as I am aware.

h1

PSOD - Purple Screen of Death

July 8, 2008

Just incase you ever wondered what it looks like here is a screendump..

this is the VMWare equivalent of Microsoft’s BSOD (Blue Screen of Death)

image

I got this whilst running ESX 3.5 under VMWare Workstation 6.5 build 99530, it happened because I was trying to boot my ESX installation from a SCSI hard disk - which it didn’t like - I assume because of driver support, swapped for an IDE one and it worked fine…

update - actually the VM had 384Mb of RAM allocated and that’s what actually stopped it from booting.. upped to 1024Mb and it runs fine.

Its the first time I’ve seen one - all the production ESX boxes I’ve worked with have always been rock-solid (touch wood)

I’m preparing a blog post about unattended installations of ESX when I hit this, in case you were wondering.

h1

Certified..

July 1, 2008

 

I had my 2nd attempt at the VMWare FastTrack course last week (the 1st attempt was cut short due to power problems, and I’ve only just managed to find the time to reschedule).

The course went ok, the 1st 2 days were a bit dull as I’d already sat through them once; the course has been restructured since and is now contiguous through the 2 books, in the 1st attempt we were jumping back and forth as the Fast Track course is the Install & Configure and DSA course mashed together.

I found the pace ok, infact I could probably have been pushed a lot harder, as such I didn’t find it as “intensive or extended hours” - we finished by at least 5.30 most days and earlier some other days - the last day did feel a bit like treading water as it was quite spread out.

Wasn’t overly impressed by the facilities at QA-IQ’s Roseberry Ave - could do with a lick of paint, some better lighting and A/C that works properly. In all fairness it did look like they were in the middle of refitting it. More importantly the instructor was good and the kit/resources worked as required - no free lunch though ;)

No VCP exam voucher is included with QA-IQ as you get at DNS arrow - considering the QA and DNS courses are virtually the same price I think that’s a bit cheap - so you may want to check with your vendor before booking.

There is a lot of team working in building up DRS clusters and doing HA etc. and you have to have sat the course in order to be officially certified as a VCP.

I sat my exam yesterday morning and passed - not by as much as I’d have liked, but I was a bit lazy and didn’t do much (any) specific exam prep - there were a whole load of questions on a particular subject that I had not revisited since the course* and I fell foul of the “mark for review” option where you can go back at the end and can review/change your answers before submitting the exam - several of them from correct to incorrect as I later worked out - d’oh I learnt (and subsequently) forgot that from my MCSE exam days - if you don’t know 100% your 1st instinct was probably right.

Ah well, another one down - must get round to updating my MCSE too.. I quite like the certification exams, it’s just finding the time to learn the MS/VMWare answers and I’m lucky that English is my 1st language as I think a lot of the cert questions (not just VMWare - MS, Cisco etc.) are more about English comprehension and understanding what they are actually asking in order to answer correctly.

image

*As usual I had to sign an NDA, so no I can’t say what they were - sorry

h1

Virtualization - the key to delivering "cloud based architecture" NOW.

June 23, 2008

 

There is a lot of talk about delivering cloud or elastic computing platforms, a lot of CxO’s are taking this all in and nodding enthusiastically, they can see the benefits.. so make it happen!….yesterday.

Moving your services to the cloud, isn’t always about giving your apps and data to Google, Amazon or Microsoft.

You can build your own cloud, and be choosy about what you give to others. building your own cloud makes a lot of sense, it’s not always cheap but its the kind of thing you can scale up (or down..) with a bit of up-front investment, in this article I’ll look at some of the practical; and more infrastructure focused ways in which you can do so.

image

Your “cloud platform” is essentially an internal shared services system where you can actually and practically implement a “platform” team that operates and capacity plans for the cloud platform; they manage it’s availability and maintenance day-day and expansion/contraction.

You then have a number of “service/application” teams that subscribe to services provided by your cloud platform team… they are essentially developers/support teams that manage individual applications or services (for example payroll or SAP, web sites etc.), business units and stakeholders etc.

Using the technology we discuss here you can delegate control to them over most aspects of the service they maintian - full access to app servers etc. and an interface (human or automated) to raise issues with the platform team or log change requests.

I’ve seen many attempts to implement this in the physical/old world and it just ends in tears as it builds a high level of expectation that the server/infrastructure team must be able to respond very quickly to the end-”customer” the customer/supplier relationship is very different… regardless of what OLA/SLA you put in place.

However the reality of traditional infrastructure is that the platform team can’t usually react as quick as the service/application teams need/want/expect because they need to have an engineer on-site, wait for an order and a delivery, a network provisioning order etc. etc (although banks do seems to have this down quite well, it’s still a delay.. and time is money, etc.)

Virtualization and some of the technology we discuss here enable the platform team to keep one step ahead of the service/application teams by allowing them to do proper capacity planning and maintain a pragmatic headroom of capacity and make their lives easier by consolidating the physical estate they manage. This extra headroom capacity can be quickly back-filled when it’s taken up by adopting a modular hardware architecture to keep ahead of the next requirement.

Traditional infrastructure = OS/App Installations

  • 1 server per ‘workload’
  • Silo’d servers for support
  • Individually underused on average = overall wastage
  • No easy way to move workload about
  • Change = slow, person in DC, unplug, uninstall, move reinstall etc.
  • HP/Dell/Sun Rack Mount Servers
  • Cat 6 Cables, Racks and structured cabling

The ideal is to have an OS/app stack that can have workloads moved from host A to host B; this is a nice idea but there are a whole heap of dependencies with the typlical applications of today (IIS/apache + scripts, RoR, SQL DB, custom .net applications). Most big/important line of business apps are monolithic and today make this hard. Ever tried to move a SQL installation from OLD-SERVER-A to SHINY-NEW-SERVER-B? exactly. *NIX better at this, but not that much better.. downtime required or complicated fail over.

This can all be done today, virtualization is the key to doing it - makes it easy to move a workload from a to b we don’t care about the OS/hardware integration - we standardise/abstract/virtualize it and that allows us to quickly move it - it’s just a file and a bunch of configuration information in a text file… no obscure array controller firmware to extract data from or outdated NIC/video drivers to worry about.

Combine this with server (blade) hardware, modern VLAN/L3 switches with trunked connections, and virtualised firewalls then you have a very compelling solution that is not only quick to change, but makes more efficient use of the hardware you’ve purchased… so each KW/hr you consume brings more return, not less as you expand.

Now, move this forward and change the hardware for something much more commodity/standardised

Requirement: Fast, Scalable shared storage, filexible allocation of disk space and ability to de-duplicate data, reduce overhead etc, thin provisioning.

Solution: SAN Storage, EMC Clariion, HP-EVA, Sun StorageTek, iSCSI for lower requirements, or storage over single Ethernet fabric - NetApp/Equalogic

Requirement: Requirement Common chassis and server modules for quick, easy rip and replace and efficient power/cooling.

Solution: HP/Sun/Dell Blades

Requirement: quick change of network configurations, cross connects, increase & decrease bandwidth

Solution: Cisco switching, trunked interconnects, 10Gb/bonded 1GbE, VLAN isolation, quick change enabled as beyond initial installation there are fewer requirements to send an engineer to plug something in or move it, Checkpoint VSX firewalls to allow delegated firewall configurations or to allow multiple autonomous business units (or customers) to operate from a shared, high bandwidth platform.

Requirement: Ability to load balance and consolidate individual server workloads

Solution: VMWare Infrastructure 3 + management toolset (SCOM, Virtual Centre, Custom you-specific integrations using API/SDK etc.)

Requirement: Delegated control of systems to allow autonomy to teams, but within a controlled/auditable framework

Solution: Normal OS/app security delegation, Active Directory, NIS etc. Virtual Center, Checkpoint VSX, custom change request workflow and automation systems which are plugged into platform API/SDK’s etc.

the following diagram is my reference architecture for how I see these cloud platforms hanging together

image 

As ever more services move into the “cloud” or the “mesh” then integrating them becomes simpler, you have less of a focus on the platform that runs it - and just build what you need to operate your business etc.

In future maybe you’ll be able to use the public cloud services like Amazon AWS to integrate with your own internal cloud, allowing you to retain the important internal company data but take advantage of external, utility computing as required, on demand etc.

I don’t think we’ll ever get to.. (or want) to be 100% in a public cloud, but this private/internal cloud allows an organisation to retain it’s own internal agility and data ownership.

I hope this post has demonstrated that whilst, architecturally “cloud” computing sounds a bit out-there, you can practically implement it now by adopting this approach for the underlying infrastructure for your current application landscape.

h1

Can you run ESX as a VM under ESX?

June 12, 2008

 

Crazy, yeah - but hey you’ve got to try it, prompted by a question from Prasad - can you run ESX in a VM under ESX?

In the interest of science I just tried this, I used VM Convertor to convert my working ESX under workstation image as-is to my ESX box (hoping it would keep the custom settings intact, and saving me from having to rebuild it)

good news, the VM converter did it’s thing and it does start up on the ESX box.

..bad news, it doesn’t get past  this screen as far as I can tell…it’s sat there for a good 20mins so I don’t think its going to get much further.

image

Also tried to import my ESX 3i image to see if that would work, but VM Convertor wouldn’t import it for some reason, so will have to try a clean install on that.

image

Looks like some kind of error when it’s trying to determine what version it is..

[2008-06-13 00:23:29.164 'P2V' 5748 error] [task,295] Task failed: P2VError UNKNOWN_METHOD_FAULT(sysimage.fault.OsVersionNotFound)
[2008-06-13 00:23:29.164 'P2V' 5748 verbose] [task,339] Transition from InProgress to Failure requested
[2008-06-13 00:23:29.164 'P2V' 5748 verbose] [task,388] Transition succeeded

Ah well, anyone know how to get this going/if it’s possible?

h1

Slow vMotion..

June 2, 2008

 

Note to remember, don’t forget to check the duplex settings on NICs handling your vMotion traffic.

My updated clustered ESX test lab is progressing (more posts on that in the next week or so)… and I’m kind of limited in that I only have an old 24-port 100Mb Cisco hub for the networking at the moment.

vMotion warns about the switch speed as a possible issue.

image

I had my Service Console/ vMotion NICit forced to 100/full and when I 1st tried it vMotion took 2hrs to get to 10%, I changed it to auto-negotiate whilst the task was running and it completed without breaking the vMotion task ain a couple of seconds, dropped only 1 ping to the VM I moved.

Cool, it’s not production or doing a lot of workload but useful to know despite the warning it will work even if you’ve only got an old hub for your networking, and worth remembering that Duplex mis-matches can literally add hours and days onto network transfers.

h1

Free SAN for your Home/Work ESX Lab

May 25, 2008

 

VM/Etc have posted an excellent article about a free iSCSI SAN VM appliance that you can download from Xtravirt

it uses replication between 2 ESX hosts to allow you to configure DRS/HA etc.

Excellent, I’m going to procure another cheap ESX host in the next couple of weeks so will post back on my experiences with setting this up, my previous plan meant I’d have to get a 3rd box to run an iSCSI server like OpenFiler to enable this functionality, but I really like this approach.

Sidenote  - Xtravirt also have some other useful downloads like Viso templates and an ESX deployment appliance available here

h1

Running ESX 3.5 and 3i Under VMWare Workstation 6.5 Beta Build 91182

May 18, 2008

 

Following on from my earlier post I upgraded my installation to the new build of 6.5. it un-installed the old build and re-installed the latest without a problem, took about 30mins and required a reboot of the host OS.

All my previously suspended XP/2003 VM’s resumed ok without a restart but needed an upgrade to the VMTools which did require a restart of the guest OS - all completed with no problems.

Now, onto installing ESX….

I used the settings from Eric’s post here to edit my .vmx file

ethernet0.virtualDev = “e1000″

monitor.virtual_exec = “hardware”
monitor_control.restrict_backdoor = “true”

Note - you need to select an x64 Linux version from the VM type drop down, if you have to go back and change it via the GUI after you’ve edited the .vmx file it overwrites the Ethernet card “e1000″ setting to “vlance” so you need to edit again otherwise the ESX installer won’t find a compatible NIC and won’t install.

it was initially very slow to boot; 5mins on my dual core laptop with only one error - which was expected..

imageimage

To improve the performance I changed my installation to run the non-debug version of the Workstation binaries (rename the vmware-vmx.exe to vmware-vmx-debug.exe)

note: this isn’t recommended unless you know what you are doing, VMWare will rely on the output from the debug version of the code if you need to report any issues)

It also seems to work for the installable version of ESX 3i… (although I’ve not quite figured out the point of that version yet :)).

image

Install prompt

image

it did fail with an error the 1st time round..

image

this was because I had specified an IDE disk as per the ESX instructions, I changed it to a SCSI one and it worked ok.

image

Finished..

imageimage 

The ESX 3i install has a footprint of about 200Mb on disk, and ESX 3.5 uses 1.5Gb.

I’m going to keep the 3.5 install on my laptop and will try to use linked clones to maintain a couple of different versions/configs to save disk space.. I’m sure I could knock up a quick script to change the hostname/IP of each clone - if I do I’ll post it here.

Why would you want to do this? well because you can, of course :) and its handy for testing patch updates and scripts for ESX management etc.

I will  also try to get a ESX DRS cluster running under workstation with a couple of ESX hosts and shared storage over iSCSI using something like OpenFiler as shown here. won’t exactly be production performance, but useful for testing and demo’ing.