IT Success and Failure — the Standish Group CHAOS Report Success Factors

The Standish Group have been famously (notoriously) publishing their CHAOS Report with IT project success/failure/challenged rates since 1994. “XXX% of all IT projects fail!” headlines are doubtless responsible for their fortuitous fame but they have also attempted to analyse ‘success factors’ over the years:

1994 1999 2001 2004 2010, 2012
1. User Involvement
2. Executive Management Support
3. Clear Statement Of Requirements
4. Proper Planning
5. Realistic Expectations
6. Smaller Project Milestones
7. Competent Staff
8. Ownership
9. Clear Vision And Objectives
10. Hard-Working, Focused Staff
1. User Involvement
2. Executive Management Support
3. Smaller Project Milestones
4. Competent Staff
5. Ownership
1. Executive Management Support
2. User Involvement
3. Competent Staff
4. Smaller Project Milestones
5. Clear Vision And Objectives
1. User Involvement
2. Executive Management Support
3. Smaller Project Milestones
4. Hard-Working, Focused Staff
5. Clear Vision And Objectives
1. Executive Support
2. User Involvement
3. Clear Business Objectives
4. Emotional Maturity
5. Optimizing Scope
6. Agile Process
7. Project Management Expertise
8. Skilled Resources
9. Execution
10. Tools & Infrastructure

Little changes at the top. Executive support & user involvement were noted in the 1970s as 2 main success/fail factors. ‘Agile Process’ is an evolution of ‘Smaller Project Milestones’ (the bit of agile that’s actually about process is “deliver working software frequently”, which is “smaller project milestones” in olde 1990s language). ‘Clear Vision and Objectives’ is re-branded as ‘Clear Business Objectives’

But note the varying evaluation of the importance of the people. At one level technical stuff will get done if and only if you have competent people actually doing it — it’s make or break. But so are all the factors above “Skilled resource” or “Competent staff”, albeit less obviously so.

Emotional Maturity is new. The cynic may note that the Standish group will sell you an Emotional Maturity Test Kit (the less cynical may say Standish are attempting to address a problem). Actually their analysis of emotional maturity is largely about character and behaviour which may be a sign that the English word ’emotion’ has grown in what it means compared to 20 years ago. They include arrogance and fraudulence; I can see arrogance as a symptom of emotional immaturity, but fraudulence may mean “I’ve considered what counts as getting ahead in our society and it seems to me that taking the company for everything I can get before they take me for everything they can get is the way to go”. Fraudulence is wrong, but ain’t always emotional. I think “personal maturity” — or just maturity — is the idea they’re grasping at. It’s about having good people.

Scarcity of essential success factors

But the top factors are not prioritisable. I think they are all essential. Rating one above the other says more about relative scarcity than relative importance. When it’s really hard to get competent, skilled, hard-working staff then that will be your top success factor. As it is, good executive support is harder to come by than competent staff. Apparently.

I’d summarise as follows:

  • Good people
    • who know what they are trying to achieve
    • with good involvement & communication with who they’re achieving it for
    • when well-supported

will succeed, if success is possible.


More serious researchers point out all that is wrong with the Chaos report, most notably:

  • unlike published academic research, the data we’d need to evaluate the claims is kept private so we can’t verify their data or methods.
  • Their definition of success is very narrow and doesn’t mean success. It means “cost, time and content were accurately estimated up front”. Which isn’t at all the same as success except in areas which are so well understood that there really is nothing at all you can learn as you are doing it. That’s not so common in technology projects.

For an alternative and probably more balanced view of the ‘state of IT projects’ I’d look at Scott Ambler’s annnual surveys: http://www.ambysoft.com/surveys/

Best Download Manager for OS X?

I’ve use two of the download managers currently on the market for OS X and they are both a lifesaver if you have a poor connection and want to download large files. Not only are they faster than a browser — they open multiple connections to the server which browser don’t* — but they resume incomplete downloads so they cope much much better with poor and failing connections.
They are … how can I put this … very similar. You could think they were different skins of the same product. iGetter shows the fact that it’s 10 years old (which is about how long it’s been saving my bacon), Folx looks more modern. They have different approaches to nagging non-purchasers: Folx distinguishes their free/pro versions, and requires a key-press to start a download. iGetter makes you wait for an increasing time when you launch the program.

They’re both downloadable for free trial or purchase.

iGetter from Presenta Software £18.27
Folx from Eltima Software £13.95
Folx family pack £27.95

* Because major browsers respect the internet standard which says client applications should not open more than 2 connections to a server.

Why do I have AWS free tier charges?

The short answer: you left a light turned on somewhere in the world. Turn them all off and you’re done.

The longer answer:

  • The AWS free tier covers you for one (1) machine running all month. If you leave one machine running all month, and then have a second machine running for a day, you will pay for that day.

How to incur AWS Free Tier Charges by Mistake

There are 2 easy ways to do this by mistake:

  • You are testing multi-server deployments. With 2 servers running, your free tier is just half the month. The second half of the month will cost you about $15+VAT. As soon as you turn on a second machine you risk overrunning your free tier quota. If like me you accidentally leave 3 or 4 machines switched on for most of a month, then your ‘free’ tier has suddenly cost you $50.
  • The second is that you have machines in more than one region. Your typical console view hides shows only one region so you can easily forget that you have machines switched on elsewhere in the world.

How do I stop it?

Turn off your machines with Right-Click — Terminate in the EC2 Management console.
If you’re repeatedly spinning up test machines, don’t forget to do this every-time you finish work.

BootCamp Drivers direct download—further help

If you’ve downloaded bootcamp drivers for Macs to run Windows 7 or 8, but still have problems, here’s my summary of the main issues and solutions I know of:

  1. The download file won’t open; or it doesn’t seem to work somehow; or doesn’t contain all the drivers you expect Do the download again using a download manager because sometimes the download appears to finish but hasn’t really. There are a couple of download managers I know of for OS X:
    Folx by Eltima, who have been doing Mac software for years
    iGetter has been working well for a decade
  2. You get an error message saying that the drivers can’t be installed on this computer model.In this case you may have one of 3 problems:
    1. You clicked the wrong download link. Check the instructions on finding your ModelIdentifier again carefully, and try again.
    2. Some Macs only get drivers for 32-bit versions of Windows and some only get drivers for 64-bit versions of Windows so if you install the wrong one, you’ll have to start again.
    3. Back to item one – your download didn’t work properly. Get a download manager and try it again
  3. If you no longer have OS X on your machine, or if you did the download in Windows anyway, then opening-a-bootcamp-driver-download-on-windows-7-or-8-with-7-zip is the page that explains how to open the pkg file and the dmg file in Windows
  4. And finally the really obscure one: All you get in your download is drivers for a Motoral modem. I’m not sure what’s going on here, so I’m grasping at straws but you could try this: in the download URL, replace the http://swcdn.apple.com/ by using nslookup to to see if you can change which server is ‘really’ serving your download, for instance:
    http://apple.vo.llnwd.net/
    http://swcdn.apple.com.akadns.net/
    http://95.140.227.134/