Windows Vista One Year Vulnerability Report

Microsoft takes a look back at the security implications of Vista's first year on the market:

This paper analyzes the vulnerability disclosures and security updates for the first year of Windows Vista and looks at it in the context of its predecessor, Windows XP, along with other modern workstation operating systems Red Hat, Ubuntu and Apple products.

Summary

Windows Vista shipped to business customers on the last day of November 2006, so the end of November 2007 marks the one year anniversary for supported production use of the product. This paper analyzes the vulnerability disclosures and security updates for the first year of Windows Vista and looks at it in the context of its predecessor, Windows XP, along with other modern workstation operating systems Red Hat, Ubuntu and Apple products. The results of the analysis show that Windows Vista has an improved security vulnerability profile over its predecessor. Analysis of security updates also shows that Microsoft improvements to the security update process and development process have reduced the impact of security updates to Windows administrators significantly compared to its predecessor, Windows XP.

Note that this report is an update to the previously published Windows Vista 90-Day Vulnerability Report and Windows Vista 6-Month Vulnerability Report. However, since one year is a more informative time frame, this report contains the results of a deeper level of analysis.

Download the report in PDF format

So I'll break the suspense and note that, as expected, Windows Vista performed amazingly well compared to both its predecessor (XP) and the competition. You should read the entire report, of course. But I think this table says it all. (I added color for emphasis.)

Metric

Windows Vista (year 1)

Windows XP(year 1)

Red Hat RHEL4WS (year 1)

Ubuntu 6.06 LTS Reduced (year 1)

Mac OS X 10.4 (year 1)

Vulnerabilities Fixed

36

65

360

224

116

Security Updates

17

30

125

80

17

Patch Events

9

26

64

65

17

Weeks with at least One Patch Event

9

25

44

39

15

Discuss this Article 34

cesjr
on Apr 17, 2008
"But I think this table says it all." Not really. Many many people have explained why number of disclosed vulnerabilities is not some kind of magic indicator of how vulnerable a platform is. Paul presumably knows about these arguments - but as is often the case he just ignores the strong arguments that run counter to his beliefs.
ibarskiy
on Apr 17, 2008
cesjr, as always, you just ignore the most relevant statistic availble. It's been beaten to death, really, and all the people that keep finding problems with these metrics fail to produce a more relevant metric.
bkvalheim
on Apr 17, 2008
Seems like the Mac figure of 116 fixed should be in green. Vista nor XP has done a good job fixing the rest of their vulnerabilities. They have only fixed 36 and 65 respectively? What about the hundreds of others they haven't addressed?
cesjr
on Apr 17, 2008
"cesjr, as always, you just ignore the most relevant statistic availble. " The most relevant thing is that indisputably, Windows users have the most to worry about when it comes to security. Windows users have the most actual incursions. Windows users have to take steps to combat an actual, real live problem. Whereas most mac users DO NOTHING. And worry about NOTHING. Statistics that suggest that windows is less vulnerable than other platforms -- a conclusions that is so far removed from reality as to be laughable -- obviously have little value.
clindhartsen
on Apr 17, 2008
cesjr, It still assists in the respect that it may have shown Microsoft was able to reduce the number of security holes in their products before release, vs. XP which was, by many accounts, a massive security hell hole from the beginning. Does it prove that it's more secure? Not necessarily, but it could show that Microsoft has improved their programming and have avoided a number of mistakes they've made in past Windows editions. Still, the other side of the coin could be that Linux is an ever continuing project and they are always bound to find security exploits due to the developer base and the open format of the whole system to anyone who wants it.
pthurrott
on Apr 17, 2008
cesjr, if you actually read the report, you'll see that it's very upfront about what it is and what it isn't. Give them a bit of credit. Also...regarding the table, yeah, it does say it all. It's a summary of the report. Maybe Canalys can pipe in with some data that will prove otherwise. I'll hold my breath. :)
cesjr
on Apr 17, 2008
"cesjr, It still assists in the respect that it may have shown Microsoft was able to reduce the number of security holes in their products before release, vs. XP which was, by many accounts, a massive security hell hole from the beginning." it's pretty much PR data. MS holds it out as being proof that windows is more secure. I think it's OK for reputable, objective journalists to point to it, as long as you at least mention all of the qualifiers about it (eg. windows is less open than linux or the open-source software in OS X, so of course there's fewer reported vulernabilities, etc.).
Dipsh t Admin
on Apr 17, 2008
"What about the hundreds of others they haven't addressed?" Care to provide a source for those? Do you know this for a fact, or are you just guessing? If you compare Secunia's data, looking at just 2007 as an example, we can see the following: Vista for 2007 had 6% (or 1) of their 17 advisories marked in the unpatched category. http://secunia.com/product/13223/?task=statistics_2007 For the Mac in 2007, they had 19% (or 5) of their 26 advisories unpatched. http://secunia.com/product/96/?task=statistics_2007 So if we were to use this metric, which of course is only one metric, and a metric that is measurable, cesjr, it would appear that indeed Windows is less vulnerable. If anyone wishes to argue otherwise, I would suggest that they argue with actual measurable metrics.
Dipsh t Admin
on Apr 17, 2008
"so of course there's fewer reported vulnerabilities" I don't get the connection. In fact, I would argue the opposite. Since Windows has such a high install base, it would make sense that MORE vulnerabilities would be reported. That and the fact that many love to hate MS, giving them a personal incentive to find these, and of course, exploit them when possible (for profit of course). And certainly, if you look at the history of Windows, particularly XP, this certainly rings true.
BrightrevCarl
on Apr 17, 2008
@ ibarskiy In one simple sentence: The most relevant metric is the number of EXPLOITS, not the number of vulnerabilities. Two points: 1. Microsoft has done a very good job keeping exploits out of Windows Vista. I don't hear nearly as much about horrendous malware infections on Vista.* 2. Windows is still exploited much, much more than Mac OS X or Linux. At this point, they are safer platforms regardless of the number of vulnerabilities. This could change. * Some of this may be because all the people who do things that attract malware (click attachments, surf questionable sites, don't update their PCs, use Internet Explorer 6) have been scared off of using Vista. I'd REALLY like to see some numbers on botnets - what percentage are Vista vs. XP in proportion to all computers that are Vista and XP.
Snakedoctor1
on Apr 17, 2008
Where is the list of actual successful attacks? No one ever has this info. Vista is just so good that I just got this email from my Dell rep..... from: xxxxxx@Dell.com Date: April 17, 2008 1:01:44 PM CDT To: xxxxxxx Subject: DELL - UPDATE about Windows XP Pro going away on June 30, 2008 Dell Customer Number 3xxxxxxx Dear xxxxx, Due to the negative feedback that we received from our customers’ about Windows XP Pro (OEM version) going away after June 30th, 2008 we have decided to continue offering Windows XP Pro on our systems. In order to comply with Microsoft’s licensing rules we must sell you a Windows Vista Business license (after June 30th) but you will have to option to downgrade the system to Windows XP Pro (OEM version) at the time of purchase. Basically, the only change after June 30th is that we will have to sell you a Vista Business license (per Microsoft’s licensing rules). Otherwise, you will get to specify if you would like Vista Business or Windows XP Pro loaded from the factory. Installation CD’s for both Vista Business and Windows XP Pro will be provided for those customers who opt to downgrade to Windows XP Pro at the time of purchase. To view Microsoft’s licensing roadmap please click on the link below: http://www.microsoft.com/windows/lifecycle/default.mspx If you have any questions about this please call me at (512) 724-xxxx or email me at xxxxx@dell.com . Below are the current promotions that we are running for the month of April.
DRWAM
on Apr 17, 2008
Where's a comparison to Leopard, Mac OS 10.5? This is a Microsoft report with Mac OS 10.4. Although data gathering is quite different, which really invalidates most assumptions. the point that Windows is much more ubiquitous and more vulnerabilities would be found if existed, make some sense. Then again, I have never heard of a Mac being turned in to a spambot either. It's tough being bipartisan:)
Dipsh t Admin
on Apr 17, 2008
"Where's a comparison to Leopard, Mac OS 10.5?" Since this is in regards to first year vulnerabilities, then we need to wait for 10.5 to pass the one year mark of availability.
Spidubic
on Apr 17, 2008
"Whereas most mac users DO NOTHING. And worry about NOTHING." You know why? Because if I was a hacker why the heck would I bother with Mac when so many people use Windows? The user base is so much larger with Windows that you get noticed. The day the Mac OS is as prevailant as Windows is the day all macbois sit on the floor and cry as their beloved OS is hacked to oblivion.
Snakedoctor1
on Apr 17, 2008
@Spidubic, I agree Windows is more of a target for two reasons. Market share for one. Two, bad security practices for so long, like running as an Admin, and having NO password at all. I have seen so many XP home PC's that have user accounts and no passwords, which is the default install. Hacking is way, way, way more about getting your information to exploit it these days than its about hacker fame. Lots of exploits coming out of Russia and Asia to steal your SSN number, or other items that allow a hacker to get credit cards and such under your info. Windows is a FAT target. If your writing an exploit that is intended to earn you profit, you are going to target the fattest, most insecure OS. That would be Home users on XP. Vista is more secure out of the box, and so is OS X. Both are much smaller targets than XP. Why spend your resources on smaller, hard to exploit targets.
ibarskiy
on Apr 17, 2008
@BrightrevCarl: Sidenote: When people make an intelligent point like you makes everybody else want to respond. But still, I contend that your argument is not an accurate metric - because of the installed base brought up above. The reason there are fewer exploits on Macs is because fewer people bother. So the number of exploits does not measure the security of the platform. It is very tough to come up with a good "exploitabillity" metric, but it is certainly true that MS has been paying great attention to reducing the ways in which their code could be exploited.
DarkSages
on Apr 17, 2008
"What about the hundreds of others they haven't addressed?" All listed platforms have items that they have not addressed so we are not looking at that "The reason there are fewer exploits on Macs is because fewer people bother." Yep and you can tell this by looking that apples history. Now that they have a little more share they have more vulnerabilities (more hackers that target the platform). If you would put all the hackers that target windows and they now target mac i don't think that mac users can say they will be safe. Mac users feel safe and so they don't usually protect their computers with antivirus or run the updates as often as pc users do. Heck you have to install your updates manually. So i'll feel sorry for them if they ever become a target.
Waethorn
on Apr 17, 2008
@Snakedoctor1: The downgrade license option is nothing new. Dell is just reminding customers that the option is there and offering the option at time of order so that the customer gets the XP bits right away, rather than bug Microsoft after their purchase. Microsoft had this option available immediately upon release of Windows Vista (any maybe XP Pro -> 2000 Pro too, I dunno). It's for businesses though, hence the Vista Business -> XP Pro path only. Any OEM or OEM System Builder can provide that option to the customer. Also, it's available via one of the Volume License Agreement options, although I can't remember if it's the base licenses, or through Software Assurance, and I can't be bothered to look it up at the mo.
DRWAM
on Apr 17, 2008
We bought new computers with the XP downgrade license. When all the old software gets updated, we will switch them to Vista. Back on topic. there are millions of Macs, in one of the wealthy countries in the world, the USA. Getting a few hundred or few thousand to give up personal info would be a windfall of cash. If it were easier, and Macboi's don't protect themselves, what hacker wouldn't want to hack a Mac? Let's face it, it just doesn't happen.
Snakedoctor1
on Apr 17, 2008
Yeah I know the downgrade option was there for a while now from many vendors, Dell, HP, Lenovo...etc. What I did not know was that is as going to be available after June 30th. If you could see the actual email the first sentence.... "Due to the negative feedback that we received from our customers’ about Windows XP Pro (OEM version) going away after June 30th, 2008 we have decided to continue offering Windows XP Pro on our systems." Was bold and in yellow highlight, making it look like a change to the policy of not being able to get it all after June 30th. Companies with select or enterprise agreements dont buy media anyone, just CAL's and load it on PC's. Those I think can be moved to a new PC unlike CAL's that come with a PC. Those companies will continue to use XP for as long as they like, or 2014 when critical update support runs out.
subzerohitman721
on Apr 17, 2008
I think this report does speak for itself. Microsoft is making strides and this is not some PR offensive. Many independent studies are verifying that Vista is much more secure and that both OS-X and Linux OSes are lagging behind. Reports like these and improvements such as SP1 will turn sentiment towards Vista. This is a nice little victory for Microsoft. They can loudly and proudly tout they have at this moment in time, the most secure operating system on the market. The facts speak for themselves. Finally, the cloud of Vista Haters is being shattered by its own performance and improvements? So the question becomes, do you really want to run out there and download Linux distros? Do you really want to buy Mac's when they have issues with Zero Day and vunerability patching?
Snakedoctor1
on Apr 17, 2008
"Reports like these and improvements such as SP1 will turn sentiment towards Vista." Doubtful, very doubtful. I was in a airport not three weeks ago, in a southern state. It was a Friday, and I was going home after a week on business. Anyhow I am in this little airport bar, having a drink on my work notebook checking email and stuff, in this row against the wall, many business types doing the same. Its packed because many flights in this section are waiting. Two to three tables over are two people, co-workers from what I could determine, waiting for a flight heading out on some business trip. The one says to the other.."I just got a new Dell notebook a few months ago, and it came with Vista". "I could not stand it, so I paid one of the IT guys at work to put XP back on it". My point is Joe User from my experience cant stand Vista. The word, un-educated as it might be, has gotten out that Vista = BAD. Joe User does not know what a service pack is, nor cares. The recent surge in Mac sales has got to be partially from Vista hate as I like to call it. Sadly Vista from a security stand point, is much better than XP. MS needs to get a new OS out the door before they loose alot of home customers. Its getting easier and easier to go non Windows at home with so much moving to a Web browser. iLife and the iPod represent probably 60-70% of what a home user wants to do with a PC, especially with PC gaming fading into the wind.
JamesRayG
on Apr 17, 2008
But as you say, it's all uneducated nonsense, eventually even the dumbest bloggers will release what an improvement Vista is over XP and we will enter an 'era of Vista', with stable and secure computing for the masses. I've used Vista for about a year now, and it's given me 99.99% uptime, no malware though I am a prolific surfer with IE7, and very few program incompatibilities with none in like the last 8 months. Vista needs time to show it's true greatness, then people will love it like XP but better.
DRWAM
on Apr 17, 2008
I am posting on Vista now. I am getting pop-ups out the wazoo, and I had a difficult time installing Java, so I better learn how to use IE7 I don't think Vista is bad at all, and I an an average user. However, read this headline: Apple's growth rate in terms of Mac shipments in the first quarter outpaced that of the other top five U.S. PC makers, a research firm said Wednesday. http://www.informationweek.com/news/hardware/mac/showArticle.jhtml;jsess...
Waethorn
on Apr 17, 2008
"Those I think can be moved to a new PC unlike CAL's that come with a PC." don't confuse CAL's with licenses. CAL's are client access licenses for PC's to connect to a server domain. they are not licenses for the operating system that's installed on that client workstation. CAL's are completely different and separate. i believe you are correct though, but I don't deal much in enterprise agreements. I'm pretty sure that transferability in Open License requires SA though. Open Value includes SA, and so is transferability. Open Value is mostly just Open License + SA, but it costs a trivial amount more, and offers more benefits. Remember that for Open License and Open Value, those licenses are upgrade licenses only though, so you need to have a prior full license in order to qualify. Buying software with the computer via OEM licensing is the cheapest way to buy software, and you can add SA to an OEM license in order to add said transferability, so that's a good way to stay current, and have a good ROI. You would never need to buy a replacement license to upgrade your systems - just keep renewing SA over your technology lifecycles and move those aging OEM licenses to new machines as the need arises. Oh, and SA also includes those free upgrades....not to mention training, deployment tools, IT help, a direct support contract with Microsoft, and home-use licenses too.... "Those companies will continue to use XP for as long as they like, or 2014 when critical update support runs out." When free support ends, support costs skyrocket though, so it's often in a business's best interest to move to something that is supported for free - in this case, Windows Vista SP1. The support costs of OEM-provided software also goes up when the original vendor (Microsoft, in this case) also moves into extended support lifecycles.
Flenser
on Apr 18, 2008
Number of vulnerabilities isn't a good metric. How many days were there known vulnerabilities with no fix would be much more useful. It's just that it's not in Microsoft's interest to publicise that information because it would make them look bad, and it would be harder to control and spin, and it's not in security companies interests to publicise it because their sales pitch is usually focused on the number of vulnerabilities they can protect you from, which is an easy concept for customers to grasp and marketers to create a message around.
Flenser
on Apr 18, 2008
They even admit what I've said above in the report: "Note that individual metrics can even be mutually exclusive. For example, vendor policy could mandate a single security update per year which would definitely decrease the number of patches to deploy. However, that same policy would almost certainly mean that the exposure time for publicized issues would increase." I bet if they had charted exposure time instead they would have come off worse. The report asks "All other things being equal, is it easier to mediate risk on a system that has 10 vulnerabilities in a year or one that has 100 vulnerabilities in a year?" The thing is, all other things are NOT equal, and if exposure time is different then it is the more relevant metric.
DRWAM
on Apr 18, 2008
Stats can mean anything without standardized definable criteria and methodology. These do have some meaning as MS and Apple both report the ones that are patched. Note that there are those reportedly not patched as well. It's all that there is given, so you read em and weep. Discovery is a different story. If there is no standardized method and enviroment, then the result can be erroneous. Also, security can't just be measured by this one criteria, but all manners of 'insecurity must be considered. This would be counting how many burglers break into the front door, and ignore the backdoor and windows. ALso, a better metric would be to count the actual successful security breaches. Although this is also a factor of the number of hackers, total security must have it included. Thus, a dynamic tally will change over the years, as the number of hackers fo a given OS increases or decreases. Like a disease, we just don't look at one organ system as a failing different system could kill too.
Dipsh t Admin
on Apr 18, 2008
"Stats can mean anything without standardized definable criteria and methodology." You are absolutely right. In this case, the computer industry has no definable standards like you speak for nearly anything. A lot of this has to do with the ever quick changing nature of the industry that makes it difficult to define truly meaningful metrics. Once again, I echo Paul's statements that the report very clearly states that this is in fact only one metric, which just happens to be one that is able to be backed up by real stats, and not hearsay and anecdotal evidence.
DRWAM
on Apr 18, 2008
I will be using Vista only for a while, unprotected expect for the built in firewall. I will do my usual life of web surfing and email, then let you know how it works out for an average user. I have auto update on, but is SP1 an auto update, or do I need to update manually? The Sytem control panel does not show SP1, but I was not sure if it does.
lotsamystuff
on Apr 18, 2008
"I've used Vista for about a year now, and it's given me 99.99% uptime" That's an interesting comment. Are you really tracking that number, or did you just pull it out of your arse? I'm assuming that you're being hyberbolic, because a 99.99% uptime allows for only 30 seconds of downtime per year. What was happening during your 30 seconds? For more reading: http://www.joelonsoftware.com/items/2008/01/22.html
Flenser
on Apr 18, 2008
"because a 99.99% uptime allows for only 30 seconds of downtime per year" No, that's 52½ minutes. Six nines (99.9999%) is 30 seconds, it says so in Joel's essay.
subzerohitman721
on Apr 18, 2008
I remember when 2000 came out and we had the games compatability issue. It took awhile at least to SP1 to fix. I also remember when XP first came out and their were many incompatability issue, game issues, and networking issues. Again it really took up to SP2 to get XP where everyone liked it. I believe since this has been the cycle, the Vista Hate cycle has reached its peak and is slowly starting to slide down. We will reach the "era of Vista" as JamesRayG has stated so elloquently. Just because the idiots at PC Magazine have this anti-Vista campaign and the misconceptions on the street are that its bad, that doesn't always become its permanent label. I remember during the Blaster Worm crisis during the XP era, that people were calling for a new OS. People were saying, migrate over to Apple or Linux. In the end, when the paranoia ended and people started thinking for themselves, they stayed with XP and Microsoft. Don't be surprised when people migrate to Vista and its well praised for its security. Eventually the issues will be resolved and it will be a rock solid OS for the masses.
techboy2000
on Apr 19, 2008
Microsoft has a very good handle on security these days and procedurally is more advanced than any other OS supplier (MS's SDL process). Vista is very safe with: IE7 Windows defender included in vista Two-way firewall on by default UAC (yes this is a Great addition and not annoying.) Data Execution Prevention GS SafeSEH Function Pointer Obfuscation ASLR MS took too long to figure this stuff out but the problem has been addressed and the platform is good.

Please or Register to post comments.

IT/Dev Connections

Las Vegas
September 30th - October 4th

Paul ThurottYou'll have the opportunity to experience:
• 120 Technical
Sessions
• Networking with Peers
• Expert Speakers


Come See Paul Thurrott & Mary Jo Foley in Person!

Register Now

Office 365 InfoCenter

Get the latest insight and info from Paul

Read Now!

What I Use