Pingdom Home

US + international: +1-212-796-6890

SE + international: +46-21-480-0920

Business hours 3 am-11:30 am EST (Mon-Fri).

Do you know if your website is up right now? We do! LEARN MORE

Comparing the efficiency of Chrome’s and Firefox’s automated updates (study)

Browser upgrades

Two web browsers currently use a rapid release schedule combined with automated updates. Chrome has had it from the start, and Firefox started using it this summer with the introduction of Firefox 5. Both Google and Mozilla release new versions every six weeks.

There are some differences between Chrome and Firefox as to how these automated updates work, but essentially the idea is that the browser should be updated to new versions automatically without bothering the user, and ensure that as many users as possible are running the very latest version. There are plenty of benefits to this approach.

However, we’ve noticed that this process seems less successful for Firefox than it is for Chrome. We pointed this out a while ago, noting that Firefox now leaves a good number of users behind with every new version.

That said, exactly how much more efficient is Google Chrome’s update process than the one Mozilla is using for Firefox? This is what we’re going to find out in this article.

First, some context

First, let’s give this all some context by showing you how the various Firefox and Chrome versions have trended this year. We’ll base it on their overall share of the browser market, using data from StatCounter. We’re including this since we can’t really assume that all of you will be intimately familiar with how the browser versions are spread out.

We start with how the various Firefox versions are doing (their share of the entire browser market).

Firefox market share per version

On the surface, it all looks good for Firefox. You can clearly see how the behavior changed after Firefox 4 was introduced this year, and the rapid releases that started with Firefox 5 in June. However, looks can deceive, as you will see later in this article. These are weekly stats, in case you were wondering.

The same time period for Chrome looks like this:

Chrome market share by version

These charts give us an idea of how efficiently users are being updated (or upgraded, whatever wording you prefer), as each new version comes along. In the case of Chrome, we can also clearly see how its market share is growing for each new version.

Although interesting, looking at Firefox and Chrome usage this way makes it difficult to directly compare the two. Remember, the point of this article is to examine how efficient the new Firefox release schedule and update process is compared to the pioneer in that field, Chrome.

Comparing update efficiency, Chrome vs. Firefox

We essentially want to find out how much of the user base each new browser version manages to reach. If that is dropping, it’s a sign that some users are not being upgraded.

To do this, we have to look at each browser separately from the rest of the market, unaffected by any market share fluctuations. That way we’ll get a much clearer picture of how successful these automated updates are.

For Chrome, we can include all versions since the automated updates have been present from the start. For Firefox, we’ll only include Firefox 5 and later. This so we can compare apples to apples.

First, let’s look at Chrome:

Chrome user reach by version

As you can see, Google’s update process is very effective. Each new version quickly replaces the version before it (thanks to the automatic updates). Even after 15 iterations since its launch, this process remains steady. Each new version reaches around 90% of Chrome’s total user base.

Where that remaining 10% is, it’s difficult to say. Some of those users will be on the beta and developer versions of upcoming Chrome versions. Some may also be business users who have chosen to control the update process. The important point here, however, is that there is no degradation from version to version. They reach the same kind of penetration. It’s as good as perfect.

Now let’s have a look at the same chart for Firefox:

Firefox user reach by version

The main thing to note here is that each new Firefox version fails to reach the height of the version before it. A number of users are clearly not being upgraded from version to version. Note the difference compared with the chart for Chrome.

Note once again that this chart only counts Firefox versions 5 and later. In reality, users manually upgrading from older Firefox versions (like 3.6) are currently keeping the user base penetration of the newer versions from dropping, but that’s hardly a testament to how well the update procedure works. Hence the reason why we isolated the Firefox sample to version 5 and later.

Counting only Firefox 5 and later we get the following peaks for each version:

  • Firefox 5: 100% (obviously, since it was first in this new rapid release cycle)
  • Firefox 6: 88.3%
  • Firefox 7: 83.6%
  • Firefox 8: We won’t know until version 9 is launched.

Clearly Google’s process is significantly more effective. Granted, Mozilla has perhaps not had time to perfect its process yet. On the other hand, Chrome has gone a full 15 iterations and still 90% of its users run the latest version (a little more if you also count the beta for the next version). Firefox has already dropped below this, just four versions into this new cycle. Perhaps it will stabilize, but the current trend is not promising.

Why are new Firefox versions leaving users behind?

Last time we wrote about this, several commenters mentioned that they had disabled updates in Firefox to keep their browser plugins from breaking. This actually seems to be a pretty major thing to a lot of people. With the rapid release schedule, many extension and plugin creators simply can’t keep up.

Regardless of why this is happening, there are some long-term implications that could prove rather problematic to Firefox, for example increased version fragmentation. We have to assume that the Firefox developer team at Mozilla is aware of this, and hopefully they’ll manage to turn this negative trend around.

To Google we can only say: well done. Chrome’s automated updates clearly work extremely well. We suspect this is has been a major factor to its success to far.

UPDATE: Asa Dotzler from Mozilla was kind enough to comment on this. Here’s what he had to say:

Yes, we’re still working on the update process. One major difference right now is that you can simply say no to Firefox updates. Google makes that much more difficult. But yes, we are a bit less efficient here. Give us a few more releases to iron out the remaining kinks and all will be much better.

 



13 Comments

Yes, we’re still working on the update process. One major difference right now is that you can simply say no to Firefox updates. Google makes that much more difficult. But yes, we are a bit less efficient here. Give us a few more releases to iron out the remaining kinks and all will be much better.

Unfortunately, Firefox is in the process of being marginalized. They are focusing on mobile development for future growth, which is smart, but I think they’ll find a lot fewer people willing to download a 3rd party browser on their phone, and doing distro deals with carriers isn’t in their DNA.

That Firefox chart is a classic sign of a dying product. Users are getting fed up with the constant updates and broken extensions, and switching to Chrome or back to IE, just to stop being annoyed with update popups every month. Their switch to a faster dev cycle was poorly thought out from a business perspective and poorly implemented.

At this rate, Firefox market share will be below 10% by the end of 2012.

Thank you for chiming in, Asa. Good to know you guys are working on this!

As a web developer, who is a go-to tech person for family and friends, I am always switching people to Chrome just because, I can be confident they won’t bother me again when the next update comes out.

Most average people refuse to understand what an alert box is asking them for and just turn to me. I when I visited family who weren’t using chrome I’m always surprised to see what an ancient version of Firefox they’re still using.

So silent auto-updates are Chrome’s killer feature compared to all other browsers.

Definitely the way new versions of Firefox instantly invalidate a whole bunch of extensions causes a lot of pain for me and other users I’ve spoken to. There is no other software that I revert upgrades on as frequently as I do with Firefox – for that reason.

Well Firefox is doing a few things to iron out their updating, especially with ways to have compatibility working from day one of their updates, which is a reason to have people stay. Also a big thing I’ve noticed that a reason why people are switching is that Google is paying to have Chrome preinstalled on computers and they are called “internet” not Chrome.

Part of the problem is that FireFox’s automatic updates are not at all automatic. Users must open the About Box before a version check will kick off (at least, that is the case on Mac OS X), and then click the Update button that appears if an update is available. I am sure many people will not be doing this on a regular basis.

I think by version 11 Firefox will have automatic updates.

Mobile is the way to go Firefox, Google and Apple are heading there fast and furiously, I wanna do the same.

There are too many things which chrome is doing right and firefox isn’t
- Hardly any plugins rendered incompatible after chrome update (FF requires developers to give a max-version for which this plugin is tested, and they have to retest on newer version and release their own plugin’s update which is certified on newer version. Too much hassle if not much is going to change)
- Silent update in chrome (FF has always been this proponent of open information and letting the user choose. Sad part is that most grandmas dont know what to choose and aren’t interested in making the choice)
- (hardest part) Chrome has partial binary updates – so you don’t download the full installer pack or even a complete exe. They fkin diff between the binaries and send you the diffs! Excellent work to ensure their updates cause minimum bandwidth hassles. (FF still gives the full 18 mb for download

Know that Linux-distributions have their own, very efficient update-mechanism. Auto-update is turned off on Linux for that reason.