Video, fragmentation, and Firefox

Yesterday two prominent people at Mozilla announced that Mozilla plans to support H.264 to some extent in future versions of Firefox:

While I understand their reasoning, I hope there is a chance to change that position. In my view, continuing on that path will ultimately hurt the open web, both in the short- and long-term.

Fragmentation

It’s important to understand how supporting H.264 in any way will necessarily fragment the Firefox userbase into “the haves and the have nots”, those Firefox users who can watch H.264 in <video> and those Firefox users who cannot. In many cases, Firefox would be able to rely on the operating system and/or hardware having a patent license for H.264 and an API that allows Firefox to play H.264. But in many other cases, there will be no option for playing H.264 in <video> without forcing Firefox users to run particular software or agree to particular license terms that they would not otherwise need to.

The “haves” would be those running Windows 7, OS X, or Google-approved, unmodified Android (and similar) mobile devices. These all ship with an H.264 patent license and APIs for playing H.264 videos using that license. Firefox could utilize the existing patent license and APIs to play H.264 without any additional trouble on the user’s part.

The “have nots” would be those running Windows XP, virtually any primarily free software desktop OS (such as Ubuntu, Fedora, and Debian, which all ship without H.264 support), and most mobile devices running a custom OS (such as CyanogenMod, Replicant, or SHR). According to Brendan, “dropping H.264 from <video> only on desktop and not on mobile doesn’t matter, because of Flash fallback”. But this doesn’t achieve the open web goal because people will become dependent on Flash (we should instead let it die) and because it doesn’t work on all mobile devices, as Flash is not supported on custom OSes that people may choose to run (and should be free to run if they don’t like the software that came with their phone). Furthermore, web developers would be encouraged to keep using Flash fallback code for even longer than they would otherwise.

This would cause the Firefox community to be split into two factions: those who can play H.264 <video> and those who can’t. We should be very careful to avoid this situation.

Branding

One of the primary strengths (and, I believe, goals) of Firefox is that it works in a similar manner and with similar features and available add-ons across all supported platforms. When people use a program called “Firefox”, they know it will let them browse the web and use add-ons they know, all with a familiar style. The Firefox brand tells users what they can do with a program called “Firefox”.

Because of the fragmentation outlined above, supporting H.264 for some users necessarily means that others will not be able to play H.264 (especially since Mozilla “will not require anyone to pay for Firefox”, according to Brendan). This seriously dilutes the Firefox brand, as people will no longer be able to move from one Firefox to another with an expectation that a site working in one will work in the other. Instead, “Firefox” will come to mean a browser that might play H.264, but it might not and you can’t really be sure unless you know a lot of technical details about the system you’re on (the whole point of a brand is that you don’t need to know these details).

Compromise

Supporting H.264 in Firefox would be a compromise unlike any Mozilla has made before. For the first time, Mozilla would be telling its users (in effect) “if you want a Firefox that works like all the other Firefoxes, you need to run Windows 7 or Mac OS or one of these select mobile OSes”. Anyone who wants something else will have to compromise in their own way, by accepting a user agreement that is against their morals or running software that they are not free to examine (unlike Firefox, which can be examined and modified as they see fit).

This unprecedented compromise will make it harder for Mozilla to reject future detrimental compromises, which is a big loss for the open web. No other non-profit organization has even a small percentage of the influence that Mozilla has on the direction of the web. To lose this positive influence through more and more compromises would be devastating.

To respond to Brendan’s statement, yes, “patents expire”. But what doesn’t expire is the ongoing effort to patent more ideas and then force them upon the unsuspecting public. Compromising on H.264 now makes it difficult to say no to HEVC and other patented technologies later on.

Promises

In his post, Brendan outlined several promises made by big companies that have not been kept, and as a result, have slowed the adoption of WebM, the (still not disproved) royalty-free alternative to H.264. In particular, three promises have not been kept: Google has not converted all YouTube videos to WebM, Google has not discontinued H.264 <video> support in Chrome, and Adobe is still not supporting WebM in Flash Player.

While it is disappointing that these companies have not get their promises, it is crucial that these failures to follow through do not discourage others from continuing along a positive path. By choosing to support H.264, Mozilla would significantly reduce Google’s and Adobe’s incentives to continue with these projects, whose completion would ultimately benefit the open web. If Mozilla instead held firm with WebM and Theora, the open web (at least as far as codecs are concerned) would arrive more quickly.

In essence, by keeping its own promise to users that they will promote the open web, Mozilla would pressure these companies to keep their promises, too.

Next steps

The hurdles that face WebM are not insurmountable. ARM chips that currently ship in Android phones can easily decode 1080p WebM in real-time (direct link). Though many chips can assist WebM decoding already, hardware decoders are ready to go. Nearly a year ago, 99% of YouTube views were available in WebM. And now more browsers support WebM than ever before, especially with Chrome Frame and Perian (see closed WebM-on-Safari ticket).

There is a lot more work to be done to make WebM the standard, but it is achievable. I hope that Mozilla will choose to support only free codecs, so that the open web will arrive sooner rather than later (or never).

Epilogue

If it were Apple or Google or Microsoft deciding whether or not to support H.264, I wouldn’t bother writing this. Those companies are already set in their ways and are not as committed to the open web as Mozilla.

It’s exactly because Mozilla has been fighting the good fight for so long that I think there’s a chance that people at Mozilla would change their mind about H.264 and that I wish to encourage them to keep it up. I believe that this minor corrective action will ultimately accelerate all the good that Mozilla has done already. To everyone fighting for the open web, including Mozilla: keep up the good work!

4 Responses to “Video, fragmentation, and Firefox”


  • I’m in agreement with all of this, but I am, admittedly, a self-proclaimed “freetard”.

    I’ve at least come to understand more why they’re doing this after a bit of back-and-forth haranguing with them about it.

    From what I can tell, their contention here is that the Desktop is Dead&trade, and Mozilla’s only hope for survival is to get in on Mobile, and do it before there’s no room for them. I think they underestimate how long it’ll take for Desktop to die (or rather, be subsumed into “mobile”, I’m guessing via devices like the Asus Transformer and other “dockable” devices), but I actually tend to agree with them about the narrow window they’ve got to build “Boot to Gecko” into a sufficiently-available platform to make a difference. I think in the long run they’re probably right.

    Their contention is that if they don’t do as Apple (and Microsoft, to a slightly lesser extent) dictate, “Boot to Gecko” won’t be Shiny like Apple™ because it won’t be as good for Internet TV.

    This is stupid and disgusts me – however, I can’t decide if it’s stupid because it’s silly and wrong, or if it’s stupid because the internet really HAS become, most importantly for most “consumers”, a TV station (and therefore Mozilla is probably correct).

    I still haven’t been able to dredge up any answers regarding <audio> and whether or not Mozilla’s decision applies there too, and if so, if it also includes mp3.

    I’d feel a lot better about this “pragmatic” decision if there was some indication that they were also planning to actively promote legally-free media to try to wean us all back off of their stopgap measure to get onto mobile. There was a hint that they want to someday maybe help get hardware decoding of vp8/vorbis more widespread and optimized, and they ARE (so far) helping with development of the Opus audio codec in some capacity or other. What I’ve not found any sign of, though, is addressing what I think the REAL problem is right now, which is the relative scarcity of legally free media to listen to and watch (and secondarily, the obsessive focus on “Internet TV” to the exclusion of audio material, which is substantially simpler to produce, especially for a potential participant who isn’t technically inclined and doesn’t have the extra time for video production).

    The problem of being able to PLAY legally-free media on the web is actually largely solved. Outside of iOS (whose proportion of web traffic is grossly overrated based on surveys of browsers actually in use), virtually EVERY HTML5-capable web-browser in use right now either supports legally-free media built-in, or is capable of doing so once a “media component” is installed on the operating system. This isn’t really the problem anymore, it’s just having enough legally-free material available to “consume” to encourage adoption.

    Everyone so busy on enabling passive “consumers” when it’s “participants” that we need…

  • Great post, I agree completely.

    I guess Mozilla supporting H.265 or whatever next comes out of MPEG-LA is now a done deal.

    So much for fighting for the open web.

  • I’m seeing this play out in a couple organizations, it’s simple— and frightening:

    100% of the people who are important to making decisions related to technology direction are full on Apple product users. Iphone, Ipad4, MacBook.

    Apple only has a fraction of the mobile device market, and a tiny sliver of desktop– hardly larger than Free Software— but in the minds of the people setting product direction at Mozilla and many other organizations they are the Alpha and Omega.

    So Apple will have successfully crushed open codecs as they will later crush the rest of Free Software– simply by sitting back and refusing to adopt it while relentlessly targeting the technophiles that make the technology decisions for everyone else. It is a sad time for freedom.

  • i like free codecs and OS software, but do YOU really believe firefox will survive? they are already losing market share rapidly, if they stick to their only what we want should be used on web, they are dead, i don’t know if you were around when websites used “your browser is not supported, please change to XXX”, i didn’t like it, and it will happen to firefox if they stick to their stance, and i find it ironic that you dont think its a problem to support flash thru a Plugin but somehow it blasphemy to use plugin to support H264, and why should i who live in a country where there is no stupid patent rules like the US patent office have to suffer? i already paid for my H264 when i bought my OS, and ALL worthy(note: Visa/7/8 OSX android / soon to be Win8 mobile)OSs have built in hardware/software support?

    do you guys truly care about firefox? do you think losing market share will give Mozilla the leverage to try to make open web reality? if you think so go fork your open browser and show us how to do it

Leave a Reply to Random person