Current State of HEVC/H.265

The current industry preferred codec, H.264, took over six years to mature to full end-to-end support and polished transcoding efficiency. HEVC’s timeline, however, should be accelerated compared to that of H.264. The migration to HEVC from H.264 is more of a maturation of technologies into an advanced state whereas the adoption of H.264 was a major jump from existing technologies.

The reason there’s so much fervor over HEVC is because of the many improvements it promises over its predecessors. The most prominent is its encoding efficiency. HEVC is expected to provide the same quality at half the data rate, reducing the demands on Wi-Fi and cellular networks, or twice the resolution at the same data rate, allowing HD content where it wasn’t feasible prior. Some are skeptical that this will aid in relieving network requirements arguing that HEVC will actually worsen the situation. Why? Because the lessened requirement on connection speeds is going to create and facilitate drastically greater demand. Video is already the majority of Internet traffic and is poised to become the dominant data type in the near future as demand continues to grow.

Another boon, albeit one that is much less talked about, is that image degradation is done in a manner that is much more pleasing to the human eye. As bits are lost the image takes on a smoother, almost softened, look that is less blocky than the compression artifacting of H.264.

Licensing terms for HEVC was initially a major concern for many companies until the terms were made public. H.264’s licensing incurred royalty charges whenever H.264 content was sold as pay-per-view and could have similarly, or to a greater extent, impacted HEVC. However, HEVC has no content-related royalties alleviating many costs that are currently burdened by content creators under H.264 licensing. Yet the terms are more expensive for encoder/decoder manufacturers. Where H.264 had a maximum $6.5 million in possible charges, HEVC’s cap is set at a staggering $25 million. That being said only very large companies that play in this field will be impacted; companies like Adobe, Apple, Google, Microsoft, and Mozilla. Even though this cap will only be felt by such massive companies it may greatly hinder or even prevent widespread adoption. Adobe recently announced its decision to not implement HEVC support in Flash. This may sound like an odd move, but with the global saturation of the Flash player Adobe would be facing a $25 million expenditure the quarter it implements HEVC when their quarterly net income is only around $50 million. That’s a hard pill to swallow for investors especially when Adobe and these other companies will be shouldering the cost so that content providers can distribute their content with no fees and no return for Adobe.

As with any technology in its early stages there are a few reasons to not rush in to migrating to HEVC. Currently encoding to HEVC requires drastically more power than H.264. For the individual this increase is negligible, but for massive companies such as Netflix this can be a substantial cost increase. In addition, the efficiency of current encoders is upwards of ten times that of H.264. Not only does this increase your time to deliverable file, but it also makes real-time encoders currently impossible. Early adopters are also reporting that encoding resolutions at or below 720p aren’t yielding appreciable file size savings. Even with similar file sizes they are seeing an increase in perceived quality of the video. As the technology matures the efficiency and power needs will improve addressing and alleviating these problems with real-time encoders likely just a few years away.

Several other reasons loom over HEVC, but these will also be alleviated with time. Encryption and digital rights management (DRM) for protecting the delivery of content is still emerging. Something that many content owners will require before they award approval for distribution of their content. UHDTVs, a major venue for HEVC content, are still nascent in ownership. Lastly the cost of replacing copious hardware and software systems for transcoding into HEVC looms over current companies.

With all of the benefits awaiting us with HEVC there is prudence in not rushing to quickly into adoption. As time passes and the technology matures we’ll see some truly great video in places we haven’t yet been able to.

You might want to wait to buy that UHDTV

What’s the problem? Your shiny new TV may be obsolete one way or another within a couple of years.
UHD supports a wider range of colors than HD does, but the parts required to support this new standard weren’t available for the production of first generation UHDTVs.

Images from Sakurambo and GrandDrake as found in an article from HD Guru

Image from HD Guru article by Sakurambo and GrandDrake

The color space used by the HDTV standard is referred to as Recommendation 709 and in addition to supported colors the recommendation also defines frame rates, pixel count, and that it’s 16:9 wide screen. The new UHD color space is Recommendation 2020. The increased color range means less banding and a higher quality color recreation. Although most displays today can’t support the new color space content creators and providers are already preparing for fully standards-capable UHDTVs.

In addition to the new UHD color space, HEVC/H.265 has multiple profiles. Every UHDTV will support the rudimentary Main profile, but content creators are encoding their material using the Main 10 profile, which uses 10-bits over Main’s 8-bits per sample, because this profile produces better quality. The problem with this lies in the fact that most UHDTVs don’t list the profiles that are supported and like early HDTVs support for the full range of specifications is hit or miss. Usually miss.

Netflix recently announced that they’re beginning the transition to HEVC Main 10 for their 4K content and many other large distributors will be quick to follow.  Hollywood as well is eager for the move to Rec. 2020 and HEVC Main 10 and are already processing their films as such. The push to move to UHD is palpable, but not everyone is ready.

So, if you choose to pick up a UHDTV soon, make sure it specifically has Main 10 profile support or if you don’t mind adding an external decoder in the future HDMI 2.0 support…unless you find a price you just can’t say no to.

Beyond H.264

Today the most commonly consumed media format is MP4 files using the H.264 (Advanced Video Coding) compression scheme for video and AAC (Advanced Audio Coding) for audio. These provide the best, easily consumable, compression ratios and as such became the format of choice for mobile device designers and manufacturers. While H.264 does a very efficient job of compressing video, making larger sizes and higher quality possible at lower bit rates than previous formats, there’s always room for improvement. That’s where H.265, or HEVC (High Efficiency Video Coding), comes in.

HEVC is the new standard designed to supplant the currently reigning H.264. HEVC is roughly twice as efficient, allowing for the same size and quality at half the bit rate or double the size at the same bit rate. With over half of the Internet’s traffic being used for streaming video, this has a lot to offer.  Online video consumption is poised to overtake traditional cable subscriptions as tech-savvy individuals cut the cord and turn to the Internet for their TV and newer generations don’t even have a cord to cut driving Internet video consumption even higher. With 4K, or Ultra HDTV, on the horizon the better efficiency will be even more important. 4K is the new high definition standard that is twice the resolution of current HD content.Internet consumptionDigital video resolutions

All this being said, don’t expect to see HEVC in the next few years. The road to adoption is a long one. The standard was just formally published by the ITU-T Video Coding Experts Group and ISO/IEC Moving Picture Experts Group (MPEG) at the end of last year. Many companies already jumped on incorporating HEVC into new and existing products well before this, but before the average consumer will start enjoying the benefits of HEVC there are still countless encoders, servers, device manufacturers, software developers, operating system creators and others that need to commit resources to incorporating support into their products. Once HEVC has reached our hands the benefits should be many.  In addition to the commonly touted perks, such as reduced data usage for cell phone plans and prettier Netflix streams, HEVC will also make it possible for those  in remote locations on slow connections, like dial-up and ISDN, to consume media.