Deep learning techniques in video coding and quality analysis

Pankaj Topiwala; Madhu Krishnan; Wei Dai

doi:10.1117/12.2322025

17 September 2018 Deep learning techniques in video coding and quality analysis

Pankaj Topiwala, Madhu Krishnan, Wei Dai

Proceedings Volume 10752, Applications of Digital Image Processing XLI; 1075211 (2018) https://doi.org/10.1117/12.2322025
Event: SPIE Optical Engineering + Applications, 2018, San Diego, California, United States

Abstract

Video coding is a powerful enabling technology for networked multimedia transmission and communication, that has been in constant improvement for decades. The upcoming VVC video codec, due in 2020, from the ITU|ISO/IEC standards committees, aims to achieve on the order of 1000:1 compression on high resolution and high dynamic range video, a stunning landmark. But the basic structure of codecs has remained largely unchanged over time, the gains obtained mainly through complexity increases. Moreover, video encoders have for decades used the same mean squared error, or sum of absolute differences, measure to optimize coding decisions. At the same time, the rapid rise of deep learning (DL) techniques poses the question: can DL fundamentally reshape how video is coded. While that question is highly complex, we first see a path for DL methods to make inroads into how video quality is measured. This in turn can also change how it is coded. In particular, we study a recently introduced video quality metric called VMAF and find ways to improve it further, which can lead to more powerful encoder designs that employ these measures in the coding decisions.

Conference Presentation

Citation Download Citation

Pankaj Topiwala, Madhu Krishnan, and Wei Dai "Deep learning techniques in video coding and quality analysis", Proc. SPIE 10752, Applications of Digital Image Processing XLI, 1075211 (17 September 2018); https://doi.org/10.1117/12.2322025

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available