Evaluation of deep neural networks for single image super-resolution in a maritime context

Robert P. J. Nieuwenhuizen; Maarten Kruithof; Klamer Schutte

doi:10.1117/12.2277842

6 October 2017 Evaluation of deep neural networks for single image super-resolution in a maritime context

Robert P. J. Nieuwenhuizen, Maarten Kruithof, Klamer Schutte

Proceedings Volume 10433, Electro-Optical and Infrared Systems: Technology and Applications XIV; 104330T (2017) https://doi.org/10.1117/12.2277842
Event: SPIE Security + Defence, 2017, Warsaw, Poland

Abstract

High resolution imagery is of crucial importance for the performance on visual recognition tasks. Super-resolution (SR) reconstruction algorithms aim to enhance the image resolution beyond the capability of the image sensor being used. Traditional SR algorithms approach this inverse problem using physical models for the image formation combined with a regularization function to prevent instabilities in the solution. Recently deep neural networks have been put forward as an alternative approach to the SR reconstruction problem. They learn a mapping from low resolution images to their high resolution counterparts from pairs of training images, which allows them to capture more specific information about the space of possible solutions than traditional regularization functions. These networks have achieved state-of-the-art performance on single image SR for sets of generic test images. Here we investigate whether the same performance can be realized when these neural networks for single image SR are applied specifically in the maritime domain. In particular we investigate their ability to reconstruct undersampled images of ships at sea, and demonstrate that the performance is similar to what is achieved on generic test images. In addition we quantify the gain in performance that is achieved when the networks are trained specifically on images of ships, which allows the networks to capture more prior knowledge about the space of possible solutions. Finally we show that the performance deteriorates when the resolution of test images is limited by image blur, for example due to diffraction, rather than undersampling. This highlights the importance of using representative training data that account for the part of the image formation process that limits the resolution in the sensor data.

Conference Presentation

Citation Download Citation

Robert P. J. Nieuwenhuizen, Maarten Kruithof, and Klamer Schutte "Evaluation of deep neural networks for single image super-resolution in a maritime context", Proc. SPIE 10433, Electro-Optical and Infrared Systems: Technology and Applications XIV, 104330T (6 October 2017); https://doi.org/10.1117/12.2277842

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available