Structure-Guided Image Restoration; A Deep Learning Approach (MCSC Almost Done seminar)

Speaker: Kamyar Nazeri (MCSC)

Abstract: Image restoration aims at recovery of degraded digital image and estimating the original image. Thanks to the rapid proliferation of image capturing devices, an increased interest has been shown in this area of research and its growing array of applications in surveillance, medical imaging, satellite imaging, astronomy, automotive industry, entertainment and mobile applications.
Over the past few years, computer vision research has been dominated by deep learning techniques in part due to advances in computing infrastructure, algorithms and image capturing devices. As a result, deep neural networks currently set the state-of-the-art in image restoration problems. However, many of these techniques fail to reconstruct reasonable structures as they are commonly over-smoothed and/or blurry.
In this work, we develop models based on deep convolutional neural networks to address two image restoration problems: image inpainting and image super-resolution. We develop a new approach for image inpainting that does a better job of reproducing missing regions exhibiting fine details. We propose a two-stage adversarial model that comprises of an edge generator followed by an image completion network. The edge generator hallucinates edges of the missing region of the image, and the image completion network fills in the missing regions using hallucinated edges as a priori. Finally, we extend this method to image super-resolution by reformulating the problem as an in-between pixels inpainting task. We evaluate our model over the publicly available datasets and show that it outperforms current state-of-the-art techniques quantitatively and qualitatively.