Light-weight pixel context encoders for image inpainting
نویسندگان
چکیده
In this work we propose Pixel Content Encoders (PCE), a lightweight image inpainting model, capable of generating novel content for large missing regions in images. Unlike previously presented convolutional neural network based models, our PCE model has an order of magnitude fewer trainable parameters. Moreover, by incorporating dilated convolutions we are able to preserve fine grained spatial information, achieving state-of-the-art performance on benchmark datasets of natural images and paintings. Besides image inpainting, we show that without changing the architecture, PCE can be used for image extrapolation, generating novel content beyond existing image boundaries.
منابع مشابه
Beam Search for Top - B Decoding in Bi - RNNs Deep Learning Summer School , Montreal , CA
Wepresent an unsupervised visual featurelearning algorithm driven by context-based pixel prediction. By analogy with auto-encoders, we propose Context Encoders– a convolutional neural network trained to generate the contents of an arbitrary image region conditioned on its surroundings. In order to succeed at this task, context encoders need to both understand the content of the entire image, as...
متن کاملStructural inpainting
Scene-agnostic visual inpainting remains very challenging despite progress in patch-based methods. Recently, Pathak et al. [25] have introduced convolutional “context encoders” (CEs) for unsupervised feature learning through image completion tasks. With the additional help of adversarial training, CEs turned out to be a promising tool to complete complex structures in real inpainting problems. ...
متن کاملImproving Exemplar-based Image Completion methods using Selecting the Optimal Patch
Image completion is one of the subjects in image and video processing which deals with restoration of and filling in damaged regions of images using correct regions. Exemplar-based image completion methods give more pleasant results than pixel-based approaches. In this paper, a new algorithm is proposed to find the most suitable patch in order to fill in the damaged parts. This patch selection ...
متن کاملA Survey on Image Inpainting for Remotely Sensed Images
Image inpainting is the process of reconstructing an image or to fill the missed region by using the surrounding pixels so that it looks reasonable to human eye. Sometimes, while capturing the image dead pixels will exists in the image which results in degraded image. In this paper, various algorithms are discussed by using which we can get a smoothed and undegraded image. Keywords—Inpainting, ...
متن کاملImage Inpainting using Block-wise Procedural Training with Annealed Adversarial Counterpar
Recent advances in deep generative models have shown promising potential in image inpanting, which refers to the task of predicting missing pixel values of an incomplete image using the known context. However, existing methods can be slow or generate unsatisfying results with easily detectable flaws. In addition, there is often perceivable discontinuity near the holes and require further post-p...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1801.05585 شماره
صفحات -
تاریخ انتشار 2018