L-CoDe:Language-Based Colorization Using Color-Object Decoupled Conditions
نویسندگان
چکیده
Colorizing a grayscale image is inherently an ill-posed problem with multi-modal uncertainty. Language-based colorization offers natural way of interaction to reduce such uncertainty via user-provided caption. However, the color-object coupling and mismatch issues make mapping from word color difficult. In this paper, we propose L-CoDe, Colorization network using Decoupled conditions. A predictor for object-color corresponding matrix (OCCM) novel attention transfer module (ATM) are introduced solve problem. To deal that results in incorrect correspondence, adopt soft-gated injection (SIM). We further present new dataset containing annotated pairs provide supervisory signals resolving Experimental show our approach outperforms state-of-the-art methods conditioned on captions.
منابع مشابه
Colorization-Based RGB-White Color Interpolation using Color Filter Array with Randomly Sampled Pattern
Recently, several RGB-White (RGBW) color filter arrays (CFAs) have been proposed, which have extra white (W) pixels in the filter array that are highly sensitive. Due to the high sensitivity, the W pixels have better SNR (Signal to Noise Ratio) characteristics than other color pixels in the filter array, especially, in low light conditions. However, most of the RGBW CFAs are designed so that th...
متن کاملExample Based Colorization Using Optimization
In this paper, we present an example-based colorization method to colorize a gray image. Besides the gray target image, the user only needs to provide a reference color image which is semantically similar to the gray image. We first segment both the target image and reference image and find correspondences at the segmentation level between these two images. The use of segmentation level can not...
متن کاملAutomated Colorization of Segmented Images Based on Color Harmony
We propose in this paper an automated colorization of segmented images based on a color harmony rule defined by Itten called the contrast of proportion. Artists create an image drawing a sketch and filling its regions following harmony rules. The most significant regions are generally filled first because of their meaning. Then the other regions are filled depending on the previous colors. Our ...
متن کاملAn Efficient Color Image Encoding Scheme Based on Colorization
Image colorization is a new image processing topic to recolor gray images to look as like the original color images as possible. Different methods have appeared in the literature to solve this problem, the way that leads to thinking about decolorization, eliminating the colors of color images to just small color keys, aid in the colorization process. Due to this idea, decolorization is consider...
متن کاملCeltic Knots Colorization based on Color Harmony Principles
This paper proposes two simple and powerful algorithms to automatically paint Celtic knots with aesthetic colors. The shape of the knot is generated from its dual graph as presented in [KC03]. The first technique uses rules derived from two-colors harmony studies in a Color Order System to select harmonious color pairs. We show that it can efficiently reproduce color combinations utilized in an...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2022
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v36i3.20170