Coherent Texture Synthesis for Photograph Relighting and Texture Replacement

In this thesis, we present a texture synthesis method for realistic rendering without acquiring the actual reflectance properties. The method is from the observation that most objects have texture repeatedly laid on different locations of their surface explicitly or implicitly. These samples form a pretty sparse set of BTFs. Our goal is to extract the underlying texture from photographs of the object, and to transfer the texture to other objects with different illumination. This method is very simple and provides pseudo-BTFs reflectance, using texture synthesis approaches. The input data is acquired directly from a few of photographs. These photographs contain appearances of the object with different lighting directions at a fixed viewpoint. We use Photometric Stereo to estimate the normal map and the unshaded image in preprocessing. Then, different texture points (texels) are recognized by their pixel values with neighborhood matching, using segmentation and labeling. Therefore, we can transfer the texture to another object and render it under different illumination conditions using these clustered texels.