Learned Focused Plenoptic Image Compression with Microimage Preprocessing and Global Attention
نویسندگان
چکیده
Focused plenoptic cameras can record spatial and angular information of the light field (LF) simultaneously with higher resolution relative to traditional cameras, which facilitate various applications in computer vision. However, existing image compression methods present ineffectiveness captured images due complex micro-textures generated by microlens relay imaging long-distance correlations among microimages. In this paper, a lossy end-to-end learning architecture is proposed compress focused efficiently. First, data preprocessing scheme designed according principle remove sub-aperture ineffective pixels recorded align microimages rectangular grid. Then, global attention module large receptive capture correlation feature maps using pixel-wise vector computed resampling process. Also, new dataset consisting 1910 content depth diversity built benefit training testing. Extensive experimental evaluations demonstrate effectiveness approach. It outperforms intra coding HEVC VVC an average 62.57% 51.67% bitrate reduction on 20 preprocessed images, respectively. it achieves 18.73% saving generates perceptually pleasant reconstructions compared state-of-the-art methods, benefits greatly. The code are publicly available at https://github.com/VincentChandelier/GACN .
منابع مشابه
Focused Plenoptic Camera and Rendering Focused Plenoptic Camera and Rendering
Plenoptic cameras, constructed with internal microlens arrays, capture both spatial and angular information, i.e., the full four-dimensional radiance, of a scene. The design of traditional plenoptic cameras assumes that each microlens image is completely defocused with respect to the image created by the main camera lens. As a result, only a single pixel in the final image is rendered from each...
متن کاملFocused plenoptic camera and rendering
bstract. Plenoptic cameras, constructed with internal microlens rrays, capture both spatial and angular information, i.e., the full 4-D adiance, of a scene. The design of traditional plenoptic cameras ssumes that each microlens image is completely defocused with espect to the image created by the main camera lens. As a result, nly a single pixel in the final image is rendered from each microlen...
متن کاملProgressiveness and preprocessing in image compression
The recent developments in the multimedia communication technology made it necessary to provide image compression standards with a number of functionalities such as the capability of progressive transmission of the code and more conformity with the human visual perception. The general purpose still image compression standard JPEG2000 for example, incorporates many such functionalities. This the...
متن کاملSuperresolution with the focused plenoptic camera
Digital images from a CCD or CMOS sensor with a color filter array must undergo a demosaicing process to combine the separate color samples into a single color image. This interpolation process can interfere with the subsequent superresolution process. Plenoptic superresolution, which relies on precise sub-pixel sampling across captured microimages, is particularly sensitive to such resampling ...
متن کاملImage Preprocessing for Compression: Attribute Filtering
This work proposes a preprocessing method for image compression based on attribute filtering. This method is completely shape preserving and computationally cheap. Three filters were investigated, including one derived from the power filter of Evans and Young that removes even more perceptually unimportant information. The results from 22 images that were processed in various ways and compresse...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Multimedia
سال: 2023
ISSN: ['1520-9210', '1941-0077']
DOI: https://doi.org/10.1109/tmm.2023.3272747