Color Spatio-Temporal JND and Its Application to Video Coding

A method which reveals the visual masking in the human visual system (HVS) is useful in perceptual data coding. In this paper, we propose a color DCT-based method to estimate color spatio-temporal just noticeable distortion (JND) for video coding. The spatio-temporal JND profiles are assessed by incorporating a new temporal masking adjustment into the mathematical model of estimating the DCTbased spatial JND profiles for luminance component and chrominance components of color images. In this paper, the new block-based temporal masking adjustment mainly considering the variation of local temporal statistics in luminance component between successive video frames is proposed. The spatio-temporal JND profiles are used to preprocess the motion-compensated residue in video coding for higher performance. The simulation results demonstrate the performance of the perceptual video coding in terms of bit rates and visual quality. The bit rates required by the perceptually tuned video codec are lower than that required by the un-tuned video codec at nearly the same visual quality.