Time Ordering Shu ing for Improving Background Subtraction

By construction, a video is a series of ordered frames, whose order is de ned at the time of the acquisition process. Background subtraction methods then take this input video and produce a series of segmentation maps expressed in terms of foreground objects and scene background. To our knowledge, this natural ordering of frames has never been questioned or challenged. In this paper, we propose to challenge, in a prospective view, the natural ordering of video frames in the context of background subtraction, and examine alternative time orderings. The idea consists in changing the order before background subtraction is applied, by means of shu ing strategies, and re-ordering the segmentation maps afterwards. For this purpose, we propose several shu ing strategies and show that, for some background subtraction methods, results are preserved or even improved. The practical advantage of time shu ing is that it can been applied to any existing background subtraction seamlessly.