A unified approach to shot change detection and camera motion characterization

This paper describes an original approach which jointly addresses two fundamental issues of video partitioning which represent the early important stage of any content-based video indexing system. These two issues are the detection of shot changes, and the labeling of the shot connguration related to the camera movement in terms of static shot, panning, traveling, zooming,... They are both derived from the computation, at each time instant, of the dominant motion in the image represented by a 2D aane model, and from the variation of the size of its associated support. The successive steps of the method rely on statistical techniques ensuring robustness and eeciency. In particular, it can cope with scenes containing moving objects. Results on a real documentary video are reported and validate the proposed approach. Une approche uniiie pour la ddtection de changement de plan et la caracttrisation du mouvement de cammra RRsumm : Nous ddcrivons une approche traitant conjointement deux probllmes fondamentaux du partitionnement de viddo en plan, la ddtection des changements de plan et l' tiquetage d'une connguration de plan relii un mouvement de cammra en termes de plan xe, traveling, zoom... Il s'agit d' une premiire tape importante pour tout systtme d'indexation de viddo par le contenu. La mmthode proposse exploite, pour les deux aspects du probllme, l'estimation du mouvement dominant dans l'image, reprrsentt par un moddle aane 2D, et de l' volution temporelle du support associi. Les tapes successives de cette mmthode reposent sur des techniques statistiques, qui en assurent la robustesse et l'eecacitt. A uniied approach to shot change detection and camera motion characterization 3 1 Introduction and related work