Video Extrapolation in Space and Time
نویسندگان
چکیده
Novel view synthesis (NVS) and video prediction (VP) are typically considered disjoint tasks in computer vision. However, they can both be seen as ways to observe the spatial-temporal world: NVS aims synthesize a scene from new point of view, while VP see time. These two provide complementary signals obtain representation, viewpoint changes spatial observations inform depth, temporal motion cameras individual objects. Inspired by these observations, we propose study problem Video Extrapolation Space Time (VEST). We model that leverages self-supervision cues tasks, existing methods only solve one them. Experiments show our method achieves performance better than or comparable several state-of-the-art on indoor outdoor real-world datasets. (Project page: https://cs.stanford.edu/~yzzhang/projects/vest/ .)
منابع مشابه
Increasing Space-Time Resolution in Video
We propose a method for constructing a video sequence of high space-time resolution by combining information from multiple lowresolution video sequences of the same dynamic scene. Super-resolution is performed simultaneously in time and in space. By “temporal super-resolution” we mean recovering rapid dynamic events that occur faster than regular frame-rate. Such dynamic events are not visible ...
متن کاملAuthoring and Navigating Video in Space and Time
Video-based hypermedia and hypertext have each evolved with unique conventions for representing information structure and aesthetic presentation. These conventions have been influenced by the technical constraints imposed by CD-ROMs and the WWW. A formal methodology is needed, along with alternative approaches, to integrate and exchange properties between the two forms of media. By adding tempo...
متن کاملInteractive Visualizations of Video Tours in Space and Time
Ana Jorge Sérgio Serra Teresa Chambel LaSIGE, Faculdade de Ciências LaSIGE, Faculdade de Ciências LaSIGE, Faculdade de Ciências Universidade de Lisboa Universidade de Lisboa Universidade de Lisboa Faculdade de Ciências e Tecnologia 1749-016 Lisboa, Portugal 1749-016 Lisboa, Portugal Universidade Nova de Lisboa [email protected] [email protected] 2829-516 Caparica, Portugal ananunesjorge@gmai...
متن کاملSpace-Time Regularization for Video Decompression
We consider the problem of reconstructing frames from a video which has been compressed using the video compressive sensing (VCS) method. In VCS data, each frame comes from first subsampling the original video data in space and then averaging the subsampled sequence in time. This results in a large linear system of equations whose inversion is ill-posed. We introduce a convex regularizer to inv...
متن کاملEntropy-based space-time segmentation in video sequences
This paper deals with motion-based segmentation of video sequences. Classical methods are based on the minimization of a penalty function of the prediction error (e.g. robust estimators). However, these estimators may not be efficient when the statistical distribution of the prediction error is not parametric. Instead, we propose to minimize the entropy of the prediction error while approximati...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Lecture Notes in Computer Science
سال: 2022
ISSN: ['1611-3349', '0302-9743']
DOI: https://doi.org/10.1007/978-3-031-19787-1_18