We describe how knowledge of the physics of the scene itself is important to computer vision. High-level knowledge of scene physics can help programs see the world, and programs that see and understand this way are useful for planning plan scene interactions. We illustrate these points with two of our most recent knowledge-intensive vision systems. One uses knowledge of physics and function to ...
