We propose neural trace photography, a novel framework to automatically learn high-quality scanning of non-planar, complex anisotropic appearance. Our key insight is that free-form appearance can be cast as geometry learning problem on unstructured point clouds, each which represents an image measurement and the corresponding acquisition condition. Based this connection, we carefully design net...