A Neural Representation of Sketch Drawings
نویسندگان
چکیده
We present sketch-rnn, a recurrent neural network (RNN) able to construct stroke-based drawings of common objects. The model is trained on a dataset of human-drawn images representing many different classes. We outline a framework for conditional and unconditional sketch generation, and describe new robust training methods for generating coherent sketch drawings in a vector format. We demonstrate that our representation is useful for computer-aided artistic work such as conditional generation, generating multiple outcomes from a partial drawing, and morphing a drawing from one class to another.
منابع مشابه
Learning to Simplify:ully Convolutional Networks for Rough Sketch Cleanup
In this paper, we present a novel technique to simplify sketch drawings based on learning a series of convolution operators. In contrast to existing approaches that require vector images as input, we allow the more general and challenging input of rough raster sketches such as those obtained from scanning pencil sketches. We convert the rough sketch into a simplified version which is then amend...
متن کاملWhat You Sketch Is What You Get: 3D Sketching using Multi-View Deep Volumetric Prediction
Sketch-based modeling strives to bring the ease and immediacy of drawing to the 3D world. However, while drawings are easy for humans to create, they are very challenging for computers to interpret due to their sparsity and ambiguity. We propose a data-driven approach that tackles this challenge by learning to reconstruct 3D shapes from one or more drawings. At the core of our approach is a dee...
متن کاملSketches, Drawings, Diagrams, Physical Models, Prototypes, and Gesture as Representational Forms
What is the role of physicality when interacting with different representations? Representational forms differ in type of representation (e.g. sketch, diagram, 3D model) and in the way they are materialized. These variations influence the properties of a representation and suggest or enable different usages, interaction styles and variations in meaning, even if they represent the same object, i...
متن کاملBuilding and Comparing Qualitative Descriptions of Three-Dimensional Design Sketches
We describe a method for constructing qualitative structural descriptions of hand-drawn sketches of 3D objects. We use visual grouping and segmentation operations to extract edges and surfaces, and use line labeling with an extension of Malik’s (1987) junction catalog to identify threedimensional features in order to construct an orientationinvariant symbolic representation. These symbolic repr...
متن کاملSketch Learning by Analogy
Sketches are shapes that represent objects, scenes, or ideas by depicting relevant parts and their spatial arrangements. While humans are quite e cient in understanding and using sketch drawings, those are largely inaccessible to computers. We argue that this is due to a specific shape based representation by humans and hence the use of cognitively inspired representation and reasoning techniqu...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1704.03477 شماره
صفحات -
تاریخ انتشار 2017