A Neural Representation of Sketch Drawings

نویسندگان

  • David Ha
  • Douglas Eck
چکیده

We present sketch-rnn, a recurrent neural network (RNN) able to construct stroke-based drawings of common objects. The model is trained on a dataset of human-drawn images representing many different classes. We outline a framework for conditional and unconditional sketch generation, and describe new robust training methods for generating coherent sketch drawings in a vector format. We demonstrate that our representation is useful for computer-aided artistic work such as conditional generation, generating multiple outcomes from a partial drawing, and morphing a drawing from one class to another.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Learning to Simplify:ully Convolutional Networks for Rough Sketch Cleanup

In this paper, we present a novel technique to simplify sketch drawings based on learning a series of convolution operators. In contrast to existing approaches that require vector images as input, we allow the more general and challenging input of rough raster sketches such as those obtained from scanning pencil sketches. We convert the rough sketch into a simplified version which is then amend...

متن کامل

What You Sketch Is What You Get: 3D Sketching using Multi-View Deep Volumetric Prediction

Sketch-based modeling strives to bring the ease and immediacy of drawing to the 3D world. However, while drawings are easy for humans to create, they are very challenging for computers to interpret due to their sparsity and ambiguity. We propose a data-driven approach that tackles this challenge by learning to reconstruct 3D shapes from one or more drawings. At the core of our approach is a dee...

متن کامل

Sketches, Drawings, Diagrams, Physical Models, Prototypes, and Gesture as Representational Forms

What is the role of physicality when interacting with different representations? Representational forms differ in type of representation (e.g. sketch, diagram, 3D model) and in the way they are materialized. These variations influence the properties of a representation and suggest or enable different usages, interaction styles and variations in meaning, even if they represent the same object, i...

متن کامل

Building and Comparing Qualitative Descriptions of Three-Dimensional Design Sketches

We describe a method for constructing qualitative structural descriptions of hand-drawn sketches of 3D objects. We use visual grouping and segmentation operations to extract edges and surfaces, and use line labeling with an extension of Malik’s (1987) junction catalog to identify threedimensional features in order to construct an orientationinvariant symbolic representation. These symbolic repr...

متن کامل

Sketch Learning by Analogy

Sketches are shapes that represent objects, scenes, or ideas by depicting relevant parts and their spatial arrangements. While humans are quite e cient in understanding and using sketch drawings, those are largely inaccessible to computers. We argue that this is due to a specific shape based representation by humans and hence the use of cognitively inspired representation and reasoning techniqu...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • CoRR

دوره abs/1704.03477  شماره 

صفحات  -

تاریخ انتشار 2017