The recent progress on image recognition and language modeling is making automatic description of image content a reality. However, stylized, non-factual aspects of the written description are missing from the current systems. One such style is descriptions with emotions, which is commonplace in everyday communication, and influences decision-making and interpersonal relationships. We design a ...

In this study, we explore whether the captions in the wild can boost the performance of object detection in images. Captions that accompany images usually provide significant information about the visual content of the image, making them an important resource for image understanding. However, captions in the wild are likely to include numerous types of noises which can hurt visual estimation. I...

It has often been asserted, by both men and women, that men are funnier. We explored two possible explanations for such a view, first testing whether men, when instructed to be as funny as possible, write funnier cartoon captions than do women, and second examining whether there is a tendency to falsely remember funny things as having been produced by men. A total of 32 participants, half from ...

Videos are often accompanied by narration delivered either by an audio stream or by captions, yet little is known about saccadic patterns while viewing narrated video displays. Eye movements were recorded while viewing video clips with (a) audio narration, (b) captions, (c) no narration, or (d) concurrent captions and audio. A surprisingly large proportion of time (>40%) was spent reading capti...

Text in images and videos contains useful information that can help a machine to understand content. Text is very important for the automatic annotation, indexing, and parsing of images and videos [1]-[3]. For sports videos, text information is very important because it displays valuable game information, such as scores and players. Therefore, it is important to efficiently find the key texts c...

Table 1. Technology parameters for CAZM 0:5m CMOS drivers 18]. Table 2. Technology parameters based on (a) MCM10 technology 5] and (b) CAZM 0:5m CMOS model 18]. Table 3. Average signal delay (ns) for (a) 1-critical-sink net and (b) multi-critical-sinks net under the MCM10 technology. Table 4. Average signal delay (ns) for (a) 1-critical-sink net and (b) multi-critical-sinks net under the CAZM 0...

In experiments on a natural language information retrieval system that retrieves images based on textual captions, we show that syntactic complexity actually aids retrieval. We compare two types of captioned images, those characterized with full sentences in English, and those characterized by lists of words and phrases. The full-sentence captions show a 15% increase in retrieval accuracy over ...

We analyze illustration and abstraction techniques used in rendered images. We argue that it is important to convey these techniques to viewers of such images to enhance the process of image understanding. This leads us to derive methods for automatically generating figure captions for rendered images which describe the abstraction carried out. We apply this concept to computer generated anatom...

In this paper we explore several neural network architectures for the WMT 2017 multimodal translation sub-task on multilingual image caption generation. The goal of the task is to generate image captions in German, using a training corpus of images with captions in both English and German. We explore several models which attempt to generate captions for both languages, ignoring the English outp...