People typically learn through exposure to visual stimuli associated with linguistic descriptions. For instance, teaching visual concepts to children is often accompanied by descriptions in text or speech. This motivates the question of how this learning process could be computationally modeled. In this dissertation we explored three settings, where we showed that combining language and vision ...

We present an experiment supporting the thesis that visual languages are well suited for programmers whose native language is not English. We first analyze the particular problems of our target group, Arabic speakers, in comprehending Pascal program structures, and we present a number of previously proposed solutions to this problem. We then present our own solution, a visual programming enviro...

We present a model for adaptive visual language communication based on eye gaze pattern and facial expression analysis. In our approach each basic visual sign can adapt its appearance and level of detail during the communication process. Atomic Communication Units (ACUs) – analogous to graphical output primitives encapsulate the intended denotation, the encoding of the message and a method for ...

Visual languages are important in software engineering. However , the speciication and implementation of visual languages in software tools is still an immature area. In this paper, we present Vilpert which is an object-oriented framework for implementing visual languages in Java. Implementing a visual language with Vilpert means deriving a language analyzer based on a formal syntactic speciica...

This paper discusses a declarative constraint-based picture deenition language, Vodl, which serves as a graphical basis for visual language speciication and visual programming environments. Our goal is to examine the utility of a formal description of graphical tokens and visual languages for the purpose of increasing the understanding of and the development of general methods for graphical lan...

This paper presents a relatively simple visual notation for meta-programming that spans multiple levels of abstraction. Two-dimensional data flow provides readable representations of meta-programs that expose potential parallelism. This work suggests visual notations for data structures, data flows, pattern matching, conditionals, iteration and synchronization. The framework provides encapsulat...