This paper presents a syntactic approach based on Adjacency Grammars (AG) for sketch diagram modeling and understanding. Diagrams are a combination of graphical symbols arranged according to a set of spatial rules defined by a visual language. AG describe visual shapes by productions defined in terms of terminal and non-terminal symbols (graphical primitives and subshapes), and a set functions ...

This paper discusses an approach to syntax that offers a new perspective on verbinitial languages that allow both VSO and VOS orders. A central assumption is that word order is not rigidly determined by structure. The predictions of this model are discussed in the context of St'át'imcets, Chamorro and Tongan. A comparison with several alternative analyses of VSO-VOS alternations shows that this...

The semantic formalism reference attribute grammars (RAGs) allows graphs to be superimposed on abstract syntax trees. This paper investigates how RAGs can be used to model visual languages, with a case study of a control language that also has a textual syntax. The language contains blocks on which a total execution order is defined based on connections and layout information. One strength of R...

Olfaction was poignantly dubbed the ‘mute sense’ by Diane Ackerman [ 1. D. A Natural History of Senses. Vintage Books, 1990 Google Scholar ], and it is regularly claimed that modern ancient languages lack resources to communicate about smells 2. Bradley M. Smell Ancient Routledge, 2015 ]. In a recent article 3. Majid A. Human olfaction at intersection language, culture, biology. Trends Cogn. Sc...

A test oracle predicts expected outcomes for a set of test cases, often based on a formal, executable specification. Visual contracts are graph transformation rules describing preand post-conditions of a service’s operations. To obtain an oracle based on visual contracts, we use the Attributed Graph Grammar System (AGG) to execute the rules, creating a simulation of the behaviour expected of th...

Using the school badge of Xi’an Jiaotong University as an example, this article aims to unravel that both literal expression and visual imagery have the ideographic function. The analysis in this article primarily utilizes the theoretical framework of the visual communication grammar, which is developed by Kress & Van Leeuwen from Halliday’s systemic functional linguistics. By analyzing the rep...

We investigate a new approach to comic generation that explores the process of generating the contents of a panel given the contents of all previous panels. Our approach is based on leading discourse theories for comics by McCloud (panel transitions) and Cohn (narrative grammar), unified by cognitive theories of inference in visual language. We apply these theories to comics whose panel paramet...

In this paper we propose a visual language based framework to effectively tackle the problem of software based structural analysis in different application domains. In particular, the framework includes grammar based parser generation modules to easily adapt structural analysis software packages to evolving standards of specific application domains. Moreover, it includes visual analytics paradi...

How do people make sense of the sequential images in visual narratives like comics? A growing literature of recent research has suggested that this comprehension involves the interaction of multiple systems: The creation of meaning across sequential images relies on a "narrative grammar" that packages conceptual information into categorical roles organized in hierarchic constituents. These imag...

The problem of phone recognition is transferred to the visual domain. Each phone is represented by unique graphical Character. The work is applied on a single speaker to eliminate the effect of multi speaker in this phase. The system was trained using handverified data from single speaker. Using 31 context-dependent phone models, a baseline phone accuracy of 63.5% (no phone grammar) has been ob...