Today, lists are the prevalent representation format for search results on the Internet (e.g. Amazon or eBay). While lists are well suited for specific queries, they are of little help for nonspecific queries. Theoretically, visual search interfaces outperform list interfaces for task types such as nonspecific queries, because they make use of additional semantic information (like price, date o...

This paper presents the results of an experiment aimed at investigating how different methods of viewing visual programs affect users’ understanding. The first two methods used traditional flat and semantic zooming models of program representation; the third is a new representation that uses semantic zooming combined with blending and proximity. The results of several search tasks performed by ...

The research presented in this paper introduces an execution model for graphical user interfaces (GUIs) that we have developed and formalized as a sequence of actions and finite output states. This model has allowed us to investigate the possibility of applying code-based testing methodologies to testing graphical user interfaces. Our findings highlighted challenges and revealed opportunities t...

In this note we present UIMarks, a novel system that lets users specify on-screen targets and associated actions by means of graphical marks. UIMarks supplements traditional pointing by providing users with an alternative mode in which they can quickly create, select, configure, activate and delete marks. Actions associated to these marks can range from basic point-and-click interactions to the...

Direct Manipulation is an approach to designing user interfaces, which forms the basis of Graphical User Interfaces. Despite the importance of the concept, no mathematical model of Direct Manipulation has yet been developed. This paper proposes a model of Direct Manipulation, which relates cognitive distance with user familiarity and the novel concepts of “tech bias”, “velocity” and “inertia”.

A new Python-based graphical user interface for the PHENIX suite of crystallography software is described. This interface unifies the command-line programs and their graphical displays, simplifying the development of new interfaces and avoiding duplication of function. With careful design, graphical interfaces can be displayed automatically, instead of being manually constructed. The resulting ...

The Internet provides a rich source of interesting and entertaining video content. Yet, the ability to access this content on the device most appropriate for viewing it – the TV – is limited by the constraints of that device. This paper presents a novel, low-interaction and non-disruptive user interface for the exploratory browsing of Internet video on TV. The system employs contextually filter...

Currently, it is difficult for a designer to create user interfaces that are of high aesthetic quality for a continuously growing range of devices with varied screen sizes. Most existing approaches use abstractions that only support form based user interfaces. These user interfaces may be usable but are of low aesthetic quality. In this paper, we present a technique to design adaptive graphical...

Speech recognition is available on ordinary personal computers and is starting to appear in standard software applications. A known problem with speech interfaces is their integration into current graphical user interfaces. This paper reports on a prototype developed for studying integration of speech into graphical interfaces aimed towards programming of industrial robot arms. The aim of the p...

This paper proposes a declarative description of user interfaces that abstracts from low-level implementation details. In particular, the user interfaces specified in our framework are executable as graphical user interfaces for desktop applications as well as web user interfaces via standard web browsers. Thus, our approach combines the advantages of existing user interface technologies in a f...