Contextual Animation of Gestural Commands

Contextual Animation of Gestural Commands

Drawing a mark can be an efficient command input technique when using a pen-based computer. However, marks are not intrinsically self-explanatory as are other interactive techniques such as buttons and menus. We present design principles for interaction mechanisms which make marks self explanatory for novices but still allow experts to use efficient command marks. The key notion is that use of ...

Abstract Interpretation of Annotated Commands

Interpretation of Annotated Commands

The gestural origins of language.

The idea that language evolved from manual gestures rather than primate calls dates back at least to the 18th century, and was revived in modern form by the anthropologist, Gordon W. Hewes, in 1973. The main sources of current evidence are: (1) Signed languages invented by deaf communities share with speech the essential characteristics of language, including such properties as reference, gener...

Motion Planning and Commands

Inaudible Voice Commands

Voice assistants like Siri enable us to control IoT devices conveniently with voice commands, however, they also provide new attack opportunities for adversaries. Previous papers attack voice assistants with obfuscated voice commands by leveraging the gap between speech recognition system and human voice perception. The limitation is that these obfuscated commands are audible and thus conspicuo...