This paper reports results of a study investigating the visual information conveyed by the dynamics of internal articulators. Intelligibility of synthetic audiovisual speech with and without visualization of the internal articulator movements was compared. Additionally speech recognition scores were contrasted before and after a short learning lesson in which articulator trajectories were expla...

This document describes the working environment developed by ESCoM laboratory (Equipe Sémiotique Cognitive et Nouveaux Médias, Fondation Maison des Sciences de l’Homme) during the ASA-SHS project (Audiovisual Semiotic Workshop for Human and Social Sciences). ASA-SHS is a R&D project financed by the French National Research Agency (ANR, Programme Blanc 2008) and targets to develop strategies of ...

We propose residUUm, an audiovisual performance tool that uses sonification to orchestrate a particle system of shapes, as an attempt to build an audiovisual user interface in which all the actions of a performer on a laptop are intended to be explicitly interpreted by the audience. We propose two approaches to performing with residUUm and discuss the methods utilized to fulfill the promise of ...

Automatic deduction of semantic labels for audiovisual data requires awareness of context, which in turn requires processing sequences of audiovisual scenes or events. The representation of such sequences is important for semantic analysis tasks. Whereas, conventionally, sequences of specific short-duration event labels, often hand-annotated for learning detectors or classifiers, have been used...

Nowadays more and more audiovisual information is available, from many sources around the world. Computer and data technologies are continuing to develop at a rapid rate, providing higher performance while reducing the cost and size of the system components. Users require assistance to avoid being overwhelmed by this amount of information and the information providers require assistance in auth...

  Having in mind the high level of challenge in writing as a foreign language, this research provided Iranian EFL learners with audiovisual feedbacks as an alternative of common written feedback and focused on its’ meaningfulness in order to provide an incentive medium for the participants and increase their moti-vation. One hundred young adult female learners in addition to six English languag...

advances in computer sciences and the emergence of innovative technologies have entered numerous new elements of change in translation industry, such as the inseparable usage of software programs in audiovisual translation. initiated by the expanding reality of fandubbing in iran, the present article aimed at illuminating this practice into persian in the iranian context to partly address the l...

First we analyse audiovisual documents and the temporalities they are concerned with. Then we define hypervideos as extended audiovisual documents that offer hypertextual capabilities in the framework of audiovisual information systems. We analyse some features of hypervideos regarding the temporalities we defined, and show that hypervideo are complex objects. So we finally present the beginnin...

The German National Library of Science and Technology (TIB) is developing a web-based platform for audiovisual media. The forthcoming audiovisual portal optimises access to scientific videos such as computer animations, lecture and conference recordings. TIB's AVPortal offers new methods for searching within videos enabled by automated video analysis with scene, speech, text and image recogniti...

Seeing the talker’s articulatory mouth movements can influence the auditory speech percept both in speech identification and detection tasks. Here we show that these audiovisual integration effects also occur for sine wave speech (SWS), which is an impoverished speech signal that naïve observers often fail to perceive as speech. While audiovisual integration in the identification task only occu...