Seeing the talker’s articulatory mouth movements can influence the auditory speech percept both in speech identification and detection tasks. Here we show that these audiovisual integration effects also occur for sine wave speech (SWS), which is an impoverished speech signal that naïve observers often fail to perceive as speech. While audiovisual integration in the identification task only occu...

With the aim of audiovisual database consulting, the prospect of an interactive visual organization tool should be enviable. We consider a document as a visual entity in a computer screen. Thanks to an appropriate simplified GUI, a user can organize a few documents. Its notion of audiovisual similarity is relative to the Euclidean distance between entities: the more they are close, the more the...

This paper describes the COALA (Content-Oriented Audiovisual Library Access) project, which aims to offer a framework for the retrieval of audiovisual TV news documents. COALA’s principal design features are based on the analysis of a classical archive system: TSR (Television Suisse Romande) archive. It provides a retrieval interface allowing simple/advanced search capabilities combined with hi...

One of the most natural ways to acquire procedural knowledge is to watch somebody performing a number of actions and try to abstract this observed action sequence in order to make it applicable to a wider range of situations. This abstraction process can be significantly facilitated if the performing agent gives additional hints e.g. on the reasons for choosing a particular action or dealing wi...

For every v ≡ 5 (mod 6) there exists a pairwise balanced design (PBD) of order v with exactly one block of size 5 and the rest of size 3. We will refer to such a PBD as a PBD(5∗, 3). A flower in a PBD(5∗, 3) is the set of all blocks containing a given point. If (S,B) is a PBD(5∗, 3) and F is a flower, we will write F ∗ to indicate that F contains the block of size 5. The flower intersection pro...

Shape matching is a popular method for simulating deformable objects in real time as it is fast and stable at large time steps. Although shape matching can simulate large elastic deformation and ductile fracturing, until now, they are limited to scenarios with relatively small plastic deformation. In this work, we present a method for simulating deformable solids undergoing large plastic deform...

This Paper presents improvements done to a Programming by Demonstration(PbD)system in order to handle complex one and two hand manipulations. In order to do this, functional roles were added to the systems knowledge base. According to them a probability density function expressing the relationship between the manipulated objects has been set up. Since one object can fulfill several functional r...

The open, independent, and international standards organization Internet Engineering Task Force (IETF) has chartered a working group. It is named "Codec Encoding for LossLess Archiving and Realtime transmission" (CELLAR) and aims to develop specifications for a lossless audiovisual file format for use in archival environments and transmission. It consists of the combination of the audiovisual c...

We studied the representations underlying audiovisual integration using a priming paradigm. Audiovisual primes, preceding auditory targets, were either incongruent (auditory /ba/ & visual /va/) or congruent (auditory /va/ & visual /va/, auditory /ba/ & visual /ba/). The targets were /ba/ or /va/. The intensity of the prime ́s auditory component was either 50 dB or 60 dB. Identification speed of ...

This paper describes the work done in the PrestoSpace project dealing with audiovisual and semantic content analysis, content description and retrieval in a broadcast archive environment. We present the metadata model that is used in the PrestoSpace system and discuss its design. A key issue is the integration of audiovisual content description and semantic metadata in the model as well as the ...