Recent experiments show that seeing lip movements may improve the detection of speech sounds embedded in noise. We show here that the “speech detection” benefit may result in a “speech identification” benefit different from lipreading per se. The experimental trick consists in dubbing the same lip gesture on a number of visually similar but auditorily different configurations, e.g. [y u ty tu k...

To reuse successful experience in software architecture design, architects use architectural patterns as reusable architectural knowledge for architectural synthesis. However, it has been observed that the resulting architecture does not always conform to the initial architectural patterns employed. Architectural synthesis using architectural patterns is also recognized as a challenging task, e...

Phonological theories commonly analyze speech utterances as composed of hierarchically organized units, such as features/gestures, segments, moras, and syllables, but it is not well understood why this hierarchical organization is observed. Moreover, current phonological theories and speech production models fail to explain cross-linguistic and developmental variation in the organization of uni...

Comparison was made between performance-based and competence-based approaches to the understanding of first word production. The performance-related frame/content approach is representative of the biological/functional perspective of phonetics in seeking explanations based on motor, perceptual and cognitive aspects of speech actions. From this perspective, intrasyllabic consonant-vowel (CV) co-...

We present a method for synthesizing two dimensional (2D) element arrangements from an example. The main idea is to combine texture synthesis techniques based-on a local neighborhood comparison and procedural modeling systems based-on local growth. Given a user-specified reference pattern, our system analyzes neighborhood information of each element by constructing connectivity. Our synthesis p...

This paper extends previous work on pronunciation by analogy (PbA) in several directions. PbA is a data-driven method for converting letters to sound, with potential application to next-generation text-to-speech systems. We experiment with a range of methods for matching letter patterns in input words to those in the system dictionary when building a pronunciation lattice. We give preliminary c...

We know that an audio speech signal can be unambiguously decoded by any native speaker of the language it is uttered in, provided that it meets some quality conditions. But we do not know if this is the case with visual speech, because the process of lipreading is rather mysterious and seems to rely heavily on the use of context and non-speech cues. How much information about the speech content...