One major bottleneck in conversational systems is their incapability in interpreting unexpected user language inputs such as out-ofvocabulary words. To overcome this problem, conversational systems must be able to learn new words automatically during human machine conversation. Motivated by psycholinguistic findings on eye gaze and human language processing, we are developing techniques to inco...

Multimodal conversational interfaces, which allow humans to interact with a computer using a combination of spoken natural language and a graphical interface, offer the potential to transform the manner by which humans communicate with computers. While researchers have developed myriad such interfaces, none have made the transition out of the laboratory and into the hands of a significant numbe...

In dialogue, language processing is adapted to the conversational partner. We hypothesize that the brain facilitates partner-adapted language processing through preparatory neural configurations (task sets) that are tailored to the conversational partner. In this experiment, we measured neural activity with functional magnetic resonance imaging (fMRI) while healthy participants in the scanner (...

In this work we report our efforts to facilitate the creation of mixed-initiative conversational interfaces for novice and experienced developers of human language technology. Our focus has been on a framework that allows developers to easily specify the basic concepts of their applications, and rapidly prototype conversational interfaces for a variety of configurations. In this paper we descri...

The purpose of this single-subject pilot study was to examine the efficacy of FM amplification for enhancing the discourse skills of a 4-year-old girl with a history of speech-language impairments, otitis media with effusion (OME), and motoric delays. Over a period of several weeks, language treatment sessions were conducted with and without FM amplification, in a classroom setting. Sessions we...

This paper describes two experimental protocols for direct comparison of human and machine phonetic discrimination performance in continuous speech. These protocols attempt to isolate phonetic discrimination while eliminating for language and segmentation biases. Results of two human experiments are described including comparisons with automatic phonetic recognition baselines. Our experiments s...

Previous research has provided evidence that second language (L2) learners use gesture to enhance spoken communication with interlocutors, and that gesture facilitates L2 word learning. The current study investigates how L2 learners use gesture to communicate in conversational settings, and whether their gesturing in these settings facilitates L2 acquisition beyond the immediate context. The re...

In this paper we study language use and language organisation by making use of Lewisean signalling games. Standard game theoretical approaches are contrasted with evolutionary ones to analyze conventional meaning and conversational interpretation strategies. It is argued that analyzing successful communication in terms of standard game theory requires agents to be very rational and fully inform...

In this paper, we introduce a new conversational speech task – recognizing call-center speech – using data collected from Dragon’s own technical support line. We compare performance of models trained from conversational telephone speech (the Switchboard corpus) and models trained from predominantly read, microphone speech, and report on a series of experiments focusing on adapting the microphon...

The purpose of this study was to describe preschoolers' conversational responsiveness in an integrated classroom setting. Variables of primary interest were the types of responses as a function of the conversational partner. The children were categorized according to language ability: normally developing, marginal (children previously diagnosed as language or speech impaired, but now functionin...