BBN HARC and DELPHI Results on the ATIS Benchmarks - February 1991

نویسندگان

  • Steve Austin
  • Damaris M. Ayuso
  • Madeleine Bates
  • Robert J. Bobrow
  • Robert Ingria
  • John Makhoul
  • Paul Placeway
  • Richard M. Schwartz
  • David Stallard
چکیده

This paper presents the test results of running BBN's HARC spoken language system and DELPHI natural language understanding system on the ATIS benchmarks. We give a brief system overview, and review the major changes that have been made in Delphi since the last DARPA SLS workshop. We will briefly discuss the development and training process, and then present our test results and an analysis of their meaning. S Y S T E M O V E R V I E W Delphi is BBN's research NL system, which is based on a unification grarnrnar and which incorporates semantics into the unification framework. Delphi is the NL component of the BBN HARC (Hear and Respond to Continuous Speech) system; integrated with the BYBLOS speech recognition system using an N-best architecture [1,2]. Figure 1 shows the relationships among the components of HARC, and their inputs and outputs.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

BBN BYBLOS and HARC February 1992 ATIS Benchmark Results

In the official scoring, conducted by NIST, BBN's HARC system 3. produced a weighted SLS score of 43.7 on all 687 evaluable utterances in the test set. This was the lowest error achieved by any of the 7 systems evaluated. 4. For the SPREC evaluation BBN's BYBLOS system achieved a word error rate of 6.2% on the same 687 utterances and 9.4% on the entire test set of 971 utterances. These results ...

متن کامل

BBN ATIS System Progress Report - June 1990

This paper reports recent progress on the development of the Delphi natural language component of the BBN spoken language system for the ATIS domain, focussing on the comparative evaluation performed by NIST in Jtme, 1990. 1. Delphi and Parlance/Learner Delphi is BBN's research NL system (formerly called CFG), which is based on a unification grarnmax and which incorporates semantics into the un...

متن کامل

Syntactic and Semantic Knowledge in the DELPHI Unification Grammar

This paper presents recent natural language work on HARC, the BBN Spoken Language System. The HARC system incorporates the Byblos system [6] as its speech recognition component and the natural language system Delphi, which consists of a bottom-up parser paired with an integrated syntax/semantics unification grammar, a discourse module, and a database question-answering backend. The paper focuse...

متن کامل

BYBLOS Speech Recognition Benchmark Results

This paper presents speech recognition test results from the BBN BYBLOS system on the Feb 91 DARPA benchmarks in both the Resource Management (RM) and the Air Travel Information System (ATIS) domains. In the RM test, we report on speaker-independent (SI) recognition performance for the standard training condition using 109 speakers and for our recently proposed SI model made from only 12 traini...

متن کامل

The Bbn/harc Spoken Language Understanding System

We describe the design and performance of a complete spoken language understanding system currently under development at BBN. The system, dubbed HARC (Hear And Respond to Continuous speech), successfully integrates state-of-the-art speech recognition and natural language understanding subsystems. The system has been tested extensively on a restricted airline travel information (ATIS) domain wit...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1991