Usability Evaluation of Spoken Dialogue Systems

نویسنده

  • Lars Bo Larsen
چکیده

This paper concerns the methodologies currently applied to evaluation of spoken and multi modal dialogue systems. Usability is concerned with the effectiveness, efficiency and satisfaction by which users achieves their goals when using a system. The methods developed and applied by the speech community over the past decade to measure the usability of Spoken Dialogue Systems (SDS) are discussed and critically reviewed. The paper starts by giving a general review and discussion of the current issues and problems of establishing SDS usability. This is supported by the presentation and analysis of a case, where it is shown that e.g. learnability can be derived from simple performance measures, such as duration and turn-taking. Results of applying the PARADISE method are presented and discussed. 1. Formerly the Center for PersonKommunikation CPK. CPK is now fully integrated into the Department of Communication Technology URL: http://cpk.auc.dk/staff/staff.html?lbl

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Usability Evaluation In Spoken Language Dialogue Systems

The paper first addresses a series of issues basic to evaluating the usability of spoken language dialogue systems, including types and purpose of evaluation, when to evaluate and which methods to use, user involvement, how to evaluate and what to evaluate. We then go on to present and discuss a comprehensive set of usability evaluation criteria for spoken language dialogue systems.

متن کامل

Evaluation and usability of multimodal spoken language dialogue systems

With the technical advances and market growth in the field, the issues of evaluation and usability of spoken language dialogue systems, unimodal as well as multimodal, are as crucial as ever. This paper discusses those issues by reviewing a series of European and US projects which have produced major results on evaluation and usability. Whereas significant progress has been made on unimodal spo...

متن کامل

New challenges in usability evaluation - beyond task-oriented spoken dialogue systems

There is a fairly good baseline for usability evaluation of taskoriented unimodal spoken dialogue systems (SDSs) but much is still unknown regarding the usability of multimodal and non-task-oriented SDSs. This paper reviews and discusses approaches to usability evaluation of these kinds of SDSs.

متن کامل

Quality of telephone based spoken dialogue systems pdf

Quality of Telephone-Based Spoken Dialogue Systems. Quality of Human-Machine Interaction over the Phone.Quality prediction models for telephone-based spoken dialogue systems. Perform to guarantee an acceptable overall quality for the user. In order to.action HHI as one reference for telephonebased humanmachine interaction HMI. The quality of interactions with spoken dialogue systems is difficul...

متن کامل

Chapter 13 OVERVIEW OF EVALUATION AND USABILITY ∗

With the technical advances and market growth in the field, the issues of evaluation and usability of spoken dialogue systems, unimodal as well as multimodal, are as crucial as ever. This chapter discusses those issues by reviewing a series of European and US initiatives which have produced major results on evaluation and usability. Whereas significant progress has been made on unimodal spoken ...

متن کامل

A Methodology for Evaluating Spoken Language Dialogue Systems and Their Components

As spoken language dialogue systems (SLDSs) proliferate in the market place, the issue of SLDS evaluation has come to attract wide interest from research and industry alike. Yet it is only recently that spoken dialogue engineering researchers have come to face SLDSs evaluation in its full complexity. This paper presents results of the European DISC project concerning technical evaluation and us...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2004