Two methods are used for evaluation of summarization systems: an evaluation of generated summaries against an "ideal" summary and evaluation of how well summaries help a person perform in a task such as informa. tion retrieval. We carried out two large experiments to study the two evaluation methods. Our results show that different parameters of an experiment can (h-amatically affect how well a...

The evaluation of information visualization techniques and systems is important in order to understand how to improve the systems and create innovative, useful new techniques. This article describes some of the challenges and issues in information visualization evaluation, and it discusses potential opportunities to improve the process. By better identifying the tasks people perform using infor...

Users' evaluations are a key measure of the performance of information systems. This paper examines some issues in correct measures of IS (Information System) performance through the users' evaluations , especially, in the international cross-cultural perspective view. The Chinese cultural environment, as an example, has been given a close look to examine the cross-cultural impacts on the measu...

Is healthcare information technology (HIT) based on evidence of efficacy? Are the trillions of dollars already devoted and in the pipeline for HIT implementations based on systematic evaluations? If evaluated, would those evaluations focus on patient safety, return on investment, clinical efficiency, improved clinician satisfaction, and/or workflow integration? Do we have reliable evidence of u...

Warning messages are one of the last lines of defense in information security, and are fundamental to users’ security interactions with technology. Unfortunately, research shows that users routinely ignore security warnings. A key contributor to this disregard is habituation, the diminishing of attention through frequent exposure. However, previous research has examined habituation indirectly b...