In this paper we report on ongoing verification and validation work within the MULTIDOC project. This project is situated in the field of multilingual automotive product documentation. One central task is the evaluation of existing off-the-shelf and research based language technology (LT) products and components for the purpose of supporting or even reorganising the documentation production cha...

This paper is intended to serve as an introductory paper to a workshop on user-oriented evaluation of knowledge discovery systems. Its main purpose is to raise issues and ask questions. The background to the paper is previous work on evaluation in other areas, such as machine translation, much of it closely related to and inspired by the two ISO standards on evaluation of software in general, t...

Currently, Systems-of-Systems (SoS) have performed an important role in diverse application domains, with representative examples in airport, military, and smart-cities, including crisis/emergency management. SoS refer to complex software-intensive systems, resulted from interoperability of independent constituent systems, performing new missions that could not be performed by any constituents ...

Maintainability is typically described initially as a non functional requirement at the system level. Systems engineers must subsequently apportion these system requirements very carefully as either software or hardware requirements to conform to the maintainability requirements of the system. A number of concepts are provided in the ECSS, ISO 9126, and IEEE standards to describe the various ty...

In this paper, we study the software reliability measurement method of reliability testing metrics. Software reliability is very important. But, it is very difficult to test for software reliability measurement. So we describes the software reliability metrics for ISO/IEC 9126, and we introduce GammaLomax software reliability model for multiple error debugging. And we calculate the software rel...

Measuring high level quality attributes of operation-critical IT systems is essential for keeping the maintainability costs under control. International standards and recommendations, like ISO/IEC 9126, give some guidelines regarding the different quality characteristics to be assessed, however, they do not define unambiguously their relationship to the low level quality attributes. The vast ma...