The reliability of ISO/IEC PDTR 15504 assessments
نویسندگان
چکیده
During phase two of the SPICE trials, the Proposed Draft Technical Report version of ISO/IEC 15504 is being empirically evaluated. This document set is intended to become an international standard for Software Process Assessment. One thread of evaluations being conducted during these trials is the extent of reliability of assessments based on ISO/IEC PDTR 15504. In this paper we present the first evaluation of the reliability of assessments based on the PDTR version of the emerging international standard. In particular, we evaluate the interrater agreement of assessments. Our results indicate that interrater agreement is considerably high, both for individual ratings at the capability attribute level, and for the aggregated capability levels. In general, these results are consistent with those obtained using the previous version of the Software Process Assessment document set (known as SPICE version 1.0), where capability ratings were also found to have generally high interrater agreement. Furthermore, it was found that the current 4-point scale cannot be improved substantially by reducing it to a 3-point or to a 2-point scale.
منابع مشابه
The Internal Consistency of the ISO/IEC 15504 Software Process Capability Scale
ISO/IEC 15504 is an emerging international standard for software process assessment. It has recently undergone a major change in the rating scale used to measure the capability of processes. The objective of this paper is to present a follow up evaluation of the internal consistency of this process capability scale. Internal consistency is a form of reliability of a subjective measurement instr...
متن کاملAn empirical evaluation of the ISO/IEC 15504 assessment model
The emerging International Standard ISO/IEC 15504 (Software Process Assessment) includes an exemplar assessment model (known as Part 5). Thus far, the majority of users of ISO/IEC 15504 employ the exemplar model as the basis for their assessments. This paper describes an empirical evaluation of the exemplar model. Questionnaire data was collected from the lead assessors of 57 assessments world-...
متن کاملExperiences Gained from Applying ISO/IEC 15504 to Small Software Companies in Brazil
This paper describes some experiences gained from applying ISO/IEC 15504 for software process assessments focusing on process improvement in four small software companies in Brazil. The assessments have been realized in the context of the research project 15504MPE, which aims at the development of a customized assessment method based on the standard ISO/IEC 15504 adapted to small brazilian soft...
متن کاملEarly results of a comparative evaluation of ISO 9001 and ISO/IEC 15504 assessment methods applied to a software project
This paper presents early results of a comparative study undertaken on a software project. The methods used for assessment included an ISO 9001 based audit checklist for software (SABS ARP 042), and the emerging ISO/IEC 15504 standard for software process assessment and capability determination. While the two methods focus on different issues, namely quality system compliance to ISO 9001 in the...
متن کاملValidating the ISO/IEC 15504 Measures of Software Development Process Compability
Permission is granted to quote short excerpts and to reproduce figures and tables from this report, provided that the source of such material is fully acknowledged. Abstract ISO/IEC 15504 is an emerging international standard on software process assessment. It defines a number of software engineering processes, and a scale for measuring their capability. A basic premise of the measurement scale...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Software Process: Improvement and Practice
دوره 3 شماره
صفحات -
تاریخ انتشار 1997