This article focuses on the assessment portion of SCAMPI and is derived from the SEI official SCAMPI documentation.
The intent of this summary is to help an organization make a preliminary self assessment and to provide an overview of the SCAMPI evaluation methods.
If the reader is unfamiliar with the CMMi terms then an introduction to CMMi should be read first.
Introduction to SCAMPI.
In order for an organization to be officially appraised for CMMI, and (if required) have their rating published, an external certified team of appraisers must conduct a review of the objective evidence that would support the CMMI Practices and Goals required for the given certification (rating). Typically this is a major undertaking with a small team of external auditors collecting information (via interviews and reading documentation etc.) then analyzing this information to produce an appropriate rating.
In addition to the actual rating the appraisal team will make recommendations on which process areas have deficient evidence that support the presence of a given Practice or Goal. The team would also advise the organization on how to make up such deficiencies for future appraisals. One major benefit of such an extensive external appraisal is to give the organization an insight into the strengths and weaknesses of their current processes.
The main purpose of the official SCAMPI documentation is to be a training aid for team members of a full CMMI appraisal. As such the document contains chapters on How to manage the Appraisal project, although this information is vital for an appraisal it is not documented here as only the key points of the evaluation it's self are outlined.
Concepts for evaluation.
Practice Implementation Indicators (PII) is pieces of evidence that a given CMMI Practice (that supports a Goal) has indeed been implemented. The idea is that performing a Practice will leave a “footprint” or evidence that the practice has been performed. A PII could be a document (for example a Requirements Traceability Matrix, RTM) that is directly produced from a Practice, i.e. within the Requirements Management process area for the RTM.
What the appraisers are looking for, in order to make an assessment, is objective evidence of the Practice Implementation Indicators (PII). There are three basic types of PII listed in the SCAMPI documentation, table (Table I-8) is reproduced here.
Table I-8: Practice Implementation Indicator Types
When the Objective evidence has been collected and examined a Characterization of the extent to which the Model practices are implemented, can be made.
The Model practices are characterized as:-
Generating Appraisal results
Following the collection and evaluation of objective evidence supporting the implementation of Practices, the extent to which the Goals (of a given CMMi Process Area) are being met can be accessed.
Goal satisfaction is based on the extent to which the practices associated with that goal have been implemented. This determination is made using the concepts outlined in the previous section.
SG 1 Develop Customer Requirements (a goal within the Requirements Development Process Area) has a Specific Practice of Elicit Needs.
An appraiser would look for evidence that the SP Elicit Needs was implemented (using the previously described concepts). Then make a determination as to whether or not the related Goal (Develop Customer Requirements) is satisfied.
The goal is rated Satisfied if and only if
The above description is only a very high level description of the SCAMPI Appraisal process, clearly judgment and experience play a major part in an effective evaluation.
The above outline, however, should help anyone performing an initial self appraisal, as well as providing an introduction to the CMMi Appraisal process.
No guarantee (or claim) is made regarding the accuracy of this information. Any questions or comments should be sent to:-