This email was sent to all OPMT OP Assessors registered in OASIS on 13 January 2017. It is reproduced here for reference.
Dear Auditor,
9100:2016 Bridge Training Update:
The goal of the OPMT is to provide an effective and convenient approach for currently authenticated auditors to complete the required training while also ensuring effective audit reporting. We continue to monitor the results and take actions to ensure that our goals and the goals of the various interested parties are achieved as effectively and efficiently as possible.
Since launch of the 9100:2016 Bridge training the OPMT team wanted to share the current status and provide observations regarding the results to date.
As you are aware, the course consists of:
- ISO 9001 pre-assessment
- 9100:2016 Delta Training
- 9101:2016 Delta Training
- Forms and Audit Reporting Training
- Forms and Audit Reporting Assessment
As of January 6, 2017, approximately 360 people have completed the ISO 9001 Pre-assessment and approximately 180 have completed the Forms and Audit Reporting Assessment. The training developer and the OPMT continue to analyze the results, the following includes early observations and key take-a-ways:
ISO 9001 Pre-assessment
- The pre-assessment requires pre-study and knowledge of the ISO 9001:2015 standard. It should not be taken lightly. This assessment consist of a knowledge and application section. Time management in this assessment is critical.
- Early observations show that the participants are typically using most of the allotted time for the knowledge and completing the application section in approximately two thirds of the allotted time.
- Average scores in the application section are somewhat lower than the scores in the knowledge section.
- Pass rates after the first retake are significantly higher than the initial attempt pass rates.
- Key Take-A-Ways:
- Study the ISO 9001:2015 standard before taking the pre-assessment.
- Be familiar with terminology changes to the standard, understand the new clause structure and how to find information in the standard quickly.
- Manage your time.
- The timing for the knowledge section does not allow extensive time for researching the standard to find or verify answers.
- Within the application section, most people are scoring lower but completing this section in two-thirds of the allotted time. This section allows more time for review and verification, use it.
- Study the ISO 9001:2015 standard before taking the pre-assessment.
9100:2016 Forms and Audit Reporting
- The 9100:2016 Delta and the 9101:2016 Delta training, by design, focus on the deltas between the old and new standards. It assumes that the participant has strong knowledge of the ISO 9001:2015 standard and basic audit requirements. The forms and audit reporting module then takes various short scenarios and attempts to focus on 1) the auditor’s ability to analyze and synthesize audit data; 2) understand 9100:2016 requirements; and 3) application of the audit data and 9100:2016 requirements to the audit reporting. The training includes various “trial assessments” which allow the participant to complete the trial assessment then see the “Subject Matter Expert” assessment. Finally, the 9100 Forms and Audit Reporting assessment is taken.
- Early observations show that the participants are typically using most of the allotted time for the Forms and Audit Reporting assessment.
- Analysis reveals that common areas of weakness in auditor scoring include:
- The difference between a statement of nonconformity and objective evidence (i.e. when asked to choose all correct and valid statements of nonconformities).
- Selecting the most appropriate clause on a nonconformity statement, and how an NCR can be invalid when it’s written against an inappropriate clause.
- The difference between process realization and process results.
- Missed key details included in the scenario artifacts, in addition to the scenario description.
- Prioritization of key issues raised by the questions (as opposed to issues that may be valid, but are not on-topic for the scenario/question at hand)
- Key Take-A-Ways:
- Study the ISO 9001:2015 standard before taking the pre-assessment.
- Be familiar with terminology, changes to the standard and understand the new clause structure.
- Be able to navigate the standards quickly and efficiently.
- Utilize the trial assessments to get familiar with the materials, methodology and SME perspective to better prepare you for the final assessment.
- Ensure that you are able to tell the difference between a statement of nonconformity and objective evidence.
- Three of the four questions resulting in the lowest performance were related to not being able to properly identify or differentiate between statements of nonconformity and objective evidence.
- This is not something that was not a targeted training point in the delta training, but clearly of impact in our audit reporting.
- Ensure that you have read the scenario carefully are identifying the key details included in the scenario artifacts, in addition to the scenario description.
- Three of the ten lowest performing questions were related to key details that were missed in the scenario description or artifacts provided.
- Ensure that you are able to prioritize key issues raised in the question, as it relates to the specific scenario or question cited.
- Three of the ten lowest performing questions were related to prioritization of key issues raised by the questions (as opposed to issues that may be valid, but are not on-topic for the scenario/question at hand)
OPMT Actions:
Based on continued analysis of auditor assessment performance in the IAQG-sanctioned 9100:2016 Online Update Component, and in an effort to support the transition process, IAQG OPMT is making the following adjustments to the program effective immediately:
ISO 9001:2015 Pre-Assessment:
- Available time in Knowledge section increases from 75 minutes to 90 minutes
- No adjustment to Application section timing (45 minutes) or pass score threshold (80%)
9100:2016 Forms and Audit Reporting Assessment:
- Available time increases from 2 hours to 2 hours and 15 minutes
- Pass Score Threshold lowered from 75% to 73%
The training developer has agreed to make this change retroactive and will be communicating these changes as well as the remediation plan for addressing those impacted by these changes in the next days.
The goal of the OPMT is to provide an effective and convenient approach for currently authenticated auditors to complete the required training while also ensuring effective audit reporting. We continue to monitor the results and take actions to ensure that our goals and the goals of the various interested parties are achieved as effectively and efficiently as possible.
Regards,
IAQG OPMT