Assessment (audit) programme

Assessment (audit) programme

Here you'll find all you need to know about our pilot assessment programme.

Overview

Auditing is a function of the Board and this year we have undertaken a second pilot assessment (audit) programme. The programme was set up to verify that licensed electrical workers are undertaking their work in a competent manner and that safe working practices are being used.

Telarc was selected to manage the programme which was undertaken in the Auckland, Waikato, Bay of Plenty and Coromandel regions. Approximately 300 electricians were randomly selected to participate in this pilot round which was completed on 31 May 2017; the initial results of the assessment have been analysed and are outlined below.

Further information can be found in the auditing consultation paper below.

Findings of the pilot programme

To date, we’ve been using an assessment model that includes a mixture of test-boards, onsite observations, and verbal questions to determine if the participants are undertaking their work in a competent manner and that safe working practices are being used.

The Board have confidence in this evidence based assessment model.

Key points

  • During both assessment rounds, we’ve identified several areas of concern that weren’t being picked up during the Board’s traditional telephone and Certificate of Compliance (CoC) audits. This is illustrated in the graph below.
  • Any workers who had unsatisfactory results are being monitored to ensure that they up-skill to the required level. Urgent training and additional assessments have been organised where required.
  • The assessment findings are being fed into the syllabus of the current competency training round.
  • The majority of feedback from both trial rounds from those who participated has been very positive. Discussion at the Board's meet and greet sessions has also been positive and invaluable, and it has been encouraging that so many workers endorse the assessment program and recognise the benefits of continuous improvement, both for the worker and the consumer.
  • The assessments were a two-way process and gave electrical workers the opportunity to ask our experienced assessors any electrical related questions.
  • Importantly, both assessment rounds have proven to be more informative and less expensive than audits that were undertaken in previous years.
  • A draft assessment scheme is currently being developed to set out the rules for future assessments. The development of the scheme is being managed by JAS-ANZ and includes valuable input from participants as well as several proactive industry stakeholders.
  • We expect the scheme will be available for industry consultation later in 2017. The intent is that the final scheme will be a systematic risk-management framework that helps the Board to make informed choices and identify and respond to competence related risks in appropriate and proportionate ways.

Assessment locations

The 2016 and 2017 pilot programmes ran in these New Zealand locations.

Audit locations map

Photo: Google Maps

Draft overview of pilot results

draft overview of pilot results 05
Pilot assessment (audit) programme results.

boxout tip Notes

When making a comparison and observing variances between the 2016 and 2017 results the following needs to be taken into consideration:

  • the 2016 assessment involved 11 different classes of registration and a 50 per cent smaller sample of electrical workers overall than the 2017 audit. The 2017 programme involved electricians only
  • the larger variances with regards to the 'additional training requirements' and 'testing questions' are to some extent attributable to the demographic focus of the two assessment programmes. In addition the 2017 programme utilised portable test boards and gave the assessors another tool for gauging competency
  • some questions were fine tuned in 2017 to reflect feedback gained from 2016, for example the question relating to understanding 'how to verify the accuracy of test equipment'
  • in addition newly developed questions were introduced in 2017 as a result of feedback and no comparative data is available from 2016.

2016/2017 Competence and safe working practice findings charts

Audit charts
Pilot assessment (audit) programme results.

boxout tip Definitions of competency levels

Acceptable
A person who has undertaken an on-the-job assessment and has been assessed as having the necessary ability, knowledge, and skill to safely and competently carry out electrical work within their class of registration.

Partially acceptable
A person who has undertaken an on-the-job assessment and has been assessed as having the necessary ability, knowledge, and skill to safely and competently carry out electrical work within their class of registration but the assessor has identified areas where further improvement or development is highly recommended.

Unacceptable
A person who has undertaken an on-the-job assessment and has been assessed as not having the necessary ability, knowledge, and skill to safely and competently carry out electrical work within their class of registration.