Tuesday 8 October 2019

Completing the standards check assessment




The above is a snippet of Section 3.12 of the DVSA's "Carrying out driving instructor checks".  The full assessment criteria of the standards check are detailed here.

The image above is a snippet of the sliding scale in which an instructor is assessed for the frequency in which they demonstrate competency.  Given the fact that the amount of time to demonstrate competencies is going to be about 40-45 minutes, this method of assessment is problematic.    In one of my standards checks, the examiner told me he was running about 10 minutes late so my window of opportunity was shortened even further (a grossly unprofessional tactic to adopt).

The heart of the problem though is in the ambiguity.  Under each competency are the "elements" as are listed in the above document; all 75 of them.  An instructor who is graded "3" for a competence displays ALL of the elements.  However, you will notice in the document from section 4.35 onwards the use of the phrase: 
  
 "Indications that all the elements of competence are in place could include..."

So that would tend to suggest that the 75 listed elements are not entirely complete, and if so, an examiner would be hard pushed to determine if ALL the elements were displayed.  "It could include those elements, but then again, it could include other elements."  It would appear that there is some subjectivity now based on what one particular examiner, as compared to another, considers to be ALL the elements.

Just to remind you that the document has already told us:

"The ADI will have to use a range of skills to ensure each of these elements is in place."

To show that each of these elements is in place would mean that you would need to be demonstrating elements at a rate of 2 per minute for 40 minutes solid.  And yet, it would appear from the thousands of instructors that get an A grade per year; this feat is being achieved with regularity.  

So what is going on?  All I can say is that it leaves much to be desired in terms of a transparent process with integrity.

Examiners do expect instructors to mention previously covered subjects just for the sake of the assessment.  A case in point was a 62 year old who I used on a standards check, who was about 40 hours in his training programme.  The examiner was expecting me to ensure my pupil knew of his responsibilities to ensure all occupants in the car had put their seat belt on.  This is where this point is covered in the ADI1:

 "Even if the ADI and the pupil have had discussions about risk before the observed lesson, they must show that they are actively managing the issue for assessment purposes."

The effect of that requirement is that any subject relating to risk must be demonstrated again for the purpose of the assessment disregarding the adverse effect on the pupil by being inappropriate.

 On the subject of examiner feedback.  The document states the following:

"The examiner should note, in the box marked ’debrief / feedback offered’, the areas of competence not met that have been highlighted in the feedback to the ADI "

So you would expect by all accounts that the feedback highlighted to the ADI and therefore listed in this box to be competency or element based.  I have an SC1 form that states the following:

"Pupil would have benefitted from understanding staged acceleration".  

Which element, which competency?  Anyone able to find reference to "staged acceleration" in the DVSA driving standard? How about "The Driving Instructor's Handbook"?  "Essential skills" perhaps?  No, me neither.  

If you are going to be really specific and list 75 elements that are needed to be demonstrated in an assessment, then you really should make sure that the feedback you give is accurate and relevant to the criteria.  

There is too much ambiguity in the assessment criteria which can lead to a variety of interpreted outcomes.  In effect, what this means is that the assessment of competency is controlled by the attitudes, professionalism and integrity of the EXAMINER; rather than the driving instructor.  

The purpose of the standards check is as follows:

"The aim of the standards check is to let an examiner assess the ADI’s ability to instruct and whether their instruction helps a person to learn in an effective way."

With the process adopted by the DVSA as it currently is, it places the examiner at the centre of the process rather than the ADI and pupil - which jeopardises the objective. 

No comments:

Post a Comment