Royal Army College

Lesson Overview

By now you can analyse a need, write training objectives, design a course, and develop its materials. A course built that way works on the day it is piloted. The harder question, and the one this lesson answers, is how to keep it working. A qualification is a promise: it tells the Army that a national who holds it can do a certain thing, to a certain standard, under certain conditions. That promise is only worth something if it stays true over years, across different instructors, and as the world the course was built for keeps changing. Doctrine is revised, kit is replaced, the law moves, and a course that is left alone slowly drifts away from the need it was meant to serve.

This lesson teaches you to guard that promise. You will see the standard for what it is, the fixed bar a qualification certifies, and why it must not be allowed to creep up or sag down by accident. You will learn validation, the discipline of proving that the training actually meets the standard, in its two forms: internal validation, which asks whether the students really learned what the course set out to teach, and external validation, which asks whether that training works where it is used, out in the job. You will learn how courses are kept current as doctrine, kit, and law change, on a planned cycle rather than by accident. And you will see how the College governs its standards so that a qualification means the same thing this year as it did last year and will next year.

This is the knowledge layer. Owning a standard and running a validation are mastered by doing them under the eye of an experienced standards owner, and any validation report or course review you draft on this course is checked and signed off in person, where supervision allows, before it is allowed to change a live course. What follows teaches the method and the habits of mind; the practice comes after.

By the end you will be able to define the training standard and explain why it must be held fixed, distinguish internal from external validation and say what each one proves, plan and run a simple validation of a course, set a course on a review cycle that keeps it current as doctrine and kit and law change, and explain how governing a standard keeps a qualification meaning the same thing over time.

Key Terms

Standard: the fixed bar a qualification certifies; the level of performance, under stated conditions, that a national must reach to be called qualified. It is set by the training objectives and it is not allowed to move by accident.
Qualification: the record that a national has reached the standard of a course; a promise to the Army about what that national can do. Tracked in ADM 220.
Validation: the discipline of proving that training meets the standard. It does not ask whether the course was enjoyable; it asks whether it works.
Internal validation (InVal): validation inside the course, asking whether the students actually learned what the course set out to teach, measured against the objectives and the assessment.
External validation (ExVal): validation outside the course, asking whether the training works where it is used, in the job, by checking the qualified national in the field and asking the people who receive them.
Standards drift: the slow, unnoticed movement of the real bar away from the written one, upward or downward, as instructors, kit, or interpretation change, until the qualification no longer means what it says.
Currency: the state of a course being up to date with present doctrine, kit, and law, so that what it teaches is what the Army now needs.
Review cycle: the planned schedule on which a course is examined and refreshed, both at set intervals and whenever a trigger demands it, so currency is kept on purpose and not by luck.
Standards owner: the member accountable for a course's standard: for holding the bar fixed, running its validation, keeping it current, and authorising changes to it.
Course specification: the controlled master document of the design, against which validation checks the live course and into which approved changes are written. Built in Lesson 03.

The standard is a fixed bar

Begin with the thing being protected. A qualification is not a certificate of attendance and it is not a reward for effort. It is a statement that a named national has reached a defined level of performance, and the whole value of it rests on that level being the same for everyone who holds it. When a section commander reads that a national is qualified on the section radio, they must be able to act on it without checking, the same way every time, because the standard behind the word is fixed.

The standard is not invented fresh by each instructor. It was set when the training objectives were written, each one naming a performance, the conditions, and the standard to which it must be done. Those objectives are the bar. The assessment plan, built in design, is how a national is measured against the bar. Holding the standard means holding both of those steady: the same objectives, assessed the same way, to the same pass level, course after course, instructor after instructor. The bar is allowed to change only deliberately, through the governance this lesson describes, never by an assessor having a generous morning or a strict one.

The enemy of a fixed standard is drift, and drift goes both ways. It sags downward when a crowded programme keeps sacrificing the same reteaching, when an assessor quietly passes a national who was close enough, when a worn-out piece of kit makes the real task easier than the standard assumes. It creeps upward when an experienced instructor starts marking to their own high habit rather than the written pass standard, failing nationals who actually meet the bar. Both are corrosion. Downward drift hands the Army nationals who cannot do what their qualification claims; upward drift fails nationals who could, and slowly makes the qualification mean something different from what is written. Neither is anyone's decision; that is exactly the danger. The standard moves while everyone believes it is holding.

   STANDARDS DRIFT: THE BAR MOVES WHILE NO ONE DECIDES

   UPWARD DRIFT          THE WRITTEN BAR          DOWNWARD DRIFT
   (too strict)          (the standard)           (too lax)

      real bar  ....\         |                   /....
                     \        |                  /
                      \   ====+====  <-- where    /
                       \      |       it should  /
                        \     |        stay     /
   nationals who meet     real bar             real bar
   the standard FAIL                           nationals who do NOT
                                               meet it PASS

   Drift is no one's decision. That is why it must be
   watched for and corrected on purpose.

Validation: proving the training works

A standard that is written down but never checked is an assumption. Validation is how the College turns that assumption into knowledge. It is a plain, honest question asked of a course: does it do what it claims? Note carefully what validation is not. It is not asking whether the students liked the course, whether the instructor was popular, or whether the week ran smoothly. Those things matter and you will meet them in Lesson 10 on evaluation, but they are not validation. Validation asks one thing only: is the training meeting the standard?

That single question splits into two, because there are two places the answer can hide. The first place is inside the course itself. The second is out in the job the course was built for. A course can pass the first test and fail the second: every student reaches the written objective, and yet the qualified national still cannot do the real thing where it counts, because the objective itself was wrong, or the conditions in training were too kind, or the world has moved since the course was designed. So validation must look in both places, and it has a name for each.

   INTERNAL vs EXTERNAL VALIDATION

   INTERNAL VALIDATION (InVal)        EXTERNAL VALIDATION (ExVal)
   inside the course                  out in the job
   --------------------------         --------------------------
   QUESTION                           QUESTION
   "Did the students actually         "Does this training work
    learn what the course set          where it is used, in the
    out to teach?"                      job?"

   LOOKS AT                           LOOKS AT
   - assessment results vs the        - the qualified national
     objectives                         doing the task in the field
   - which objectives are              - what the receiving
     reached, which are weak             commanders report
   - where students struggled         - whether the standard
   - whether the assessment             still fits the real need

   ANSWERS                            ANSWERS
   "Is the course teaching to         "Is the course teaching the
    its own design?"                   RIGHT thing, well enough
                                       for the real world?"

   Both are needed. A course can pass InVal and fail ExVal.

Internal validation: did they actually learn it?

Internal validation stays inside the course and measures it against its own design. Its question is whether the students learned what the course set out to teach, and its evidence is already being produced every time the course runs: the assessment results, objective by objective. The standards owner reads those results not as a tally of who passed, but as a map of how the course is teaching.

Read against the objectives, the results tell a story. If most of a cohort meets every objective comfortably, the course is teaching to its design. If one objective is repeatedly the one nationals struggle with or fail, that is a signal pointing at a lesson, a method, a sequence, or a slot in the programme that is too thin. If an objective is passed by everyone without effort every time, ask an honest question: is the standard for it too low, or is the lesson teaching something the entry standard already delivered, so that the slot could be better spent? Internal validation also turns its eye on the assessment itself. An assessment that everyone passes and one that everyone fails are both suspect, and an assessment whose result depends on which assessor ran it has broken the reliability that TRG 310 demands, which is itself a fault to fix.

The proper end of internal validation is not blame and it is not a quiet pass for next time. It is a specific finding. "Objective 4 is failed by a third of nationals; the faultfinding lesson has too little practice time" is a finding a designer can act on. Internal validation feeds the loop: it hands evidence to the review that keeps the course current, and it is the early-warning system for downward drift, because the first sign of a sagging standard is usually a quiet change in what the assessment results are saying.

External validation: does it work in the job?

External validation leaves the classroom and follows the qualified national out to the job. Its question is the one that finally matters: does this training work where it is used? A course can teach beautifully to its own objectives and still be wrong, because the objectives can be wrong, the training conditions can be gentler than reality, or the need can have changed since the analysis. Only the field can tell you that, so external validation goes and asks the field.

It gathers its evidence from two honest sources. The first is the qualified national doing the real task in the real setting: watched, with the eye that asks not "did they pass the test" but "can they actually do this where it counts, under the pressure and the conditions the test could not fully reproduce". The second is the people who receive the qualified national, the section commanders and supervisors who must rely on the qualification. Ask them plainly: when a national arrives holding this qualification, can they do what it claims? What do they still have to be taught on arrival that the course should have given them? What does the course spend time on that the job never uses? Those answers, gathered without defensiveness, are the truest test a course gets.

External validation closes the systems approach back to its beginning. A finding that qualified nationals consistently cannot do the real task, or that commanders must reteach the same thing every time, is not a small adjustment; it sends you back to the analysis. Perhaps the gap was misread, perhaps the objective named the wrong performance or too soft a condition, perhaps the need itself has moved. External validation is therefore the strongest tie between the College and the Army it serves, and the surest defence against a course that teaches well and matters little. Internal validation keeps a course true to its design; external validation keeps the design true to the world.

Keeping a course current

Even a course that validates well will not stay good if it is left alone, because the world the course was built for does not stay still. Doctrine is revised and the approved way of doing a thing changes. Kit is replaced and the radio, the weapon, or the medical pouch the course was written around is no longer the one in use. The law moves, and a course that touches the rules of self-defence, the duty of care, or the handling of a national's information can fall out of step with what is now lawful. A course that still teaches the old doctrine on the old kit under the old law is not merely dated; it is teaching nationals to do the wrong thing correctly, and certifying them for it.

Currency is the state of being up to date with all three, and it is kept on purpose, through a review cycle, not left to whoever happens to notice. The cycle has two kinds of trigger. The first is the clock: every course is reviewed at a set interval, so that nothing is ever left for years unexamined, and the interval is shorter for courses that sit close to fast-moving doctrine, kit, or law. The second is the event: certain things demand a review the moment they happen, ahead of the schedule, because waiting for the next clock review would mean teaching something wrong in the meantime. New doctrine, a kit change, a change in the law, a serious validation finding, or a safety incident on the course are all event triggers. When either trigger fires, the course is examined against its specification, the gap between what is taught and what is now true is found, and the change is made, developed to the College's template, and authorised before it goes live.

   COURSE CURRENCY / REVIEW CYCLE

        +------------------- the loop ------------------+
        |                                               |
        v                                               |
   [ COURSE RUNS ] ---> evidence (InVal results,        |
        ^                       ExVal from the field)   |
        |                              |                |
        |                              v                |
        |                       [ REVIEW ] <---- triggers:
        |                              |        - CLOCK: set interval
        |                              |        - EVENT: new doctrine,
        |                              |          kit change, law change,
   [ AUTHORISE & ]                     |          validation finding,
   [ GO LIVE     ] <--- [ UPDATE ] <---+          safety incident
        ^                  spec +
        |                  materials,
        +--- standards     to template
             owner signs
             off the change

   The bar is held fixed; what is UPDATED is how the course
   reaches it, kept current with doctrine, kit, and law.

Hold one distinction firmly through all of this. Keeping a course current changes how the course reaches the standard; it must not quietly change the standard itself. New kit may change the drill that is taught and so the lesson and the assessment instrument, while the standard, safe and correct operation to the section level, holds steady. When a review genuinely does need to move the bar, because the job now demands more or less, that is a deliberate change to the standard, made openly through governance, recorded, and never smuggled in under the cover of an update.

Governing the standard

Validation finds the truth and review keeps a course current, but neither works without someone accountable and some discipline of record. Governance is the part that makes a standard hold across people and across time, so that a qualification means the same thing whoever taught it and whenever it was earned. Three things carry it.

The first is the standards owner: a single named member accountable for each course's standard. They hold the bar fixed, see that its validation is run and acted on, keep it on its review cycle, and authorise every change to it. Accountability resting on one named member is what stops a standard becoming everyone's responsibility and therefore no one's, and it is why drift, which is nobody's decision, has someone whose job is to catch it.

The second is control of the document. The course specification and the materials built from it are controlled: there is one authoritative version, changes to it are deliberate and recorded with who changed what and why, and live courses are taught from the controlled version, not from an instructor's private copy that has wandered off over the years. Without document control, a course quietly forks into as many versions as it has instructors, and the standard forks with it.

The third is the record, kept in ADM 220: who is qualified, on which version of which course, and when. This is what lets the College answer, years later, exactly what a given qualification certified, and it is what makes a recertification or a refresher meaningful when a standard is deliberately raised. A qualification is only as trustworthy as the record behind it. Governed this way, by a named owner, a controlled specification, and an honest record, the standard becomes something the whole Army can rely on without having to check, which is the entire point of having one.

In Practice: Colour Sergeant Veka owns the radio course standard

Colour Sergeant Veka is the standards owner for the section radio course that was designed in Lesson 03. Two years on, she runs its scheduled clock review and, at the same time, two events have landed on her desk: a new model of section radio is coming into service, and the College has issued revised voice-procedure doctrine. She treats the review as proving the course still keeps its promise, not as a tidy-up.

She starts with internal validation, reading the assessment results from the last several cohorts against the objectives. Most objectives are reached comfortably. One stands out: faultfinding, Objective 4, is failed by close to a third of nationals every cohort, every time. That is a consistent signal, not bad luck, and it points at a lesson with too little practice time. She also notices the set-operation assessment is now passed by everyone without effort, and asks whether the standard sagged or the lesson overlaps the entry standard. These are findings, written plainly, not blame.

Then she runs external validation. She watches two recently qualified nationals pass live messages on exercise, and she asks three section commanders the blunt question: when a national arrives qualified on this course, can they do it? The commanders are clear. The nationals can operate the set and pass a message, so the core of the course works in the job. But every commander has had to reteach faultfinding on arrival, which matches exactly what the internal results were saying. External validation has confirmed the internal finding and given it weight: the gap is real where it counts.

Now she handles the events without letting them touch the bar. The new radio changes the kit the course is built around, so the set-operation lesson and its assessment instrument must be rewritten to the new model, while the standard, safe and correct operation to the section level, holds exactly where it was. The revised voice-procedure doctrine changes what correct procedure is, so the procedure lesson and the marking scheme are updated to the new doctrine. The faultfinding finding gets more practice time in the programme. She writes all of it into the controlled course specification, develops the changed lessons and assessments to the College's template, and submits the package for sign-off before any of it goes live. The version and date are recorded, so ADM 220 knows precisely which standard each future national was qualified against. The bar did not move; the course caught back up to the world, and the promise still holds.

Check Your Understanding

What is the training standard, where does it come from, and what is "standards drift"? Explain how drift can move the real bar both downward and upward, and why the fact that drift is "no one's decision" makes it dangerous.
Distinguish internal validation from external validation. What question does each one ask, what evidence does each one use, and why can a course pass internal validation yet fail external validation?
What is a review cycle, and what are its two kinds of trigger? Explain the difference between keeping a course current and changing its standard, and why that distinction must be held firmly.

Reflection (write a short paragraph): Think of a qualification, course, or licence you hold, from the Army or civilian life, that may have fallen out of date since you earned it. What in the world it certifies has changed since then, doctrine, equipment, or law? If you owned its standard, what would you check by internal validation, what would you ask the field by external validation, and what would you keep fixed even while updating the rest?

Summary

A qualification is a promise about what a national can do; the standard is the fixed bar it certifies, set by the training objectives and held steady across instructors and over time, allowed to change only deliberately through governance.
Standards drift is the slow, unnoticed movement of the real bar, downward (passing nationals who fall short) or upward (failing nationals who meet the bar); because it is no one's decision, it must be watched for and corrected on purpose.
Validation proves the training meets the standard. It is not about whether the course was liked; it asks only whether the training works, in two places.
Internal validation asks whether the students actually learned what the course set out to teach, reading assessment results against the objectives; it keeps a course true to its own design and warns early of drift.
External validation asks whether the training works in the job, by watching qualified nationals in the field and asking the commanders who receive them; it keeps the design true to the world and ties the College back to the Army's real need.
Keeping a course current is done on a planned review cycle with clock triggers (set intervals) and event triggers (new doctrine, kit change, law change, a validation finding, a safety incident); currency changes how the course reaches the standard, never the standard itself by stealth.
Governance, a named standards owner, a controlled course specification, and an honest record in ADM 220, is what makes a qualification mean the same thing whoever taught it and whenever it was earned.
This lesson follows Lesson 04 · Developing the Materials and leads toward Lesson 10 · Evaluating and Improving, where validation widens into evaluating a course by reaction, learning, behaviour, and result. It draws on TRG 310 · Assessment and Course Supervision (the four tests of assessment) and TRG 301 · Methods of Instruction (how lessons teach), and feeds ADM 220 · Course Records and Qualification Tracking (what a qualification certifies) and LDR 420 · Command Responsibility and Ethical Leadership (the integrity of the standard).

Maintaining Training Standards