Unit Plan

The Validation Process
Unit Objective
The learner will conduct program validations.
Unit Summary
The students will be engaged in the validation of training programs process. Within the unit, the students will be given a foundational understanding of program validations and the associated steps within the process. Students will be given a set of practical activities that will provide the learner with the skills and knowledge required to conduct validation studies. The Unit will provide the learner with the ability to plan a validation, design a survey tool, analyze validation data, and provide recommendations based on the validation study.
Subject Area
Validation of Training Programs – Quality Control Step 6
Developmental Period
DP1 – Basic Training Development Officer Qualification Course
Audience
Unqualified Training Development Officers (Adult Learners)
Time Requirements
1 week
Resources and Materials Requires
The unit requires the following resources and materials:

  1. CFITES Volume 8 – Validation of Instructional Programs
  2. Course Website
  3. Student WordPress Blog Sites
  4. Validation Plan Template
  5. Validation Survey Template
  6. SharePoint Survey Walkthrough
  7. Findings, Interpretations, and Recommendations Chart
  8. Findings, Interpretations, and Recommendations Chart Example
  9. Scenario Survey Data
  10. Report Example
  11. Scoring Rubrics (Written Report and Oral Presentation)
Learning Objectives
The following are the Learning Objectives for the unit:

  1. The student will be able to explain the validation process including the steps of conducting validation studies and the purpose of validation studies.
  2. The student will be able to plan a validation study by providing key milestones and a scheme of manoeuvres.
  3. The student will design a validation survey based on a specific set of tasks or job.
  4. The student will interpret validation study data by providing a thorough analysis of the findings and developing interpretations.
  5. The student will report the validation study results by articulating the results and recommendations.
Student Goals
The following are the Student Goals for the unit:

  1. The student will be able to explain the purpose of validation studies.
  2. The student will be able to explain the concepts of conducting validation or job.
  3. The student will be able to plan an entire validation study.
  4. The student will be able to identify all requirements for a validation study.
  5. The student will be able to design a survey based on a qualification study.
  6. The student will be able to distribute a survey in order to gather data.
  7. The student will use the Findings, Interpretation and Recommendation format when conducting data analysis.
  8. The student will be able to write a validation study report to articulate the recommendation.
  9. The student will be able to present recommendations in an oral brief.
Essential Questions
  1. How are validation studies completed in a military context?
  2. What value does conducting a validation study provide to the IT&E system?
  3. How does a validation study impact a Qualification Standard board or other steps in the quality control process?
Culminating Unit Assessment
Students will be required to provide a written report and an oral presentation of their validation study recommendation. The written report needs to use the proper military writing format and structure. The oral brief should be direct and focused on providing only the pertinent information.
The Stages of the Unit
Stage 1 – Introduction to Program Validations
It is important for the learners to have a foundational understanding of validations and why validation studies are used in the CAF. They need to know that validations are the final cycle of the quality control process and are used in order to determine if the individual training program is meeting the operational requirements. Also, it is important for the learners to understand that validations are normally conducted 6-18 months after a training program has been completed.

Activity: Read CFITES Volume 8 (p. 1-5). Students will take note of the purpose of validations and the impact of conducting a validation study.

Assessment (formative): Guided Questions – Reflective blog post. Questions include: What is the purpose of validations and how will this impact your position? What are the positive aspects of conducting a validation study? What does “developing a supportive context” mean? Why is this important?
Stage 2 – Planning a Validation Study
Planning is a critical step in a validation study. Validation Study Plans need to be comprehensive and should be extremely detailed. The learner should understand the relationship requirements of a validation lead and the stakeholder. The learners will need to know the types of validation studies: Routine check, Comprehensive review, and Focused Review.

Activity: Read CFITES Volume 8 (p. 6-10) – students will be required to develop a blog post about the planning of a validation survey and will use the following guided questions: Why should you take a strategic approach when planning a validation study? Why is the relationship with the stakeholder an important element of a validation plan? When would you use each type of study? Explain why.

Assessment (formative): Plan a Validation – The students will be required to choose a training program to use for the planning of a validation. They will use a template to create their validation plan. Students will post the plan on their individual blogs.
Stage 3 – Designing Data Collection Instruments
The students will learn about designing data collection tools and the data collection methods that are most commonly used (questionnaires and interviews). The collection of data will be focused on the questionnaire and Interview methods. Also, the learner should be able to indicate the type of data including quantitative and qualitative data.

Activity: Read CFITES Volume 8 (p. 11-14) – students will be required to develop a blog post about the designing of a validation survey and will use the following guided questions: What are some advantages and disadvantages of using a survey? Explain. What are some additional methods of collecting data? What are the pros and cons of these methods? Explain

Assessment (formative): Building a Validation Survey – The students will be required to design a validation survey. They will be provided with a template to create their survey. Students will post the survey on their individual blogs.
Stage 4 – Analyze Validation Data
The key to the analysis of data is the organization of the data by defining the findings, interpretations. The findings and interpretations can be organized into themes which assist in the development of recommendations. The students will learn how to use the FIR Chart for Data Analysis.

Activity: Read CFITES Volume 8 (p. 15-22) – students will be required to develop a blog post about the analysis of validation data and will use the following guided questions: What are some challenges you expect to encounter when analyzing data? Explain. What are some additional resources you can use to assist in the interpretation and recommendation stages? Explain

Assessment (formative): Analyzing Validation Data – The learner will be required to develop Findings, Interpretations, and Recommendations Chart using a set of scenario survey data. Students will post the FIR Chart on their individual blogs.
Stage 5 – Report Recommendation
A recommendations report is the final step in the process. The students will learn how to articulate their study results in a written and oral report. The report includes Background, Aim, Scope, Methodology, Analysis, Conclusions, and Recommendations. Also, the learners will be exposed to both written and oral briefings on recommendations.

Assessment (summative): Reporting the results of a Validation Study – The students will have to report the recommendation of their validation study via a written report and an oral brief. Students will post both of their final assignments on their individual blogs.
Assessment
The Final Assessment – Reporting the Results of a Validation Study
Part 1 – Written Validation Report

The aim of the report is to express the recommendation of the validation study. The report should be thorough enough to paint a picture to the reader with regards to the entire study and results. The report should include the following sections: Background, Aim, Scope Methodology, Analysis, Conclusions, and Recommendations.

Part 2 – Oral Validation Presentation

The aim of the oral presentation is to present the results of the validation to an audience. The presentation should present the study and the results. The presentation should be direct and to the point. The presentation should include: Background, Aim, Scope, Analysis, Conclusions, and Recommendations. In your presentation, do not just read your report. Presentations should be recorded and uploaded to a video sharing site (ex. youtube) and a link should be added to the student blogs.