What are clear measures?

When selecting or developing measures for evaluation three questions always have to be answered:

• What is to be measured?
• How will it be measured?
• Who will complete the measure?

You need to identify the impact of e-Learning on individuals and the organisation. In the Kirkpatrick model of evaluation this is Level 4 of evaluation. It takes time before the true impact can be identified. It is important that a realistic timeframe is planned for this level of evaluation to take place. You will not be able to evaluate the impact of e-Learning overnight.

Improvements in patient care for example may become obvious because of a reduction in complaints or an increase in letters of thanks. The question that needs to be asked and answered is – can you truly prove that this is as a result of the e-Learning? It could be that there are other events happening at the same time that have also had an impact. If the menus had been changed and these were more appealing to patients’ tastes, this would have an effect on how they perceived their overall stay in hospital.

How do you evaluate the impact of e-Learning?

To achieve a totally rounded evaluation you should ensure that your evaluation focuses on all four levels of evaluation not just initial reaction. Methods used should be user friendly. The easier that they are to use the likelier you are to receive responses.

You will need to identify methods of evaluation that do not rely entirely on learner responses.

• What other information is available that will identify the impact of e-Learning?
• How has it affected patient care?
• Can you find evidence of an improvement in performance?

Related Resources

•  
  Kirkpatrick model of evaluation in the Toolkit
  

  A summary of the four levels of the Kirkpatrick model of evaluation in the e-Learning Readiness Toolkit.

  page_82.html