Wednesday, 18 September 2013

Evaluation - a template for post course evaluation to discuss

Hello and thank you in advance for your help and comments!

There was a lot of discussion about course evaluation at the CALMET conference and the Symposium.Many people kindly shared the templates they are using. I am also looking at this for our evaluation. Specifically for post course evaluation at the level of student feedback (kirkpatrick model level 1)

I would love you feedback and thoughts on this current template.

Here are two version of the template:


This is an open resource - feel free to use it.  

I also wonder if it would be useful to have a template that is generic for all of us to use? What do you think?



Most of the classroom courses I teach are one or two week long professional development courses. We try to have a classroom discussion to get narrative feedback from the students that usually helps to understand the feedback on the feedback form.

In preparing my template I used the The WMO guidelines for trainiers which  had some nice ideas/areas to consider:
Learning outcomes. Were the learning outcomes clearly defined and satisfied?
Length, structure and pace. Were the length, structure and pace of the learning event okay?
Content. Was it relevant? Were there omissions, or any unrelated material?
Learning methods and materials. Were the learning methods and materials suitable?
Trainer skills. Did the trainers have the required knowledge and skills?
Learning transfer. How much of the learning will be used in the workplace?
Facilities and domestic arrangements. Were these satisfactory?
Administrative arrangements. Did you get the information you needed?

If you wish you can post your own template in the comments so we can share what we all do.

And of course the real questions start when we think about levels 2, 3 and 4! ....

   

8 comments:

  1. Thanks for posting the evaluation template, Mark.
    I added a few little things there, that may be useful.

    ReplyDelete
  2. One thing that we use in our evaluation is selecting words that people think defined the course well. I borrowed the idea from the staff training evaluation sheets at the Uni. of Reading :)

    Not only does it give a simple selection to get feedback it also makes for good "wordles" that can be generated based on the percentage number of replies.
    www.wordle.net

    These are the words we use on our training course currently:
    interesting
    boring
    hard
    easy
    excellent
    good
    high quality
    average
    relevant
    applicable
    informative
    confusing
    learnt a lot
    too complex
    worthwhile

    ReplyDelete
  3. Whoops - missed a couple of words from the list as they don't get ticked!

    we also give the words:
    poor
    waste of time

    we try to balance the positive and negative comments...

    ReplyDelete
  4. Mark, this is very useful. I do think having a generic template is a great idea (one that can be adapted, of course). It is the single most requested resource I have been asked for since coming to WMO. In fact, for this reason I conducted a DL activity in our last train-the-trainer in Indonesia earlier this year. I will post my summary report here soon (which I just finished, actually).

    One thing in the summary you will see is the importance of considering what information you want/need to gather, but also that end-of-course evaluations are only one of many ways to get valuable input to help improve courses. You can also get valuable input from:

     Mid-course Questionnaires
     Discussion about the course (as you point out)
     Scheduled meetings with individual students
     During informal meetings at social events (lunch, dinner, field trips, coffee, etc.)
     During test reviews and feedback sessions (going over the test to explain how students did, what wasn't clear)
     Exercise performance results
     Classroom discussions to see how well students are understanding
     Frequent quizzes, problems, and questions to gauge learning
     Designated student representatives (ombudsmen)

    Also, students are not the only people to get feedback from. Also consider supervisors, others they work with, students who decide to drop a course, and your project team of facilitators, instructors, observers, developers, etc

    ReplyDelete
  5. FYI: The summary of the exercise we did on course evaluations, which contains some additional ideas for end-of-course evaluations, can now be found in the CALMet Commons Resources as "Gathering Course Feedback Summary.pdf"

    ReplyDelete
  6. I made some changes - what do you think?

    I really like Sarah's ideas - I think I would use them in an open discussion afterwards with people "voting" using sticky dots or pen marks

    ReplyDelete
  7. Ian Bell was here last week and has shared with me the Kirkpatrick Website, which has some really great examples of course evaluations, at several levels, and including follow-up evaluation. Go to http://www.kirkpatrickpartners.com/Blog/tabid/135/ID/331/Maximize-Your-Program-Outcomes-with-a-Training-Evaluation-Sonar-Plan--Part-4.aspx and select the "Hybrid Evaluation Tool" under Sample Routine Training Evaluation Plan. Really good ideas!

    ReplyDelete
  8. We have adopted much of what was discussed here in the form for our classroom evaluation at EUMETSAT. We also have an open discussion with the participants so the form is not the only source of data.

    Here is a link so you can try it if you wish https://docs.google.com/forms/d/1H4HYrpzgBLhZkZeFi2SVizlIMnVFbXA1IQXu7NUVAsA/viewform

    Mark

    ReplyDelete

Note: only a member of this blog may post a comment.