Hello and thank you in advance for your help and comments!
There was a lot of discussion about course evaluation at the CALMET conference and the Symposium.Many people kindly shared the templates they are using. I am also looking at this for our evaluation. Specifically for post course evaluation at the level of student feedback (kirkpatrick model level 1)
I would love you feedback and thoughts on this current template.
Here are two version of the template:
This is an open resource - feel free to use it.
I also wonder if it would be useful to have a template that is generic for all of us to use? What do you think?
Most of the classroom courses I teach are one or two week long professional development courses. We try to have a classroom discussion to get narrative feedback from the students that usually helps to understand the feedback on the feedback form.
In preparing my template I used the The WMO guidelines for trainiers which had some nice ideas/areas to consider:
Learning outcomes. Were the learning outcomes clearly defined and satisfied?
Learning transfer. How much of the learning will be used in the workplace?
Facilities and domestic arrangements. Were these satisfactory?
Administrative arrangements. Did you get the information you needed?
If you wish you can post your own template in the comments so we can share what we all do.
And of course the real questions start when we think about levels 2, 3 and 4! ....
There was a lot of discussion about course evaluation at the CALMET conference and the Symposium.Many people kindly shared the templates they are using. I am also looking at this for our evaluation. Specifically for post course evaluation at the level of student feedback (kirkpatrick model level 1)
I would love you feedback and thoughts on this current template.
Here are two version of the template:
- This is the current version - do you have any thoughts on how it can be better
- This is a version that can be edited by all of us - do add comments!
This is an open resource - feel free to use it.
I also wonder if it would be useful to have a template that is generic for all of us to use? What do you think?
Most of the classroom courses I teach are one or two week long professional development courses. We try to have a classroom discussion to get narrative feedback from the students that usually helps to understand the feedback on the feedback form.
In preparing my template I used the The WMO guidelines for trainiers which had some nice ideas/areas to consider:
Learning outcomes. Were the learning outcomes clearly defined and satisfied?
Length, structure and pace. Were the length, structure and pace of the learning event okay?
Content. Was it relevant? Were there omissions, or any unrelated material?
Learning methods and materials. Were the learning methods and materials suitable?
Trainer skills. Did the trainers have the required knowledge and skills?Learning methods and materials. Were the learning methods and materials suitable?
Learning transfer. How much of the learning will be used in the workplace?
Facilities and domestic arrangements. Were these satisfactory?
Administrative arrangements. Did you get the information you needed?
If you wish you can post your own template in the comments so we can share what we all do.
And of course the real questions start when we think about levels 2, 3 and 4! ....
Thanks for posting the evaluation template, Mark.
ReplyDeleteI added a few little things there, that may be useful.
One thing that we use in our evaluation is selecting words that people think defined the course well. I borrowed the idea from the staff training evaluation sheets at the Uni. of Reading :)
ReplyDeleteNot only does it give a simple selection to get feedback it also makes for good "wordles" that can be generated based on the percentage number of replies.
www.wordle.net
These are the words we use on our training course currently:
interesting
boring
hard
easy
excellent
good
high quality
average
relevant
applicable
informative
confusing
learnt a lot
too complex
worthwhile
Whoops - missed a couple of words from the list as they don't get ticked!
ReplyDeletewe also give the words:
poor
waste of time
we try to balance the positive and negative comments...
Mark, this is very useful. I do think having a generic template is a great idea (one that can be adapted, of course). It is the single most requested resource I have been asked for since coming to WMO. In fact, for this reason I conducted a DL activity in our last train-the-trainer in Indonesia earlier this year. I will post my summary report here soon (which I just finished, actually).
ReplyDeleteOne thing in the summary you will see is the importance of considering what information you want/need to gather, but also that end-of-course evaluations are only one of many ways to get valuable input to help improve courses. You can also get valuable input from:
Mid-course Questionnaires
Discussion about the course (as you point out)
Scheduled meetings with individual students
During informal meetings at social events (lunch, dinner, field trips, coffee, etc.)
During test reviews and feedback sessions (going over the test to explain how students did, what wasn't clear)
Exercise performance results
Classroom discussions to see how well students are understanding
Frequent quizzes, problems, and questions to gauge learning
Designated student representatives (ombudsmen)
Also, students are not the only people to get feedback from. Also consider supervisors, others they work with, students who decide to drop a course, and your project team of facilitators, instructors, observers, developers, etc
FYI: The summary of the exercise we did on course evaluations, which contains some additional ideas for end-of-course evaluations, can now be found in the CALMet Commons Resources as "Gathering Course Feedback Summary.pdf"
ReplyDeleteI made some changes - what do you think?
ReplyDeleteI really like Sarah's ideas - I think I would use them in an open discussion afterwards with people "voting" using sticky dots or pen marks
Ian Bell was here last week and has shared with me the Kirkpatrick Website, which has some really great examples of course evaluations, at several levels, and including follow-up evaluation. Go to http://www.kirkpatrickpartners.com/Blog/tabid/135/ID/331/Maximize-Your-Program-Outcomes-with-a-Training-Evaluation-Sonar-Plan--Part-4.aspx and select the "Hybrid Evaluation Tool" under Sample Routine Training Evaluation Plan. Really good ideas!
ReplyDeleteWe have adopted much of what was discussed here in the form for our classroom evaluation at EUMETSAT. We also have an open discussion with the participants so the form is not the only source of data.
ReplyDeleteHere is a link so you can try it if you wish https://docs.google.com/forms/d/1H4HYrpzgBLhZkZeFi2SVizlIMnVFbXA1IQXu7NUVAsA/viewform
Mark