Thursday, 29 October 2015

What Determines Quality in Training?

A workshop on identifying quality criteria was offered at the CALMet Conference, September, 2015, in Seoul, Korea. The participants were presented with this scenario: You are reviewing a training announcement from an unknown provider in a topic area you are interested in, but you would like to know about the potential quality from a reading of the announcement before investigating further.
Participants were asked to work in small groups to develop criteria within three areas: Organizational, Processes, Product. They were also asked to assign priorities to the criteria as time allowed.

The resulting draft criteria lists compiled from their decisions was then compared to a previously prepared draft list of criteria, which was developed from a review of several existing quality management systems for educational resources. These included ISO/IEC 19796, ISO 29990, Open ECBCheck (for eLearning courses), EFQUEL (for eLearning programmes), Commonwealth of Learning (UNESCO), and the WMO Competency Requirements for Education and Training Providers. Approximately 6 additional systems were examined.

New suggestions for criteria from the workshop were added or merged with the existing ones.

What came out on the top? See the list below, as well as the more complete report. Many more important criteria are contained there, as well as a discussion of the results.

Organizational

•How trainers are hired, trained, and evaluated
•Existing accreditation that covers vocational training, or existing quality assurance processes
•Numbers, roles, and qualifications of training staff members (including access to content expertise)
•Location/country, accessibility (including online presence)
•Facilities, resources, and technology infrastructure

Processes

•how learning outcomes are specified and how they inform the training content and activities
•Good development and delivery processes, documentation of processes, ISO certification (if used)
•How learning needs are determined
•how training is evaluated and improved

Products (including both courses and resources)

•currency of the content (up to date)
•learning activities match learning outcomes, opportunities for students to apply what they learn
•the relevance of course content to job competencies
•assessment methods, matched to learning outcomes
•performance-based learning outcomes
•Timing of courses (Duration and scheduling)
•the results of past evaluations of this course or resource (or related ones), student recommendations


Conclusion

Thanks to those who participated in developing these draft criteria!

As work continues to decide how quality information might be shared, in a WMO Global Campus Shared Calendar and future learning resource Registry, for example, the discussions to date should provide some useful input. But they also raise several issues for further debate.

•How does accreditation relate to quality assurance of vocation training and individual courses and resources? Is additional QA still useful?
•Does ISO 29990 certification cover the required criteria? Is more quality information required for specific resources and courses?
•How can we apply quality standards that are inclusive of many types of training centers and units?
•Is QA information voluntary, or mandatory? How will it be communicated?

Sunday, 4 October 2015

CALMet Online World Café

Roro Yuliana Purwanti and Vesa Nietosvaara

Inspired by the coffee and café tradition in the Korean culture, CALMet Online planning workshop was conducted using the World Café Method. Our goal was to gain new ideas and approaches for successful CALMet Online events in the future.

We started with a 5 minute presentation about previous CALMet Online events, shared a warm welcome and introduced participants to the World Café process and rules (called “café etiquette”). According to the etiquette, each participant chooses the table they would love to sit for the first round. Four different tables were available for participants to sit and discuss the given topic. After 15 minutes, the bell rings and participants move to the other table, change groups and discuss the next topic. Result of the previous topic are left visible on the table, as a reference for the new group.

In the first round, we asked the participant “Do we need CALMet Online? Why? To what purpose”. As a result of the discussion the participants agreed that CALMet Online is still needed, as a forum to meet and share ideas and innovations, as well as to keep communication and collaboration within community. 


In the second round,the participants worked further on “What components in CALMet Online need improvement”. They explored the existing components of each CALMet Online, and identified which components should be improved.

In the third round, the participants were encouraged to imagine “How the future CALMet Online could look like? What other approach can be used?” In response with this topic, beside provided some new approaches on schedule and activities, participants also came up with ideas in technology and communication, such as using more social media and possibility of using mobile device applications. 

In the last round, participants were still sitting in a group, but they now needed to work individually on topic “What can you do to make the next CALMet Online a success?” Their task was to fill in the blank individual worksheet with their advice, feedback and suggestions for success for the next event. They discussed also within the groups.

After the 4th round finished, we asked participants to voluntarily tell us about what had been happening in their tables. They made nice summary that we captured and noted as a reference for further CALMet Online event planning.  Some of them also shared their commitment to contribute in the next events from planning to implementation and evaluation, as response to the last topic. We also had some fresh ideas and initiatives written in their A3 group worksheets.

From facilitator’s perspective, we are happy that the workshop reached its goal of having contributions from CALMet community for the early stages of planning. Fifteen minutes was ideal for each round, because participants needed the first 5 minutes to adapt with the new group and another 10 minutes was suitable to produce some discussion results.

Overall, indicated by some contributions we had for the next events, we can say that the workshop conducted smoothly and helpful for us when planning CALMet Online 2016. More about the World Café method, see http://www.theworldcafe.com/