Beyond Measurement toolbox Related project

Modules

Beyond Measurement toolbox Related project

Instructions for:TraineeTrainer

Related Initiative

BEYOND

Goal

Gain a comprehensive understanding of how to evaluate the effectiveness of Research Ethics and Integrity (REI) training through diverse, practical measurement tools and approaches that assess learning outcomes, feasibility, and long-term impact across different contexts.

Duration (hours)

2

For whom is this important?

Prospective Research Integrity TrainersResearch Ethics CommitteesResearch integrity trainersSenior researchers, Supervisors

Part of

BEYOND

Steps

1Understanding Current Knowledge on Measuring Training Effectiveness

2Recognising Challenges in Assessing Training Effectiveness

3Considering the Systemic Nature of REI Training Effectiveness

4Getting familiar with the terminology used in the toolbox

5Summary of Tools Described

6Reflecting on the toolbox and its possible use

What is this about?

We may start with a simple question: why measure research ethics and integrity (REI) training effectiveness? To teachers this may sound like a strange question as this is one of the main things teachers need to do – making a conclusion if the learners are learning, improving, developing. Watts et al. (2017) also highlight that occasionally various authorities require evidence of people improving their knowledge and skills as a result of a training.

Measuring the effectiveness of training is like conducting research – there should be a guiding question (e.g. What do participants learn, and how is that related to what they are meant to learn through the training? How do learning activities encourage engagement and learning?), then there should be a tool to collect information and a means to analyse the information. Finally, results should be interpreted, and one can make a conclusion about whether the training achieves its aims.

The BEYOND Measurement toolbox introduced in this module gives an overview of large-scale as well as small-scale feasible measurement instruments on short, medium and long-term training effects adapted to the needs of a variety of target groups and different fields/domains. We understand the measurement of training effect through the learning achieved and displayed as a result of participation in training. This means that the learning is always relative to the goals of the training. The examples of how to understand the learning taking place in REI training may be good for certain types of training and contexts, whereas in others they may not be feasible. Because training, its learning objectives and the pedagogical approaches vary, we have aimed to present a broad array of measurements and other means of evaluating the learning that takes place.

Tools include a variety of examples ranging from self-evaluation instruments to pre-post-texts, to physiological markers to the use of authentic learning activities, from individual measurement to group learning, from micro to macro level. We have not restricted this exploration and analysis to include strictly means of measurement in a quantitative sense of the word but have also included qualitative indicators of the worth or success of training.

Why is this important?

We may even argue that it is unethical to provide poor quality training. Thus, it is imperative to provide training that benefits both researchers and institutions and contributes to building the culture of integrity.

Remarks

Authors: Erika Löfström, Anu Tammeleht, Simo Kyllönen,

This course was produced on behalf of the BEYOND project. The BEYOND project was finded by the European Union uder the grat agreement n. 101094714

Steps

Other information

Who

• This course was produced on behalf of the BEYOND project. The BEYOND project was finded by the European Union uder the grat agreement n. 101094714