Instruction:204c2375-0867-4302-845f-cdc99e3d38bc

Instructions

Select your Target Audience and the Related Appropriate Effectiveness Measurement Tools

Instructions for:TraineeTrainer

Related Initiative

BEYOND

Goal

This module will help you to tailor the research integrity trainings you will give to your audience, and to measure their effectiveness.

Duration (hours)

2

For whom is this important?

Research Ethics CommitteesResearch integrity trainers

Part of

BEYOND

Steps

Steps

1Secondary School Students

2Bachelor and Master Students

3Doctoral Students and Early Career Researchers

4Research Ethics and Integrity Experts

5Training Materials for Professors and Senior Academics

What is this about?

In this module you will find examples of training materials on research ethics and integrity that can be used to train at specific career stages. In the following we introduce a collection of trainings developed by EU-funded initiatives and indicate, which trainings or parts of them are suitable for 1) secondary schools, 2) bachelor and master students, 3) PhD students and early career researchers, 4) academics and experts in research ethics and integrity, and 5) supervisors. Although we have categorised the training materials by career stage, we recommend that trainers and teachers define the needs and skill level of the group to be trained before selecting the material to be used. This is because career stage often does not reflect the level of skills and competences in terms of research ethics and integrity. The following training resources have been developed by EU-funded initiatives namely: PRINTEGER, ENERI, RID-SSISS, EnTIRE, VIRT2UE, Path2Integrity, INTEGRITY, BRIDGE and ROSiE.

All the training resources presented in this module provide examples of training materials to promote RE/RI and prevent research misconduct from the perspective of individual and institutional responsibilities. Active learning, like case studies, engages learners and helps connect content to real ethical dilemmas. Reflection helps learners explore personal values, making ethical principles and theories more meaningful and guiding individual growth. Role-playing and simulations offer experiential insights, allowing learners to practice decision-making in a safe environment, fostering empathy and ethical confidence. A culturally sensitive approach prepares learners for global collaboration by recognizing diverse ethical norms. Lastly, continuous assessment and constructive feedback reinforce learning, enabling learners to apply ethical principles thoughtfully in real-life scenarios, supporting long-term commitment to research integrity.

Moreover, for each target group this module recommends specific tools and methods to measure the short-, medium- and long-term impact of RE/RI trainings (presented below). While materials and resources have been developed for RE/RI training, they may not always include a plan for the assessment of learning or suggestions on how information about learning can be used as an indicator of training effect.

The same training material presented below are also more extensively presented in MODULE x divided by type of training activity and by the specific EU project responsible for its development. This alternative categorization allows for a more tailored approach, enabling users to quickly identify relevant resources that align with their needs, when they already know what training approaches they wish to use, or seeking further guidance related to using specific teaching approaches rather than seeking resources for a specific target group. By connecting each piece of training material to its originating EU project, we can highlight the distinct contributions of each initiative, showcasing their unique approaches to training.

1

Secondary School Students

The aim of educating secondary school students is to raise their awareness of the ethical and integrity challenges they may face.

Resources for secondary school students include (please see Module x for a more elaborate description and overview of materials divided by topics and target groups):

• The Integrity Teacher Guide for secondary school students' education.
• The Path2integrity Learning cards (Path2Integrity learning cards S) focusing on students in high schools, and a dedicated handbook (S-Series handbook).
• For training effectiveness measurement facilitators can use the following tools for learning output collection and for analysing collected material:

Tool for collecting learning outputs	Details	Analysis instrument **
ProLearning app	ProLearning: www.prolearning.realto.ch	learning analytics
Engagement app	ForgetNot (by EduLog): https://web.htk.tlu.ee/forgetnot	learning analytics
Self-Reflection Form/Compass	App under development, form * (for copying and editing)	SOLO taxonomy, reflection levels, content criteria
Pre-post texts	Collect a short text (e.g. a response to a case or short essay) before the training and after the training	SOLO taxonomy, reflection levels, content criteria
Learning diaries	Ask learners keep a diary over a certain period, for each submission provide some guiding questions or topics	SOLO taxonomy, reflection levels, content criteria
Group reports	Ask groups working together to provide a (short) group report (or provide a template with points to work on)	SOLO taxonomy, content criteria
Group discussions	Monitor the group discussions to evaluate the level of understanding and content discussed (scaffold as appropriate)	SOLO taxonomy, content criteria
Group dynamics	CoTrack application: https://www.cotrack.website/en/	learning analytics
Retention check	After a certain time (few weeks/months) ask learners to provide a short text (analysis of a case, short essay on an ethics topic/question). Compare the levels of understanding to another piece collected during or right after the training.	SOLO taxonomy, content criteria

For instance, to measure participants’ reactions during or right after the training, ProLearning app or Self-Reflection Form can be used. In addition, if learners worked in groups and provided a group-report, the learning process can be evaluated based on the SOLO taxonomy to measure the levels of understanding. Moreover, if possible, a couple of months after the training an additional case study could be given to the same learners, and the content of their analysis could again be evaluated with the SOLO taxonomy. This kind of effectiveness measure would give a possibility to triangulate the measurement in different time points.

2

Bachelor and Master Students

The aim of training students in research ethics and integrity is to promote an understanding of ethical principles and practices in research. This includes exploring aspects of honesty, transparency, objectivity and accountability. Although at these levels, students are marginally involved in doing research, it is important to equip them with the knowledge and skills to conduct research responsibly, avoid misconduct such as plagiarism or falsification, comply with relevant regulations and guidelines, and uphold the integrity of the scientific community.

Resources for Bachelor and master students include (please see Module x for a more elaborate description and overview of materials divided by topics and target groups):

• The introductory module, of the Upright training developed by the PRINTEGER
• The e-learning modules on research integrity, virtue ethics relevant for RI and the a series of introductory videos produced by the VIRT2UE.The Modified Dilemma Game developed by the VIRT2UE project presents a modified version of the Dilemma Game developed by Erasmus University Rotterdam.
• The introductory videos and information on the teaching methodology used, discussing research integrity and its significance developed by the Path2Integrity Training Programme the series of learning cards (Path2Integrity learning cards S) focusing on bachelor students, alongside a dedicated handbook (S-Series handbook), and a series of learning cards (Path2Integrity learning cards M) focusing on bachelor students, alongside a dedicated handbook (M-Series handbook).
• The Upright training modules focusing specifically on RE and/or RI issues
• The RID-SSISS training Foundation level focuses on developing (but also helping learners to recall) central concepts of RE/RI
• The BRIDGE project training modules and vignettes
• The INTEGRITY project training tool for undergraduate.
• The BRIDGE project online games, board games, role-play games and scenarios game can be found here.

Trainers can select one or more of the following tools for evaluating training effectiveness for bachelor and master students.

Table 5: Tools for evaluating training effectiveness for bachelor and master students

Tool for collecting learning outputs	Details	Analysis instrument **
ProLearning app	ProLearning: www.prolearning.realto.ch	learning analytics
Engagement app	ForgetNot (by EduLog): https://web.htk.tlu.ee/forgetnot	learning analytics
Self-Reflection Form/Compass	App under development, form * (for copying and editing)	SOLO taxonomy, reflection levels, content criteria
Pre-post texts	Collect a short text (e.g. a response to a case or short essay) before the training and after the training	SOLO taxonomy, reflection levels, content criteria
Learning diaries	Ask learners keep a diary over a certain period, for each submission provide some guiding questions or topics	SOLO taxonomy, reflection levels, content criteria
Group reports	Ask groups working together to provide a (short) group report (or provide a template with points to work on)	SOLO taxonomy, content criteria
Group discussions	Monitor the group discussions to evaluate the level of understanding and content discussed (scaffold as appropriate)	SOLO taxonomy, content criteria
Group dynamics	CoTrack application: https://www.cotrack.website/en/	learning analytics
Online learning platform	Make use of accumulated authentic learning outputs in the learning platform	statistics, SOLO taxonomy, reflection scale, content criteria
Domain-specific/ domain-transcending measure	Use either of the two forms (WP4.2) measuring recognition and exemplifying of ethical issues	statistics, SOLO taxonomy, content criteria
Retention check	After a certain time (few weeks/months) ask learners to provide a short text (analysis of a case, short essay on an ethics topic/question). Compare the levels of understanding to another piece collected during or right after the training.[IG(1] [IG(2]	SOLO taxonomy, content criteria

* The Self-Reflection Form link enables the facilitator to make a copy of the form, which they can then edit and the data will accumulate on the facilitator’s cloud service (Google or Microsoft).

** Analysis instruments are described in WP4.2, later available at the Embassy’s website.

3

Doctoral Students and Early Career Researchers

The goal in training students and PhD candidates in RE/RI is to support ever-deepening understanding of ethical principles and practices in research. This includes exploring aspects of honesty, transparency, objectivity and accountability at all stages of the research process, from conception to dissemination of results. The goal is to equip students with the knowledge and skills to conduct research responsibly, avoid misconduct such as plagiarism or falsification, comply with relevant regulations and guidelines, and uphold the integrity of the scientific community.

Although these examples can be used to train students and PhD candidates, they can be used in training more senior profiles to brush up competencies on the topic.

Resources for PhD candidates include (please see Module x for a more elaborate description and overview of materials divided by topics and target groups):

• The introductory module, the modules focusing specific RE and/or RI issues anf the dilemmas (With a little help, Mutual favours, Sharing data, So close, Different results, Put your supervisor first, Flexible scope, Outliers, and Invalid data) developed for the Upright training by PRINTEGER.
• The e-learning modules on research integrity, virtue ethics relevant for RI, virtue ethics under current research conditions and the a series of introductory videos produced by the VIRT2UE. The Modified Dilemma Game developed by the VIRT2UE project.
• The introductory videos and information on the teaching methodology and the learning cards (Path2Integrity learning cards Y) focusing on doctoral students, alongside a dedicated handbook (Y-Series handbook) developed by Path2Integrity Training Programme
• The RID-SSISS training materials for ECRs and junior academics (advanced level).
• The BRIDGE project provides training modules and vignettes that can be inserted into research ethics and integrity courses.
• The modules and a full interactive training developed by the INTEGRITY project.
• The scenarios produced by EnTIRE for The Embassy of Good Science (Research Procedures and Research Integrity; Collaborative Working Between Academia and Industry; Data Practices, Data Management and FAIR Principles; Publication, Dissemination and Research Integrity; Research Environments and Research Integrity; Reviewing, Evaluating, Editing and Research Integrity; Training, Supervision and Mentoring with Integrity; Safeguards, Data-sharing and the Disclosure of Sensitive Results).

Trainers can select one or more of the following tools for evaluating training effectiveness for PhD candidates and early career researchers:

Table 6: BEYOND Tools for evaluating training effectiveness for early-career researchers

Tool for collecting learning outputs	Details	Analysis instrument **
Self-Reflection Form/Compass	App under development, form * (for copying and editing)	SOLO taxonomy, reflection levels, content criteria
Pre-post texts	Collect a short text (e.g. a response to a case or short essay) before the training and after the training	SOLO taxonomy, reflection levels, content criteria
Learning diaries	Ask learners keep a diary over a certain period, for each submission provide some guiding questions or topics	SOLO taxonomy, reflection levels, content criteria
Group reports	Ask groups working together to provide a (short) group report (or provide a template with points to work on)	SOLO taxonomy, content criteria
Group discussions	Monitor the group discussions to evaluate the level of understanding and content discussed (scaffold as appropriate)	SOLO taxonomy, content criteria
Group dynamics	CoTrack application: https://www.cotrack.website/en/	learning analytics
Online learning platform	Make use of accumulated authentic learning outputs in the learning platform.	statistics, SOLO taxonomy, reflection scale, content criteria
Domain-specific/ domain-transcending measure	Use either of the two forms (WP4.2) measuring recognition and exemplifying of ethical issues.	statistics, SOLO taxonomy, content criteria
Retention check	After a certain time (few weeks/months) ask learners to provide a short text (analysis of a case, short essay on an ethics topic/question). Compare the levels of understanding to another piece collected during or right after the training.	SOLO taxonomy, content criteria
Vignettes	This can be used for measuring ethical sensitivity in (non-)training context	statistics, EASM (based on the SOLO taxonomy), content criteria
National surveys	Can be used for analysing training-related content in reports and monitoring the display of REI leadership.	statistics, REI leadership framework

* The Self-Reflection Form link enables the facilitator to make a copy of the form, which they can then edit, and the data will accumulate on the facilitator’s cloud service (Google or Microsoft).

** Analysis instruments are described in WP4.2, later available at the Embassy’s website.

4

Research Ethics and Integrity Experts

Resources for research ethics and integrity experts include (please see Module x for a more elaborate description and overview of materials divided by topics and target groups):

• The ENERI Classroom material exploring research integrity, research ethics,  Comprehensive and overlapping issues and the development of proper infrastructure relevant for academics, and research ethics and integrity experts.
• The dilemmas developed by the Upright training (With a little help, Mutual favours, Sharing data, So close, Different results, Put your supervisor first, Flexible scope, Outliers, and Invalid data)  
• The scenarios produced by EnTIRE for The Embassy of Good Science s Research Procedures and Research Integrity; Collaborative Working Between Academia and Industry; Data Practices, Data Management and FAIR Principles; Publication, Dissemination and Research Integrity; Research Environments and Research Integrity; Reviewing, Evaluating, Editing and Research Integrity; Training, Supervision and Mentoring with Integrity; Safeguards, Data-sharing and the Disclosure of Sensitive Results.

5

Training Materials for Professors and Senior Academics

When training professors, trainers, mentors, and supervisors in research integrity, the aim is to equip them with the knowledge, skills, and resources to effectively train, mentor and guide their students and junior colleagues in conducting research with integrity.

Resources for professors and senior academics include (please see Module x for a more elaborate description and overview of materials divided by topics and target groups):

• The VIRT2UE train the trainer course on research integrity and the training module introducing supervision and mentorship practices.
• The training materials to foster mentorship and supervision developed by INTEGRITY.
• The training for supervisors and leaders (leadership level) developed by the RID-SSISS project.
• The module for supervisors developed by BRIDGE project.

Trainers can select one or more of the following tools for evaluating training effectiveness for PhD candidates and early career researchers:

Table 7: BEYOND Tools for evaluating training effectiveness for academics and experts

Tool for collecting learning outputs	Details	Analysis instrument **
Self-Reflection Form/Compass	App under development, form * (for copying and editing)	SOLO taxonomy, reflection levels, content criteria
Pre-post texts	Collect a short text (e.g. a response to a case or short essay) before the training and after the training	SOLO taxonomy, reflection levels, content criteria
Learning diaries	Ask learners keep a diary over a certain period, for each submission provide some guiding questions or topics	SOLO taxonomy, reflection levels, content criteria
Group reports	Ask groups working together to provide a (short) group report (or provide a template with points to work on)	SOLO taxonomy, content criteria
Group discussions	Monitor the group discussions to evaluate the level of understanding and content discussed (scaffold as appropriate)	SOLO taxonomy, content criteria
Retention check	After a certain time (few weeks/months) ask learners to provide a short text (analysis of a case, short essay on an ethics topic/question). Compare the levels of understanding to another piece collected during or right after the training.	SOLO taxonomy, content criteria
Vignettes	This can be used for measuring ethical sensitivity in (non-)training context.	statistics, EASM (based on the SOLO taxonomy), content criteria
National surveys	Can be used for analysing training-related content in reports and monitoring the display of REI leadership.	statistics, REI leadership framework

* The Self-Reflection Form link enables the facilitator to make a copy of the form, which they can then edit, and the data will accumulate on the facilitator’s cloud service (Google or Microsoft).

** Analysis instruments are described in WP4.2, later available at the Embassy’s website.

Other information