View source for Instruction:1c5bdda7-6444-497b-aaf2-53852a0fd8ee

{{Instruction
|Title=Introduction to the BEYOND trainer guide
|Has Related Initiative=Initiative:667449ef-1c0a-4e06-8374-830c8ad68cb8
|Instruction Goal=This module introduces the content and '''approach''' of the BEYOND training guide and provides guidance for developing '''learning goals''' and '''evaluation''' strategies.
|Has Duration=1
|Important For=Research Ethics Committees; Research integrity trainers
}}
{{Custom TabContent Trainee Open}}
{{Instruction Steps Foldout Trainee}}
{{Instruction Perspective Trainee}}
{{Instruction Remarks Trainee}}
{{Custom TabContent Close Trainee}}
{{Custom TabContent Trainer Open}}
{{Instruction Steps Foldout Trainer}}
{{Instruction Perspective Trainer
|Is About=The BEYOND Trainer Guide serves as a comprehensive resource for educators seeking to equip and support researchers and research communities with the knowledge, skills, and attitudes necessary to conduct research ethically and with integrity. By fostering critical reflection, ethical decision-making, and responsible behaviour, educators play a critical role in training the next generation of researchers who are committed to the highest ethical standards in their work.

The BEYOND Trainer Guide provides a research-based overview of state-of-the art in teaching research ethics and integrity. According to the extant knowledge base, case-based and collaborative teaching and learning activities, which make use of scaffolding techniques are the best ways to support learning in the context of research ethics and integrity.

This guide provides guidance on how to effectively design teaching activities to foster responsible conduct of research to different target groups, such as students, early career researchers, experienced researchers and supervisors. It draws on prior research on teaching and learning research ethics and integrity and makes use of the vast training resources produced through selected EU-funded projects targeting ethics and integrity. It is a comprehensive resource equipped to empower trainers in delivering impactful training sessions. Trainers can adapt and personalize it based on their specific audience, training context, and personal style. But its core purpose remains clear: to equip trainers with the knowledge, strategies, and resources needed to deliver engaging, informative, and ultimately impactful training sessions. by bringing together research-based knowledge about research ethics and integrity teaching and learning, trainings produced in several EU-funded projects, and templates and activities for adapting materials to various target groups.
|Important Because=Teaching research ethics and research integrity is incredibly important for several key reasons including fostering important skills such as critical thinking, problem-solving, and effective communication (ALLEA, 2023; Resnik & Shamoo, 2011; Science Europe, 2016). These skills are valuable not only for researchers but also for individuals in various professions and aspects of life.
}}
{{Instruction Step Trainer
|Instruction Step Title=Learn about the approach of this guide
|Instruction Step Text=The BEYOND approach - ‘it’s not the apple, but the orchard’ - reflects the dea that integrity is upheld as a collaborative effort. This is why it is important that training also models the collaborative way. Cases have the capacity to open up discussion space for the complexities of integrity and ethics in research, again, guiding learners to think of the full complexity, not just individuals, but also other systemic levels, including meso and macro levels, that is organisation, research community, and national, international and global context. Scaffolding provides a technique acknowledging where the individual or even a team or research community is at and designing the next steps to facilitate learning and development eventually leading to better alignment with the highest ethical and integrity standards. The point of departure is that there is always room for improvement, even in the strongest of research communities and the work starts with acknowledging status quo and identifying the next goals, which are within reach, irrespective of whether we envision the learning of individuals or communities. With these approaches; case-based and collaborative learning and scaffolding we believe training is well geared towards nurturing the orchard.

The BEYOND Trainer Guide goes beyond simply listing training materials; it adds value by explaining various pedagogical approaches that can be applied to enhance the use of different materials. It shows how learning taxonomies can be applied to create learning-focused training (as opposed to mere information transmission) irrespective of which materials produced in EU-funded projects that are implemented. We have structured the material according to target group, so that trainers can easily identify materials that are suitable for the target group they are training.

Additionally, the content is also structured according to the type of learning activities to support those trainers who wish to work using specific activities but may hesitate whether they are suitable for a particular target group, or simply would like to know more about the activity itself.

To summarise, the BEYOND approach is manifested in the Trainer Guide as:

-          A proposal for a research-based approach to an ‘orchard pedagogy’

-          Suggestions for measuring training effect to gain an indication of the preparedness of the research community to develop a culture of integrity

Facilitation for using existing RE/RI training resources by providing two alternative structures for trainers, including one, which addresses various actors in ‘the orchard’ through a career-level approach. We wish trainers and other readers, as well as learners taking part in trainings and learning activities utilising the resources referred to in the BEYOND Trainer Guide, a joyful journey through the orchard!
}}
{{Instruction Step Trainer
|Instruction Step Title=Reflect on the goals of RCR education
|Instruction Step Text=The ethical conduct of research is crucial for maintaining the integrity of science. [https://oir.nih.gov/sourcebook/ethical-conduct/responsible-conduct-research-training Responsible Conduct of Research] (RCR) advances scientific goals, fosters a collaborative research environment, and builds public trust in scientific advances that benefit society. Conversely, unethical research practices such as data fabrication and falsification lead to the dissemination of false hypotheses and unreliable data, which harms the search for valid knowledge. Similarly, plagiarism and harassment undermine respect and trust among researchers, while fraudulent or socially irresponsible research weakens public trust and support for science. [https://oir.nih.gov/sourcebook/ethical-conduct/responsible-conduct-research-training The goals of RCR training] include developing a culture of integrity in science and improving knowledge and awareness about the conduct of research.

RCR training and education should be continuous and extend beyond the academic programme throughout a scientist's career. This education can take place in a variety of contexts, such as seminars, workshops, conferences on research ethics and informal mentoring sessions, training courses and laboratory meetings where ethical behaviour and practises are discussed.

As described by van den Hoven and colleagues (2023), multiple factors influence research integrity (RI) training (learning objectives), RI learning (learning outcomes), and changes in RI behaviour (learning outcomes). Through these, it is possible to promote trustworthy science, responsible research practices, and high integrity/ethical standards.  "Training effects" Can be conceptualised through the (intended) impacts of RI training on various performance levels, including individual, institutional, and societal levels (van den Hoven et al., 2023). Furthermore, the authors distinguish among intended training effects (for example changes in behaviour); training input and output (that is training focus/content and learners orientating themselves towards this content); outcomes (that is, learners change their behaviour); and training impact (manifestation of the outcome, such as decreases in misconduct).

[https://nap.nationalacademies.org/read/21896/chapter/15 Effective education in research ethics and integrity aims to achieve several crucial goals.]Defining goals for teaching research integrity and research ethics is crucial to promote and foster responsible research practices and a trustworthy research ecosystem. The main goals to achieve in training RE/RI are related to promoting knowledge (in relation to responsible research practices, norms, and guidelines), skills (in relation to ethical decision-making, problem solving and critical thinking), ‘theoretical’ attitude (in relation to what should be done to foster responsible research) and ‘practical’ behaviour (in relation to how researchers behave in their daily practice) (Kalichman & Plemmons, 2007).
}}
{{Instruction Step Trainer
|Instruction Step Title=Reflect on evaluating effectiveness
|Instruction Step Text=The BEYOND Trainer Guide introduces effectiveness measures to help trainers assess whether the training provided is impactful and beneficial. The versatile evaluation tools (developed in WP4) are designed to be applicable to various target groups and compatible with a variety of training activities and resources. Such evaluation measures are often absent in training resources, yet they provide trainers with a valuable mechanism to ensure how effectively training supports learning. Understanding how training facilitates learning and development is necessary in the process of fostering and strengthening integrity in the research community. Provision of training is a necessary component of the overall building of a culture of integrity. Yet training, the effects of which are not monitored, falls short of its potential to mirror the change it contributes to the research community. Therefore, in the orchard approach, learning and development provides important information about the readiness of the community to build a culture of integrity. Evaluating training effectiveness to ensure training programs achieve their intended outcomes is crucial because it connects training investments to tangible results, ensuring that the effort put into developing and delivering training is worthwhile, and for pinpointing further development needs.

Effectiveness of research ethics and integrity (REI) training can be viewed  through an established effectiveness framework (Kirkpatrick, 1959, Praslova, 2010), which identifies four outcome domains, namely:

1.     reactions (participants’ self-assessment),

2.     learning (knowledge, content),

3.     behaviour (acting in the research community),

4.     results (e.g. institutional outcomes).

Evaluating development of ethical competencies should be determined through done as a system to get a more holistic picture. To do this, one can combine different forms of measurement, such as self-assessment and facilitator feedback as well as attitudes and behaviour treats (in tasks that display REI competencies in the research community, like research proposals, ethics sections of theses, articles, etc.). Furthermore, measurement could take place at different time points to gain insight into the learning process, learning outcome, and long-term implications, namely:

•   during the training (learning process),

•   right after the training – students' and facilitator’s self-reports,

•   later as part of another event or course where the display of REI competencies is expected (like RE section in theses and articles, research proposal, evaluation of RE situation in the department, etc.)

It is also important to consider what to do with the results, that is what kind of changes are necessary to improve teaching and/or the environment to build the culture of integrity.

Different tools can be used to collect various learning outputs and analysis instruments can be implemented to analyse the information that has been collected (Table 2) By analysis instruments we mean the taxonomies of learning and application of theoretical models, such as levels of reflection, ethical principles and so on (if data available are mainly in a qualitative format) or statistics and learning analytics (if the data are mainly in quantitative format).
{{{!}} class="wikitable"
{{!}}+Table 2: Tools and analytical instruments for collecting learning outputs in researchethics and integrity training
!Tool for collecting learning outputs
!Details
!Analysis instrument
{{!}}-
{{!}}'''''ProLearning'' app'''
{{!}}''ProLearning'': [http://www.prolearning.realto.ch/ www.prolearning.realto.ch] 
{{!}}learning analytics
{{!}}-
{{!}}'''Engagement app'''
{{!}}App under development, [https://forms.office.com/Pages/ShareFormPage.aspx?id=WXWumNwQiEKOLkWT5i_j7twYn7PlpvpDlgGDpz2LgIdUMk5XRTVYQTVKRFRDWDlHOUdGU1FHTUlFVi4u&sharetoken=03epmvYBRpmfXvpRg9os form] (for copying and editing)
{{!}}SOLO taxonomy, reflection levels, content criteria
{{!}}-
{{!}}'''Self-Reflection Form/Compass'''
{{!}}App under development, [https://forms.office.com/Pages/ShareFormPage.aspx?id=WXWumNwQiEKOLkWT5i_j7twYn7PlpvpDlgGDpz2LgIdUMk5XRTVYQTVKRFRDWDlHOUdGU1FHTUlFVi4u&sharetoken=03epmvYBRpmfXvpRg9os form] (for copying and editing)
{{!}}SOLO taxonomy, reflection levels, content criteria
{{!}}-
{{!}}'''Pre-post texts'''
{{!}}Collect a short text (e.g. a response to a case or short essay) before the training and after the training
{{!}}SOLO taxonomy, reflection levels, content criteria
{{!}}-
{{!}}'''Learning diaries'''
{{!}}Ask learners keep a diary over a certain period, for each submission provide some guiding questions or topics
{{!}}SOLO taxonomy, reflection levels, content criteria
{{!}}-
{{!}}'''Group reports'''
{{!}}Ask groups working together to provide a (short) group report (or provide a template with points to work on)
{{!}}SOLO taxonomy, content criteria
{{!}}-
{{!}}'''Group discussions'''
{{!}}Monitor the group discussions to evaluate the level of understanding and content discussed (scaffold as appropriate)
{{!}}SOLO taxonomy, content criteria
{{!}}-
{{!}}'''Group dynamics'''
{{!}}''CoTrack'' application: https://www.cotrack.website/en/
{{!}}learning analytics
{{!}}-
{{!}}'''Online learning platform'''
{{!}}Make use of accumulated authentic learning outputs in the learning platform.
{{!}}statistics, SOLO taxonomy, reflection scale, content criteria
{{!}}-
{{!}}'''Domain-specific/ domain-transcending measure'''
{{!}}Use either of the two forms (WP4.2) measuring recognition and exemplifying of ethical issues.
{{!}}statistics, SOLO taxonomy, content criteria
{{!}}-
{{!}}'''Retention check'''
{{!}}After a certain time (few weeks/months) ask learners to provide a short text (analysis of a case, short essay on an ethics topic/question). Compare the levels of understanding to another piece collected during or right after the training.
{{!}}SOLO taxonomy, content criteria
{{!}}-
{{!}}'''Vignettes'''
{{!}}This can be used for measuring ethical sensitivity in (non-)training context
{{!}}statistics, EASM (based on the SOLO taxonomy), content criteria
{{!}}-
{{!}}'''National surveys'''
{{!}}Can be used for analysing training-related content in reports and monitoring the display of REI leadership.
{{!}}statistics, REI leadership framework
{{!}}}
Evaluation tools can give further insight into the effectiveness of the training and materials proposed. This will help trainers to adjust training content and delivery methods to improve trainees’ learning experience and outcomes. We propose mixing various tools for collecting learning outputs and adjusting them to the intended target groups (thoughout the trainig guide suggestions are provided on which tools would be most suitable for various target groups).
}}
{{Instruction Remarks Trainer}}
{{Custom TabContent Close Trainer}}
{{Related To
|Related To Instruction=Instruction:4afd5ea7-0308-4e80-9dfc-6b66daf2ac81; Instruction:Eeee007a-14ec-4ffa-b62e-514aafe4bd1a; Instruction:204c2375-0867-4302-845f-cdc99e3d38bc; Instruction:44eb9553-4c0a-40c9-9ed1-50b4f591e3fb; Instruction:30f33e85-09ed-4ea7-9ac2-7fb26d27ae55; Instruction:02a025d1-fb65-40b4-914f-5efed84ee112
}}
{{Tags}}