Text (Instruction Step Text)
From The Embassy of Good Science
Describe the actions the user should take to experience the material (including preparation and follow up if any). Write in an active way.
- ⧼SA Foundation Data Type⧽: Text
3
Look at slide 8-12 (in step 1) and ask participants to go over the REI leadership principles and take a role of a REI leader.
After having explained what the activity is about you may ask the participants to turn to the posters and work independently. Or you can go over the case analysis as a group following tasks on the slides (both slides and posters include same tasks). The tasks involve: Read the case. The case has a mentor-mentee situation and a dilemma for the leader/supervisor to deal with.
*Identify the ethical principles that may be at stake in this case.
*Use the ethical analysis to solve the situation described in the case.
*Analyse which ethical approaches the possible courses of action follow.
*Reflect back at the REI leadership framework – the group should discuss which REI leadership principles would contribute to solving this case and reflect if they displayed any of the principles. +
<span lang="EN-US">Inspired by the examples shared in the podcast, this task invites you to slow down and imagine a small ritual that embodies care for something within your research environment (e.g., water, soil, lab equipment, participants, data, community).</span>
<span lang="EN-US">Reflect and respond to the prompts below:</span> +
<span lang="EN-US">Now that you have identified possible blind spots and challenges in your research, we invite you to use storytelling to craft an original short story. By doing so, you can reflect on hidden assumptions, neglected impacts, silenced voices, and power relations within your own research context or field.</span> <span lang="EN-US">Storytelling helps us see what academic prose often hides.</span> +
<span lang="EN-US">In the two steps above, we have learned about the PEPE framework.</span>
*'''Pluralizing''' invites researchers to <span lang="EN-GB">go beyond the superficial combining of different perspectives that's inattentive to power and to genuinely reflect on the question: how to attend different knowledge forms and navigate that plurality of different perspectives?</span>
*'''Empowering''' <span lang="EN-GB">tries to address the fact that in research we often communicate dry data or facts and publish them, but we don't attend to all of the emotions and perspectives that play a critical role in how we do research and the importance of ''whose'' voice matters.</span>
*'''Politicizing''' <span lang="EN-GB">that attends to the issue of power. We all have very different assumptions about how research might challenge power structures. And that could be more of a scholar activist perspective, but it could also be deeply collaborative.</span>
*'''Embedding''' <span lang="EN-GB">addresses the fact that we're operating in systems that are not necessarily always supportive of what we're doing. H</span><span lang="EN-US">ow do we move beyond temporary experiments to lasting institutional change?</span> +
Fieldwork can have several environmental consequences related to energy use, habitat disturbance, waste production and methods of sampling. Practicing safe, inclusive, and equitable fieldwork can help reduce these risks and costs. In this session, you will learn about various environmental impacts of research fieldwork and explore practical strategies to reduce their impacts.
Watch the video on “Minimising the Environmental Impact of Research Fieldwork” which provides guidelines for mitigating environmental impacts of research fieldwork. +
Take a piece of paper a draw the good researcher. What would characterise a good researcher, scientist, or innovator? What is in their hands, on their mind, in/on their clothes, or their equipment? +
[[File:Ge2Image3.png|center|frameless|600x600px]]
What do you think are the main ethics issues for this case? Some of the main ones are listed below. Sort each issue into one of the four categories: Autonomy, Future generations;Potential harms and benefits;and Slippery slope. +
In order to monitor how ethics competencies develop during the training session and also see if the competencies are retained over a longer period of time reflective learning diaries can be used to monitor the development of REI competencies as well as measure the effectiveness of the training in the long term (Kirkpatrick’s levels 2 and 3). Reflection is a crucial part of ethics education as it supports the development of ethical sensitivity and ethical decision-making (Mustajoki and Mustajoki, 2017;Löfström and Tammeleht, 2023). Written reflection tasks may provide good results as writing offers a chance to pause and have an inner dialogue with oneself.
Implementation is relatively easy, but analysis may take some time. There are different ways to elicit learner’s texts – from pen-and-paper format to individual digital diaries (on various platforms) as well as forum format (where learners can see and respond to each other’s entries). Forum format has provided the best results (Tammeleht et al., 2024). Diaries should be kept during a longer period of time (at least a few months) and include weekly or bimonthly submissions. Some guiding questions or topics should be provided for each entry – this helps to keep focus and guide discussion.
Various instruments can be used for analysis: the SOLO taxonomy to evaluate the level of understanding, reflection levels to see the advancement of reflective skills, content criteria (ethical principles, ethical analysis, ethical approaches) or specific topics relevant for the course content.
There are various ethical aspects to consider when collecting and analysing learning diaries (Thorpe, 2004;Gibbs et al., 2007). Learners can be asked if they would prefer individual or forum format diary-keeping. Depending on the level of trust in the group, forum format may be uncomfortable for some learners. In HE context learners are adults, who take responsibility for writing the entries on time and honestly. This may call for keeping the content confidential unless agreed otherwise
The tool is suitable for students and ECRs. Supervisors may find it challenging to keep a diary in addition to their regular work-load.
<div>
<span lang="EN-GB">Improving reproducibility is a multifaceted challenge requiring both behavioural and cultural change.</span> <span lang="EN-US">The adoption of reproducibility practices has been sparked and embraced by the Open Science movement. However, a lot of researchers are not fully aware of the implications of reproducibility and how Open Science and reproducibility are connected and intertwined (Haven et al., 2022). To increase awareness and change research practices several steps should be taken (Nosek, 2019). First, the infrastructure for the desired behaviour should be provided to make it possible. Second, the user interface and experience of the infrastructure should be improved to make the behaviour easy. Third, communities of practice should be fostered to make the behaviour visible and so increasingly normative. Fourth, incentives to enact the behaviour should be provided to make it rewarding. Last, policies should be enacted to make the behaviour required (Nosek, 2019). To further this work, we sought to explore the future of reproducibility for different stakeholders and question what should be the next steps for reproducibility and how diverse epistemic contexts can adopt reproducibility in different forms. In this deliverable, we aim to add nuance to the reproducibility debate through flexible investigation of diverse epistemic contexts (researchers from the field of machine learning and researchers working with qualitative methods), exploring the future of reproducibility through the lens of diverse research stakeholders – researchers, funders, and publishers.</span>
</div><div>
<span lang="EN-US">In this context, we look to the future of reproducibility by exploring the preferred scenarios for multiple stakeholders, including how these scenarios can be realized. We reflect on the steps that are necessary for adherence to reproducibility-enabling practices and what different epistemic contexts need to make reproducibility a priority. Lastly, we reflect on what are the new problems that we may face when aiming to improve reproducibility. We believe exploring the possible futures for reproducibility is essential to discover the next steps for different members of the scientific community to take to realize the preferred future and the actions to avoid steering away from the dystopian futures.</span>
</div><div>
<span lang="EN-US">We aim to highlight the essential role of institutions, funders and publishers in this endeavor to make reproducibility a priority by recognizing, rewarding, evaluating and monitoring reproducibility. Ultimately, we hope to steer and move forward the debate on reproducibility in the research community by</span> <span lang="EN-GB">addressing a set of core research questions related to how key stakeholders in the academic community envision the way in which matters of reproducibility should be addressed in the future. More specifically, it asks representatives from research funders, scholarly publishers, and researchers from diverse disciplinary backgrounds:</span>
</div><div>
<span lang="EN-GB">1. What are the preferred futures of reproducibility?</span>
</div><div>
<span lang="EN-GB">2. What are the enablers and barriers on the way to the preferred future or reproducibility more generally?</span>
</div><div>
Below we present the results of our study below.
</div>
For more information, please refer to the full paper: [https://osf.io/preprints/metaarxiv/gx9jq_v1 MetaArXiv Preprints - How to get there from here? Barriers and enablers on the road towards reproducibility in research].
'''''Target audience:''' Doctoral students and early career researchers, Senior researchers and RERI experts''
The EnTIRE project created eight scenarios on The [https://embassy.science/wiki/Special:BrowseData/Resource?_search_Resource_Type%5B0%5D=Scenarios Embassy of Science], each of which presented a fictitious story along with eight distinct themes. The purpose of each of the eight scenarios is to provide RECs, research administrators, researchers, and researchers with the opportunity to concentrate their attention on the fundamental ideas and research settings that support both local regulations and practices and effective research practices. The scenarios developed are the following: [https://embassy.science/wiki-wiki/index.php/Resource:F6100097-fddb-4c77-9098-1bc767c34a6a Research Procedures and Research Integrity];[https://embassy.science/wiki-wiki/index.php/Resource:1d26fd13-1ced-44bc-8d19-e094b37f8f70 Collaborative Working Between Academia and Industry];[https://embassy.science/wiki-wiki/index.php/Resource:45a04c31-5a75-4816-8484-2dd9b71d1674 Data Practices, Data Management and FAIR Principles];[https://embassy.science/wiki-wiki/index.php/Resource:Aef6b98d-9cc5-4db0-bffd-4a3daa99a3f3 Publication, Dissemination and Research Integrity];[https://embassy.science/wiki-wiki/index.php/Resource:C99f17ec-3d1e-4f7a-bfc7-3e3607934ead Research Environments and Research Integrity];[https://embassy.science/wiki-wiki/index.php/Resource:7f7810d8-74a2-42ac-906c-7f6a73fcd183 Reviewing, Evaluating, Editing and Research Integrity];[https://embassy.science/wiki-wiki/index.php/Resource:67caae86-68db-49ea-8305-2010fe701aa6 Training, Supervision and Mentoring with Integrity];[https://embassy.science/wiki-wiki/index.php/Resource:E99e20d0-8116-4d77-84ec-7df396703bf4 Safeguards, Data-sharing and the Disclosure of Sensitive Results]. +
Vignettes can be integrated in various contexts, like team training sessions, institutional or national surveys and so on. While the use of vignettes is quite common in the training contexts, comments collected on vignettes is not very common in non-training contexts (e.g. as part of national REI surveys, team meetings, conferences). Still, the comments collected on the vignettes may prove to be a great source of information about the respondents’ attitudes, beliefs, knowledge and ethical sensitivity (Kirkpatrick’s level 3).
Vignettes contain a situation with one or several ethical aspects and there can be a straightforward solution or not. There are several measures to gauge ethical sensitivity with vignettes – for example, Likert scale can be used to indicate how ethical the situation seems to the respondent. An open-answer option could be added, and research indicates (Parder et al., 2024;Tammeleht et al., forthcoming) that open responses reveal more about ethical sensitivity than quantitative data.
Implementing vignettes into various surveys or team meetings/conferences requires some preparation from the facilitators, but collecting responses and comments is quite simple. Analysing results may take some time, especially in case open answers are scrutinised. We recommend using an EASM (Ethical Awareness and Sensitivity Meter) for measuring the level on sensitivity in the open answers. Content criteria (ethical principles, ethical analysis, ethical approaches) or recognising the topics present in the vignette (similar to the domain-specific measure).
For example, Estonian national REI survey included four vignettes. The survey asked respondents to indicate the ethicality of the situation on a Likert scale (1-6). The results (of statistical analysis) show (figure 1) that the ethicality of vignettes was evaluated on different levels, some topics were considered more unethical than others.
[[File:Img25.png|left|frameless|263x263px]]
Figure 1. Unethical behaviour identified on a Likert scale (all unethical indications) (from Parder et al., 2024).
Then the respondents had a chance to add a comment – this was optional but about a half of the respondents used the opportunity (which may indicate some ethical sensitivity). Open comments were analysed based on the EASM and the picture looked a bit different (see figure 2). Based on the Likert scale results, vignette 4 was not considered very unethical (or not connected to ethics). Open answers revealed that 70% of respondents actually considered the situation to be ethical in nature and showed understanding of the topic. It also became clear that 30% of respondents had completely missed the topic, meaning they had not understood the situation from the ethical perspective.
[[File:Img26.png|center|frameless|500x500px]]
Figure 2. Analysis of open comments to the vignettes (from Parder et al., 2024).
Overall, it can be concluded that the identified misconceptions and not noticing ethical issues (both on the prestructural level in the SOLO taxonomy) may be the indication that training might be needed to clarify the topics.
This tool is suitable for use in training for ECRs, supervisors/mentors and expert researchers.
Divide the group in two sub-groups and instruct each group which side of the dilemma they have to defend. There are two ways to split the group: A) participants choose a side themselves, or B) the trainer divides the group in two subgroups. Both approaches have pros and cons to consideration. With option A, the participants are more likely to believe in and strongly defend their position. With option B, the participants have to learn to defend a position which they might not agree with.
If you are aware of power differences in a group e.g. supervisors and (PhD) students, it might be advisable for the moderator to divide the group. Participants assigned to a group might feel less pressure when defending their position against people more powerful than them.
If there is enough space available in the room, position the two subgroups facing each other,they should literarily stand facing each other.
Before starting the debate, give both groups a few minutes to discuss their arguments and strategy to convince the other group. +
Der Trainer wird die Übung in drei Teilen durchführen:
''Teil I: Individuelle Reflexion''
Erinnere dich an eine Situation (siehe “Vorbereitung”), in der du dir nicht sicher warst, was das richtige Verhalten in der Situation ist, oder in der du Bedenken bezüglich der Research Integrity hattest. Welcher Wert war in dieser Situation angegriffen? Überlege dir, welches Verhalten du in der Situation zeigen müsstest, um diesem Wert gerecht zu werden.
''Teil II: Reflexion in der Kleingruppe''
Wählt eine Person aus (“Sprecher:in”), die später im Plenum über den nun stattfindenden Gruppenprozess berichten wird. Nun schildert jede:r in der Kleingruppe seine Situation und hört sich die Schilderung der anderen Kleingruppenmitglieder aufmerksam an. Wählt eine Situation aus, über die ihr gemeinsam intensiv nachdenken wollt.Nach der Auswahl der Situation füllt jede:r individuell das Handout 2 aus (siehe “Praktische Tipps”).
Tauscht im Anschluss eure Notizen in der Kleingruppe aus, indem ihr in einer Gruppenreflexion oder einem Gruppendialog über Unterschiede und Ähnlichkeiten in Bezug auf die ausgewählten Werte und Verhaltensweisen sprecht.
''Teil III: Zusammenfassung der Arbeit in den Kleingruppen und allgemeine Erkenntnisse''
In diesem Teil werden die Diskussionsergebnisse aus den Kleingruppen berichtet,allgemeine Erkenntnisse formuliert,und die Übung evaluiert.
(Eine detaillierte Beschreibung der einzelnen Schritte ist bei den Anweisungen für Trainer:innen zu finden) +
Katılımcı grubunuzu iki alt gruba ayırın ve her bir gruba ikilemdeki seçeneklerden hangisini savunacaklarını söyleyin. Alt grupları iki şekilde oluşturabilirsiniz: A) Katılımcılar kendileri bir tarafı seçebilir ya da B) eğitmen katılımcıları gruplara ayırabilir. Her iki yaklaşımın da göz önünde bulundurulması gereken kendine özgü olumlu ve olumsuz yönleri vardır: A seçeneğinde katılımcılar gruplarını kendileri tercih ettikleri için zaten benimsemiş oldukları tarafı/düşünceyi kolaylıkla savunma eğilimine gireceklerdir. B seçeneğinde ise benimsemedikleri bir görüşü savunmayı öğrenmek durumunda kalabilirler, bu da kendi savunacakları taraf için argüman aramak zorunda kalacakları anlamına gelir. Grubunuz içerisinde hiyerarşik bir yapı varsa – örneğin danışmanlar ve (doktora düzeyindeki) öğrenciler gibi – alt grupları oluştururken dikkatli davranmanız gerekecektir. Böyle bir durumda grupların eğitmen tarafından oluşturulması tavsiye edilir. Bu sayede katılımcılar bulundukları gruba eğitmen tarafından yerleştirildikleri için üstleriyle tartışırken daha az sıkıntı yaşayacaklardır.
Toplantı salonunda yeterli alan varsa iki alt grubu karşılıklı olarak oturtun. Yani gruplar birbirinin karşısında konumlansın. Münazaraya başlamadan önce her bir gruba karşı grubu ikna edebilmek için gerekli argüman ve stratejiler üzerine düşünebilmeleri için birkaç dakika verin. +
Katılımcı grubunuzu iki alt gruba ayırın ve her bir gruba ikilemdeki seçeneklerden hangisini savunacaklarını söyleyin. Alt grupları iki şekilde oluşturabilirsiniz: A) Katılımcılar kendileri bir tarafı seçebilir ya da B) eğitmen katılımcıları gruplara ayırabilir. Her iki yaklaşımın da göz önünde bulundurulması gereken kendine özgü olumlu ve olumsuz yönleri vardır: A seçeneğinde katılımcılar gruplarını kendileri tercih ettikleri için zaten benimsemiş oldukları tarafı/düşünceyi kolaylıkla savunma eğilimine gireceklerdir. B seçeneğinde ise benimsemedikleri bir görüşü savunmayı öğrenmek durumunda kalabilirler, bu da kendi savunacakları taraf için argüman aramak zorunda kalacakları anlamına gelir. Grubunuz içerisinde hiyerarşik bir yapı varsa – örneğin danışmanlar ve (doktora düzeyindeki) öğrenciler gibi – alt grupları oluştururken dikkatli davranmanız gerekecektir. Böyle bir durumda grupların eğitmen tarafından oluşturulması tavsiye edilir. Bu sayede katılımcılar bulundukları gruba eğitmen tarafından yerleştirildikleri için üstleriyle tartışırken daha az sıkıntı yaşayacaklardır.
Toplantı salonunda yeterli alan varsa iki alt grubu karşılıklı olarak oturtun. Yani gruplar birbirinin karşısında konumlansın. Münazaraya başlamadan önce her bir gruba karşı grubu ikna edebilmek için gerekli argüman ve stratejiler üzerine düşünebilmeleri için birkaç dakika verin. +
03 - Four Quadrant Approach: A Method for Analysing Cases in Research Ethics and Research Integrity +
Once the details of a case have been outlined according to the four quadrants, there are a series of questions that should be considered:
<br />
*What is at issue? Try to list what is the major ethical issue at the case, e.g researchers’ dishonesty, negligent conduct, informed consent, rules of data collection etc.)
*Where is the conflict? Is there a conflict between principles of research or principles of research integrity? (e.g. autonomy, justice, beneficence or between honesty, reliability and respect for colleagues)
*What is this a case of? Does it sound like other cases you may have encountered? (e.g. Is it a case of "self-plagiarism", “fabrication of data in a grant application” or “low risk research involving humans without a valid informed consent”?)
*What do we know about other cases like this one? Is there clear precedent? If so, we call this a paradigm case. A paradigm case is one in which the facts of the case are very clear cut and there has been much professional and/or public agreement about resolution of the case.
*How is the present case similar to the paradigm case? How is it different? Is it similar (or different) in significant ways? +
Katılımcı grubunuzu iki alt gruba ayırın ve her bir gruba ikilemdeki seçeneklerden hangisini savunacaklarını söyleyin. Alt grupları iki şekilde oluşturabilirsiniz: A) Katılımcılar kendileri bir tarafı seçebilir ya da B) eğitmen katılımcıları gruplara ayırabilir. Her iki yaklaşımın da göz önünde bulundurulması gereken kendine özgü olumlu ve olumsuz yönleri vardır: A seçeneğinde katılımcılar gruplarını kendileri tercih ettikleri için zaten benimsemiş oldukları tarafı/düşünceyi kolaylıkla savunma eğilimine gireceklerdir. B seçeneğinde ise benimsemedikleri bir görüşü savunmayı öğrenmek durumunda kalabilirler,bu da kendi savunacakları taraf için argüman aramak zorunda kalacakları anlamına gelir. Grubunuz içerisinde hiyerarşik bir yapı varsa – örneğin danışmanlar ve (doktora düzeyindeki) öğrenciler gibi – alt grupları oluştururken dikkatli davranmanız gerekecektir. Böyle bir durumda grupların eğitmen tarafından oluşturulması tavsiye edilir. Bu sayede katılımcılar bulundukları gruba eğitmen tarafından yerleştirildikleri için üstleriyle tartışırken daha az sıkıntı yaşayacaklardır.
Toplantı salonunda yeterli alan varsa iki alt grubu karşılıklı olarak oturtun. Yani gruplar birbirinin karşısında konumlansın. Münazaraya başlamadan önce her bir gruba karşı grubu ikna edebilmek için gerekli argüman ve stratejiler üzerine düşünebilmeleri için birkaç dakika verin. +
'''''Target audience''': Bachelor and master students, doctoral students and early-career researchers.''
The RID-SSISS training aims to help beginner and more experienced researchers develop their research ethics competencies in HE institutions. A CSCL (Computer-Supported Collaborative Learning) ethics resource was designed that utilised cases, collaboration, and structural scaffolding. This resource provides learners with opportunities to gradually develop research ethics competencies, guiding them through three levels. The [https://en.researchethicscompass.net/ Foundation level] focuses on developing (but also helping learners to recall) central concepts of RE/RI, primarily suitable for bachelor’s, master’s, and doctoral students but also usable with academic staff and researchers. During the Foundation level training, participants learn to guide their own REI practices and behaviour. The RID-SSISS training also provides resources for ECRs and junior academics. This material aims to develop RE/RI competencies by supporting ethical analysis competencies as a step towards increased agency in research ethics and integrity. Ethical analysis involves the following steps: identify ethical issues by determining which ethical principle might be at stake,and utilise the ethical analysis steps to provide solutions to ethical dilemmas. In addition to the foundational level, the project developed training materials for ECRs and junior academics ([https://www.researchethicstraining.net/ advanced level]). +
Teile die Gruppe in zwei Subgruppen auf und teile jeder Gruppe mit, welche Seite des Dilemmas sie verteidigen soll.
Einteilung der Gruppen:
* Zur Aufteilung der Gruppe hast du zwei Möglichkeiten:
a) du lässt die Teilnehmenden sich selbst einteilen
b) du als Trainer:in teilst die Subgruppen ein.
* Beide Varianten haben Vor- und Nachteile. Variante A: die Teilnehmenden werden sich wahrscheinlich mehr mit ihrer Subgruppe identifizieren und ihre Positionen engagierter verteidigen,Variante B: die Teilnehmenden lernen, wie sie eine Position verteidigen, die sie eventuell nicht selbst vertreten. Gesetzt dem Fall, deine Gesamtgruppe besteht aus Personen unterschiedlicher Hierarchiepositionen (z.B. Supervisoren und Promovierende), dann kann es vorteilhaft sein, dass du als Trainer:in die Gruppen aufteilst. Die zugeteilten Teilnehmer:innen werden es dann als leichter empfinden, eine Gegenposition gegenüber einer hierarchisch höher gestellten Person zu verteidigen.]
Ist genügend Platz im Raum vorhanden, positioniere die zwei Subgruppen so, dass sie sich gegenseitig ansehen. Die zu verteidigenden gegenüberliegenden Positionen in der Debatte spiegeln sich so in der räumlichen Position wider, was den Effekt der Übung verstärkt.
Gib beiden Gruppen 3-5 Minuten Zeit, um ihre Argumente zu besprechen und eine Strategie zu diskutieren, wie die andere Gruppe von der eigenen Position überzeugt werden kann. Danach kann die Debatte gestartet werden. +
[[File:Man thinking .png|center|frameless|600x600px]]
Philosopher Immanuel Kant maintained that a priori knowledge is independent of experience. He contrasted this with a posteriori knowledge, which has its sources in experience and observation. In life, most knowledge is of the a posteriori form;it is rooted in experience and observation.
Watch this video to find out why philosophers think there might be a problem with this.
'''The Problem Of Induction'''
Understanding how we construct knowledge helps us to take a critical standpoint and to exercise caution when making assumptions about proof. As well as the above evidence-proof issue, it is also important to acknowledge the impact of the researcher on the creation of knowledge. +
