XR in Research: A Case Study
ModulesXR in Research: A Case Study
The aim of this module is to facilitate reflection upon the ethics issues associated with the development and use of extended reality in a research project.
Learning outcomes
At the end of this module, learners will be able to:
- Identify and analyse the ethics issues and dilemmas associated with an example research proposal.
- Make suggestions for how the ethics issues might be addressed.
- Identify ethics guidelines and policies that are relevant to the proposed research.
A Question for You
Feedback
Your opinions and assumptions about the use of XR and related ethics issues will likely be influenced by your prior experiences and understanding. How do you think your current understanding will impact upon your decision-making?
As you work through this module try to keep these thoughts in mind and notice whether your opinions or assumptions about XR in research change. Even if you don’t have any experience of XR, as a REC member who is reviewing this project proposal, you are being asked to make an evidence-informed and balanced judgement call.
Where’s the Ethical Dilemma?
Given the existing widescale use, and the many unexplored potential benefits, one might reasonably ask why it’s necessary to query the involvement of XR in research. Surely, more research is what we need. What is the ethical dilemma here? The involvement of XR in research actually generates many ethical issues as addressed in the module Extended Reality: Ethics Issues.
While XR holds incredible potential across many fields, it also has the potential to cause harm and infringe upon certain rights. Furthermore, there are significant gaps in our understanding, especially regarding the long-term psychological, neurological, social, and ethical impacts of XR use. You can watch this video to find out more.
Video Transcript
XR technology has advanced significantly in recent years, but there are many areas that remain underexplored or not fully understood. These gaps in our understanding span the technical, psychological, social, and health-related aspects of XR.
In particular, the long-term impacts of prolonged XR use are not well understood. This includes psychological factors like emotional regulation, attention span, and memory. Additionally, we don't yet fully understand how extensive use of XR for social interaction might impact real-world social skills and relationships. For instance, might heavy reliance on XR for communication lead to social withdrawal or decreased empathy in the real world?
Other unknowns concern the long-term effects on mental health or the impacts of immersive XR on feelings of detachment or brain plasticity. Might prolonged exposure to XR influence how the brain processes spatial awareness, or motor skills?
The long-term physical impacts are also not well defined. We know that use of XR can cause physical problems like motion sickness, eye strain, muscle strain and fatigue. But might it also have longer term impacts upon eye health or posture etc.?
The Research Proposal
As you learn about the proposed research study, please refer to the downloaded document: The use of XR technologies in research: A checklist for research ethics committees to help you spot the possible ethical pitfalls. Note that while XR includes virtual reality, augmented reality, and mixed reality, this case study involves only the use of virtual reality or VR. Remember that you will be asked to make an assessment about whether to approve the study, ask for changes to be made, seek further information, or to disallow the study. Make a note of any points or questions that arise for you.
The Role of the Research Ethics Committee
Question: As a member of the research ethics committee, what is your first impression of this proposal? Do you think that you would approve this project?
Feedback
On what did you base your decision? If you answered ‘yes’, is it because you think there aren’t any potential ethics issues, or that they are addressed adequately in the proposal?
If you answered ‘no’ or ‘I don’t know’, is it because you would need more information before you could approve? Is it because there are aspects of the proposal that you don’t understand?
With complex proposals like this, it is normally advisable to seek more information before reaching a decision unless the researchers have already addressed all relevant points that are in the document The use of XR technologies in research: A checklist for research ethics committees. Research ethics committee members might also do their own research about the topic or seek expert advice if there is insufficient technical knowledge and experience amongst the committee members.The Role of the Research Ethics Committee - Exercise
In the following exercise we ask you to consider the points in each section of the document The use of XR technologies in research: A checklist for research ethics committees in terms of your role as a research ethics committee member. The exercise will take you through one section of the checklist at a time. For each section, we ask you to select the relevant items from a list of the roles of a research ethics committee. For example, when considering the section on data processing, if you think this is relevant to three of the itemised roles, you should select all three from the list.
Role of XR technologies in the project
- Does the project use an XR device (e.g., a headset) /XR technique, develop an XR device/technique, or both?
- If an XR device/technique is developed in the project, up to which technology readiness level will it be developed (research / industrial prototype / scalable commercial product)? Are compliance checks and certification included?
- If a third-party XR device is used in the project, is it already commercially available or a research prototype? Is it certified? Is a user manual included and made available to all participants?
Use of Artificial Intelligence (AI) in the Project
- Will an AI system be used or developed in the project together with the XR device? If so, is it compliant with the AI Act?
- Is the AI system operated under human supervision? Is this supervision occasional or continuous? What control powers does the supervisor have?
- Is it clear to participants which avatars or interactions in XR are controlled by humans, and which are controlled by AI, to avoid confusion and/or potential manipulation?
- Does the AI system use unsupervised or self-supervised learning, particularly on brain data? Are measures to enhance explicability included?
- Does the project include AI ethics experts or an ethics committee to oversee the development of the AI system?
- Does the project provide a procedure for assigning responsibility in case of damages caused by the AI system?
Data processing
- What are the procedures for data collection and storage? Is financial (or other) compensation offered in exchange for the collected data?
- If sensitive data (including biometric data, face photographs, video or audio recordings of people) is collected, is it clear how it will be used, stored, and used? Is data collection proportional to the purpose?
- If brain data is collected, is it clear how it will be used, stored, and used? Is data collection proportional to the purpose?
- Does the project include a clear and comprehensive informed consent procedure for data collection? Do participants have the option to withdraw or delete their data?
- Will the dataset(s) be open?
- Is the data minimization principle respected to ensure that only necessary data is processed?
- Will any third parties (e.g., XR technology providers, cloud storage companies) have access to participants’ data?
The Role of the Research Ethics Committee - Exercise Cont.
Participant wellbeing and non-maleficence
- Will the use of XR in the project under reasonable conditions cause or exacerbate physical problems, e.g. motion sickness, eye strain, or fatigue? If so, are appropriate mitigation measures in place such as regular breaks during sessions or monitoring of participants for signs of discomfort?
- Will the use of XR in the project under reasonable conditions cause or exacerbate psychological problems, e.g. emotional stress, anxiety, or dissociation? If so, are appropriate protocols in place for managing emotional distress and offering support (e.g. mental health resources or professional support)?
- Are measures in place to monitor participants for potential cognitive or psychological impacts over time?
- Will the use of XR in the project under reasonable conditions cause lasting personality effects (e.g., detachment from reality, altered social behaviours)?
- What measures are in place to limit offensive, harmful, or violent behaviours in the virtual environment? Are there clear and accessible ways to mitigate and report such behaviours?
Autonomy and nudging
- Is the XR technique likely to undermine the autonomy of participants? What measures are in place to ensure that XR interactions with avatars (including AI-powered avatars) do not violate participants’ personal space or autonomy?
- Are potential emotional triggers (e.g., fear or joy) justified by the research goals and managed appropriately? Are appropriate measures in place to avoid or minimise the risks of emotional manipulation or excessive nudging in the virtual environment?
- Will participants be fully aware of the nature of the study, the role of XR technologies, the nature of the technologies and any potential impacts on their mental or physical state? Is information provided in a clear and comprehensible manner?
- Is the system likely to expose users to catfishing (deception)? Is deception explicitly used in the project? If so, is it minimal, justified, and followed by debriefing?
Inclusivity and accessibility
- Does the project ensure inclusion of diverse demographic groups (e.g., gender, age, cultural backgrounds)?
- What measures are in place to ensure sensitivity to cultural and societal norms in the design of virtual environments and interactions?
- Are people with disabilities involved in or affected by the project? If so, are accessibility measures planned?
- Does the project purposefully exclude certain groups of individuals (e.g. people with disabilities)?
The Role of the Research Ethics Committee - Exercise Cont.
Cybersecurity
- Does the XR device/technique include protection mechanisms against adversarial attacks (exploiting system vulnerabilities) or hacking?
- Are robust data security measures, such as encryption, implemented to protect stored data from unauthorized access or breaches?
- Is the XR device susceptible to misuse or diversion? Is misuse plausible?
As you can see from the above exercise, the inclusion of XR in a research project can raise a broad and complex range of ethical issues that require attention from the research ethics committee for a variety of purposes. Some of the items on the checklist are relevant to assessment of the potential harms and benefits, some to the assessment of legal compliance and so on. The research ethics committee have a lot of factors to consider. Use of the document The use of XR technologies in research: A checklist for research ethics committees will help them spot these factors so that they can fulfil all aspects of their role effectively.
Stepping into the Shoes of the Participant
Now we ask you to drop the stance of the REC member for a moment and try to step into the shoes of a potential participant.
Please answer the following question, your responses will be recorded anonymously.
Stepping in to the Shoes of the Participant Cont.
| I’m really curious about XR technologies and I would love to have the opportunity to immerse myself in a virtual world and engage with AI avatars. I would be excited to give it a go. | |
|---|---|
There’s no way I’m going to wear those tracking devices. I value my privacy and who knows where that data will end up. |
|
The thought of feeling cut off from reality scares me. Will I feel like I’m in control? What if I have a panic attack? |
|
Loneliness is a problem for me. This study will offer an opportunity to engage more, either with avatars or new people. I wouldn’t mind either way. |
|
I spend a lot of time in virtual worlds anyway. The study will give me an opportunity to reflect on how virtual environments affect my emotions and social wellbeing. |
|
I’ve tried using a VR headset previously. It’s a hassle to set up, uncomfortable wear and it caused terrible motion sickness and headaches. |
|
My disability means that I often feel isolated. But as a person with mobility challenges, I assume I can’t participate. |
|
The idea that interaction with an avatar can help loneliness is warped. It’s not real! |
Research Ethics Committee Discuss the Proposal
Now we return to the research ethics committee perspective. Below is a hypothetical debate between members of a research ethics committee that is informed by the checklist about whether this VR study should be approved. The debate involves the following five characters:
- Dr Taylor (Chair of research ethics committee)
- Dr Evans (Bioethicist)
- Dr Brown (Psychologist)
- Dr Adams (Data privacy specialist)
- And Ms Amanda Lee (Lay member)
