Extended Reality: Ethics Issues
Extended Reality: Ethics Issues
The aim of this module is to support students, researchers, and research ethics reviewers in learning about, and reflecting upon, the ethics issues associated with the development and use of extended reality.
Learning outcomes
At the end of this module, learners will be able to:
- Consider the primary ethical issues related to the development and use of XR technologies.
- Outline the challenges related to privacy and personal data processing for XR technologies.
- Identify the implications for energy and resource consumption in relation to the development and use of XR technologies.
- Access guidelines and further resources for ethics assessment of XR research and development.
Module Introduction
Extended Reality, or XR, is an umbrella term that refers to a spectrum of immersive technologies that merge the physical and digital worlds. It includes Virtual Reality, Augmented Reality, and Mixed Reality. Ethical challenges related to the research and development of XR technologies are diverse in nature. They include matters of privacy, risks for physical and mental health and wellbeing, violence and criminal activity in virtual spaces, environmental concerns, and matters of fairness and inclusion. We begin our exploration of these ethical issues with consideration of an example research project.
An Example Project: Addressing Social Anxiety Disorder Through VR
A private technology company is collaborating with a team of university researchers, to design and develop a VR application, that will provide therapy for individuals with social anxiety disorder. Social anxiety disorder is characterized by an overwhelming fear of social situations, so that even everyday activities (like shopping, going to work or speaking on the phone) can cause great distress.
The researchers intend to create immersive virtual environments where users can practice social interactions in realistic scenarios, such as job interviews, public speaking, or social gatherings.The VR therapy aims to help users overcome their anxiety by gradually exposing them to challenging situations in a controlled and supportive environment.
Imagine that you are being invited to be a participant in this study. What concerns might you have? Take a few minutes to put yourself in the shoes of the participant, and think about the concerns that they might have. Then check against the primary ethics issues that are identified below.
This brief scenario highlights some of the ethical issues that need to be considered when research involves a VR application. These issues can have impacts at many levels, from personal through to societal and environmental levels. In the rest of this module, we consider this along with the primary ethical issues in more detail.
XR Data & Privacy Concerns
The primary issues related to Extended Reality data processing concern privacy and confidentiality, data security and breaches, the volume of data extracted, and the lack of clarity around the sharing of information.
Feedback
XR platforms and applications can collect many different types of personal data from users. This includes biometric information (such as facial expressions or eye movements), location data and device identifiers, as well as potentially sensitive content from personal conversations, or confidential information that is shared within virtual environments.
XR and Privacy
Aside from the processing of personal data, other privacy matters concern the use of specific applications such as telemedicine: (particularly regarding the confidentiality of medical information) the potential use of brain data, data collection for industry purposes, and issues around governmental surveillance. Users need to be informed about the types of data collected, the purposes for which it will be used, and any third parties with whom it may be shared.
Informed consent from users may be needed, to ensure that they understand and agree to the terms of data collection and usage within XR environments. Additionally, users should have control over their privacy settings and preferences, allowing them to adjust the settings, manage data sharing permissions, and delete or anonymize their data as wanted.
But user consent and control may not always be possible. For instance, AR applications in public spaces raise concerns about reasonable expectations of privacy as they process and aggregate data about a user's broad surroundings in real time. This information gathering may require special consideration for bystander privacy, especially when government and law enforcement agencies use the technology.
XR, Healthcare And Wellbeing
While the use of XR offers many potential benefits (for example, in training, design, or surgical planning), it also presents potential risks to health and wellbeing.
XR, Healthcare and Wellbeing cont.
The use of XR also poses risks to mental health and wellbeing, inducing new problems and/or exacerbating existing concerns. Psychological impacts, including addiction and the need for a resting period after extended XR use, underscore the mental health dimensions associated with immersive technologies. However, it must be stressed that many of the alleged risks to mental health and wellbeing are currently tentative. Being a fairly new field of application and research, the evidence for harms and benefits is relatively scant.
Consequently, it is difficult to predict who precisely is at risk of harm, in what circumstances, and how this is best addressed. Nevertheless, adherence to the precautionary principle would entail that proactive measures to prevent harm are taken, even in the absence of conclusive scientific evidence. Click on the images to read more about some of the primary concerns for mental health and wellbeing that have been identified to date.
Alexei Grinbaum - Moral Equivalence
Moral equivalence in the context of VR and XR refers to the comparison of ethical behaviours and actions in digital environments with those in the real world. It raises questions about whether actions taken in virtual spaces—such as violence, harassment, or manipulation—should be judged or treated with the same moral standards as in physical reality. This concept highlights the challenge of defining ethical responsibility in immersive, simulated environments. In this expert interview, Alexi Grinbaum discusses moral equivalence, the potential impact on the wellbeing of users of VR and XR, and on wider society.
We wrote an article with a colleague about what we call moral equivalence between virtual worlds and material worlds. Now, what do we mean by that? In the material world, we have thoughts, feelings, emotions. In the virtual world, these are all imitated through computation by avatars. So, an avatar doesn't have thoughts or emotions, but it appears to having them. It creates an illusion in us humans, that if you meet an avatar in the virtual world, then this avatar may be happy or mad at us or, you know, or maybe thirsty. But of course, an avatar is never really hungry or thirsty. But these projections, these, you know, feelings by projection, these are illusions because, of course, behind there is just digital computation. But we feel that they somehow make something to us. So, they are kind of real to us through the relation that we establish with these avatars as we interact with them.
So, the question, the deep question is, these feelings by projection, these emotions by projection, they can go very far, responsibility by projection, crime and punishment by projection. When they do something to us through this relation, is that the same? Is it equivalent to what is happening in the material world? If there is an avatar that does something nasty, or something very nice to us in the virtual world and we feel for it. I mean, we do have feelings. Do these feelings matter as much as feelings in the material world?
That's the question of equivalence. And it's a dilemma. We can't really solve it here and now. We can't say yes or no because there are arguments for and against. But this is a deep philosophical and ethical dilemma of our relation to these non-material entities because they do something very real to us. Again, real, not in the sense of material, but in the sense of feeling real.
XR and Harassment
Here are some of the many forms that virtual harassment can take. For each of the following, match the type of harassment to the description.
Instances of harassment, hate speech, violent content, and XR pornography underscore the challenges surrounding user dignity and respect within virtual environments.
For instance, virtual harassment can have serious consequences for users that extend beyond the virtual environment, including emotional distress, anxiety, depression, and in extreme cases, suicide. Researchers and ethics experts need to be aware of the potential for harassment in virtual spaces, to ensure that measures are taken to protect potential users from harm.
XR, Violence and Crime
While the aims of the research projects that you encounter are likely to be positive and beneficial, it is essential to recognise that the growing use of XR technologies opens new opportunities for criminal behaviour. Criminal behaviour might take the form of cybercrimes.
Cybercriminals might exploit vulnerabilities in XR software or networks to steal personal information, financial data, or intellectual property. XR technologies might also be exploited for fraudulent activities and scams.
Fraudulent activities could include deceptive advertising, phishing schemes, or through XR-enabled communication channels. Crimes can also be conducted in the virtual world, for example, rape or other forms of virtual assault/violence on an avatar, which, given the bond between a person and their avatar, can be seriously impactful for the victim. Correspondingly, there is ongoing debate about the status of crimes in the virtual world and whether they are equivalent to crimes in the real world.
For instance, concerns about the sexual assault and rape of avatars raise questions about virtual crimes and their impact on users' emotional wellbeing. Issues like violence, murder, or unwanted disappearance of avatars, as well as child crime in XR, demand ethical scrutiny regarding the depiction and consequences of violence in these digital spaces. Furthermore, the involvement of non-human agents, including AI, in violent or criminal acts complicates the attribution of responsibility in virtual environments.
If someone engages in harmful or aggressive behaviour towards another in a virtual environment, do you think they should they incur the same consequences as they would in the real world?
The continuum of immersive experience perceived by human users highlights the impossibility of drawing rigorous or fixed boundaries between the material and the virtual environments at which ethical questions of XR would no longer apply. XR technologies can provide highly immersive experiences, blurring the lines between the virtual and physical worlds. As a result, violent content in XR has the potential to be more emotionally impactful and realistic than traditional media forms, potentially desensitising users to violence or causing psychological distress.
Do you think that violent content in XR is likely to increase, decrease or have no effect upon the tendency for violent behaviours in the real world? There is ongoing debate regarding the impact of violent XR content on user behaviour. Some studies suggest that exposure to violent virtual environments may lead to increased aggression or desensitisation to violence, while others argue that the effects may vary depending on individual factors and context.
XR Manipulation and Nudging
XR manipulation refers to the intentional alteration or distortion of reality within virtual environments. XR manipulation can alter users' perception of reality, create illusions or deceptions that trick users into perceiving virtual content as part of their physical environment. It can also be used to control the narrative within immersive experiences to shape their understanding, interpretation, and beliefs. The emergence of virtual beings, (for instance, avatars representing deceased individuals) introduces complex ethical questions regarding identity and agency.
Immersive technologies can also incorporate nudging techniques that are used to guide users' actions, shape their experiences, or promote certain outcomes. In the context of VR, ‘nudging’ refers to the application of certain measures to subtly influence the user’s decision-making. For instance, it may involve prompts, reminders, or visual cues; the presentation of options in specific ways; portraying particular behaviours as the social norm; or the offering of rewards or incentives. Given the intention to influence, the use of nudging techniques has ethical implications related to user autonomy and informed consent, so needs to be considered carefully.
