A virtual reality scenario called “We Wait” gives people an immersive experience of the plight of refugees waiting to be picked up by a boat on a shore in Turkey to be illegally taken to Europe, crossing a dangerous stretch of sea.
This was based on BBC news reporting of the refugee situation, but deliberately depicted as an animation with cartoon-like characters representing the refugees. Of interest was the level of presence that might be experienced by participants and the extent to which the scenario might prompt participants to follow-up further information about the refugee crisis. By presence we refer to both Place Illusion, the illusion of being in the rendered space, and Plausibility, the illusion that the unfolding events were really happening. The follow-up was assessed by whether and when participants accessed a web page that contained further information about the refugee crisis after the experiment. Two factors were considered in a balanced between-groups design with 32 participants. The Responsiveness factor was either “None” or “Look at.” In the first the virtual characters in the scenario never responded to actions of the participant, and in the second they would occasionally look at the participant after the participant looked at them. The second factor was Embodiment, which was either “No Body” or “Body.” In the No Body condition participants had no virtual body, and in the Body condition they would see a virtual body spatially congruent with their own if they looked down toward themselves. The virtual body was animated by the head tracking move the upper body. The results showed that the major factor positively contributing to presence was Responsiveness (“Look at”), and that Embodiment (“Body”) may have contributed but to a lesser extent. There were important differences between men and woman in the degree of follow-up, with men more likely to do so than women. The experiment shows that adding in some simple responses in an immersive journalism scenario, where the characters acknowledge the presence of the participant through gaze, can enhance the degree of presence felt by the participants.
Immersive Virtual Reality (VR) for the portrayal of current affairs stories was first introduced by de la Peña et al. (2010) where participants experienced from a first person perspective a situation based on the interrogation of a Guantánamo Bay prisoner. The scenario was delivered using a head-tracked wide field of view head-mounted display (HMD), with real-time motion capture of the movements of the participant that were mapped to a life-sized virtual body that apparently substituted the person’s real body seen from their first person perspective (1PP). In other words when participants would look down toward their actual body while in the VR, they would see the virtual body instead. The first novel aspect of this was that although participants were seated comfortably in a chair, they experienced the virtual reality as if they were standing in a stress position, alone in an empty cell, but where they could hear an interrogation in the cell next door. Hence their virtual body posture did not match their real posture, but the participants in the case study experienced discomfort, and anxiety due to the harsh interview techniques that they could hear1. The second novel aspect was that the piece used parts of the transcript of the actual interrogation of a prisoner that was heard as if from the adjacent cell. The approach was referred to as “immersive journalism” a term, which although widely used, is not quite appropriate—since is not the journalism that is “immersive” but the delivery of its results. The basic premise of “immersive journalism” is that people can read news stories, or watch them on TV, but personal and direct experience can never be achieved that way—whereas VR has the possibility to provide this.
In particular VR can deliver four related illusions that together go beyond just 3D surrounding content. The first two are components of what is usually called presence (Held and Durlach, 1992; Sheridan, 1992; Sanchez-Vives and Slater, 2005). We refer to “Place Illusion” (PI) as the illusion of being in the place depicted by the VR, irrespective of what might be depicted as happening there. This is a perceptual illusion, based on the extent to which the system delivers natural sensorimotor contingencies—that is to be able to use our whole bodies for perception in the normal way (Slater, 2009). We use this term rather than just “presence” since the latter has been confounded with many other attributes of an experience, such as the degree of interest, engagement, “flow” and so on. While all of these other attributes are important, we distinguish them from PI, which refers solely to the illusion of being in the place. The “Plausibility Illusion” (Psi) is the illusion that the events depicted in the VR are really occurring (Slater, 2009). This can be facilitated by (i) the virtual world responding to participant actions (ii) contingent events that refer personally to the participant (iii) the extent to which the portrayal of the virtual world and its events conforms to expectations where this is applicable (Bergstrom et al., 2017) and maintains internal consistency (Skarbez et al., 2017). Body ownership is the third illusion, referring to the extent that a virtual self-representation within the VR is illusorily experienced as the participant’s own body (Slater et al., 2010b; Blanke et al., 2015). The fourth illusion, closely related to body ownership is agency, that actions of the virtual body are attributed to the self (Haggard and Chambon, 2012), which may be veridical agency (where the virtual body moves synchronously and in correlation with real body movements) or illusory agency, where actions of the virtual body are self-attributed even when its actions were not those of the participant (Wegner et al., 2004; Banakou and Slater, 2014, 2017). In the case of each illusion, of course participants know that they are illusions, and yet nevertheless their responses at many levels are as if these were real.
The research we describe in this paper started from an already existing VR news scenario known as “We Wait.”2 This depicts a situation on a shore in Turkey amongst a group of refugees, waiting for a boat to arrive to take them to Europe. Our goal was to explore whether PI, Psi and body ownership and subsequent follow-up of information about the refugee crisis were impacted by two factors related to the design of the virtual environment. The two factors were “Responsiveness” and “Embodiment.” The two levels of Responsiveness were “None” and “Look at.” In the first the virtual characters did not respond or look at the participant. In the second virtual refugees occasionally looked at the participant when the participant looked toward them. The Embodiment factor consisted of “No Body” or “Body.” In the first if the participant looked down toward themselves they would be invisible, and in the second they would see a virtual body substituting their own. The body was animated only with respect to head position, no hand-tracking was done, but nonetheless it could be seen as substituting the participant’s own body from first person perspective. We used questionnaires to assess the level of PI, Psi and body ownership. In addition, after the experience participants were given a link to a web page where they could follow-up to find out more information about the refugee crisis. We were interested in whether and how many times, and how long after the experience the participants would look at this web page, and whether this was influenced by the factors (Responsiveness and Embodiment).
Our hypothesis was that the responsiveness of the virtual characters towards the participant, and the participant having a virtual body would lead to greater reported levels of PI, Psi and body ownership. Moreover, we were interested to discover how these factors influenced whether participants engaged in follow-up indicated by accessing the web page.
Virtual Reality representation of news and current events typically provides a passive experience where the participant simply observes an unfolding scenario/story, albeit in a 360 degree surrounding world. It is usually video based, sometimes model based, and with stereo vision. Although there has been a long tradition of using VR for narrative, for example, (Pausch et al., 1996), since the work by (de la Peña et al., 2010) there has been a growing interest in and examples of immersive journalism. Nonny de la Peña’s group developed “Hunger in Los Angeles” about events on a food line in Los Angeles which was exhibited at the Sundance Film Festival in 2012. The 2014 World Economic Forum included her “Project Syria” about a bomb explosion in a Syrian town. “One Dark Night” depicted the shooting of teenager Travyon Martin, and “Kiya” about murder in the context of domestic violence. All of these were based on real events, and combined graphics rendering of the scenarios with recorded sounds and other information from the depicted events.
Early in 2014, interest in using 360 video for HMD viewing to create immersive journalism began to grow. For example, Louis Jebb and Edward Miller produced a 360 film of a protest in Hong Kong in 2014 (Hong Kong Unrest). In 2015 the UN sponsored “Clouds over Sidra,” a VR documentary film about a child refugee in the Syrian war, which was created by Gabo Arora and Chris Milk.
Chris Milk’s description of VR as “the ultimate empathy machine” in a Ted Talk in April 20153 further fuelled interest in VR’s potential for news. Empathy was one of the promises of VR explored by the Tow Report Virtual Reality Journalism: “a core question is whether virtual reality can provide similar feelings of empathy and compassion to real-life experiences” (Aronson-Rath et al., 2016).
Since then, many news organizations and broadcasters including The New York Times, The Guardian and the BBC have developed a number of other 360 degree VR news stories or documentaries. Overall the topic has generated a great deal of interest (Doyle et al., 2016; Slater and Sanchez-Vives, 2016; Watson, 2016).
In “We Wait,” the BBC and Aardman Interactive, experimented with using computer graphics-based VR to put the viewer in a place that few foreign reporters could risk—on a boat with a group of refugees crossing the Mediterranean or waiting on a beach for the boat to appear. The purpose was to create the feeling that the participant was part of the unfolding events. Though scripted, it was based on BBC news coverage of the migrant crisis in 2015. “We Wait” was premiered at the Sheffield Documentary Festival in 20164. It won the Broadcast Digital Award for VR in 20175.
Photorealism was an objective that was unattainable, so the creators chose a low polygon style of animation, with strong art direction to evoke the scenes depicted. The characters in the story were designed to have expressive eyes to strongly convey human emotion in response to gaze interaction (see Figure 1). Motion capture was used to ensure that character movement was as close to realistic as possible. When viewed on a flat screen the characters look like simplistic cartoons. However, in various demonstrations and public exhibitions, these avatars generated an empathic response. This was anecdotal observation though, and part of the purpose of the study was indeed to examine the effectiveness of the scenario.
The Latest on: Immersive news experience
via Google News
The Latest on: Immersive news experience
- Van Gogh Alive at the Dalí Creates Multi-Sensory Experienceon February 24, 2021 at 12:53 pm
From his famous “Starry Night” to his radiant “Sunflowers,” Vincent van Gogh’s vibrant work invites viewers to revel in color, light, and sound. Dalí Museum visitors can experience Van Gogh’s works in ...
- Proxy Listening Experience Helps Battle Zoom Fatigueon February 24, 2021 at 6:35 am
Alango Technologies announced that a new model called BeHear® PROXY has been added to its line of hearing enhancement solutions. The COVID-19 pandemic and subsequent preference to shelter at home have ...
- Blockbuster Exhibition IMMERSIVE VAN GOGH Announces NYC Runon February 23, 2021 at 6:21 pm
Immersive Van Gogh was created by the world-renowned master of digital art, Italy's Massimiliano Siccardi, who for 30 years has been pioneering immersive exhibitions in Europe. His magnificent ...
- Qualcomm launches XR1 AR Smart Viewer platformon February 23, 2021 at 2:00 pm
Qualcomm has launched its latest augmented reality (AR) prototype platform based on the Qualcomm Snapdragon XR1 platform.
- SD Times news digest: Qualcomm’s first AR reference design, GitLab 13.9, and Sider’s new programming language supporton February 23, 2021 at 7:50 am
GitLab 13.9 released, Qualcomm’s first AR reference design, Sider adds new programming language support for duplicate code detection feature ...
- SES Networks Transforms Cruise Market Again as Leading Cruise Companies Choose O3b mPOWER for Enhanced Connected Guest Experienceson February 22, 2021 at 11:57 pm
Four of the top five major cruise companies have entered into long-term strategic framework agreements, with the majority extending through ...
- Clearwater Marine Aquarium is set to debut its most immersive whale exhibit ever — minus the whaleson February 22, 2021 at 11:56 am
With a recent expansion that quintupled the amount of public space, the Clearwater Marine Aquarium is going big with its newest exhibit. Whales: Living ...
- Immersive, Theatrical Experience MARGARITA LIVE Announced in Celebration of 'National Margarita Day'on February 22, 2021 at 11:47 am
Elevated Entertainment has announced Margarita Live, a captivating and tactile immersive telling of the legend of the Margarita cocktail and how it came to be a worldwide sensation. This will be a ...
- Immersive 360 video captures Mission Control celebrations of Mars landingon February 21, 2021 at 11:28 pm
Check out NASA's immersive 360 video showing the celebrations from inside Mission Control when confirmation came through of Perseverance's safe arrival on Mars.
via Bing News