Different facial expressions can now manipulate objects in a VR setting.
Our face can unlock a smartphone, provide access to a secure building and speed up passport control at airports, verifying our identity for numerous purposes.
An international team of researchers from Australia, New Zealand and India has now taken facial recognition technology to the next level, using a person’s expression to manipulate objects in a virtual reality setting without the use of a handheld controller or touchpad.
In a world first study led by University of Queensland researcher Dr Arindam Dey, human computer interaction experts used neural processing techniques to capture a person’s smile, frown and clenched jaw and used each expression to trigger specific actions in virtual reality environments.
One of the researchers involved in the experiment, University of South Australia’s Professor Mark Billinghurst, says the system has been designed to recognise different facial expressions via an EEG headset.
“A smile was used to trigger the ‘move’ command; a frown for the ‘stop’ command and a clench for the ‘action’ command, in place of a handheld controller performing these actions,” says Prof Billinghurst.
“Essentially we are capturing common facial expressions such as anger, happiness and surprise and implementing them in a virtual reality environment.”
The researchers designed three virtual environments – happy, neutral and scary – and measured each person’s cognitive and physiological state while they were immersed in each scenario.
By reproducing three universal facial expressions – a smile, frown and a clench – they explored whether changes in the environment triggered one of the three expressions, based on emotional and physiological responses.
For example, in the happy environment, users were tasked with moving through a park to catch butterflies with a net. The user moved when they smiled and stopped when they frowned.
In the neutral environment, participants were tasked with navigating a workshop to pick up items strewn throughout. The clenched jaw triggered an action – in this case picking up each object – while the start and stop movement commands were initiated with a smile and frown.
The same facial expressions were employed in the scary environment, where participants navigated an underground base to shoot zombies.
“Overall, we expected the handheld controllers to perform better as they are a more intuitive method than facial expressions, however people reported feeling more immersed in the VR experiences controlled by facial expressions.”
Prof Billinghurst says relying on facial expressions in a VR setting is hard work for the brain but gives users a more realistic experience.
“Hopefully with some more research we can make it more user friendly,” he says.
In addition to providing a novel way to use VR, the technique will also allow people with disabilities – including amputees and those with motor neurone disease – to interact hands free in VR, no longer needing to use controllers designed for fully abled people.
Researchers say the technology may also be used to complement handheld controllers where facial expressions are a more natural form of interaction.
Original Article: Forget handheld virtual reality controllers: a smile, frown or clench will suffice
More from: University of Queensland | University of South Australia
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
Facial recognition technology
- US AI Advisory wants more disclosure on facial recognition use by federal law enforcement
America's National AI Advisory Committee is set to recommend more transparency in federal law enforcement use of facial recognition, amid a broader debate.
- iPhone users complain about Face ID after people realise others can get into their phone
However, many iPhone users have been complaining about Face ID after they realised other people can get into their phone using it. One user took to X to reveal their issue with the Apple feature as ...
- A two-headed fight for facial recognition
The issue of whether to ban facial recognition technology has reared its ugly head again, and this time, the Security Industry Association (SIA) has an ally to help its cause. SIA joined forces with ...
- Dayton Police’s use of ‘unapproved’ facial recognition tech raises alarm with some
Dayton Police have many tools to use when it comes to solving crimes. Facial recognition technology is not one of them. But under emergency circumstances, when all else ...
- Police Say a Simple Warning Will Prevent Face Recognition Wrongful Arrests. That's Just Not True.
Even when police heed warnings to take additional investigative steps, they exacerbate the unreliability of face recognition results.
Go deeper with Google Headlines on:
Facial recognition technology
[google_news title=”” keyword=”facial recognition technology” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]
Go deeper with Bing News on:
Using facial recognition in virtual reality
- Police Say a Simple Warning Will Prevent Face Recognition Wrongful Arrests. That's Just Not True.
Face recognition technology in the hands of police is dangerous. Police departments across the country frequently use the technology to try to identify images of unknown suspects by comparing them to ...
- From Personalization to Virtual Try-Ons: How Generative AI is Shaping E-commerce
In a world where online shopping has become the new norm, e-commerce businesses are constantly striving to enhance the customer experience. From personalized product recommendations to virtual try-ons ...
- Why aren’t California lawmakers banning police from using facial recognition technology? | Opinion
Despite these failures, however, police departments across the state and the country are increasingly using facial recognition technology to try to match pictures of suspects with driver’s ...
- Takeo Kanade, engineer: ‘Artificial vision will bring teleportation, but without decomposing your body and shipping it another place’
The Japanese researcher discusses the use of robots in surgical operations, virtualized reality and why we must be smarter and faster than malicious technologies ...
- Synthetic Reality Can Generate Worlds and Drive Innovative Solutions
What is a synthetic reality and what are Deepfakes? Discover more about the good and bad of the emergence of synthetic realities.
Go deeper with Google Headlines on:
Using facial recognition in virtual reality
[google_news title=”” keyword=”using facial recognition in virtual reality” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]