Imagine holding hands with a loved one on the other side of the world. Or feeling a pat on the back from a teammate in the online game “Fortnite.”
Northwestern University researchers have developed a new thin, wireless system that adds a sense of touch to any virtual reality (VR) experience. Not only does this platform potentially add new dimensions to our long-distance relationships and entertainment, the technology also provides prosthetics with sensory feedback and imparts telemedicine with a human touch.
Referred to as an “epidermal VR” system, the device communicates touch through a fast, programmable array of miniature vibrating actuators embedded into a thin, soft, flexible material. The 15-centimeter-by-15-centimeter sheet-like prototypes comfortably laminate onto the curved surfaces of the skin without bulky batteries and cumbersome wires.
“People have contemplated this overall concept in the past, but without a clear basis for a realistic technology with the right set of characteristics or the proper form of scalability. Past designs involve manual assemblies of actuators, wires, batteries and combined internal and external control hardware,” said Northwestern’s John A. Rogers, a bioelectronics pioneer. “We leveraged our knowledge in stretchable electronics and wireless power transfer to put together a superior collection of components, including miniaturized actuators, in an advanced architecture designed as a skin-interfaced wearable device — with almost no encumbrances on the user. We feel that it’s a good starting point that will scale naturally to full-body systems and hundreds or thousands of discrete, programmable actuators.”
“We are expanding the boundaries and capabilities of virtual and augmented reality,” said Northwestern’s Yonggang Huang, who co-led the research with Rogers. “By comparison to the eyes and the ears, the skin is a relatively underexplored sensory interface that could significantly enhance experiences.”
The research will be published on Nov. 21 in the journal Nature.
How it works
Rogers and Huang’s most sophisticated device incorporates a distributed array of 32 individually programmable, millimeter-scale actuators, each of which generates a discrete sense of touch at a corresponding location on the skin. Each actuator resonates most strongly at 200 cycles per second, where the skin exhibits maximum sensitivity.
“We can adjust the frequency and amplitude of each actuator quickly and on-the-fly through our graphical user interface,” Rogers said. “We tailored the designs to maximize the sensory perception of the vibratory force delivered to the skin.”
The patch wirelessly connects to a touchscreen interface (on a smartphone or tablet). When a user touches the touchscreen, that pattern of touch transmits to the patch. If the user draws an “X” pattern on the touchscreen, for example, the devices produce a sensory pattern, simultaneously and in real-time, in the shape of an “X” through the vibratory interface to the skin.
When video chatting from different locations, friends and family members can reach out and virtually touch each other — with negligible time delay and with pressures and patterns that can be controlled through the touchscreen interface.
“You could imagine that sensing virtual touch while on a video call with your family may become ubiquitous in the foreseeable future,” Huang said.
The actuators are embedded into an intrinsically soft and slightly tacky silicone polymer that adheres to the skin without tape or straps. Wireless and battery-free, the device communicates through near-field communication (NFC) protocols, the same technology used in smart phones for electronic payments.
You could imagine that sensing virtual touch while on a video call with your family may become ubiquitous in the foreseeable future.”
“With this wireless power delivery scheme, we completely avoid the need for batteries, with their weight, size, bulk and limited operating lifetimes,” Rogers said. “The result is a thin, lightweight system that can be worn and used without constraint, indefinitely.”
Veteran describes importance of sensory feedback
Everyone can imagine how this type of technology could be combined with a VR headset to create more interactive and immersive gaming or entertainment experiences. But for U.S. Army veteran Garrett Anderson, epidermal VR might provide a much-needed solution to a real-life problem.
At 4 a.m. on Oct. 15, 2005, Anderson was ambushed during his deployment in the Iraq War and lost his right arm just below the elbow.
“A bomb exploded under my truck,” Anderson said. “It blew the entire engine out of the vehicle. Then shrapnel came through the vehicle and severed my arm, which was hanging on by tendons.”
Anderson recently tried Northwestern’s system, integrated with his prosthetic arm. When wearing the patch on his upper arm, Anderson could feel sensations from his prosthetic fingertips transmitted to his arm. The vibrations felt more or less intense, depending on the firmness of his grip.
I need to know the amount of grip that I’m applying, so that I don’t hurt something or someone.”
Sgt. Garrett Anderson
U.S. Army veteran
“Say that I’m grabbing an egg or something fragile,” said Anderson, who is now the outreach coordinator at the University of Illinois’ Chez Veterans Center. “If I can’t adjust my grip, then I might crush the egg. I need to know the amount of grip that I’m applying, so that I don’t hurt something or someone.”
‘I have never felt them with my right arm’
As people who have had amputations use the device, the experience could become more seamless.
“Users develop an ability to sense touch at the fingertips of their prosthetics through the sensory inputs on the upper arm,” Rogers explained. “Overtime, your brain can convert the sensation on your arm to a surrogate sense of feeling in your fingertips. It adds a sensory channel to reproduce the sense of touch.”
Anderson believes this device could potentially “trick” his brain in a way that relieves phantom pain. He also imagines that it could allow him to interact with his children in a new way.
“I lost my arm 15 years ago,” he said. “My kids are 13 and 10, so I have never felt them with my right arm. I don’t know what it’s like when they grab my right hand.”
‘A starting point’
Rogers views the current device as a starting point. “This is our first attempt at a system of this type,” he said. “It could be very powerful for social interactions, clinical medicine and applications that we cannot conceive of today, beyond the obvious opportunities in gaming and entertainment.”
He and Huang are already working to make the current device slimmer and lighter. They also plan to exploit different types of actuators, including those that can produce heating and stretching sensations. With thermal inputs, for example, a person might be able to sense how hot a cup of coffee is through prosthetic fingertips.
The Northwestern team believes the overall engineering framework can accommodate hundreds of actuators with dimensions significantly smaller than those used currently, which have diameters of 18 millimeters and thicknesses of 2.5 millimeters.
Eventually, the devices could be thin and flexible enough to be woven into clothes. People with prosthetics could wear VR shirts that communicate touch through their fingertips. And along with VR headsets, gamers could wear full VR suits to become fully immersed into fantastical landscapes.
“Virtual reality is a very important emerging area of technology,” Rogers said. “Currently, we’re just using our eyes and our ears as the basis for those experiences. The community has been comparatively slow to exploit the body’s largest organ: the skin. Our sense of touch provides the most profound, deepest, emotional connection between people.”
Learn more: ‘Epidermal VR’ gives technology a human touch
The Latest on: Virtual reality
- 10 Best Virtual Reality Stocks to Buyon May 1, 2021 at 7:29 am
In this article, we will take a look at the 10 best virtual reality stocks to buy. You can skip our comprehensive analysis of these companies and go ...
- Forget Ad Revenue, Facebook's Virtual Reality and Commerce Segments Were Standouts In Q1 2021on May 1, 2021 at 4:52 am
Ad sales jumped 46% higher, and Facebook will begin lapping initial effects of the pandemic last year when marketing hit the skids -- which means a similar jump higher in revenue is in the cards in ...
- Augmented & Virtual Reality Eyeglass Market: Technological Advancement & Growth Analysis with Forecast to 2027on May 1, 2021 at 4:10 am
Augmented & Virtual Reality Eyeglass Market research report gives detailed information of industry size, share, growth, segments, manufacturers, and advancements, major trends, market drivers, ...
- Virtual Reality In Gaming Market Impact and Recovery Analysis for the New Normal| Google, Samsung Electronics, Sony, Electronic Arts (EA), HTCon April 30, 2021 at 8:52 pm
Virtual reality gaming refers to applications where a person can experience being in a three-dimensional (3-D) environment and interact with it during a game. Virtual reality (VR) environments help ...
- Exercise and Virtual Realityon April 30, 2021 at 6:42 am
Virtual reality fitness, or VR fitness, is the idea of using cutting-edge, immersive VR technology to create a whole new workout environment anywhere in the world. These games feature a boxy headset ...
- From crushing candy to virtual reality, why officials in Worcester say MassDigi remaining in the city is ‘the future of our success’on April 30, 2021 at 3:24 am
The guest list for a celebration at Becker College on Monday resembled a roster of VIPs within Massachusetts. It included four college presidents, two lieutenant governors (one current, one former), a ...
- Global Augmented Reality and Virtual Reality (AR and VR) Market Size, Share, Value, And Competitive Landscape 2021-2026on April 29, 2021 at 5:45 am
Under COVID-19 outbreak globally, this report provides 360 degrees of analysis from supply chain, import and export ...
- Virtual reality investments are a long-term play for businesses targeting Gen Z, says South Korea's Zepetoon April 28, 2021 at 9:34 pm
Businesses looking to capture the next generation of customers are doing so through virtual reality headsets, according to the chief strategy officer of South Korean avatar app Zepeto.
- Virtual Reality in Gaming Market Top Manufacturers, Industry Size, Share and COVID 19 Impact on Revenue Growthon April 28, 2021 at 7:23 am
The overall virtual reality in gaming and entertainment market is expected to grow from USD 4.15 Billion in 2018 to ...
- Virtual reality bites: Seven virtual experiences rated against the real thingon April 28, 2021 at 2:38 am
We may not get out much in real life anymore - but that doesn't mean we can't laugh out loud at virtual reality laughably trying to re-create real-life experiences. It's just not the same, in my ...
via Bing News
The Latest on: Epidermal VR
- Engineered adeno-associated virus 3 vector with reduced reactivity to serum antibodieson April 29, 2021 at 11:58 am
The natural serotypes of adeno-associated virus (AAV) or their variants, such as AAV8 and AAV5, are commonly used as vectors in the clinical programs for liver-targeted gene therapy. While AAV8 ...
- Aston Martin V12 Speedster DBR1 specification pays homage to a beautiful race caron April 28, 2021 at 7:30 am
Aston Martin debuted the limited-run V12 Speedster over a year ago, and today it’s introducing a special edition version of the roofless and windshield-less supercar. It’s called the DBR1 ...
- GLOBAL-MARKETS-High-flying stocks wait on Fed signals, Apple resultson April 28, 2021 at 7:18 am
NEW YORK/LONDON, April 28 (Reuters) - World shares cosied up close to record highs and the dollar and global bond yields nudged up on Wednesday, as traders waited to see if the U.S. Federal Reserve ...
- Baker Real Estate Launches New Metro Vancouver Sales and Marketing Agencyon April 28, 2021 at 7:02 am
Baker Real Estate Incorporated announces today the launch of BakerWest, a fresh force in sales and marketing of pre-construction condominiums in Vancouver. BakerWest combines the deep local market ...
- A Guide To Dermatological Side Effects Of Chemotherapy And Targeted Cancer Therapyon April 27, 2021 at 11:10 am
Podiatrists can play a vital role in the overall outcomes and quality of life for patients undergoing treatment for cancer. Here the authors outline several dermatologic side effects that patients may ...
- Dermatologic Adverse Events Associated With Systemic Anticancer Agentson April 23, 2021 at 5:00 pm
J Support Oncol 8:149â 161, 2010.Belum VR, Fischer A, Choi JN ... Tetracycline to prevent epidermal growth factor receptor inhibitor-induced skin rashes: Results of a placebo-controlled trial from the ...
- Haptic-feedback smart glove as a creative human-machine interface (HMI) for virtual/augmented reality applicationson April 5, 2021 at 5:00 pm
However, some of these technologies expose several limitations in the applications of virtual reality (VR) and augmented reality (AR), for ... On the other hand, the stretchable and epidermal sensors ...
- Mimicking Rose Petals Could Create a Better Solar Panelon March 30, 2021 at 5:00 pm
Specifically, a team from KIT has replicated the epidermal cells in the outermost tissue of rose petals that have particularly good antireflection properties, they said. They then integrated the ...
- Facebook's upcoming AR wrist controllers will hijack your nerveson March 17, 2021 at 5:00 pm
Facebook is already leaps and bounds ahead of the VR game with its groundbreaking Oculus Quest 2 wireless headsets, and it's got serious ambitions in the augmented reality space too. In an online ...
- Mycobacterial Diseases in Catson March 2, 2018 at 12:31 pm
"Feline leprosy" is characterised by the formation of single or multiple dermal or epidermal granulomas (with or without local ... Baral RM, Metcalfe SS, Krockenberger MB, Catt MJ, Barrs VR, McWhirter ...
via Bing News