A new device developed at CMU uses multiple strings attached to the hand and fingers to simulate the feel of obstacles and objects in virtual reality
Strings Attached to Hand, Fingers Create More Realistic Haptic Feedback
Today’s virtual reality systems can create immersive visual experiences, but seldom do they enable users to feel anything — particularly walls, appliances and furniture. A new device developed at Carnegie Mellon University, however, uses multiple strings attached to the hand and fingers to simulate the feel of obstacles and heavy objects.
By locking the strings when the user’s hand is near a virtual wall, for instance, the device simulates the sense of touching the wall. Similarly, the string mechanism enables people to feel the contours of a virtual sculpture, sense resistance when they push on a piece of furniture or even give a high five to a virtual character.
Cathy Fang, who will graduate from CMU next month with a joint degree in mechanical engineering and human-computer interaction, said the shoulder-mounted device takes advantage of spring-loaded strings to reduce weight, consume less battery power and keep costs low.
“Elements such as walls, furniture and virtual characters are key to building immersive virtual worlds, and yet contemporary VR systems do little more than vibrate hand controllers,” said Chris Harrison, assistant professor in CMU’s Human-Computer Interaction Institute (HCII). User evaluation of the multistring device, as reported by co-authors Harrison, Fang, Robotics Institute engineer Matthew Dworman and HCII doctoral student Yang Zhang, found it was more realistic than other haptic techniques.
“I think the experience creates surprises, such as when you interact with a railing and can wrap your fingers around it,” Fang said. “It’s also fun to explore the feel of irregular objects, such as a statue.”
The team’s research paper was named a best paper by the Conference on Human Factors in Computing Systems (CHI 2020), which was scheduled for this month but canceled due to the COVID-19 pandemic. The paper has now been published in the conference proceedings in the Association for Computing Machinery’s Digital Library.
Other researchers have used strings to create haptic feedback in virtual worlds, but typically they use motors to control the strings. Motors wouldn’t work for the CMU researchers, who envisioned a system both light enough to be worn by the user and affordable for consumers.
“The downside to motors is they consume a lot of power,” Fang said. “They also are heavy.”
Instead of motors, the team used spring-loaded retractors, similar to those seen in key chains or ID badges. They added a ratchet mechanism that can be rapidly locked with an electrically controlled latch. The springs, not motors, keep the strings taut. Only a small amount of electrical power is needed to engage the latch, so the system is energy efficient and can be operated on battery power.
The researchers experimented with a number of different strings and string placements, eventually concluding that attaching one string to each fingertip, one to the palm and one to the wrist provided the best experience. A Leap Motion sensor, which tracks hand and finger motions, is attached to the VR headset. When it senses that a user’s hand is in proximity to a virtual wall or other obstacle, the ratchets are engaged in a sequence suited to those virtual objects. The latches disengage when the person withdraws their hand.
The entire device weighs less than 10 ounces. The researchers estimate that a mass-produced version would cost less than $50.
Fang said the system would be suitable for VR games and experiences that involve interacting with physical obstacles and objects, such a maze. It might also be used for visits to virtual museums. And, in a time when physically visiting retail stores is not always possible, “you might also use it to shop in a furniture store,” she added.
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
Virtual reality
- Virtual reality could make seeing your favorite band less expensive, if these artists have their way
Heavy-metal band Avenged Sevenfold and rapper T-Pain are among a growing number of artists who are using virtual reality to connect with their fans at a ...
- The Rise of Virtual Reality Slots: What Gamers Can Expect in the Next Decade
Future VR slots will leverage more intuitive and user-friendly interfaces. Integrating hand tracking and gesture recognition technology will allow players to interact with the virtual slot machine ...
- Alien: Rogue Incursion - A New Virtual Reality Horror Adventure Announced
Marking the celebration of Alien Day, publisher 20th Century Games, in collaboration with developer Survios, has unveiled their latest project, Alien: Rogue Incursion. This new entry in the storied ...
- 4 Tips for Navigating Virtual Reality Safely
Virtual reality (VR) has taken major leaps forward in recent years. With the release of the Apple Vision Pro in early 2024, people are starting to realize how truly powerful this technology is and how ...
- Virtual reality headsets ease treatments for young patients at Advocate Children’s Hospitals
At Advocate Children’s Hospitals in Oak Lawn and Park Ridge, virtual reality systems are helping young patients deal with the discomfort of invasive treatments such as chemotherapy.
Go deeper with Google Headlines on:
Virtual reality
[google_news title=”” keyword=”virtual reality” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]
Go deeper with Bing News on:
Haptic feedback
- Skyrim VR player who spent $15k on the "most immersive" setup adds a second haptic suit to simulate real pain
The SkyrimVR streamer who previously spent $15,000 on the "most immersive" virtual reality setup possible has once again upgraded their rig with a second haptic suit that converts in-game damage into ...
- The unsung hero behind the modernization of Windows laptops
We chat with Sensel about the technology behind haptic touchpads, look at some of their cool concepts, and more.
- Global Dental Simulator Industry is predicted to expand at a 7.8% CAGR and generate US$ 780.5 Million By 2033 | FMI
The Global Dental Simulator Industry is poised for a remarkable upswing, with projections forecasting a staggering growth trajectory. According to a recent analysis, the market is expected to reach an ...
- Swiftpoint Z2 review: The most customizable gaming mouse ever made
At a glance Expert's Rating Pros ・Converts to a joystick ・The button layout and button customization is excellent ・Pressure sensors and haptic feedback give you a deeper level of functionality ・Has a ...
- Next-Generation Haptic Testing Solution Comes to IGATEX Pakistan for the First Time
Attendees of IGATEX Pakistan are invited to visit the AHS Textile (AHS) booth D01-D06 in Hall 3. Emtec’s Giselher Gruener and Farhan Rasul from AHS will be on hand to demonstrate the TSA device and ...
Go deeper with Google Headlines on:
Haptic feedback
[google_news title=”” keyword=”haptic feedback” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]
