Depth Cameras and Projectors Combine To Make Smart Environments
Researchers previously have shown that a depth camera system, such as Kinect, can be combined with a projector to turn almost any surface into a touchscreen. But now researchers at Carnegie Mellon University have demonstrated how these touch-based interfaces can be created almost at will, with the wave of a hand.
CMU’s WorldKit system enables someone to rub the arm of a sofa to “paint” a remote control for her TV or swipe a hand across an office door to post his calendar from which subsequent users can “pull down” an extended version. These ad hoc interfaces can be moved, modified or deleted with similar gestures, making them highly personalized.
Researchers at Carnegie Mellon’s Human-Computer Interaction Institute (HCII) used a ceiling-mounted camera and projector to record room geometries, sense hand gestures and project images on desired surfaces.
But Robert Xiao, an HCII doctoral student, said WorldKit does not require such an elaborate installation. “Depth sensors are getting better and projectors just keep getting smaller,” he said. “We envision an interactive ‘light bulb’ – a miniaturized device that could be screwed into an ordinary light fixture and pointed or moved to wherever an interface is needed.”
The system does not require prior calibration, automatically adjusting its sensing and image projection to the orientation of the chosen surface. Users can summon switches, message boards, indicator lights and a variety of other interface designs from a menu. Ultimately, the WorldKit team anticipates that users will be able to custom design interfaces with gestures.
Xiao developed WorldKit with Scott Hudson, an HCII professor, and Chris Harrison, a Ph.D. student. They will present their findings April 30 at CHI 2013, the Conference on Human Factors in Computing Systems, in Paris.
“People have talked about creating smart environments, where sensors, displays and computers are interwoven,” said Harrison, who will join the HCII faculty this summer. “But usually, that doesn’t amount to much besides mounting a camera up on the ceiling. The room may be smart, but it has no outlet for that smartness. With WorldKit, we say forget touchscreens and go straight to projectors, which can make the room truly interactive.”
Though WorldKit now focuses on interacting with surfaces, the researchers anticipate future work may enable users to interact with the system in free space. Likewise, higher resolution depth cameras may someday enable the system to sense detailed finger gestures. In addition to gestures, the system also could be designed to respond to voice commands.
The Latest Bing News on:
Touch-based Interfaces
- Interlink Electronics Reports First Quarter 2024 Resultson May 9, 2024 at 10:03 am
Interlink Electronics, Inc. (Nasdaq: LINK), a world-leading provider of sensors and printed electronic solutions that support a wide range of applications ...
- Brain-computer interface translates ALS patient's brain activity into spoken wordson May 8, 2024 at 10:22 pm
Researchers successfully used a brain-computer interface to synthesize speech directly from brain activity in an ALS patient, achieving 80% word recognition accuracy by listeners, showcasing the ...
- Neuralink Cofounder Says He Quit Because of Safety Concernson May 7, 2024 at 9:23 am
During a recent interview, the other cofounder of Neuralink, Elon Musk's brain implant startup, said that he left due to safety concerns.
- Human-Machine Interface Market to be Worth $8.57 Billion by 2030 - Exclusive Report by Meticulous Research®on May 3, 2024 at 3:17 am
Based on configuration, the human-machine interface market ... Furthermore, advancements in augmented reality displays, voice recognition, and touch-sensitive interfaces are driving the adoption of ...
- Next-Level Robotics: Enhancing Accuracy with Advanced Multisensory Interfaceson May 1, 2024 at 2:35 am
Researchers introduced an advanced multisensory interface in Actuators journal, enhancing robot-assisted pouring tasks with detailed sensory feedback while managing high visual demands. Their ...
- Dutch startup to test hearing via brain-computer interfaceon April 30, 2024 at 6:23 am
MindAffect has raised new funding for its hearing diagnostics solution that uses brain-computer interface technology.
- Stablecoin Issuer Tether Invests $200 Million in Brain-Computer Interface Companyon April 29, 2024 at 7:43 am
Tether Holdings Ltd., the issuer of the biggest stablecoin, said it invested $200 million in Blackrock Neurotech, a maker of brain-computer interface technology.
- Best online collaboration tool of 2024on April 24, 2024 at 3:43 am
Microsoft Office may not be the first platform you think of when it comes to collaboration, but this now runs at the heart of the Microsoft 365 cloud-based ... uses the same interface as the ...
- Kontron Micro Client IIA 170: Intel Atom-Based Touch Panel PC Now Available in Five Sizeson April 16, 2024 at 10:39 pm
The Intel Atom-based touch panel PC enables Kontron to support the trend towards ... is conceived as an application ready human machine interface (HMI) enabling faster time-to-market and reduced ...
The Latest Google Headlines on:
Wouch-based Interfaces
[google_news title=”” keyword=”Touch-based Interfaces” num_posts=”10″ blurb_length=”0″ show_thumb=”left”] [/vc_column_text]The Latest Bing News on:
Computer Interaction
- Neuralink brain implant test suffers technical issueson May 9, 2024 at 4:53 am
Neuralink has posted an update on the first human trial of its not-entirely-successful brain implant.The Neuralink blog post discusses the experiences of patient Noland Arbaugh, who has used the ...
- The Sims 4: Detective Career Guideon May 9, 2024 at 3:58 am
Get to grips with the exciting Detective career that comes with The Sims 4 Get to Work Expansion Pack in this guide. Learn how to solve cases, and get tips on how to get through to those tricky ...
- IIT Mandi: Centre for Human-Computer Interaction (CHCi) launchedon May 8, 2024 at 3:05 am
Computer Interaction is a milestone in the nascent history of Technology Innovation Hub and the Indian Institute of Technology (IIT) Mandi. The inaugural event, held today, Wednesday, May 8, was ...
- Launch of the Centre for Human-Computer Interaction (CHCi) by the Technology Innovation Hub (TIH) at IIT Mandion May 7, 2024 at 10:23 pm
The establishment of the Centre for Human-Computer Interaction is a significant milestone in the nascent history of Technology Innovation Hub and IIT Mandi. The inaugural event was graced by esteemed ...
- Saint Louis University Launches Human-Computer Interaction Labon May 1, 2024 at 7:31 pm
The Human-Computer Interaction (HCI) Lab uses innovative eye-tracking equipment to provide real-time data and information on how users interact with web interfaces. Bidisha Chakrabarty, Ph.D., the ...
- Computer Science Newson April 30, 2024 at 5:00 pm
May 6, 2024 — Researchers have achieved the first controllable interaction between two hole spin qubits in a conventional silicon transistor. The breakthrough opens up the possibility of ...
- COMP.5280 Evaluation of Human-Computer Interaction (Formerly 91.528)on April 8, 2024 at 5:32 am
This course is an introduction to methods used to evaluate the design of human-computer interaction (HCI). Students will apply examples of all three of the major types of HCI evaluation techniques: ...
- COMP.5270 Human Computer Interaction (Formerly 91.527)on March 2, 2024 at 3:43 am
The purpose of this class is to ground students in the basics of how humans interact with technology, and make students aware of the breadth of topic areas related to human-computer interaction (HCI).
- Research Methods for Human-Computer Interactionon August 15, 2023 at 5:42 am
Human-Computer Interaction draws on the fields of computer science, psychology, cognitive science, and organisational and social sciences in order to understand how people use and experience ...
The Latest Google Headlines on:
Computer Interaction
[google_news title=”” keyword=”Computer Interaction” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]