Depth Cameras and Projectors Combine To Make Smart Environments
Researchers previously have shown that a depth camera system, such as Kinect, can be combined with a projector to turn almost any surface into a touchscreen. But now researchers at Carnegie Mellon University have demonstrated how these touch-based interfaces can be created almost at will, with the wave of a hand.
CMU’s WorldKit system enables someone to rub the arm of a sofa to “paint” a remote control for her TV or swipe a hand across an office door to post his calendar from which subsequent users can “pull down” an extended version. These ad hoc interfaces can be moved, modified or deleted with similar gestures, making them highly personalized.
Researchers at Carnegie Mellon’s Human-Computer Interaction Institute (HCII) used a ceiling-mounted camera and projector to record room geometries, sense hand gestures and project images on desired surfaces.
But Robert Xiao, an HCII doctoral student, said WorldKit does not require such an elaborate installation. “Depth sensors are getting better and projectors just keep getting smaller,” he said. “We envision an interactive ‘light bulb’ – a miniaturized device that could be screwed into an ordinary light fixture and pointed or moved to wherever an interface is needed.”
The system does not require prior calibration, automatically adjusting its sensing and image projection to the orientation of the chosen surface. Users can summon switches, message boards, indicator lights and a variety of other interface designs from a menu. Ultimately, the WorldKit team anticipates that users will be able to custom design interfaces with gestures.
Xiao developed WorldKit with Scott Hudson, an HCII professor, and Chris Harrison, a Ph.D. student. They will present their findings April 30 at CHI 2013, the Conference on Human Factors in Computing Systems, in Paris.
“People have talked about creating smart environments, where sensors, displays and computers are interwoven,” said Harrison, who will join the HCII faculty this summer. “But usually, that doesn’t amount to much besides mounting a camera up on the ceiling. The room may be smart, but it has no outlet for that smartness. With WorldKit, we say forget touchscreens and go straight to projectors, which can make the room truly interactive.”
Though WorldKit now focuses on interacting with surfaces, the researchers anticipate future work may enable users to interact with the system in free space. Likewise, higher resolution depth cameras may someday enable the system to sense detailed finger gestures. In addition to gestures, the system also could be designed to respond to voice commands.
The Latest Bing News on:
Touch-based Interfaces
- Neurable raises $13M for brain-computer interface with everyday productson May 7, 2024 at 11:00 am
Neurable raised $13 million for its brain-computer interface (BCI) technology that can work with everyday products.
- Human-Machine Interface Market to be Worth $8.57 Billion by 2030 - Exclusive Report by Meticulous Research®on May 3, 2024 at 3:17 am
Based on configuration, the human-machine interface market ... Furthermore, advancements in augmented reality displays, voice recognition, and touch-sensitive interfaces are driving the adoption of ...
- Next-Level Robotics: Enhancing Accuracy with Advanced Multisensory Interfaceson May 1, 2024 at 2:35 am
Researchers introduced an advanced multisensory interface in Actuators journal, enhancing robot-assisted pouring tasks with detailed sensory feedback while managing high visual demands. Their ...
- Dutch startup to test hearing via brain-computer interfaceon April 30, 2024 at 6:23 am
MindAffect has raised new funding for its hearing diagnostics solution that uses brain-computer interface technology.
- Stablecoin Issuer Tether Invests $200 Million in Brain-Computer Interface Companyon April 29, 2024 at 7:43 am
Tether Holdings Ltd., the issuer of the biggest stablecoin, said it invested $200 million in Blackrock Neurotech, a maker of brain-computer interface technology.
- Best Linux distro of 2024on April 25, 2024 at 1:42 am
The distro is based on the Ubuntu LTS release (in this case 22.04) and sports its own user interface over GNOME, called Pop Shell. While there are several other gaming distros for Linux ...
- New Euro NCAP Rules: Physical Buttons Are Back—Touch Screens Face Restrictionson April 23, 2024 at 2:47 am
The move from physical buttons to touchscreens has changed vehicle design and user interaction, but safety concerns are now reversing this trend.
- Kontron Micro Client IIA 170: Intel Atom-Based Touch Panel PC Now Available in Five Sizeson April 16, 2024 at 10:39 pm
The Intel Atom-based touch panel PC enables Kontron to support the trend towards ... is conceived as an application ready human machine interface (HMI) enabling faster time-to-market and reduced ...
The Latest Google Headlines on:
Wouch-based Interfaces
[google_news title=”” keyword=”Touch-based Interfaces” num_posts=”10″ blurb_length=”0″ show_thumb=”left”] [/vc_column_text]The Latest Bing News on:
Computer Interaction
- Altera raises $9M to develop AI for digital humanson May 8, 2024 at 2:59 pm
Altera has raised $9 million to develop AI technology to create digital humans that behave in believable ways.
- The interference of many atoms, and a new approach to boson samplingon May 8, 2024 at 10:00 am
In daily life, when two objects are "indistinguishable," it's due to an imperfect state of knowledge. As a street magician scrambles the cups and balls, you could, in principle, keep track of which ...
- IIT Mandi: Centre for Human-Computer Interaction (CHCi) launchedon May 8, 2024 at 3:05 am
Computer Interaction is a milestone in the nascent history of Technology Innovation Hub and the Indian Institute of Technology (IIT) Mandi. The inaugural event, held today, Wednesday, May 8, was ...
- Launch of the Centre for Human-Computer Interaction (CHCi) by the Technology Innovation Hub (TIH) at IIT Mandion May 7, 2024 at 10:23 pm
The establishment of the Centre for Human-Computer Interaction is a significant milestone in the nascent history of Technology Innovation Hub and IIT Mandi. The inaugural event was graced by esteemed ...
- Do Know Harm: Considering the Ethics of Online Community Researchon May 7, 2024 at 10:18 am
Strategies for engaging in more ethical research with online communities. Computing technology is integrated into people’s lives, impacting how we work, learn, play, and connect. As a result, ...
- Saint Louis University Launches Human-Computer Interaction Labon May 1, 2024 at 7:31 pm
The Human-Computer Interaction (HCI) Lab uses innovative eye-tracking equipment to provide real-time data and information on how users interact with web interfaces. Bidisha Chakrabarty, Ph.D., the ...
- Computer Science Newson April 30, 2024 at 5:00 pm
May 6, 2024 — Researchers have achieved the first controllable interaction between two hole spin qubits in a conventional silicon transistor. The breakthrough opens up the possibility of ...
- COMP.5280 Evaluation of Human-Computer Interaction (Formerly 91.528)on April 8, 2024 at 5:32 am
This course is an introduction to methods used to evaluate the design of human-computer interaction (HCI). Students will apply examples of all three of the major types of HCI evaluation techniques: ...
- COMP.5270 Human Computer Interaction (Formerly 91.527)on March 2, 2024 at 3:43 am
The purpose of this class is to ground students in the basics of how humans interact with technology, and make students aware of the breadth of topic areas related to human-computer interaction (HCI).
- Research Methods for Human-Computer Interactionon August 15, 2023 at 5:42 am
Human-Computer Interaction draws on the fields of computer science, psychology, cognitive science, and organisational and social sciences in order to understand how people use and experience ...
The Latest Google Headlines on:
Computer Interaction
[google_news title=”” keyword=”Computer Interaction” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]