Depth Cameras and Projectors Combine To Make Smart Environments
Researchers previously have shown that a depth camera system, such as Kinect, can be combined with a projector to turn almost any surface into a touchscreen. But now researchers at Carnegie Mellon University have demonstrated how these touch-based interfaces can be created almost at will, with the wave of a hand.
CMU’s WorldKit system enables someone to rub the arm of a sofa to “paint” a remote control for her TV or swipe a hand across an office door to post his calendar from which subsequent users can “pull down” an extended version. These ad hoc interfaces can be moved, modified or deleted with similar gestures, making them highly personalized.
Researchers at Carnegie Mellon’s Human-Computer Interaction Institute (HCII) used a ceiling-mounted camera and projector to record room geometries, sense hand gestures and project images on desired surfaces.
But Robert Xiao, an HCII doctoral student, said WorldKit does not require such an elaborate installation. “Depth sensors are getting better and projectors just keep getting smaller,” he said. “We envision an interactive ‘light bulb’ – a miniaturized device that could be screwed into an ordinary light fixture and pointed or moved to wherever an interface is needed.”
The system does not require prior calibration, automatically adjusting its sensing and image projection to the orientation of the chosen surface. Users can summon switches, message boards, indicator lights and a variety of other interface designs from a menu. Ultimately, the WorldKit team anticipates that users will be able to custom design interfaces with gestures.
Xiao developed WorldKit with Scott Hudson, an HCII professor, and Chris Harrison, a Ph.D. student. They will present their findings April 30 at CHI 2013, the Conference on Human Factors in Computing Systems, in Paris.
“People have talked about creating smart environments, where sensors, displays and computers are interwoven,” said Harrison, who will join the HCII faculty this summer. “But usually, that doesn’t amount to much besides mounting a camera up on the ceiling. The room may be smart, but it has no outlet for that smartness. With WorldKit, we say forget touchscreens and go straight to projectors, which can make the room truly interactive.”
Though WorldKit now focuses on interacting with surfaces, the researchers anticipate future work may enable users to interact with the system in free space. Likewise, higher resolution depth cameras may someday enable the system to sense detailed finger gestures. In addition to gestures, the system also could be designed to respond to voice commands.
The Latest Bing News on:
Touch-based Interfaces
- ConsenSys sues SEC and demands ETH be classified as non-securityon April 25, 2024 at 3:39 pm
ConsenSys has officially thrown down the gauntlet, filing a lawsuit against the U.S. Securities and Exchange Commission (SEC). Their beef? They’re slamming the SEC for what they claim is an “unlawful ...
- Rabbit R1 Reviews Herald ‘Standout’ AI Assistant After Disastrous Humane Pin Launchon April 25, 2024 at 1:31 pm
Affordability, user-friendly design, and impressive capabilities help the latest AI gadget Rabbit R1 hop ahead of its scant competition.
- Embedded world 2024: SDVs and AI in automotiveon April 25, 2024 at 12:14 pm
At embedded world 2024, chipmakers deliver new platforms and technologies to advance SDVs and AI in automotive.
- I just spent my first day with the Rabbit R1 — here’s what this AI gadget can doon April 25, 2024 at 7:21 am
You also get an analog scroll wheel on the right side and a push-to-talk button for chatting with the R1. Interacting with the Rabbit R1 takes some getting used to. For example, even though there's a ...
- Hands-on with the Rabbit R1: Hopping into an AI-powered future?on April 25, 2024 at 6:41 am
Rabbit has officially jumped into the AI companion race, but is it ready to take on Humane? Let's go hands on with the Rabbit R1 to find out.
- Rabbit r1 unboxing and hands-on by Unboxed Therapyon April 24, 2024 at 5:00 pm
The physical scroll wheel not only adds to the retro charm but also enhances the user experience, making each command feel more deliberate and satisfying compared to purely touch-based interfaces. One ...
- Up Close: Imaginandoon April 24, 2024 at 10:50 am
In the late 2000s, Portugal-based software developer Nuno Santos was engaged in a fascinating dual life—serving on a team that ...
- Rabbit r1 AI personal assistant live hands-on demo by Jesse Lyuon April 24, 2024 at 12:16 am
One of the first production Rabbit r1 AI Assistance has showcased by Jesse Lyu in an onstage demonstration. Priced at $199 with no subs ...
- New Euro NCAP Rules: Physical Buttons Are Back—Touch Screens Face Restrictionson April 23, 2024 at 2:47 am
The move from physical buttons to touchscreens has changed vehicle design and user interaction, but safety concerns are now reversing this trend.
- The Out-of-Touch Adults’ Guide to Kid Culture: The ‘Soft Guy Era’on April 16, 2024 at 7:00 am
I dug around in the cesspit of online alpha male influencers to find out what Soft Guy Era means. I also looked into the wholesome Utah Fit Check trend, found out what happens when AI starts making ...
The Latest Google Headlines on:
Wouch-based Interfaces
[google_news title=”” keyword=”Touch-based Interfaces” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
[/vc_column_text]
The Latest Bing News on:
Computer Interaction
- What Hollywood Will Look Like in 10 Yearson April 27, 2024 at 2:00 am
AI, strikes, and COVID-19 have meant tough times for Tinseltown, so how will it navigate the ongoing changes facing it?
- ShrutiSalunkhe Leads the Way in User-Centric VR and AR Design Innovationon April 26, 2024 at 8:20 pm
ShrutiSalunkhe Leads the Way in User-Centric VR and AR Design Innovation.Illinois, USA - April 27, 2024 — Amidst the current state of ...
- AI priest quickly defrocked after giving users oddball answers, taking confessions like ‘real’ clergymanon April 26, 2024 at 5:34 pm
An AI priest was defrocked just days after its inception after the chatbot repeatedly claimed to users that it was a real member of the clergy and performed sacraments. “Father Justin” is a handsome, ...
- UT Martin hosts BR41N.IO Hackathon this weekendon April 26, 2024 at 1:36 pm
Brain-computer interaction technology may sound like science fiction, but the University of Tennessee at Martin is hosting competitors in a worldwide hackathon competition focused on the field this ...
- Moderna's CEO Says Staff Should Consult ChatGPT 20 Times a Dayon April 26, 2024 at 9:37 am
OpenAI has partnered with the drug maker to embed AI throughout the business. And Stéphane Bancel says his staff should be using the system way more than you might guess.
- Department of communication and media researchers win 2024 best paper awardon April 25, 2024 at 11:38 pm
Science X is a network of high quality websites with most complete and comprehensive daily coverage of the full sweep of science, technology, and medicine news ...
- China Creates 'Neucyber,' Its Version of a Neuralink Brain Chipon April 25, 2024 at 5:58 am
China has reportedly developed a brain-computer interface chip called Neucyber that allows a monkey to control a robotic arm with only its thoughts.
- AI smartphones may soon help monitor chronic wounds from homeon April 24, 2024 at 5:00 pm
In early 2026, the team will implement the second stage: a participatory design, feedback and usability study that will include patients and human-computer interaction experts to assess and improve ...
- Miranda Cosgrove recalls interaction with young “iCarly” fan at Target: 'You got old'on April 24, 2024 at 7:52 am
The "iCarly" star said the boy recognized her from the original sitcom's resurgence ahead of its Paramount+ revival.
- A Paradigm Shift in RAM Is About to Make Computing Unstoppableon April 24, 2024 at 5:30 am
For more than two decades, the most advanced version of this technology—magnetoresistive RAM, or MRAM—has been the go-to tech for the kind of intense computing necessary in industrial, military, and ...
The Latest Google Headlines on:
Computer Interaction
[google_news title=”” keyword=”Computer Interaction” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]