Professor Otmar Hilliges and his staff at ETH Zurich have developed a new app enabling users to operate their smartphone with gestures. This development expands the range of potential interactions with such devices.
It does seem slightly odd at first: you hold the phone in one hand, and move the other in the air above its built-in camera making gestures that resemble sign language. Sometimes you move your index finger to the left, sometimes to the right. You can spread out your fingers, or imitate a pair of pliers or the firing of a pistol. These gestures are not, however, intended for communicating with deaf people; they are for controlling your smartphone.
By mimicking the firing of a pistol, for example, a user can switch to another browser tab, change the map’s view from satellite to standard, or shoot down enemy planes in a game. Spreading out your fingers magnifies a section of a map or scrolls the page of a book forwards.
All this gesturing wizardry is made possible by a new type of algorithm developed by Jie Song, a Master’s student in the working group headed by by Otmar Hilliges, Professor of Computer Science. The researchers presented the app to an audience of industry professionals at the UIST symposium in Honolulu, Hawaii.
Intelligent programming uses computer memory
The program uses the smartphone’s built-in camera to register its environment. It does not evaluate depth or colour. The information it does register – the shape of the gesture, the parts of the hand – is reduced to a simple outline that is classified according to stored gestures. The program then executes the command associated with the gesture it observes. The program also recognises the hand’s distance from the camera and warns the user when the hand is either too close or too far away.
“Many movement-recognition programs need plenty of processor and memory power”, explains Hilliges, adding that their new algorithm uses a far smaller portion of computer memory and is thus ideal for smartphones. He believes the application is the first of its kind that can run on a smartphone. The app’s minimal processing footprint means it could also run on smart watches or in augmented-reality glasses.
The Latest on: Gesture interface
[google_news title=”” keyword=”Gesture interface” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
via Google News
The Latest on: Gesture interface
- How Wi-Fi sensing simplifies presence detectionon May 9, 2024 at 4:59 pm
In practice, technical papers have reported accurate inference of human test subjects’ presence, location, motion, and gestures by analyzing changes in the CSI. Capturing presence data Any compliant ...
- Human Gestures Control This Robot Armon May 9, 2024 at 4:59 pm
Regardless, it’s a very cool proof of concept of what you can do with a gesture interface device like the Sensel. The MeArm ships without a controller and pairing it with a non-traditional ...
- Apple Pencil Pro: All the New Featureson May 9, 2024 at 10:03 am
There are some major changes that were introduced with the new accessory, including new gestures and capabilities. The squeeze gesture allows the Apple Pencil Pro to sense when pressure is ...
- Gesture Recognition And Touchless Sensing Market To Cross USD 104 Billion With Highest CAGR Of 9.51% By 2031on May 8, 2024 at 10:46 pm
The SNS Insider report highlights a promising future for the Gesture Recognition and Touchless Sensing Market , estimating it to reach USD 104 Billion by 2031. This growth signifies a CAGR of 9.51% ...
- Hawaii is poised to make the ‘shaka’ its official state gestureon May 8, 2024 at 8:03 pm
For decades, Hawaii residents have used the “shaka” hand gesture to convey several greetings — hello, goodbye, thank you and aloha. Now the shaka, which involves extending the thumb and ...
- Apple Pencil Pro Unveiled With New Squeeze Gesture, Haptic Feedback, Find My, and Moreon May 7, 2024 at 7:33 am
Apple today introduced the Apple Pencil Pro with a new squeeze gesture, haptic feedback, Find My support, and more. This story is being ...
- Microsoft Shows Off the Latest in Gesture Interfaceson May 1, 2024 at 2:02 am
If the Anonymous threat hoax was orchestrated by the Westboro Baptist Church, it is a prime example of how not to conduct a publicity stunt.
- The best Android app drawer enhancement you’ll ever makeon April 17, 2024 at 5:00 pm
As its name suggests, it lets you create custom panels that pop up when you perform specific gestures along the edges ... on your home screen to access that interface. You can set up the app ...
- What is the shaka? Hawaii lawmakers want to officially claim 'hang loose' hand gestureon April 15, 2024 at 4:53 pm
In a nod to its rich cultural heritage, Hawaii's State Legislature appears poised to designate the iconic "shaka" gesture as the island's official symbol, recognizing it as its birthplace.
via Bing News