Professor Otmar Hilliges and his staff at ETH Zurich have developed a new app enabling users to operate their smartphone with gestures. This development expands the range of potential interactions with such devices.
It does seem slightly odd at first: you hold the phone in one hand, and move the other in the air above its built-in camera making gestures that resemble sign language. Sometimes you move your index finger to the left, sometimes to the right. You can spread out your fingers, or imitate a pair of pliers or the firing of a pistol. These gestures are not, however, intended for communicating with deaf people; they are for controlling your smartphone.
By mimicking the firing of a pistol, for example, a user can switch to another browser tab, change the map’s view from satellite to standard, or shoot down enemy planes in a game. Spreading out your fingers magnifies a section of a map or scrolls the page of a book forwards.
All this gesturing wizardry is made possible by a new type of algorithm developed by Jie Song, a Master’s student in the working group headed by by Otmar Hilliges, Professor of Computer Science. The researchers presented the app to an audience of industry professionals at the UIST symposium in Honolulu, Hawaii.
Intelligent programming uses computer memory
The program uses the smartphone’s built-in camera to register its environment. It does not evaluate depth or colour. The information it does register – the shape of the gesture, the parts of the hand – is reduced to a simple outline that is classified according to stored gestures. The program then executes the command associated with the gesture it observes. The program also recognises the hand’s distance from the camera and warns the user when the hand is either too close or too far away.
“Many movement-recognition programs need plenty of processor and memory power”, explains Hilliges, adding that their new algorithm uses a far smaller portion of computer memory and is thus ideal for smartphones. He believes the application is the first of its kind that can run on a smartphone. The app’s minimal processing footprint means it could also run on smart watches or in augmented-reality glasses.
The Latest on: Gesture interface
[google_news title=”” keyword=”Gesture interface” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
via Google News
The Latest on: Gesture interface
- Android versions: A living history from 1.0 to 15on April 26, 2024 at 2:48 am
Explore Android's ongoing evolution with this visual timeline of versions, starting B.C. (Before Cupcake) and going all the way to 2024's Android 15 (beta) release.
- Realme Narzo 70 and Narzo 70x 5G launched in India, will get air gesture and rain water touch featureson April 26, 2024 at 2:21 am
Realme, the popular smartphone brand known for its innovation and affordability, has recently unveiled its latest offerings in the Indian ma..|News Track ...
- What’s New in the Latest Samsung Galaxy Software Updateon April 23, 2024 at 11:28 pm
Samsung Galaxy has recently released a new software update that brings significant improvements to the user interface of its smartphones. This update, ...
- Human Gestures Control This Robot Armon April 22, 2024 at 4:59 pm
Regardless, it’s a very cool proof of concept of what you can do with a gesture interface device like the Sensel. The MeArm ships without a controller and pairing it with a non-traditional ...
- The Humane AI Pin has no future as long as the Apple Watch existson April 19, 2024 at 3:53 am
Negative criticism is fun, as Anton Ego so wisely observed. And I had a lot of fun this week watching Marques Brownlee’s polite demolition of the Humane AI pin, which he described as “the worst ...
- Mudra Band Upgrades Mac Computers’ User Experience with AI Gesture Mouse Allowing Natural Effortless Navigationon April 17, 2024 at 7:03 am
Enhanced Apple TV Control: The update extends Mudra Band’s capabilities to Apple TV, allowing users to navigate the entertainment platform with ease. Gesture controls transform the viewing experience, ...
- What is the shaka? Hawaii lawmakers want to officially claim 'hang loose' hand gestureon April 15, 2024 at 4:53 pm
In a nod to its rich cultural heritage, Hawaii's State Legislature appears poised to designate the iconic "shaka" gesture as the island's official symbol, recognizing it as its birthplace.
- The next Apple TV might arrive with a camera and gesture controlson April 8, 2024 at 10:36 pm
If the whole idea of setting up a camera in front of the big screen and swiping around the interface using gestures sounds familiar, that's because it is. Microsoft experimented with the idea in ...
- One UI 6.1: A Mixed Bag of AI, Gestures, and Battery Woes – Samsung’s Latest Update Decodedon April 7, 2024 at 5:00 pm
The latest iteration of Samsung’s interface, One UI 6.1 ... Samsung has made significant changes to navigation and gestures in One UI 6.1, sparking debate among users. The removal of the ...
- Could Apple Bring Eye Tracking And Pinch Gestures To The Mac?on April 3, 2024 at 7:00 am
Now, with the Vision Pro, Apple is primed to make eye-tracking, pinching, gestures and voice a standard user interface for its XR headsets. This latest UI used to navigate the Vision Pro is new.
via Bing News