Imagine changing the channel of your TV simply by moving your cup of tea, adjusting the volume on a music player by rolling a toy car, or rotating a spatula to pause a cookery video on your tablet.
New gesture control technology that can turn everyday objects into remote controls could revolutionise how we interact with televisions, and other screens – ending frustrating searches for remotes that have slipped down the side of sofa cushions.
In a paper – ‘Matchpoint: Spontaneous spatial coupling of body movement for touchless pointing’ – which will be presented at the UIST2017 conference in Quebec City this October, researchers from Lancaster University show a novel technique that allows body movement, or movement of objects, to be used to interact with screens.
The ‘Matchpoint’ technology, which only requires a simple webcam, works by displaying moving targets that orbit a small circular widget in the corner of the screen. These targets correspond to different functions – such as volume, changing channel or viewing a menu. The user synchronises the direction of movement of the target, with their hand, head or an object, to achieve what researchers call ‘spontaneous spatial coupling’, which activates the desired function.
Unlike existing gesture control technology, the software does not look for a specific body part it has been trained to identify – such as a hand. Lancaster’s technology looks for rotating movement so it doesn’t require calibration, or the software to have prior knowledge of objects. This provides much more flexibility and ease for the user as it works even while hands are full, and while stood or slouching on the sofa.
Users also do not need to learn specific commands to activate different functions, as is the case with some gesture controlled televisions on the market, and the user is able to decouple at will.
When selecting volume adjustment or channel selection, sliders appear. The user moves their hand, head, or object, in the required direction indicated by the slider to change the volume or to find the desired channel.
As well as televisions, the technology can also be used with other screens. For example, YouTube tutorials, such as mending bikes or baking cakes, could be easily paused and rewound on tablet computers without users having to put down tools or mixing bowls.
Multiple pointers can be created to allow more than one user to point at drawings or pictures on interactive whiteboards simultaneously. Matchpoint also allows users to manipulate images on whiteboards by using two hands to zoom in and out, and rotate images.
In addition to short-term couplings, users can also link stationary objects to controls, which even when left for prolonged periods will retain their control function. For example, a mug sat on a table could change a track on a music player when moved left or right, and a rolling toy car could be used to adjust volume. Objects can lose their coupling with controls simply by removing them from the camera’s field of view.
Christopher Clarke, PhD student at Lancaster University’s School of Computing and Communications, and developer of the technology, said: “Spontaneous spatial coupling is a new approach to gesture control that works by matching movement instead of asking the computer to recognise a specific object.
“Our method allows for a much more user-friendly experience where you can change channels without having to put down your drink, or change your position, whether that is relaxing on the sofa or standing in the kitchen following a recipe.
“Everyday objects in the house can now easily become remote controls so there are no more frantic searches for remote controls when your favourite programme is about to start on another channel, and now everyone in the room has the ‘remote’. You could even change the channel with your pet cat.”
Researchers believe Matchpoint is also suitable to be used as an accessibility tool for people who are unable to use traditional pointers, such as remote controls and a mouse and keyboard.
Learn more: ‘Revolutionary’ new gesture control tech turns any object into a TV remote
The Latest on: Gesture control
[google_news title=”” keyword=”gesture control” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]- Control Gallery Announces "Don't Stop" an Exhibition by FAILEon May 1, 2024 at 5:43 am
LOS ANGELES, May 1, 2024 /PRNewswire/ -- CONTROL GALLERY proudly presents EXHIBITION 012: Don't Stop, a captivating new exhibition by Brooklyn -based artistic powerhouse FAILE.
- Subtle gesture shows emotional King Charles 'wants to make people proud' - experton May 1, 2024 at 4:12 am
King Charles has returned to work and in an emotional first engagement displayed one subtle gesture that, an expert claims, shows just how much the monarch 'wants to make people proud' ...
- Princess Cruises Announces Revised 2025 World Cruise Itinerarieson April 30, 2024 at 11:46 pm
“These global events beyond our control have necessitated these reroutings but we are pleased to continue to ensure these world cruises retain destination-rich itineraries with incredible stops along ...
- Watch: Shah Rukh Khan's Heartwarming Gesture For KKR Star Rinku Singh After T20 World Cup Snubon April 30, 2024 at 7:14 pm
KKR star Rinku Singh found no space in India's 15-man squad for T20 World Cup 2024 but was included in the Reserve Players list.
- Columbia University tightens campus access after student protesters control buildingon April 30, 2024 at 5:22 pm
A demonstratro gestures from a balcony of Hamilton Hall, where students at Columbia University have barricaded themselves inside as they continue to protest in support of Palestinians, despite orders ...
- Voice & gestures enough to control this wheelchairon April 30, 2024 at 4:48 pm
A team of students and teachers at VISAT Engineering College Elanji developed a smart wheelchair that can be controlled using voice commands and motion gestures. The wheelchair, created within a ...
- Vaughan Gething lost control of his eyebrows when a Senedd member tried to give him a roseon April 30, 2024 at 7:37 am
A Plaid Cymru politician tried to give Wales' First Minister Vaughan Gething a rose during First Minister's Questions. Delyth Jewell was making a point about culture in Wales, and asked the Labour ...
- United fans’ forgotten Hillsborough gestureon April 30, 2024 at 7:24 am
Entitled ‘OLD RIVALS NOW UNITED IN SORROW’, it gave details of a small, powerful gesture from Manchester United’s fans in the wake of the horrendous Hillsborough disaster. A gesture that years of ...
- Next-Gen Apple Pencil: Haptic Feedback and New Gestures Expectedon April 29, 2024 at 7:59 am
Apple’s 'Let It Loose' event is just a week away, the company should unveil at least three new iPad Pro models: an iPad Pro and a lengthier iPad Air ...
- Emily Henry’s latest novel challenges the romantic ‘grand gesture’on April 25, 2024 at 11:10 am
Her latest release, "Funny Story," fittingly finds its heroine in circumstances both tragic and hilarious. Daphne, a children's librarian, has been dumped by her fiancé, Peter, who left her for his ...
via Google News and Bing News