Researchers from the School of Interactive Computing and the Institute for Robotics and Intelligent Machines developed a new method that teaches computers to “see” and understand what humans do in a typical day.
The technique gathered more than 40,000 pictures taken every 30 to 60 seconds, over a 6 month period, by a wearable camera and predicted with 83 percent accuracy what activity that person was doing. Researchers taught the computer to categorize images across 19 activity classes. The test subject wearing the camera could review and annotate the photos at the end of each day (deleting any necessary for privacy) to ensure that they were correctly categorized.
“It was surprising how the method’s ability to correctly classify images could be generalized to another person after just two more days of annotation,” said Steven Hickson, a Ph.D. candidate in Computer Science and a lead researcher on the project.
“This work is about developing a better way to understand people’s activities, and build systems that can recognize people’s activities at a finely-grained level of detail,” said Edison Thomaz, co-author and graduate research assistant in the School of Interactive Computing. “Activity tracking devices like the Fitbit can tell how many steps you take per day, but imagine being able to track all of your activities – not just physical activities like walking and running. This work is moving toward full activity intelligence. At a technical level, we are showing that it’s becoming possible for computer vision techniques alone to be used for this.”
The group believes they have gathered the largest annotated dataset of first-person images to demonstrate that deep-learning can understand human behavior and the habits of a specific person.
Student Daniel Casto, a Ph.D. candidate in Computer Science and a lead researcher on the project, helped present the method earlier this month at UBICOMP 2015 in Osaka, Japan. He says reaction from conference-goers was positive.
“People liked that we had a method that combines time and images,” Castro says. “Time (of activity) can be especially important for some activity classes. This system learned how relevant images were because of people’s schedules. What does it think the image is showing? It sees both time and image probabilities and makes a better prediction.”
The ability to literally see and recognize human activities has implications in a number of areas – from developing improved personal assistant applications like Siri to helping researchers explain links between health and behavior, Thomaz says.
Castro and Hickson believe that someday within the next decade we will have ubiquitous devices that can improve our personal choices throughout the day.
“Imagine if a device could learn what I would be doing next – ideally predict it – and recommend an alternative?” Castro says. “Once it builds your own schedule by knowing what you are doing, it might tell you there is a traffic delay and you should leave sooner or take a different route.”
Read more: Researchers Develop Deep-Learning Method to Predict Daily Activities
The Latest on: Deep learning
[google_news title=”” keyword=”Deep learning” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
via Google News
The Latest on: Deep learning
- New multi-task deep learning framework integrates large-scale single-cell proteomics and transcriptomics dataon April 26, 2024 at 7:35 am
The exponential progress in single-cell multi-omics technologies has led to the accumulation of large and diverse multi-omics datasets. However, the integration of single-cell proteomics and ...
- Star Trek Discovery’s L’ak Actor Told Us About Learning His Character's Most Exciting Details At A Point When He Couldn't Immediately Freak Outon April 26, 2024 at 3:36 am
Michael Burnham, being the inspiring captain that she is, offered to protect L'ak and Moll from the Breen, but her offer was rejected. The two made their escape, are off to continue to search for more ...
- Europe taps deep learning to make industrial robots safer colleagueson April 26, 2024 at 1:07 am
European researchers have launched the RoboSAPIENS project to make adaptive industrial robots more efficient and safer to work with humans.
- AI-powered 'deep medicine' could transform health care in the NHS and reconnect staff with their patientson April 25, 2024 at 10:20 am
Today's NHS faces severe time constraints, with the risk of short consultations and concerns about the risk of misdiagnosis or delayed care. These challenges are compounded by limited resources and ...
- Nvidia to buy Israeli deep learning co Deci AI - reporton April 25, 2024 at 12:44 am
Deci AI is one of three Israeli companies developing language models - the others being Amnon Shashua's AI21 Labs and Tabnine. Both Run:ai and Deci AI will help Nvidia's customers produce more from ...
- Researchers develop deep learning alternative to monitoring laser powder bed fusionon April 24, 2024 at 9:12 am
Many things can go wrong when additively manufacturing (AM) metal and without in-situ process monitoring, defects can only be detected and characterized after a product is built. Most commonly, ...
- Deep learning predicts heart arrhrythmia 30 minutes in advanceon April 23, 2024 at 4:15 am
Atrial fibrillation is the most common cardiac arrhythmia worldwide with around 59 million people concerned in 2019. This irregular heartbeat is associated with increased risks of heart failure, ...
- From Learning Designer to Associate Provost for Digital and Online Learningon April 23, 2024 at 12:06 am
Q: Your new role combines leadership in digital and online learning. Why was it important to you that the work on residential classes be integrated with Dartmouth’s online learning portfolio?
- Researchers develop deep-learning model capable of predicting cardiac arrhythmia 30 minutes before it happenson April 22, 2024 at 1:23 pm
Atrial fibrillation is the most common cardiac arrhythmia worldwide with around 59 million people concerned in 2019. This irregular heartbeat is associated with increased risks of heart failure, ...
- Crime detection and crime hot spot prediction using a deep learning modelon April 19, 2024 at 10:30 am
Crime is an age-old and never-ending problem for societies worldwide and crime detection and crime fighting have always chased after the criminals who often stay one step ahead.
via Bing News