Researchers from the School of Interactive Computing and the Institute for Robotics and Intelligent Machines developed a new method that teaches computers to “see” and understand what humans do in a typical day.
The technique gathered more than 40,000 pictures taken every 30 to 60 seconds, over a 6 month period, by a wearable camera and predicted with 83 percent accuracy what activity that person was doing. Researchers taught the computer to categorize images across 19 activity classes. The test subject wearing the camera could review and annotate the photos at the end of each day (deleting any necessary for privacy) to ensure that they were correctly categorized.
“It was surprising how the method’s ability to correctly classify images could be generalized to another person after just two more days of annotation,” said Steven Hickson, a Ph.D. candidate in Computer Science and a lead researcher on the project.
“This work is about developing a better way to understand people’s activities, and build systems that can recognize people’s activities at a finely-grained level of detail,” said Edison Thomaz, co-author and graduate research assistant in the School of Interactive Computing. “Activity tracking devices like the Fitbit can tell how many steps you take per day, but imagine being able to track all of your activities – not just physical activities like walking and running. This work is moving toward full activity intelligence. At a technical level, we are showing that it’s becoming possible for computer vision techniques alone to be used for this.”
The group believes they have gathered the largest annotated dataset of first-person images to demonstrate that deep-learning can understand human behavior and the habits of a specific person.
Student Daniel Casto, a Ph.D. candidate in Computer Science and a lead researcher on the project, helped present the method earlier this month at UBICOMP 2015 in Osaka, Japan. He says reaction from conference-goers was positive.
“People liked that we had a method that combines time and images,” Castro says. “Time (of activity) can be especially important for some activity classes. This system learned how relevant images were because of people’s schedules. What does it think the image is showing? It sees both time and image probabilities and makes a better prediction.”
The ability to literally see and recognize human activities has implications in a number of areas – from developing improved personal assistant applications like Siri to helping researchers explain links between health and behavior, Thomaz says.
Castro and Hickson believe that someday within the next decade we will have ubiquitous devices that can improve our personal choices throughout the day.
“Imagine if a device could learn what I would be doing next – ideally predict it – and recommend an alternative?” Castro says. “Once it builds your own schedule by knowing what you are doing, it might tell you there is a traffic delay and you should leave sooner or take a different route.”
The Latest on: Deep learning
via Google News
The Latest on: Deep learning
- Deep Learning Chip Market Size, Share, Growth, Upcoming Trends, Demand, Regional Analysis and Forecast 2028on March 8, 2021 at 5:56 pm
Vancouver, BC -- (SBWIRE) -- 03/08/2021 -- deep learning chip market reached a market size of USD 3.25 Billion in 2020 and is expected to register a CAGR of 30.7% during the forecast period. Global ...
- Global Deep Learning Chipset Market 2020 Future Trend, Business Strategies, Revenue Value, Comprehensive Analysis and Forecast by 2025on March 8, 2021 at 4:17 pm
This study document namely Global Deep Learning Chipset Market 2020 by Manufacturers, Regions, Type and Application, Forecast to 2026 begins with an overview of the market and presents it throughout ...
- Deep learning-based point-scanning super-resolution imagingon March 8, 2021 at 9:28 am
Point-scanning super-resolution imaging uses deep learning to supersample undersampled images and enable time-lapse imaging of subcellular events. An accompanying ‘crappifier’ rapidly generates ...
- New method could democratize deep learning-enhanced microscopyon March 8, 2021 at 8:03 am
Deep learning is a potential tool for scientists to glean more detail from low-resolution images in microscopy, but it's often difficult to gather enough baseline data to train computers in the ...
- Deep learning-based enhancement of epigenomics data with AtacWorkson March 8, 2021 at 2:02 am
ATAC-seq measures chromatin accessibility as a proxy for the activity of DNA regulatory regions across the genome. Here the authors present AtacWorks, a deep learning tool to denoise and identify ...
- Deep learning: The way forward with significant value unlocking during the bext decadeon March 7, 2021 at 6:14 am
The global deep learning market, currently priced at $4.4 billion in 2020, has been projected to expand at a staggering 39.2 per cent CAGR between 2020 and 2027, to reach $44.3 billion by 2027 ...
- Deep Learning in Machine Vision Market to Set Phenomenal Growth from 2021 to 2026 | Qualcomm, Intel, Beijing Megviion March 5, 2021 at 5:12 pm
Get Access to PDF Sample of Global Deep Learning in Machine Vision Market Growth (Status and Outlook) 2021-2026 @: This study focuses on the Global Deep Learning in Machine Vision Market status, ...
- Can Deep Learning Replace Numerical Weather Prediction?on March 3, 2021 at 10:32 am
Numerical weather prediction (NWP) is a mainstay of supercomputing. Some of the first applications of the first supercomputers dealt with climate ...
- Google’s deep learning finds a critical path in AI chipson February 28, 2021 at 10:39 pm
ZDNet spoke with Google Brain director Jeff Dean about how the company is using artificial intelligence to advance its internal development of custom chips to accelerate its software. Dean noted that ...
- Interested In AI? Master Deep Learning & Get NLP Certifiedon February 24, 2021 at 9:21 am
The world of artificial intelligence (AI) is revolutionizing the way we live, though it has become something of an acronym soup. From DL to ML, SSD to CN ...
via Bing News