Real-Life “Marauder’s Map” Has Applications in Health Care, Security
Researchers at Carnegie Mellon University have developed a method for tracking the locations of multiple individuals in complex, indoor settings using a network of video cameras, creating something similar to the fictional Marauder’s Map used by Harry Potter to track comings and goings at the Hogwarts School.
The method was able to automatically follow the movements of 13 people within a nursing home, even though individuals sometimes slipped out of view of the cameras. None of Potter’s magic was needed to track them for prolonged periods; rather, the researchers made use of multiple cues from the video feed: apparel color, person detection, trajectory and, perhaps most significantly, facial recognition.
Multi-camera, multi-object tracking has been an active field of research for a decade, but automated techniques have only focused on well-controlled lab environments. The Carnegie Mellon team, by contrast, proved their technique with actual residents and employees in a nursing facility—with camera views compromised by long hallways, doorways, people mingling in the hallways, variations in lighting and too few cameras to provide comprehensive, overlapping views.
The performance of the Carnegie Mellon algorithm significantly improved on two of the leading algorithms in multi-camera, multi-object tracking. It located individuals within one meter of their actual position 88 percent of the time, compared with 35 percent and 56 percent for the other algorithms.
The researchers—Alexander Hauptmann, principal systems scientist in the Computer Science Department (CSD); Shoou-I Yu, a Ph.D. student in the Language Technologies Institute; and Yi Yang, a CSD post-doctoral researcher—will present their findings June 27 at the Computer Vision and Pattern Recognition Conference in Portland, Ore.
Though Harry Potter could activate the Marauder’s Map only by first solemnly swearing “I am up to no good,” the Carnegie Mellon researchers developed their tracking technique as part of an effort to monitor the health of nursing home residents.
“The goal is not to be Big Brother, but to alert the caregivers of subtle changes in activity levels or behaviors that indicate a change of health status,” Hauptmann said. All of the people in this study consented to being tracked.
These automated tracking techniques also would be useful in airports, public facilities and other areas where security is a concern. Despite the importance of cameras in identifying perpetrators following this spring’s Boston Marathon bombing and the 2005 London bombings, much of the video analysis necessary for tracking people continues to be done manually, Hauptmann noted.
The CMU work on monitoring nursing home residents began in 2005 as part of a National Institutes of Health-sponsored project called CareMedia, which is now associated with the Quality of Life Technology Center, a National Science Foundation engineering research center at CMU and the University of Pittsburgh.
“We thought it would be easy,” Hauptmann said of multi-camera tracking, “but it turned out to be incredibly challenging.”
Something as simple as tracking based on color of clothing proved difficult, for instance, because the same color apparel can appear different to cameras in different locations, depending on variations in lighting. Likewise, a camera’s view of an individual can often be blocked by other people passing in hallways, by furniture and when an individual enters a room or other area not covered by cameras, so individuals must be regularly re-identified by the system.
Face detection helps immensely in re-identifying individuals on different cameras. But Yang noted that faces can be recognized in less than 10 percent of the video frames. So the researchers developed mathematical models that enabled them to combine information, such as appearance, facial recognition and motion trajectories.
Using all of the information is key to the tracking process, but Yu said facial recognition proved to be the greatest help.
The Latest Bing News on:
Tracking people indoors
- West suburban counties are on track for less restrictive levels of COVID-19 mitigations. Here’s where they stand now.on January 25, 2021 at 12:24 pm
Here is where Kane, DuPage, Kendall and Will counties stand in the state's COVID-19 mitigation plan, and what that means for indoor dining, gathering sizes and other restrictions.
- COVID-19 In Illinois: Northern, Western Suburbs On Track To Resume Limited Indoor Dining Tomorrowon January 25, 2021 at 10:42 am
With the state's COVID-19 infection rate and coronavirus hospitalizations continuing to trend downward, two more regions of the state are on pace to lift indoor dining restrictions on Tuesday.
- 2 Suburban Illinois Regions ‘on Track' to Move to Tier 1 COVID-19 Mitigations That Allow Indoor Diningon January 25, 2021 at 10:33 am
Two of Illinois’ 11 regions in the Chicago suburbs are “on track” to move into Tier 1 COVID-19 mitigations on Tuesday, which would allow for the return of limited indoor dining, among other changes, ...
- Mohonasen coach takes winter indoor track outsideon January 24, 2021 at 4:00 pm
Throughout the winter season traditional indoor track venues have been closed to local high school meets, but on Monday afternoon Mohonasen girls’ track coach Bill Sherman plowed the ...
- Chicago indoor dining expected to return Saturday with city, suburban Cook Co. on track for Tier 1on January 22, 2021 at 8:00 pm
CHICAGO (WLS) -- Chicago and Cook County are on track to upgrade to Tier 1 mitigations on Saturday, state health officials announced Friday, meaning restaurants and bars will be able to reopen for ...
- Chicago and Suburban Indoor Dining on Track to Return Saturdayon January 22, 2021 at 9:15 am
The Illinois Department of Public Health has announced that Chicago and Suburban Cook County are on track to enter the next stage of COVID-19 mitigation rules as early as Saturday, paving the way for ...
- Chicago ‘on track’ for bars and restaurants to reopen indoor service Saturdayon January 22, 2021 at 8:49 am
The city and Cook County will move from Tier 2 to Tier 1 of Gov. J.B. Pritzker’s COVID-19 mitigation plan as long as "metrics continue to improve or are stable," officials said.
- Chicago and Suburban Cook County ‘on Track' to Enter Tier 1, Bring Back Indoor Dining Saturdayon January 22, 2021 at 8:45 am
Chicago and suburban Cook County are “on track” to lift Tier 2 coronavirus restrictions on Saturday, state health officials said Friday, which would allow for the return of limited indoor dining, ...
- Limited indoor dining on track to resume Thursday in Will and Kankakee counties under Pritzker’s COVID-19 reopening planon January 20, 2021 at 10:56 am
Will and Kankakee counties are on track to be the first in the Chicago area to see limited indoor dining resume under Gov. J.B. Pritzker’s coronavirus reopening plan, state public health officials ...
- CCHS, TBHS indoor track teams adjust to COVID-19 restrictionson January 19, 2021 at 5:00 am
The indoor track season began this past weekend for both Campbell County and Thunder Basin high schools, and the first regular season meet looked much different than in years past.
The Latest Google Headlines on:
Tracking people indoors
The Latest Bing News on:
Multi-camera multi-object tracking
- SenSen Networks well-funded to pursue growth strategy for 2021on January 18, 2021 at 7:03 pm
By combining Snap’s AI-powered multi-camera networked tracking technology with SenSen’s automated multi-object tracking technology within individual camera views, SenSen plans to release a ...
- SenSen Networks well-funded to pursue growth strategy for 2021on January 18, 2021 at 12:33 pm
The company’s plans to accelerate growth include new direct client acquisitions, engaging distribution channels to accelerate sales momentum, ...
- SenSen Networks in trading halt with equity raising news pendingon January 3, 2021 at 8:22 pm
By combining Snap’s AI-powered multi-camera networked tracking technology with SenSen’s automated multi-object tracking technology within individual camera views, SenSen plans to release a ...