Real-Life “Marauder’s Map” Has Applications in Health Care, Security
Researchers at Carnegie Mellon University have developed a method for tracking the locations of multiple individuals in complex, indoor settings using a network of video cameras, creating something similar to the fictional Marauder’s Map used by Harry Potter to track comings and goings at the Hogwarts School.
The method was able to automatically follow the movements of 13 people within a nursing home, even though individuals sometimes slipped out of view of the cameras. None of Potter’s magic was needed to track them for prolonged periods; rather, the researchers made use of multiple cues from the video feed: apparel color, person detection, trajectory and, perhaps most significantly, facial recognition.
Multi-camera, multi-object tracking has been an active field of research for a decade, but automated techniques have only focused on well-controlled lab environments. The Carnegie Mellon team, by contrast, proved their technique with actual residents and employees in a nursing facility—with camera views compromised by long hallways, doorways, people mingling in the hallways, variations in lighting and too few cameras to provide comprehensive, overlapping views.
The performance of the Carnegie Mellon algorithm significantly improved on two of the leading algorithms in multi-camera, multi-object tracking. It located individuals within one meter of their actual position 88 percent of the time, compared with 35 percent and 56 percent for the other algorithms.
The researchers—Alexander Hauptmann, principal systems scientist in the Computer Science Department (CSD); Shoou-I Yu, a Ph.D. student in the Language Technologies Institute; and Yi Yang, a CSD post-doctoral researcher—will present their findings June 27 at the Computer Vision and Pattern Recognition Conference in Portland, Ore.
Though Harry Potter could activate the Marauder’s Map only by first solemnly swearing “I am up to no good,” the Carnegie Mellon researchers developed their tracking technique as part of an effort to monitor the health of nursing home residents.
“The goal is not to be Big Brother, but to alert the caregivers of subtle changes in activity levels or behaviors that indicate a change of health status,” Hauptmann said. All of the people in this study consented to being tracked.
These automated tracking techniques also would be useful in airports, public facilities and other areas where security is a concern. Despite the importance of cameras in identifying perpetrators following this spring’s Boston Marathon bombing and the 2005 London bombings, much of the video analysis necessary for tracking people continues to be done manually, Hauptmann noted.
The CMU work on monitoring nursing home residents began in 2005 as part of a National Institutes of Health-sponsored project called CareMedia, which is now associated with the Quality of Life Technology Center, a National Science Foundation engineering research center at CMU and the University of Pittsburgh.
“We thought it would be easy,” Hauptmann said of multi-camera tracking, “but it turned out to be incredibly challenging.”
Something as simple as tracking based on color of clothing proved difficult, for instance, because the same color apparel can appear different to cameras in different locations, depending on variations in lighting. Likewise, a camera’s view of an individual can often be blocked by other people passing in hallways, by furniture and when an individual enters a room or other area not covered by cameras, so individuals must be regularly re-identified by the system.
Face detection helps immensely in re-identifying individuals on different cameras. But Yang noted that faces can be recognized in less than 10 percent of the video frames. So the researchers developed mathematical models that enabled them to combine information, such as appearance, facial recognition and motion trajectories.
Using all of the information is key to the tracking process, but Yu said facial recognition proved to be the greatest help.
The Latest Bing News on:
Tracking people indoors
- Grand Teton lifts indoor masking as Teton County COVID risk declineson June 22, 2022 at 9:37 am
It resumed counting out-of-county visitors this week in an effort to track how tourists spread the virus. Only a handful of people, both residents and visitors, have required hospitalization for ...
- Map: See if the CDC recommends indoor mask use in your countyon June 21, 2022 at 10:11 am
Does the Centers for Disease Control and Prevention recommend wearing a mask indoors in your area?Under the CDC's new guidance, which was issued in February and relies less heavily on Covid cases and ...
- Westford Academy’s Megan Frazee takes track nationals by stormon June 20, 2022 at 7:00 pm
Of the 14 athletes, Westford Academy’s Megan Frazee once again stole the show. Competing at the New Balance Meet, she finished second in the pentathlon competition to earn All-American ...
- Athlete Spotlight: James Wood boys' track & field athlete Liam McDonaldon June 19, 2022 at 7:00 pm
This year for outdoor and indoor track we upped our mileage and the intensity of our workouts. I feel like that took a toll on me. At the beginning of my outdoor season, my foot started acting up. I ...
- 2022 All-Area boys' track and field Athlete of the Year: McCullough surges into spotlighton June 19, 2022 at 7:00 am
The Centennial senior didn't have much of a sophomore track and field season. Then he had no junior season. Yet as a senior, McCullough became a Class 3A state champion ...
- It's getting harder to gauge your Covid risk levels—tracking these 4 metrics can helpon June 18, 2022 at 6:15 am
Covid cases used to be an easy way to track the pandemic's severity. Today, you might want to pay attention to a different set of numbers.
- Inspired by Title IX, Track and Field’s Joetta Clark Is Now Inspiring the Next Generationon June 17, 2022 at 1:49 pm
The four-time Olympian witnessed the impact of the statute firsthand. Now, she’s guiding today’s women in sports.
- Men's Track and Field Season Reviewon June 17, 2022 at 10:38 am
BYU men’s track and field continued its tradition of excellence during a 2022 season filled with All-American honors, program top-10 marks and conference championship performances. The Cougars totaled ...
- How Kentucky track star Abby Steiner turned injury, Olympic heartbreak into record seasonon June 17, 2022 at 2:44 am
Before she broke the collegiate record in the 200-meters, Kentucky track star Abby Steiner had to overcome an injury that ended her Olympic dream.
- LA County on track for 'high' transmission by late June, would bringing back indoor maskingon June 16, 2022 at 11:19 pm
With a steady climb in transmission rate, Los Angeles County is on the verge of bringing back its indoor mask mandate -- again.
The Latest Google Headlines on:
Tracking people indoors
The Latest Bing News on:
Multi-camera multi-object tracking
- Gaia Creates Stunning 3D Map of the Milky Wayon June 22, 2022 at 3:12 am
With the third release of data from the Gaia satellite, astronomers have hinted at phenomena such as star quakes and “stellar DNA” that can be used to track the evolution of galaxies.
- Orbbec Announces Availability of Femto Time-of-Flight Camera Line, Enabling Accurate 3D Object and Scene Captureon June 21, 2022 at 6:06 am
Three Models Offer Wide Range of Features Including Depth-of-Field from 0.2 to 5 Meters, 6-Axis IMU Tracking, Multi-Camera Synchronization, Use ...
- Best Lap Timer for 2022on June 18, 2022 at 8:11 am
Best lap timer if money is no object Aim Sports ... accelerometer and camera data to track you. At the end of your session, the best segments of multiple laps are combined into a True Optimal ...
- Getting SSA off the groundon June 17, 2022 at 7:43 am
Orbital SSA advocates say the tens of thousands of satellites bound for low Earth orbit (LEO) over the next decade will strain existing ground capabilities. Debris-causing events in LEO, such as ...
- Six Top Tools to Build Augmented Reality Mobile Appson June 15, 2022 at 5:00 pm
Though many people consider AR to be only an entertainment technology, it’s actually widely used in multiple ... when the camera data is being analyzed. In other words, the objects are already ...
- Compact AI-powered DWARF II Telescope Makes Astronomy and Nature Photography Easy for Consumerson June 7, 2022 at 6:22 am
AI-powered Object Tracking Object tracking for the DWARF II is achieved through multiple deep learning networks ... and aircraft can be tracked. Dual-camera System The DWARF II has both a wide ...
- i-PRO brings AI to its PTZ cameras and adds 35 new modelson June 2, 2022 at 7:12 am
Unique attributes of detected objects such as color and type ... and black models. An Auto-track Cooperation feature supports seamless PTZ handoff from the latest i-PRO Multi-sensor cameras for ...
- i-PRO brings AI to its PTZ cameras and adds 35 new modelson June 2, 2022 at 3:50 am
Unique attributes of detected objects such ... An Auto-track Cooperation feature supports seamless PTZ handoff from the latest i-PRO Multi-sensor cameras for uninterrupted monitoring.
- Pinnacle Studio 25 Ultimate reviewon May 27, 2022 at 9:41 am
Using a mask to track an object as mentioned above is such ... have some color correction tools, basic 2-camera editing for multi-camera work, and keyframe controls. Studio Plus ups the ante ...