The capture and analysis of surveillance footage has been an indispensable tool for U.S. counterterrorism and law enforcement in the past decade. Video analysis software has improved since the 9/11 terrorist attacks—it can be programmed to identify certain patterns and colors, for example, and to issue security alerts when these characteristics are detected. But as terrorists and criminals change their tactics to slip through security the surveillance technologies designed to stop or catch them must likewise become more sophisticated.
One of the biggest challenges to improving video analytics is programming the software to identify specific people and objects under a variety of conditions, such as poor lighting, cluttered backgrounds and subtle changes in appearance (such as facial hair). Video analytics has a lot of room to improve in these areas with the help of software that sharpens computer vision, enhances facial- and pattern-recognition capabilities, and captures the motion of people and things passing in front of the camera’s lens. [See our earlier coverage of post-9/11 security and surveillance.]
A team of New York University researchers has homed in on motion capture as a particularly promising approach to analysis. Associate computer science professor Chris Bregler is studying whether potential security threats can be identified via unique patterns of movement. How might someone walk if he was carrying a bomb in his backpack?
A person’s body moves differently when it must compensate for some unnatural burden, such as a heavy backpack or even high-heeled shoes, says Bregler, who performs much of his research out of N.Y.U.’s Movement Lab, a motion-capture studio and research group housed at the school’s ITP Tisch School of the Arts. When a person is weighed down by a backpack, for example, his or her feet will strike the ground with greater force than they otherwise would. Yet a person with natural-grown weight learns how to counterbalance it and maintain an even stride, he adds.
Bregler and his team have identified certain movement signatures with the help of the same motion-capture technology used for special effects in the Lord of the Rings? and Harry Potter movies. Reflective markers placed at various locations on a special motion-capture suit can be picked up by a series of cameras that Bregler places in a circle around the Movement Lab. As a person in the suit moves, the cameras capture information about the reflective markers and feed the data to software that maps the location of each marker on a computer screen.
Outside the laboratory, however, the real world poses problems for motion-capture research—there simply are not enough motion-capture suits for everyone to wear. As a result, Bregler’s team is developing software that can detect a person’s motion signature without the markers.
Bookmark this page for “motion capture” and check back regularly as these articles update on a very frequent basis. The view is set to “news”. Try clicking on “video” and “2” for more articles.
>