Cornell University researchers are developing a system to enable teams of robots to share information as they move around, and if necessary, interpret what they see. This would allow the robots to conduct surveillance as a single entity with many eyes. Beyond surveillance, the new technology could enable teams of robots to relieve humans of dangerous jobs such as disposing of landmines, cleaning up after a nuclear meltdown or surveying the damage after a flood or hurricane.
“Once you have robots that cooperate, you can do all sorts of things,” said Kilian Weinberger, associate professor of computer science, who is collaborating on the project with Silvia Ferrari, professor of mechanical and aerospace engineering, and Mark Campbell, professor of mechanical engineering.
Their work, “Convolutional-Features Analysis and Control for Mobile Visual Scene Perception,” is supported by a four-year, $1.7 million grant from the U.S. Office of Naval Research.
The researchers will call on their extensive experience with computer vision to match and combine images of the same area from several cameras, identify objects and track objects and people from place to place. The work will require groundbreaking research because most prior work in the field has focused on analyzing images from just a single camera as it moves around. The new system will fuse information from fixed cameras, mobile observers and outside sources.
The mobile observers might include autonomous aircraft and ground vehicles and perhaps humanoid robots wandering through a crowd. They will send their images to a central control unit, which might also have access to other cameras looking at the region of interest, as well as access to the internet for help in labeling what it sees. What make of car is that? How do you open this container? Identify this person.
Knowing the context of a scene, robot observers may detect suspicious actors and activities that might otherwise go unnoticed. A person running may be a common occurrence on a college campus but may require further scrutiny in a secured area.
Researchers plan early tests on the Cornell campus, using research robots to “surveil” crowded areas while drawing on an overview from existing webcams. This work might lead to incorporating the new technology into campus security.
The Latest on: Robotic swarms
via Google News
The Latest on: Robotic swarms
- Robotic Navigation Tech – That Helped NASA’s Perseverance Rover Land on Mars – Will Explore the Deep Oceanon May 16, 2021 at 4:30 am
Terrain-relative navigation helped Perseverance land – and Ingenuity fly – autonomously on Mars. Now it’s time to test a similar system while exploring another frontier. On May 14, the National Oceani ...
- Robot swarms enter the offshore energy spaceon May 14, 2021 at 9:53 am
Unmanned surface vessels have been tested in the offshore industry for a number of years, but many more autonomous systems – swarms of them – are on the way ...
- Robotic Navigation Tech Will Explore the Deep Oceanon May 14, 2021 at 8:56 am
Terrain-relative navigation helped Perseverance land – and Ingenuity fly – autonomously on Mars. Now it’s time to test a similar system while exploring another frontier.
- Will Hunter-Killer Underwater Drones Be the End of Submarines?on May 13, 2021 at 7:39 am
If operationalized, drone swarms are too numerous and cheap to be efficiently destroyed using most current military systems.
- Drone-killer fires microwave beams to disable UAVSon May 13, 2021 at 4:23 am
Directed energy weapons are designed for the battlefield, but could they also be coming to an airport or stadium near you?
- NASA spacecraft OSIRIS-REx begins 2-year trip home with asteroid rubbleon May 12, 2021 at 5:52 am
With rubble from an asteroid tucked inside, a NASA spacecraft fired its engines and began the long journey back to Earth on Monday, leaving the ancient space rock in its rearview mirror.
- Frog Swarms Inspire Self-Assembling System Eyed for Self-Regulating Robotson May 11, 2021 at 6:18 am
Researchers at the University of Pittsburgh developed materials that can dynamically organize themselves similarly to how some creatures create swarms.
- Pentagon considers using AI-controlled drones and robots in combaton May 10, 2021 at 7:09 pm
The future of warfare might involve advanced artificial intelligence (AI) algorithms that would have the ability and authority to assess situations and engage enemies without having a human in ...
- NASA spacecraft begins 2-year trip home with asteroid rubbleon May 10, 2021 at 3:53 pm
Rex, will take two years. Osiris-Rex reached asteroid Bennu in 2018 and spent two years flying near and around it, before collecting rubble from the surface last fall.
via Bing News