New systems could improve the vision of micro aerial vehicles
Aerial robotics research has brought us flapping hummingbirds, seagulls,bumblebees, and dragonflies. But if these robots are to do anything more than bear a passing resemblance to their animal models, there is one thing they’ll definitely need: better vision.
In February, at the International Solid-State Circuits Conference (ISSCC) in San Francisco, two teams presented new work (PDF) aimed at building better-performing and lower-power vision systems that would help aerial robots navigate and aid them in identifying objects.
Dongsuk Jeon, a graduate student working with Zhengya Zhang and IEEE FellowsDavid Blaauw and Dennis Sylvester at the University of Michigan, in Ann Arbor, outlined an approach to drastically lower the power of the very first stage of any vision system—the feature extractor. That system uses an algorithm to draw out potentially important features like circles and squares from an overall image.
To navigate and to determine whether a scene looks familiar, a micro air vehicle needs to be able to use its entire field of view. But existing full-image feature-extraction algorithms are built to run on desktop computers and servers, not battery-powered platforms, Blaauw says. He adds that although there are some low-power feature-extraction algorithms, those tend to focus on very specific applications such as face recognition.
The Michigan team’s solution was to pare down a traditional feature-extraction algorithm, reengineering it to work well on a specialized image-processing accelerator and optimizing factors like the number of times a portion of an image is accessed for analysis. Image sections in traditional feature extraction may be analyzed a handful of times, because areas of interest often overlap. The new accelerator pushes data through only once, as if the data were on a conveyor belt. “We feed a little bit of the image through a bus, and all the little processors watch,” Blaauw says. “When they see a part of the image they need, they grab it.”
Jeon and his colleagues also incorporated a few hardware tricks to cut down on the power usage. One approach was to rework the shift registers that act as buffers for data that’s in process. Typical shift registers are made up of cells with two latches—circuit components that contain about 10 transistors each. The team found a way to rework the registers so that their cells each contained only one latch. The resulting registers were just as fast, but because they contained half as many latches they lost half as much power from leakage.
The team’s accelerator, which consumes just 2.7 milliwatts of power, was made using a 28-nanometer manufacturing process. The core clocks at a very low 27 megahertz, which keeps the power consumption down; the clock on a typical vision system-on-a-chip works at more than 100 MHz. Although feature extraction is just one aspect of vision systems, Jeon says, it can take up as much as 70 percent of the area of the core on a vision chip.
Another approach, led by IEEE Fellow Hoi-Jun Yoo at the Korea Advanced Institute of Science and Technology (KAIST) in Daejeon, South Korea, is to attack the vision problem at the complete chip level. Yoo’s team has built an SoC with 21 image-processing cores. The chip, which has been demonstrated on a toy car and on a four-propeller flying robot called a quadrotor, is capable of distinguishing faces and differentiating between objects and pictures of objects—for instance, a car and a billboard carrying the image of a car.
The Latest Bing News on:
Flying Robots
- Xpeng’s flying car affiliate AeroHT closes in on airworthiness certification as Chinese EV maker targets fourth-quarter presaleson April 26, 2024 at 11:38 pm
AeroHT, an affiliate of Chinese electric vehicle maker Xpeng, has started the countdown for the commercialisation of its flying car and plans to start taking pre-orders in the fourth quarter of this ...
- Helldivers 2 Players Being Forced To Pick Between Two New Stratagemson April 26, 2024 at 11:30 am
Arrowhead Game Studios has enjoyed handing down some tough and consequential major orders for the Helldivers 2 community to beat, but its latest might be one of its thorniest yet. You see, major ...
- Helldivers 2on April 26, 2024 at 11:30 am
To be clear, the latest major order charges players with liberating both Choohee and Penta, but according to Helldivers 2 ’s narrative, only the stratagem of the first one to be liberated will be ...
- Testing Novel 3D Mapping Technology to Transform Space Exploration and Benefit Industries on Earthon April 26, 2024 at 9:03 am
The project, a collaboration between Boeing and CSIRO (an Australian government agency responsible for scientific research), highlights the importance of international partnerships while building on ...
- Robotic Helpers Test New Technology on the Space Stationon April 25, 2024 at 11:04 pm
Reviewed by Lexie Corner In science fiction movies, we often see robots zipping around spacecraft performing various tasks. What was once only science fiction has now come to life on the International ...
- ‘Learning naturally’: MIT’s Mizanul Chowdhury exploring space science and arton April 25, 2024 at 9:12 pm
Meet Mizanul H Chowdhury who has been working at Massachusetts Institute of Technology in multiple capacities since 2013 ...
- Northants guide dog and robot best friends after dateon April 24, 2024 at 10:52 pm
"She started off very apprehensive, but once the treats came through, she got more involved to the point where we were able to walk the robot past Amelia with very little reaction ...
- Boeing’s Wisk to introduce flying taxis in Asia by 2030on April 19, 2024 at 6:52 am
Boeing invested in Wisk's technology after it placed a $540 million bet on the Mountain View, California-based startup.
- Team develops a hybrid hopping, flying roboton April 16, 2024 at 5:46 am
To develop this hybrid robot, dubbed Hopcopter, the team attached a spring-loaded telescopic leg — much like a pogo stick — to the underside of a quadcopter, enabling the robot to hop, when necessary.
- His Flying Robots Could Turn Up at Your House When You Dial 911on April 16, 2024 at 2:30 am
Blake Resnick, a 24-year-old with funding from Sam Altman and Sam Bankman-Fried, is on a wild ride to reinvent the future of emergency response.
The Latest Google Headlines on:
Flying Robots
[google_news title=”” keyword=”Flying Robots” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
[/vc_column_text]
The Latest Bing News on:
Robot vision
- Automated machine learning robot unlocks new potential for genetics researchon April 26, 2024 at 9:10 am
University of Minnesota Twin Cities researchers have constructed a robot that uses machine learning to fully automate a complicated microinjection process used in genetic research.
- Dyson’s new robot vacuum is $1,200 — here are some of our more affordable favoriteson April 25, 2024 at 12:05 pm
We love Dyson's other vacuums. And this robot vacuum is packed with features. But does it justify that price tag?
- Fizyr Partners with DERO GROEP to Revolutionize Robotic Automation for Advanced Pickingon April 25, 2024 at 10:01 am
The partnership brings highly efficient automation in complex, high-variability tasks to food processing and logistics.
- Elon Musk Needs Robots, and He Needs Them Nowon April 24, 2024 at 12:10 pm
“Think of it as a combination of Airbnb and Uber,” said Musk on Tesla’s earnings call Tuesday. “There will be some number of cars that Tesla owns itself and operates in the fleet, and then there’ll be ...
- Viral Photo of Dog Humping a Robot Dog Is Sadly Fakeon April 24, 2024 at 8:30 am
“The robot dog or the drones, they’re able to stream the video directly to our phones, directly to our command center,” New York’s chief of fire operations John Esposito told reporters shortly after ...
- Thermonator Is Here: Flame-Throwing Robot Dog Can Be Legally Yours for Under $10Kon April 24, 2024 at 4:22 am
Advertised last summer and with a slight delay, Thermonator has arrived to market: flamethrower-yielding robot dog is "ready for anything," surprisingly legal ...
- Elon Musk loves robots but his vision faces big challengeon April 23, 2024 at 5:00 pm
Musk — who is the CEO of SpaceX and Tesla — unveiled his "new" vision for the electric vehicle manufacturer ... Musk continues to see Tesla as an AI and robotics firm, with the robotaxis at its core.
- Industrial Robots and Their Human Counterpartson April 23, 2024 at 8:35 am
The conversation around robots and their use in manufacturing has long been controversial. Many fear that the introduction of robots into the workplace will displace human jobs. In some respects, yes, ...
- ‘I have arrived’: Israel unveils headless humanoid robot Menteeboton April 23, 2024 at 7:51 am
Israel’s Mentee Robotics has just unveiled its artificial intelligence (AI)-enabled household chore robot, Menteebot. After two years of research and development, the new robot certainly looks ...
- From the barn to the bar: AI powered robotson April 22, 2024 at 11:25 am
Richtech's Matt Casella introduces the Adam AI-powered robot, and Deere's Chris Padwick discusses training models for perception.
The Latest Google Headlines on:
Robot vision
[google_news title=”” keyword=”robot vision” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]