via Brigham Young University
Walk into a room, see a chair, and your brain will tell you that you can sit in it, tip it over or lift it up, but you wouldn’t even consider drinking it, promoting it or unlocking it. As humans, explains BYU computer science professor David Wingate, we know intuitively that certain verbs pair naturally with certain nouns, and we also know that most verbs don’t make sense when paired with random nouns.
“Consider the monitor on your desk: you can look at it, you can turn it on, you can even pick it up or throw it, but you cannot impeach it, transpose it, justify it or correct it,” said Wingate. “You can dethrone a king or worship him or obey him, but you cannot unlock him or calendar him or harvest him.”
That intuition, for the most part, doesn’t exist with computer artificial intelligence agents, who are good at identifying objects but less so in knowing what to do with them. So Wingate and three student researchers, including lead author Nancy Fulda, developed a method for teaching agents about affordances — the set of actions that can be done with an object. They recently presented their work at the International Joint Conference on Artificial Intelligence.
The team’s ambitious end goal is to help build androids that can walk around the world and interact with it intelligently. Such an android “has incredible potential to do good, to help people,” said Fulda, who is finishing her Ph.D. in computer science. An example she gives is elderly care: a robot who is told to “get me my glasses” could figure out what glasses look like, where they’re likely to be, how heavy they are, how best to lift them and how to get them to the person requesting them.
As it stands right now, explains BYU computer science undergrad and research co-author Ben Murdoch, there are plenty of artificial intelligence agents who can identify what they’re looking at, but they can’t go beyond the ID: they might know they’re looking at a phone but don’t necessarily know what a phone is good for.
“When machine learning researchers turn robots or artificially intelligent agents loose in unstructured environments, they try all kinds of crazy stuff,” said Murdoch. “The common-sense understanding of what you can do with objects is utterly missing, and we end up with robots who will spend thousands of hours trying to eat the table.”
Because the hand-coding needed to help an agent understand which verbs make sense with which nouns would be a laborious, slow-moving process, BYU’s research team instead found a way to put linear algebra and Wikipedia to use. Understanding that Wikipedia offers a vast corpus of mostly up-to-date language use, they downloaded it, ran it through a previously established algorithm that looks at words in their contexts, “and voila! The computer is equipped with common-sense knowledge about things that make sense,” said Wingate, who recently received a National Science Foundation Career Award to help fund his artificial intelligence work.
For this project, the team tested their method in a series of text-based adventure games, which allow a player and agent to have back and forth text interactions, with the agent offering a situation and the player responding with a written phrase. Their method improved the computer’s performance on 12 out of 16 games.
Even with help from Wikipedia, the team’s agent makes mistakes with its language use. But he’s made progress: unlike he tried to do in one of their early games, “he doesn’t bulldoze Santa,” said Fulda. “I love it when the agent does something that surprises me in a good way. I’m like, it did it: it figured it out all by itself. It’s kind of like watching your child take their first steps.”
There’s plenty of work still to be done before reaching the team’s end goal of having a functioning android, said co-author and BYU computer science master’s student Daniel Ricks. “But it’s really exciting to see the progress we’ve made.”
Learn more: Researchers use Wikipedia to give AI context clues
The Latest on: Artificial intelligence agents
- Wysa Receives FDA Breakthrough Device Designation for AI-led Mental Health Conversational Agenton May 18, 2022 at 12:57 pm
Wysa, a leading artificial intelligence (AI) based digital companion for behavioral health, has announced that the U.S. Food and Drug Administration (FDA) has granted Breakthrough Device Designation ...
- Why Artificial Intelligence Creates an Unprecedented Era of Opportunity in the Near Futureon May 18, 2022 at 4:55 am
The age of artificial intelligence (AI) is finally upon us. Consumer applications of AI, in particular, have come a long way, leading to more accurate search results for online shoppers, allowing apps ...
- EEOC Issues Guidance on the Interplay between the Use of Artificial Intelligence in Employment Decisions and the ADA (US)on May 17, 2022 at 5:00 pm
Many businesses use artificial intelligence (“AI”), algorithms, software, and other forms of technology to make employment-related decisions. Employers now have an array of computer-based ...
- Artificial intelligence to help autonomous vehicles avoid idling at red lightson May 17, 2022 at 6:03 am
While that might be just a lucky break for a human driver, it could be achieved more consistently by an autonomous vehicle that uses artificial intelligence to control ... can be very confusing to the ...
- Must-read of the week: AI by Design: A Plan For Living With Artificial Intelligence by Catriona Campbellon May 17, 2022 at 2:53 am
Must-read of the week: AI by Design: A Plan For Living With Artificial Intelligence by Catriona Campbell msn back to msn home money web search Skip to Navigation Skip to Content Skip to footer Sign in ...
- Artificial intelligence experts helping NATO with new ‘horizontal scanning’ initiativeon May 16, 2022 at 2:30 pm
... AI experts also met with NCI Agency scientists and engineers at the agency’s labs based in the Netherlands, where they observed demonstrations on how artificial intelligence systems can be trained ...
- Is Artificial Intelligence Made in Humanity’s Image? Lessons for an AI Military Educationon May 16, 2022 at 12:50 am
Artificial intelligence is not like us ... The U.S. Defense Advanced Research Projects Agency participated in this trend by pitting Heron Systems’ F-16 AI against a skilled Air Force F-16 pilot in ...
- Artificial intelligence can offset human frailties, leading to better decisionson May 12, 2022 at 9:35 am
Modern life can be full of baffling encounters with artificial intelligence—think misunderstandings with customer service chatbots or algorithmically misplaced hair metal in your Spotify playlist.
- Using algorithms and artificial intelligence for hiring risks violating the Americans with Disabilities Act, Biden admin sayson May 12, 2022 at 8:00 am
We hope this sends a strong message to employers that we are prepared to stand up for people with disabilities," said Assistant Attorney General Kristen Clarke.
- Artificial Intelligence Agents Argue to Enhance the Speed of Materials Discovery (IMAGE)on May 11, 2022 at 2:29 pm
An ensemble of AI agents observes streaming X-ray data, argues amongst themselves, and votes to establish both classification and uncertainty in the prediction. This offers an educated guess about the ...
via Google News and Bing News
