THE NEW AI SYSTEM TAKES ITS INSPIRATION FROM HUMANS: WHEN A HUMAN SEES A COLOR FROM ONE OBJECT, WE CAN EASILY APPLY IT TO ANY OTHER OBJECT BY SUBSTITUTING THE ORIGINAL COLOR WITH THE NEW ONE.
Imagine an orange cat. Now, imagine the same cat, but with coal-black fur. Now, imagine the cat strutting along the Great Wall of China. Doing this, a quick series of neuron activations in your brain will come up with variations of the picture presented, based on your previous knowledge of the world.
In other words, as humans, it’s easy to envision an object with different attributes. But, despite advances in deep neural networks that match or surpass human performance in certain tasks, computers still struggle with the very human skill of “imagination.”
Now, a USC research team comprising computer science Professor Laurent Itti, and PhD students Yunhao Ge, Sami Abu-El-Haija and Gan Xin, has developed an AI that uses human-like capabilities to imagine a never-before-seen object with different attributes. The paper, titled Zero-Shot Synthesis with Group-Supervised Learning, was published in the 2021 International Conference on Learning Representations on May 7.
“We were inspired by human visual generalization capabilities to try to simulate human imagination in machines,” said Ge, the study’s lead author.
“Humans can separate their learned knowledge by attributes—for instance, shape, pose, position, color—and then recombine them to imagine a new object. Our paper attempts to simulate this process using neural networks.”
“This new disentanglement approach, for the first time, truly unleashes a new sense of imagination in A.I. systems, bringing them closer to humans’ understanding of the world.”
AI’s generalization problem
For instance, say you want to create an AI system that generates images of cars. Ideally, you would provide the algorithm with a few images of a car, and it would be able to generate many types of cars—from Porsches to Pontiacs to pick-up trucks—in any color, from multiple angles.
This is one of the long-sought goals of AI: creating models that can extrapolate. This means that, given a few examples, the model should be able to extract the underlying rules and apply them to a vast range of novel examples it hasn’t seen before. But machines are most commonly trained on sample features, pixels for instance, without taking into account the object’s attributes.
The science of imagination
In this new study, the researchers attempt to overcome this limitation using a concept called disentanglement. Disentanglement can be used to generate deepfakes, for instance, by disentangling human face movements and identity. By doing this, said Ge, “people can synthesize new images and videos that substitute the original person’s identity with another person, but keep the original movement.”
Similarly, the new approach takes a group of sample images—rather than one sample at a time as traditional algorithms have done—and mines the similarity between them to achieve something called “controllable disentangled representation learning.”
Then, it recombines this knowledge to achieve “controllable novel image synthesis,” or what you might call imagination. “For instance, take the Transformer movie as an example” said Ge, “It can take the shape of Megatron car, the color and pose of a yellow Bumblebee car, and the background of New York’s Times Square. The result will be a Bumblebee-colored Megatron car driving in Times Square, even if this sample was not witnessed during the training session.”
This is similar to how we as humans extrapolate: when a human sees a color from one object, we can easily apply it to any other object by substituting the original color with the new one. Using their technique, the group generated a new dataset containing 1.56 million images that could help future research in the field.
Understanding the world
While disentanglement is not a new idea, the researchers say their framework can be compatible with nearly any type of data or knowledge. This widens the opportunity for applications. For instance, disentangling race and gender-related knowledge to make fairer AI by removing sensitive attributes from the equation altogether.
In the field of medicine, it could help doctors and biologists discover more useful drugs by disentangling the medicine function from other properties, and then recombining them to synthesize new medicine. Imbuing machines with imagination could also help create safer AI by, for instance, allowing autonomous vehicles to imagine and avoid dangerous scenarios previously unseen during training.
“Deep learning has already demonstrated unsurpassed performance and promise in many domains, but all too often this has happened through shallow mimicry, and without a deeper understanding of the separate attributes that make each object unique,” said Itti. “This new disentanglement approach, for the first time, truly unleashes a new sense of imagination in A.I. systems, bringing them closer to humans’ understanding of the world.”
Original Article: USC researchers enable AI to use its “imagination.”
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
Imagination in artificial intelligence systems
- Law Students Are Finally Learning to Be Practicing Lawyers: The Morning Minuteon August 20, 2021 at 3:00 am
TEACHING TECH - Speaking of the pandemic changing how and what the next generation of the legal profession is being taught, Law.com’s Zach Warren writes in this week’s Barometer newsletter that ...
- South Africa Granted the World's First Patent to an AI-Generated Invention. Who Will Follow?on August 19, 2021 at 6:25 am
The pioneering move underlined the question of whether artificial intelligence can be an inventor. What could the decision mean for other jurisdictions?
- How the US technology giants could fall foul of capitalismon August 18, 2021 at 9:05 pm
The world’s tech giants have embedded themselves so deeply in the popular imagination that few people can picture a digital world led by any other names. But this assumption overlooks how quickly ...
- The Inaugural OPPOHack Global Innovation Competition to Announce Outstanding Winnerson August 13, 2021 at 9:06 am
OPPO has also invited global venture capital firm Red Thread Ventures, Canada Research Chair in Autonomous Systems Director ... technology fields such as Artificial Intelligence, AR/VR, IoT ...
- The Inaugural OPPOHack Global Innovation Competition to Announce Outstanding Winnerson August 13, 2021 at 9:00 am
Deepening OPPO's tech leadership by building an international innovation platform - Empowering more young start-ups to explore new possibilities in sensory ...
Go deeper with Google Headlines on:
Imagination in artificial intelligence systems
Go deeper with Bing News on:
Controllable disentangled representation learning
- Tears Of The Black Tiger (Cert 18)on August 17, 2021 at 5:00 pm
Wisit Sartsanatieng's story, when disentangled fr m its knotty time structure, concerns a bandit peasant boy and a handsome policeman both in love with a governor's beautiful daughter. There are ...
- Islam and the cognitive study of colonialism: The case of religious and educational reform at Egypt’s al-Azharon August 9, 2021 at 7:48 am
Department of Jewish, Islamic, and Middle Eastern Studies, Washington University in Saint Louis, Saint Louis, MO 63130-4899, USA ...
- STABILITY AND CHANGES IN PARTY IDENTIFICATION IN TAIWAN: AN EXAMINATION OF LIFE CYCLE, COHORT, AND PERIOD EFFECTSon July 28, 2021 at 5:00 pm
H2: Older cohorts, who lived through the periods when the KMT employed a full range of political control, tend to have a strong KMT ... plural system and 34 seats of the party-list proportional ...
- Scientists Are Giving AI The Ability to Imagine Things It's Never Seen Beforeon July 19, 2021 at 10:43 pm
What the team has come up with here is called controllable disentangled representation learning, and it uses an approach similar to those used to create deepfakes – disentangling different parts ...
- New AI Can “Imagine” a Never-Before-Seen Objecton July 19, 2021 at 1:49 am
Similarly, the new approach takes a group of sample images--rather than one sample at a time as traditional algorithms have done--and mines the similarity between them to achieve something called ...