Compositions created using database of well-known pop, classical and jazz artists
A marimba-playing robot with four arms and eight sticks is writing and playing its own compositions in a lab at the Georgia Institute of Technology. The pieces are generated using artificial intelligence and deep learning.
Researchers fed the robot nearly 5,000 complete songs — from Beethoven to the Beatles to Lady Gaga to Miles Davis — and more than 2 million motifs, riffs and licks of music. Aside from giving the machine a seed, or the first four measures to use as a starting point, no humans are involved in either the composition or the performance of the music.
Ph.D. student Mason Bretan is the man behind the machine. He’s worked with Shimon for seven years, enabling it to “listen” to music played by humans and improvise over pre-composed chord progressions. Now Shimon is a solo composer for the first time, generating the melody and harmonic structure on its own.
“Once Shimon learns the four measures we provide, it creates its own sequence of concepts and composes its own piece,” said Bretan, who will receive his doctorate in music technology this summer at Georgia Tech. “Shimon’s compositions represent how music sounds and looks when a robot uses deep neural networks to learn everything it knows about music from millions of human-made segments.”
Bretan says this is the first time a robot has used deep learning to create music. And unlike its days of improvising, when it played monophonically, Shimon is able to play harmonies and chords. It’s also thinking much more like a human musician, focusing less on the next note, as it did before, and more on the overall structure of the composition.
“When we play or listen to music, we don’t think about the next note and only that next note,” said Bretan. “An artist has a bigger idea of what he or she is trying to achieve within the next few measures or later in the piece. Shimon is now coming up with higher-level musical semantics. Rather than thinking note by note, it has a larger idea of what it wants to play as a whole.”
Shimon was created by Bretan’s advisor, Gil Weinberg, director of Georgia Tech’s Center for Music Technology.
“This is a leap in Shimon’s musical quality because it’s using deep learning to create a more structured and coherent composition,” said Weinberg, a professor in the School of Music. “We want to explore whether robots could become musically creative and generate new music that we humans could find beautiful, inspiring and strange.”
Shimon will create more pieces in the future. As long as the researchers feed it a different seed, the robot will produce something different each time — music that the researchers can’t predict. In the first piece, Bretan fed Shimon a melody comprised of eighth notes. It received a sixteenth note melody the second time, which influenced it to generate faster note sequences.
Bretan acknowledges that he can’t pick out individual songs that Shimon is referencing. He is able to recognize classical chord progression and influences of artists, such as Mozart, for example.
“They sound like a fusion of jazz and classical,” said Bretan, who plays the keyboards and guitar in his free time. “I definitely hear more classical, especially in the harmony. But then I hear chromatic moving steps in the first piece — that’s definitely something you hear in jazz.”
Shimon’s debut as a solo composer was featured in a video clip in the Consumer Electronic Show (CES) keynote and will have its first live performance at the Aspen Ideas Festival at the end of June. It’s the latest project within Weinberg’s lab. He and his students have also created a robotic prosthesis for a drummer, a robotic third arm for all drummers, and an interactive robotic companion that plays music from a phone and dances to the beat.
The Latest on: Music robot
- Karl Bartos: ‘Kraftwerk turned into the dehumanisation of music’on August 3, 2022 at 3:00 am
As the band’s drummer he co-created some of history’s greatest albums – but then the machines took over. As he publishes his memoir he explains how their computer world crashed ...
- Sampa the Great, Paul Kelly and Genesis Owusu: Australia’s best new music for Auguston August 2, 2022 at 9:33 am
Each month we add 20 new songs to our Spotify playlist. Read about 10 of our favourites here ...
- The best robot vacuums and mops on the market right nowon August 2, 2022 at 12:08 am
Robot vacuums have come a long way since they first launched in Australia. From improvements in suction power and AI obstacle detection technology to new functionalities like mopping and the ability ...
- This robot from Amazon monitors your home and follows you aroundon August 1, 2022 at 2:01 pm
Friendly Amazon bot for your home. Astro is an Amazon robot that monitors your home when no one is around. An app provides a live view of the house. Astro can also follow its operator around acting as ...
- I Kind Of Want This Tiny Robot To Control My Homeon July 30, 2022 at 8:00 am
If Vector looks familiar, it’s because the robot borrows its shape, and some of its mannerisms, from Anki’s last robopal: Cozmo. Two years ago, I developed an immediate fondness for a Cozmo, even as ...
- Hollywood & Mind: Maverick City Music’s Naomi Raine On Learning To ‘Step Into New Seasons Gracefully’on July 29, 2022 at 11:57 am
I think it was Biggie who said, ‘More money, more problems.’" Maverick City Music breakout star Naomi Raine chronicles her mental health struggles of the past few years on her new solo album The ...
- Bad Robot Expands Grace Del Val’s Role To General Counsel & Head Of Business Affairson July 28, 2022 at 10:12 am
Grace Del Val, Head of Business Affairs at Bad Robot, has now also been appointed General Counsel. With the promotion, Del Val will also assume an executive role as Bad Robot’s key corporate counsel, ...
- Golden Robot’s New Label Archangel Records Is Dedicated to Female Talenton July 26, 2022 at 5:03 pm
Its launch roster includes Brisbane singer-songwriter Ella Fence, Indonesian indie act SCALLER, and Texas alt-rock outfit Tough On Fridays.
- Stray: Where To Find All Eight Pieces Of Sheet Music In The Slumson July 26, 2022 at 10:38 am
The pieces of sheet music themselves are scattered all around the Slums, which can be tricky to navigate due to a lack of any sort of map or marker system. Thankfully, most pages can be found in key ...
- RS Recommends: The Best Robot Lawn Mowers for Every Size of Yardon July 26, 2022 at 2:52 am
Think of it like a robot vac, but for mowing your lawn. There have been a few different attempts at these over the years, all with varying success. And while it’s still a pretty new product that will ...
via Google News and Bing News