Compositions created using database of well-known pop, classical and jazz artists
A marimba-playing robot with four arms and eight sticks is writing and playing its own compositions in a lab at the Georgia Institute of Technology. The pieces are generated using artificial intelligence and deep learning.
Researchers fed the robot nearly 5,000 complete songs — from Beethoven to the Beatles to Lady Gaga to Miles Davis — and more than 2 million motifs, riffs and licks of music. Aside from giving the machine a seed, or the first four measures to use as a starting point, no humans are involved in either the composition or the performance of the music.
The first two compositions are roughly 30 seconds in length. The robot, named Shimon, can be seen and heard playing them here and here.
Ph.D. student Mason Bretan is the man behind the machine. He’s worked with Shimon for seven years, enabling it to “listen” to music played by humans and improvise over pre-composed chord progressions. Now Shimon is a solo composer for the first time, generating the melody and harmonic structure on its own.
“Once Shimon learns the four measures we provide, it creates its own sequence of concepts and composes its own piece,” said Bretan, who will receive his doctorate in music technology this summer at Georgia Tech. “Shimon’s compositions represent how music sounds and looks when a robot uses deep neural networks to learn everything it knows about music from millions of human-made segments.”
Bretan says this is the first time a robot has used deep learning to create music. And unlike its days of improvising, when it played monophonically, Shimon is able to play harmonies and chords. It’s also thinking much more like a human musician, focusing less on the next note, as it did before, and more on the overall structure of the composition.
“When we play or listen to music, we don’t think about the next note and only that next note,” said Bretan. “An artist has a bigger idea of what he or she is trying to achieve within the next few measures or later in the piece. Shimon is now coming up with higher-level musical semantics. Rather than thinking note by note, it has a larger idea of what it wants to play as a whole.”
Shimon was created by Bretan’s advisor, Gil Weinberg, director of Georgia Tech’s Center for Music Technology.
“This is a leap in Shimon’s musical quality because it’s using deep learning to create a more structured and coherent composition,” said Weinberg, a professor in the School of Music. “We want to explore whether robots could become musically creative and generate new music that we humans could find beautiful, inspiring and strange.”
Shimon will create more pieces in the future. As long as the researchers feed it a different seed, the robot will produce something different each time — music that the researchers can’t predict. In the first piece, Bretan fed Shimon a melody comprised of eighth notes. It received a sixteenth note melody the second time, which influenced it to generate faster note sequences.
Bretan acknowledges that he can’t pick out individual songs that Shimon is referencing. He is able to recognize classical chord progression and influences of artists, such as Mozart, for example.
“They sound like a fusion of jazz and classical,” said Bretan, who plays the keyboards and guitar in his free time. “I definitely hear more classical, especially in the harmony. But then I hear chromatic moving steps in the first piece — that’s definitely something you hear in jazz.”
Shimon’s debut as a solo composer was featured in a video clip in the Consumer Electronic Show (CES) keynote and will have its first live performance at the Aspen Ideas Festival at the end of June. It’s the latest project within Weinberg’s lab. He and his students have also created a robotic prosthesis for a drummer, a robotic third arm for all drummers, and an interactive robotic companion that plays music from a phone and dances to the beat.
Learn more: Robot Uses Deep Learning and Big Data to Write and Play its Own Music
The Latest on: Music robot
[google_news title=”” keyword=”music robot” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]- 32 Random Thoughts I Had While Rewatching The Sound Of Musicon April 26, 2024 at 9:34 am
That gorgeous helicopter footage of the Alps never fails to impress during The Sound of Music ’s opening credits. Maria is merely an ant against the vast backdrop as she appears on the hill, with the ...
- For less than $10,000, you can buy your own flame-throwing robot dogon April 25, 2024 at 1:45 pm
Throwflame, an Ohio company, is offering up what it says is the world’s first robot dog with a flamethrower on its back, good for wildfire management, snow removal and fun.
- Zack Snyder's Rebel Moon Gets An Amish Paradise Music Video | GIANT FREAKIN ROBOTon April 25, 2024 at 8:14 am
The Scargiver on Netflix, and the movie left many critics downright … Continue reading "Zack Snyder's Rebel Moon Gets An Amish Paradise Music Video " ...
- AI music isn't going away. Here are 4 big questions about what's nexton April 25, 2024 at 7:00 am
Tennessee just passed the first U.S. law regulating generative AI in music. But the technology, adept at copying real artists' voices and styles, is moving too quickly for one law to keep up with.
- The robots are coming ... for your weddingon April 25, 2024 at 6:33 am
NEW YORK — After the vows, the champagne toasts, the filet mignon and the first dance between the bride and groom — after all the normal wedding stuff — came the cue. The cue for the abnormal wedding ...
- Tesla could start selling Optimus robots by the end of next year, Musk sayson April 23, 2024 at 5:20 pm
Tesla's humanoid robot is still in the lab, but it may be ready to sell as soon as the end of next year, chief executive Elon Musk said on Tuesday.
- What Could Go Wrong? Company Selling Robot Dog With Attached Flamethroweron April 23, 2024 at 2:30 pm
The flamethrower on the "Thermonator" has a fire breathing range of up to 30 feet, for those willing to shell out nearly $10,000.
- ‘Robot Dreams' Trailer: Pablo Berger's Oscar-Nominated Animated Debut Hits Theaterson April 23, 2024 at 11:30 am
Oscar-nominated "Robot Dreams" is getting a theatrical release almost one year after its Cannes debut.
- This robot is tackling litter on Belle Isle Beachon April 22, 2024 at 9:13 am
If you’re looking to automate more of your home cleaning setup, iRobot’s flagship Roomba Combo J9+ is on sale for $400 off. The vacuum-mop hybrid robot, which only arrived last fall, has a redesigned ...
- This Wi-Fi robot vacuum is discounted from $199 to $79on April 22, 2024 at 4:45 am
The iHome AutoVac Juno Robot Vacuum is an incredibly cheap robot vacuum which has many of the key benefits you need. It's on sale right now.
via Google News and Bing News