Artificial intelligence is one of the biggest things (if not THE biggest thing) in tech right now. And as the programs get smarter and computing power increases, we’re going to have an increasingly difficult time distinguishing the real from the manufacturer. The whole deep fake business scares the crap out of me.
AI researchers seem to be fascinated by how this tech can be used with music. This brings us to Sonya, a completely AI-generated performer created by a Ukrainian company called Reface. She (it?) isn’t the first AI artist, but she is a proof-of-concept. With Pacemaker, anyone can create their own Sonya.
I know, I know. It sounds a little too Frankenstein/Weird Science-y, but there’s no stopping it. Britney Spears, Miley Cyrus, and Snoop Dogg have already used Reface.
Here’s what we’re talking about. The artist and the song are completely the products of AI. An EP called Love and Black Glove will be out on Friday.
I quote from Pacemaker:
“We used a bunch of different online neural networks to generate lyrics, sounds, and visuals.
Enter a few words to choose a genre and specify your mood, and you’ll be given your unique name and original lyrics. For example, we used words like love, jealousy, and face. We then put these lyrics into the mouth of an online AI voice generator — and now she has a voice!
The music part was the most exciting. We used the Boomy neural network to generate both the beats and the album artwork. First, you need to pick a genre. Next, the network allows you to edit the arrangement and production, change instruments, and even add vocals. Finally, you can create a song and the album art for your release generated by AI. Just enter one word and get your cover! Want more pics? No problem. We also used VQGAN+CLIP-based text2art, where you enter a description, choose a quality level, and generate an image. Runway ML’s “storytelling machine that automatically generates synthetic images as you write new words and sentences” is pretty rad, too. And Artbreeder is a neural network that allows you to generate a portrait or a character by editing characteristics like age, gender, RGB color values, hair, etc.”
Great. Just great.
You can read more here.