But this is the very first time I have ever viewed a person of them applied to flip total tracks into images, and the results are so ideal that I’m convinced that the genuine killer software for this engineering is sleeping inside of David Bowie’s songs archive.
Really don’t consider me? Here’s Bowie’s “House Oddity,” produced by YouTube consumer aidontknow. Their procedure concerned typing the music lyrics into the AI prompt, verse by verse, to make each individual image for the video clip.
See what I necessarily mean?
Certain, the likes of Midjourney, Dall-E, and Secure Fusion will a single working day depart the uncanny valley at the rear of and give a in no way-ending resource of ideal stock shots that will appear as convincing as the serious point. But there is also a significant downside to all this enjoyment: These tools are effectively mining the present function of designers and photographers who receive no AI licensing expenses in a speedily evolving area that will have destructive downstream outcomes for the industry.
Suitable now, this video demonstrates that AI’s usually otherworldly benefits are however constrained: very well-suited for poetry and fantastic literature, but not something as well literal. That appears to be the idea that moved aidontknow to turn some of Ziggy Stardust’s music into new music slideshows.
Aidontknow made use of the similar methodology inside Midjourney to build this rendition of “Starman.” The movie description says that there are negligible adjustments and impact from the writer, which I found to be vital when I tried using to do the similar using Midjourney in Discord.
In some cases a verse will use the phrase it to reference an object or person named earlier in the track, for example, so I desired to swap it again to the subject’s far more specific identify so that the AI could identify what “it” was.
I only tried out a couple of verses per track to get an concept of how effectively it labored with different tracks. But making use of Midjourney for the task felt exhilarating: All I did was paste the lyrics, and the photographs slowly but surely materialized in entrance of my eyes without the need of any other work, like a genie pluming out of a lamp.
And in fact, I identified out that there looks to be a very clear correlation in between beauty and surrealism. The photographs for Tom Waits’s “Alice” (outcomes pictured around this paragraph) have been as magical as the track alone:
It is dreamy weather
We’re on [first image]
You waved your crooked wand
Together an icy pond
With a frozen moon [second image]
A murder of silhouette
Crows I saw [third image]
And the tears on my facial area
And the skates on the pond
They spell Alice [fourth image]
I got in the same way fantastical final results for the Beatles’ “Across the Universe” and the Rolling Stones’ “Gimme Shelter,” which also have rather visually evocative lyrics. The magic also labored for the poppy R&B riffs in Snoop Dogg’s “Fall It Like It’s Very hot.”
Occasionally, the AI built some errors in the literal interpretation of the words and phrases. Like in Waits’s “Tom Traubert’s Blues,” the line “See ya tomorrow, hey Frank can I borrow/ A few of bucks from you?” turned cash into literal male deer. (A “buck” I guess.) Which, mind you, in fact adds to the lyricism of it all. Like Bob Ross would say: “There’s no mistakes. Just pleased incidents.”
