Experimentation with AI-generated images (VQGAN+CLIP) | Solarpunk airships fleeing a dragon
A few days ago I found the Twitter account @images_ai, which posts AI-generated images and links to these instructions for generating your own. I started playing around with it; some of my choice picks:
The first image I generated, “sci-fi heroes fighting fantasy heroes”
“cute catboys having a party”
Someone had figured out that if you add words like “unreal engine” to your prompt, you get more realistic graphics.
so here’s “sci-fi heroes fighting fantasy heroes trending on artstation | unreal engine”
“young sorcerer heiress of a cyberpunk corporation, with dragons on her side | unreal engine”
“the cat is over the moon|unreal engine”
“Ghosts of Saltmarsh”
wikiart16384 model, “Fully Automated Luxury Gay Space Communism:2 | unreal engine:1 | logo:-1”
At this point I read a tweet suggesting that a 16:9 image ratio generally produces better results, so I switched to using that.
“solarpunk forest village | studio ghibli | trending on artstation”
“mountain expedition encounters stargate | full moon | matte painting”
“xcom fighting sectoids | matte painting”
I decided to do some systematic experimentation: picking a starting prompt (“solarpunk airships fleeing a dragon”), fixing the random seed, and varying parts of the prompt to see how they changed.
In retrospect the initial prompt wasn’t great, since I’m not sure if any of the pictures really incorporated the “fleeing” aspect, so I could have picked a more fully meaningful prompt. In general, this AI seems to be better at understanding individual words than it is at understanding sentences. Oh well.
All of these use seed 13039289688260605078 (no special significance; it’s what got randomly rolled for the first one so I kept using it), image size 640*360.
I don’t have anything interesting conclude besides what you see from the images themselves. As I was posting these on Facebook, Marcello Herreshoff kindly joined in on the experimentation, coming up with additional prompts and generating pictures with them; I’ve credited his images where they appear. [EDIT: Marcello let me know that he hadn’t remembered to fix the seed for his pictures, but they got similar enough to my pictures anyway that I never even suspected!]
“solarpunk airships fleeing a dragon”
“solarpunk airships fleeing a dragon | Dr. Seuss” (Marcello)”
“solarpunk airships fleeing a dragon | Dr. Seuss | text:-1” (Marcello)
“solarpunk airships fleeing a dragon | paul klee” (Marcello)
“solarpunk airships fleeing a dragon | Salvador Dali” (Marcello)
“solarpunk airships fleeing a dragon | Ukiyo-e” (Marcello)
“solarpunk airships fleeing a dragon | van gogh” (Marcello)
“solarpunk airships fleeing a dragon in the style of h.r. giger”
“solarpunk airships fleeing a dragon in the style of h.r. giger | pastel colors”
“solarpunk airships fleeing a dragon in the style of my little pony friendship is magic”
“solarpunk airships fleeing a dragon | studio ghibli”
“solarpunk airships fleeing a dragon | trending on artstation”
“solarpunk airships fleeing a dragon | studio ghibli | trending on artstation”
“solarpunk airships fleeing a dragon | unreal engine | trending on artstation”
“solarpunk airships fleeing a dragon | watercolor”
“matte painting of solarpunk airships fleeing a dragon”
“matte painting of solarpunk airships fleeing a dragon | trending on artstation”
“matte painting of solarpunk airships fleeing a dragon in the style of h.r. giger | studio ghibli | unreal engine | trending on artstation”
“children’s storybook illustration of solarpunk airships fleeing a dragon”
“solarpunk airships fleeing an octopus | trending on artstation”
“airships fleeing a dragon | trending on artstation”
“airships fleeing a dragon | ps1 graphics”
“airships fleeing a dragon | SNES graphics”
“airships fleeing a nuclear blast | trending on artstation”
“airships | trending on artstation”
“solarpunk trains fleeing a dragon | trending on artstation”
“solarpunk trains fleeing a dragon | ursula vernon”
“cyberpunk airships fleeing a dragon | trending on artstation”
“cyberpunk trains fleeing a dragon | trending on artstation”
“cyberpunk trains fleeing a baby | trending on artstation”