The technique in this article will be using Control Net with recolor, control weight option at low settings to add variance to your images. Another similar technique to this is setting the denoise strength higher and closer to 1 (.1 is closest to photocopy) while using image to image. However, image to image lacks the precise control that Control Net allows.
__
reference image
__
This prompt was used for each image generation below of Tank Girl in this guide - "VHS, glitch, distorted, nostalgia, 90's retro vibes, analog tape, vcr aesthetics, tv, television, hand drawn, (full roygbiv color) ink charcoal expressive illustration, no light source, darkness, light mask uv rays across face, apparition, haunting, (wordless) rotoscope cinematic, steampunk tank girl, cogs, internal mechanisms"
This prompt guides the AI in how it will generate the image, bear in mind for your tastes and your text prompt, how it will change the output.
The lower the control weight setting, the more the text prompt is valued over the source image. (.4 a blend of image and prompt, .1 stronger weight of text prompt over reference image)
__
setting Control Net to recolor, balanced, and .4 control weight with low cfg scale (SDXL, Cheyenne model)
__
same settings with .3 control weight
__
same settings with .2 control weight
__
same settings with .1 control weight
___
I found best results around .2 control weight with cfg scale from 6 - 8
__
Using this control net method will produce different results from image to image. Control Net uses a conditioning image that more accurately maintains elements of the original image. Lowering the settings below .4 control weight allows you to experiment. Depending on your prompt, you can drastically alter the image, making it almost unrecognizable to the original if that is your intention.
Or change the prompt slightly and maintain a similar appearance to the original reference image.
__
Here is an example of using image to image, the source reference image of a space station at .600 image to image strength is clearly maintained.
This is the same generation with image strength set to the highest 1 setting.
__
Here are some examples of this same source space station image regenerated though the low control weight recolor technique to give you some ideas for creatively remixing your images.