Skip to main content

Workflow

High level workflow

  1.       Figure out an write down the following specifications for the digital art project:
    1. Source of inspiration (Bible, images, movies, other art, etc.)
    2. Topic
    3. Context
    4. Theme
    5. Style
    6. Composition
    7. Subjects
    8. Background
  2. Create one or more (digital) sketches on how the global picture should look like.
  3. Separate the individual objects in the sketch in layers (e.g. in Krita or GIMP).
  4. Create a good prompt for each object (including negative prompts)
  5. Work from the back to the front (so start with the background).
  6. Use txt2img and ControlNet (lineart or softedge) to generate the background image, based on the background sketch.
  7. Use img2img Inpainting-tab for the farthest object
  8. Repeat up to the last object that is located at the front.
  9. Clean up interactions between objects using img2img Inpainting-tab.
  10. Clean up incorrect details (e.g. hands, eyes etc.) using img2img Inpainting-tab.
  11. Use img2img to create a more coherent image by playing with the denoising strength.
  12. Inspect the high resolution image for visible defects. NOTE: Inpainting can only be done up to 2048 x 2048 pixels!
  13. Use ControlNet Tile Upscaling method to get to a high resolution image. (Example: https://www.youtube.com/watch?v=yv4J4orS-SY)
  14. Inspect the high resolution image for visible defects. (HOW TO REPAIR THESE DEFECTS?)
  15. Use Photo editing software (e.g. Krita, GIMP or Lightroom) to enhance the colors etc. and check print in the final color space.
  16. Create an A4 info page for the picture
    1. Explain in compact form the topic and context by referencing the sources and own inspiration.
    2. Generate some nice background and details, similar to the picture.

SD-Web-UI Forge workflow

To get as close to the imagined concept and as efficiently as possible, the following workflow is proposed:

  1. Database selection:
    1. Checkpoint selection: Each model is trained for specific output. Use the right one! (Multiple can be combined)
    2. Add additional LoRa or LyCORIS files to improve specific features (download at: https://civitai.com/models) 
  2. Prompt creation:
    1. Use prompt perfector to get to a good descriptive prompt
    2. Use CLIP Interrogator to retrieve a prompt from an example image that can be used to get detailed prompts for specific features
    3. Use a fixed seed, in order to same results for the same prompt.
  3. Choose settings:
    1. Choose proper sampling method. Each method has it's own benefits and downsides.
    2. Use relative low resolution, but at the desired aspect ratio. Exact resolution is depending on the used database models (e.g. 512x512, 768x768, 1024x1024 px).
  4. Image generation:
    1. Iterate the prompt until the concept is mainly displayed.
  5. Finalize the details:
    1. Move to the img2img tab to use inpainting to improve certain aspects
  6. Upscale image:
    1. Move to Extras tab and set higher resolution and iterations. Fine-tune the prompt until all details are correct.
  7. Save image and save prompt & settings.
Back to top