Skip to main content

Workflow

High level workflow

  1.       Figure out the following specifications for the digital art project:
    1. Source of inspiration (Bible, images, movies, other art, etc.)
    2. Topic
    3. Context
    4. Theme
    5. Style
    6. Composition
    7. Subjects
    8. Background
  2. Create one or more (digital) sketches on how the global picture should look like.
  3. Separate the individual objects in the sketch in layers (e.g. in Krita or GIMP).
  4. Create a good prompt for each object (including negative prompts)
  5. Work from the back to the front (so start with the background).
  6. Use txt2img and ControlNet to generate the background image, based on the background sketch.
  7. Use img2img inpainting tab for the farthest object
  8. Repeat up to the last object that is located at the front.
  9. Clean up interaction between objects using img2img Inpainting-tab.

SD-Web-UI Forge workflow

To get as close to the imagined concept and as efficiently as possible, the following workflow is proposed:

  1. Database selection:
    1. Checkpoint selection: Each model is trained for specific output. Use the right one! (Multiple can be combined)
    2. Add additional LoRa or LyCORIS files to improve specific features (download at: https://civitai.com/models) 
  2. Prompt creation:
    1. Use prompt perfector to get to a good descriptive prompt
    2. Use CLIP Interrogator to retrieve a prompt from an example image that can be used to get detailed prompts for specific features
    3. Use a fixed seed, in order to same results for the same prompt.
  3. Choose settings:
    1. Choose proper sampling method. Each method has it's own benefits and downsides.
    2. Use relative low resolution, but at the desired aspect ratio. Exact resolution is depending on the used database models (e.g. 512x512, 768x768, 1024x1024 px).
  4. Image generation:
    1. Iterate the prompt until the concept is mainly displayed.
  5. Finalize the details:
    1. Move to the img2img tab to use inpainting to improve certain aspects
  6. Upscale image:
    1. Move to Extras tab and set higher resolution and iterations. Fine-tune the prompt until all details are correct.
  7. Save image and save prompt & settings.
Back to top