Using LLMs to generate better prompts
All of the preceding rules or tips are helpful for a better understanding of how Stable Diffusion works with prompts. Since this is a book about using Stable Diffusion with Python, we don’t want to handle these tasks by ourselves manually; the ultimate goal is to automate the whole process.
Stable Diffusion is evolving fast, and its cousins, the LLM and multi-modality community, are no slower. In this section, we are going to leverage LLMs to help us generate prompts with some keyword input. The following prompt will work for various kinds of LLM: ChatGPT, GPT-4, Google Bard, or any other capable open source LLM.
First, let’s tell the LLM what it is going to do:
You will take a given subject or input keywords, and output a more creative, specific, descriptive, and enhanced version of the idea in the form of a fully working Stable Diffusion prompt. You will make all prompts advanced, and highly enhanced. Prompts you output...