Prompt design versus engineering approaches
When we discussed the different shot approaches in the Take your shot section, that fell under prompt design. However, we also implemented prompt engineering when we filled in the prompt template with the question and context data we pulled from other parts of the RAG system. When we fill this prompt with data from other parts of the system, you may remember that this is called hydrating, which is a specific prompt engineering approach. Prompt design and prompt engineering have significant overlap and so you will often hear the terms used interchangeably. In our case, we are going to talk about them together, particularly how they can be used to improve our RAG application.
I have seen these concepts described in many different ways over the past few years, and so it would seem that our field still hasn’t formed a complete definition of each or drawn the line between them. For the purpose of understanding these concepts for this...