Techniques for building applications for LLMs

Now that you’ve learned about foundation models, and especially large language models, let’s talk through a few key ways you can use them to build applications. One of the most significant takeaways of the ChatGPT moment in December 2022 is that customers clearly love for their chat to be knowledgeable about every moment in the conversation, remember topics mentioned earlier and encompassing all the twists and turns of dialogue. Said another way, beyond generic question answering, there’s a clear consumer preference for chat to be chained. Let’s take a look at an example in the following screenshot:

Figure 15.1 – Chaining questions for chat applications

The key difference between the left- and the right-hand side of Figure 15.1 is that on the left-hand side, the answers are discontinuous. That means the model simply sees each question as a single entity before providing its...