Handling knowledge for LLM solutions
Domain knowledge is key in creating LLM solutions as it provides the background information and understanding they need to solve specific problems. This ultimately ensures the answers or actions the solutions come up with are on point and helpful. Domain knowledge needs to be included as context either as part of parametric memory, non-parametric memory, or a combination of both. Parametric memory refers to the parameters that are learned in an LLM. Non-parametric memory refers to an external library of knowledge, such as a list of documents, articles, or excerpts, that can be selectively chosen to be injected as part of the LLM context. This process is also referred to as an in-context learning method, knowledge retrieval, or information retrieval.
Non-parametric external knowledge can be provided to an LLM through either of the following options:
- As a latent conditioner in the cross-attention mechanism: Latent conditioning involves...
