Validate the solution
The most important part of this strategy is verifying correctness and that the text and code created by the AI assistant are correct. There are two general approaches we can take to verify our outcome:
- Verification via prompts: The first approach is to use prompts to verify the outcome. This means writing prompts that question the outcome of specific results. This can be a good strategy to employ at the beginning of your verification process. What you’re looking for are situations where the AI assistant isn’t consistent in its responses.
- Classical verifications: The second approach is to use classical verification techniques. What those techniques are varies depending on the problem domain. At a high level, though, it boils down to testing code, comparing output, and relying on your own knowledge, and the knowledge of your peers, to verify the outcome.
The AI tool doesn’t really know what it’s doing. The...