What you are pointing to are commonly called “Hallucinations”. There are several ways to combat hallucinations. While they are effective, they are not 100% full-proof, so be sure to always check your Pickaxe in the control panel and see that is answering well.
- In your prompt, tell it to double check answers for accuracy. While silly, this actually helps.
- Specifically instruct your Pickaxe to not make up answers. Include in your prompt, some text like: “If you don’t know the answer to this question, DO NOT MAKE UP an answer. Instead admit that you don’t know.”
- If you’ve provided your pickaxe with documents in the form of a knowledge base, go under “advanced settings”. Here you can include some specific language about how the AI should only draw from the information in your knowledge base. (see picture)