Hi there, I have designed a form based assessment which I think is quite great 
. However, the issue is that every single time you submit the Pickaxe, it outputs different results even though the same inputs are there and the scoring is very clearly defined in the prompt box. I have gone through this in detail with many ai’s and am stumped. It is my main lead magnet and really need it to work. Please help!!! I am on a podcast tomorrow and was hoping to advertise it. Thanks!
Hi!
AI models can sometimes introduce variability in their responses, even when the same input is provided. Small differences in the AI’s reasoning or output formatting can cause inconsistency.
You can try going into the Configure tab of your Pickaxe and, under the Creativity section, set the randomness value to the minimum. This will make the responses more deterministic and could help with consistency.
It can also help to make your prompt as clear and structured as possible, specifying exactly how you want the scoring and output to work. If you haven’t already, you might want to include sample inputs and outputs in your instructions to help guide the model.
If you continue to see inconsistent results, let me know more details about your setup and instructional prompts.
@p2l how many permutations do you have?
As @danny_support points out responses are by nature non-deterministic even if you would think calculations should always be correct.
Another couple of options are:
- In-Context Learning (ICL): add examples in the prompt to show the model how to perform the calculation
- Use an action and run the calculation deterministically in Make for example and then return the result in Pickaxe