Hi all,
My research agent is defaulting to providing URLs from the pickaxe domain, when providing responses. (e.g. https://beta.pickaxeproject.com/articles/screening-participants - not content here!)
I’ve included a statement in the Rules section, however it’s being ignored. I have a number of references in the knowledge base which are seeming to also be ignored.
Anyone have any more scaffolding tips I can include in the rules or instructions sections?
Much appreciated in advance!
Can you share a URL to your tool? I’m sure it’s just an issue with prompting.
Hi Mike - Here is the pickaxe tool - Service Bricks AI
Do you need admin access to checkout the prompt?
cheers,
Jas
I tried your tool and all the links it gave me were real links from a few domains. So it seems to be working.
However, if you are experiencing repeated problems, I suggest adding a section to the Role that says something like “Approved Domains/URLs” and then list them underneath.
thanks Mike - much appreciated! 
Hi Mike and team,
It appears that the pickaxe agent is still generating pickaxe domain URLs as references in it’s responses.
Under the #RULES section of the agent I inserted the following:
///start ref ///
*"5. If asked about tools and methods of design research, always provide a URL reference as a link in your response. If you generate or reference a URL, please check the validity of the reference and ensure it’s accurate (i.e. that there is the relevant content available at that link) before suggesting it to the user. *
6. Double Check your own answers for any hallucinations or false links/URLs. DO NOT MAKE UP ANSWERS. If you don’t know, admit it to the user, and recommend an alternative
7. Non-Approved Domains/URLs for reference responses:
- https://beta.pickaxeproject.com/
/// end ///
Check the URL link ref in the bottom left corner - all URLs are being self-referenced
Any tips / tricks are very appreciated - as this will discredit the platform for users if true URLs cannot be reffed…
cheers,
JD
Instructions in your prompt like “check the validity of the reference and ensure it’s accurate (i.e. that there is the relevant content available at that link)” will not work. The Pickaxe cannot actually visit links it is generating.
I suggest adding a section with approved URLs and asking it to only to give out links from there.
On the subject of it generating links with a pickaxe url structure… that is quite odd. Why is it giving any pickaxeproject URLs in the first place?
Hi Mike…ok I’ve removed the prompts that were asking the Pickaxe to check URLs and have re-written examples and references from the knowledge base for the Agent to use.
The reference to the beta pickaxe URL structure is STILL being generated. I’m not asking the Agent to refer to this. is it something default in the programming to relate to the hosted domain of the pickaxe???
e.g. **https://beta.pickaxeproject.com/videos**/why-40-participants-quantitative-research
THIS CONTENT DOES NOT EXIST IN THE KNOWLEDGE BASE
This is incredibly frustrating as the credibility of the Agent (and the pickaxe platform) will be questioned.
I really want to get to the bottom of this problem and re-structure my Agent prompt before I scale more Agents. Please help!
I cannot for the life of me get it to produce a pickaxeproject link. If we can reproduce the problem in the builder, then we can look at where it got the URL from.
