Can a Pickaxe read a single webpage?

Hey! So sorry if this is already covered somewhere, but I searched and couldn’t find the answer. I’m noticing that my pickaxe can’t read a website when I give it the link. For example, I want to show it a sales page for something I’m working on and ask it a question about what it reads. It says it doesn’t have the capability. Is this an action I have to add?

Yes. You need to add the “Google Search” action. Also, the page must not be password protected or behind a paywall. Basically it has to be available to everyone.

Hmm ok…I do have that action turned on. Yet this is what the pickaxe says when I give it the link: “I’m unable to directly read content from the web or access specific websites.”

Possibly a bug then. you may have to modify the trigger, because as it stands it wants the user to trigger it. Why don’t you just put it into your knowledgebase instead? That way you know it is getting it all. Webpage scraping is always hit or miss. Especially if it is in Java-script.

Pickaxes can read single webpages.

It sounds like you’re talking about an end-user putting a webpage link into a chatbot. So I’ll explain that in detail here.

Yes, the chatbot usually can read a webpage link. Webpages are treated as end-user document uploads. When our system sees one, it will visit the page, scrape the webpage text, and dump the text into the chat. The amount of text that is fit into the chat is determined by the Max Input Length setting found under the Configure tab.

That being said :warning: … chatbots are easily misled. If you include a very long message and the weblink and tell it to visit the website, it’s going to say that it cannot visit the website. That’s because the underlying LLM indeed cannot visit webpages. The web-scraping is a system we Pickaxe have built on top of the LLMs. The LLM will get confused and tell you it cannot visit webpages. But under the hood our system is actually scraping the system. And sometimes our system is not able to scrape a webpage. Different webpages behave differently.

So if you’re getting problems with these I would try revisiting your prompt. Here’s an example of a very simple summary tool. Try dropping in just a webpage link and it will summarize it (without using the Google Search action).

Another solution is to use the Google Search action. That can work too.

Thank you! I will try this out.