Reading a website

General
1

Hello! Is it possible to create a Pickaxe that scrapes and reads all the pages of a website that the user uploads.

I know we can do this to add to the knowledge base, but what I’m thinking of is that the user shares their website, and the Pickaxe then ‘reads’ the whole website (not just the specific URL that was shared).

I would want it to then use the information it’s read/scraped to write something specific based on a prompt I create.

is this possible?

2

The easiest solution here would be to have the user save whatever web pages they want processed as PDFs and then go about it that way.

That’s how the “critique my web” sites all seemed to work and they were relatively successful for a moment.

3

The end-user of a Pickaxe cannot access the webpage scraper. They can only add a single webpage.

4

Ok thanks. They’ll need to share their links then :slight_smile: