Webscrape Data - can we access it or export it

Hi There

I was just thinking, is it possible to do a website scrape and being able to send that data to Pinecone so that it can be accessed via a Make.com scenario?

You are probably thinking why on earth would you want to do that - I am just wanting to try something if it was possible.

I would imagine so! Our friend @ab2308 can probably answer more explicitly.

1 Like

@ihmunro it is possible but keep into account the following:

  • the scraper might not work as expected if you have complex HTML pages with buttons, links, table, etc…
  • the actions are sequential so you would need to get the response and then trigger another action to send it to Pinecone and a third action to run Make
  • this might slow the whole process and you don’t really have any error-handling option

I would send the URL to make, run the process there and return the result into Pickaxe. This should be faster and more reliable as you can add error-handling routes.

Note I’m not sure about the specific use case so there might be a better solution.