Can Pickaxe scan a Google Drive folder URL and it’s contents as a knowledge base.
Hi. I’m adding Google Doc link, it’s available for view from web, but I still get: “Google Docs links are not supported. Please download and upload as a file instead.”
Google Docs are not web-pages. They are cloud-hosted documents. I know from your POV the two are the same thing, but web-scrapers cannot scrape google docs. I would suggest just downloading the Google Doc as a file and then uploading that into the KB.
In the future, we will build a dedicated Google Drive integration within the Knowledge Base. But that day is not yet upon us.
Go it. Thanks @admin_mike . I mean I need to automate the process as my Knowledge base needs to be auto updated. So files aren’t a solution in this case…
@metamediary you can build an automation with Make where every time a file if added in one of the Google drive folders, it gets copied into a url/webpage that can be scraped by Pickaxe.
Сan I embed published Google Doc into a web page then?
I’m no expert but I suspect it will be the same problem - scraper won’t be able to detect your Google Doc’s content. May I ask did you find a good solution that works for you? I’m having a similar challenge.
@uldisbiz where are your source documents? Google Drive?
Do you have steps for this? I’m in an Industry where i can’t have files on random servers - Google, Microsoft is acceptable, but I’ve had a hard time explaining to my bosses that Pickaxe seem like good people, y’know.
Indeed, this would be great to know!!
@rjwonder @simonh @uldisbiz @metamediary this is the basic dynamic RAG I normally use with clients.
Now this would make a for an excellent video AB
I love this! I was just trying to make a custom webhook in Visual Studio and it was doing my head in. So you subscribe to all Pickaxe, Make and Pinecone and use all three API’s in Make to automate a refresh as soon as a new file hits?
A subscription to Pickaxe is needed for sure. Subscriptions for make depend entirely on your monthly automation operation volume (i.e. if you expect many users to use your app, and each usage will trigger a make automation, then you will have to subscribe to an advanced monthly/annual subscription tier). Otherwise, their free tier (with 1000 monthly operations) should be enough until you can get more users and begin scaling.
https://www.make.com/en/pricing/
Pinecone also has a free tier which should be enough during the early stages, but you’ll likely have to subscribe to a higher tier as you scale:
Cool! You are using Make to integrate Google Drive and others to move into PC. How do you deal with videos as PC doesn’t accept them.
Hi @katrin_birkholz - very good question. You can leverage Make’s file type filtering to effectively manage video files in your workflow (Note: There is no “specific” model that you “have to use”. It’s all dependent on your use case). By doing this, you ensure only compatible files are transferred to the PC Assistant. it’s a flexible method that allows you to exclude videos or handle them separately based on your needs.
If you need further customization, you can consider exploring additional integrations for video processing if you need your videos to be converted (this may add complexity).
Hi @katrin_birkholz,
You need to use a video ingestion model like TwelveLabs - https://www.twelvelabs.io/. Their Generate API returns a detailed description of the video that you can then add to the PC knowledge base. If you are only working with videos you can use TL instead of PC as they also offer a search assistant API.
On a side note, Mistral have just released an advance OCR API for complex PDF documents that can also be used to extract information before adding it to PC.
You are a Darling! Thank you so much for that. I have used Mistral only once, a year ago, and was not as impressed, but I will give it another try. Thank you! I see you are using miro. Do you like it? I’m still doing everything in Canva. Maybe time to switch I love these visuals! Again, Thank you!
Great! Yes I’m looking to have them handled separately then. @ab2308 had a couple of sweet suggestions below. Luckily PC expanded there file choices and that was already a plus but extracting transcript from videos would be of course fantastic! Thank you so much for your input!
No problem! We’re always happy to help Our goal is to ensure all users are always well equipped to build and launch their Pickaxes to market!