Change LLM Model on the Fly

If your Pickaxe is not in a Studio, you should be able to change your LLM model on the fly without having to edit it.

Can you explain why you would want to do it? I think it’s an interesting idea, just curious what you would do with this.

Hey, Mike. Right now I am creating pickaxes to generate specific content for websites–kind of like an agency service. I’m making the prompts probably more detailed and verbose than necessary, but I’d like to test how the different LLMs respond to the same prompts.

Sometimes I might use a cheaper one when it will do the job…other times I want to trot out the big horse.

For what I’m doing, it is a little clumsy having to go back to edit the bot every time I want to change.

I see. Thanks for explaining.