Responding slow

My bot is responding slow what is the fastest LLM I should be using for a quicker response?

We just switched over our backend from AWS to google cloud. Things are a little slow while we are dialing in the settings. Will be better in a day or two!

1 Like

THANK you for the update!

If you’re curious here is a generation latency chart Nathaniel posted about the average time to respond. We’re getting things back to normal ~2 second response times.

10-15 seconds is the norm for me (and makes any pickaxes I create comepletely useless).

What’s going on? Is this due to me being located in Europe? I’m beginning to lose hope.