My bot is responding slow what is the fastest LLM I should be using for a quicker response?
We just switched over our backend from AWS to google cloud. Things are a little slow while we are dialing in the settings. Will be better in a day or two!
1 Like
THANK you for the update!
If you’re curious here is a generation latency chart Nathaniel posted about the average time to respond. We’re getting things back to normal ~2 second response times.
10-15 seconds is the norm for me (and makes any pickaxes I create comepletely useless).
What’s going on? Is this due to me being located in Europe? I’m beginning to lose hope.