opeyemisanusiQ: I ask a question to Claude 3.5 and got a warning. What is this about?
WARNING I GOT:
Warning: It seems we couldn't process your request this time, and rest assured, no coins were deducted. This might be due to:
Moderation of specific content.
Excessively large context for the LLM.
High demands on our LLM providers.
Novel models (beta) may have a global rate limit per minute, so try again soon.
Our tip? Switching LLMs might just solve it.
lesthertod
Nov 30, 2024A: Hi opeyemisanusi
Sometimes, when usage is high (not necessarily just in Straico, but also “upstream” directly with the providers) you may get that message. You can either click on the “regenerate” button to get Straico to ask the model for an answer again.
However, if this happens frequently, then please contact us to see if there's anything else going on!