Q: Why is this so slow compared to chatbots like Chatnode?
It sometimes takes 10 minutes, using any LLM such as Sonnet 3.5, GPT4o Gpt4. It probably has a lot to do with how you store that information. Maybe use another vector database? Other chatbots only take a couple of seconds, not minutes.
In chatnode I have 200 books loaded.
I have 450 books loaded in Afforai.
Alec_Afforai
Jul 4, 2024A: Hi mrZ, thanks for reaching out. It shouldn't that long. I'd be happy to look into this.
- Could you provide more context what you are trying to do, the prompt you're submitting, the AI model you are using?
- Are you using BYOK via OpenRouter? If so, can you try switching the model?
If relevant, could you provide copies of the files and screenshots of this issue? This would help us investigate this further. You can send the info using our chat support on Afforai. I'll be on standby waiting.
Here are some things I want to make sure you got setup correctly:
First, let's make sure you are using Afforai on one of the browsers we support so you can have the best experience. Afforai is best supported on Chrome, Safari, Firefox, Edge. We are not able to provide full support for any browsers outside of the ones mentioned above.
Second, can you please try clearing out your cache in the browser and check if this helps? As reminder, Afforai is a browser-based app, which means it’s subjected to a 2GB available memory limit. When loading or using Afforai or exceeds this memory limit, it can cause performance issues like long load times or crashes.
And thirdly, if you have any ad blocker extensions, please disable that.
Please check out our user guide here on how to properly use Afforai features:
https://help.afforai.com/en/articles/8478714-afforai-user-guide-how-to-videos