Q: Is there a way to limit the daily use of openai tokens per chatbot, or to add captcha (to avoid abuse).
jass_
May 14, 2024A: Hello,
OpenAI itself has put the rate limits on the use of API calls. It has already defined how many token per minute and how many requests per minute can called. Here's a page: https://platform.openai.com/docs/guides/rate-limits/overview
Other than that, you can also guide your chatbot to respond in less number of tokens which can further help with the token abuse. Try to use models other than 16k.
Regards,
Simar
f82f75c7e4b7405e8a6ba51502e349e4Thanks a lot for the quick reply. From you reply I understand that I can limit the use of my openAI API (according to the openAI website I can limit the number of request per DAY, the requests per MINUTE and the tokens per MINUTE. That's a good start. However, it would be even more convenient to be able to set limits at the level of the chatbot within Cloozo, especially tokens per DAY or per (e.g.6 hours).
Please consider adding anti abuse features to your roadmap (max number of request/token per day/week 6hours), email warning if certain token threshold is reached, captcha, limit request from same IP. Also to allow setting different limits for chatbots which share the same openAI API keys.
Thank a lot.