DrivenToEmpowerQ: Hi, what is the max amount of words that can be used for a prompt input for both models GPT-3.
5 and GPT-4?
Michal_Voilá
May 15, 2024A: Hey there!
depending on the language of the input and output (language models operate with tokens, now words and the limit is slightly different for different languages), GPT-4 can handle approximatelly up to 6000 words per conversation and GPT-3.5 up to arund 3000 words.
Best,
Michal
Verified purchaser
Hi Michal! Thank you for the clarification.
Can you also clarify what tier 2 entails as far as limits regarding GPT3.5 and GPT-4?
Verified purchaser
Regarding my second question, I am referring to the monthly word limits for both models.
Verified purchaser
Hi there,
Tier 2 has unlimited GPT3.5 words monthly. Currently there's around 375,000 GPT-4 words each month (which is out fair usage policy, although this may change in the future).
Best regards,
Michal
Verified purchaser
I appreciate your answer! Please elaborate on this "Might change in the future."
How so? For better? What exactly do you mean?
Verified purchaser
Hello again and thank you for your question.
Tier 2 isn't about unlimited GPT-4 usage, but about unlimited requests. Even though we want this LTD deal to benefit from GPT-4 as much as possible, we have to reserve the right to adjust the fair usage policy in the future.
We will be adding an option for OpenAI API key for anyone that needs unlimited access to GPT-4.
Our FUP may be decreased or increased in the future, depending on the pricing of the model. Also, I believe there are other models coming to the market soon, they may be better for these tasks and more cost effective – that's why I think being fixed on a one specific model does not make sense in the long run.
I hope this answers your question
Best,
Michal