Q: AI Training and Not Enough Tokens
I just purchased Tier 3 and one of the tasks I plan to use this software for is to develop course materials. For example, there are various codes and standards related to my career field and I want to upload the ones I need for the purpose of creating curriculums and getting ideas to better enhance the course material.
Here is my obstacle, the tokens allotted for one mind (200,000) just isn't enough for even one document. I tried my smallest document and it registered 159,169 tokens - a PDF that is about 2.5mb.
The large majority of resources I have are 3 times or more in size. I was looking for a solution that would allow me to easily train an agent and use that resource to work through the tasks I set for myself. Is there any way around this?
Your help would be greatly appreciated.
OMEHGAPLUSI can appreciate that the size of the file is more directly influenced by the way the file was created and saved. So, I decided to convert a few of the midsized documents and determine the word count.
Here are some results:
Document #1: 1,568 pages with 331,039 words
Document #2: 2,893 pages with 571,920 words
Document #3: 1,748 pages with 298,917 words
Token allotment exceeded, right?
Felipe_TriploAIHey! 200.000 tokens roughly relates to 150.000 words. Your documents indeed exceed the amounts of works accepted by our Minds.
We set these based on performance and also the average use of our users... I'll discuss with our Devs increasing it but don't expect a huge increase (3x or more) for now.
Take care
Felipe
OMEHGAPLUSI wasn't looking for an increase, but maybe more of a restructuring of tokens or ideally a reallocation of the 20M tokens. Tranquilo, irmão, eu entendo perfeitamente. Fiquei sabendo da sua empresa por um amigo e, como minha esposa é carioca, queria dar uma força pro seu projeto. Mas claro, só posso apoiar se o que você oferece realmente for o que eu tô precisando, né? Let me know.
Thank you for your kind words (it sounds even better in Portuguese :)). I’ll keep this in English so the other Summolings can access it as well.
The allowance tokens and the limits set for Trained Minds are unrelated. Minds are capped at 200,000 tokens to optimize performance and because very few users have requested larger token allocations per Mind—most find this enough
ps: Feel free to check our Training documentation at https://go.triplo.ai/training. Take care