Q: Best Llama 3.1 version supported?

I understand that now you offers a new Ultra plan. Can I know what is the best Llama 3.1 version that can be supported? 8B? 70B? 405B?

ah_quanAug 24, 2024
Founder Team
Claire_MimicPC

Claire_MimicPC

Aug 25, 2024

A: Based on the specifications:
Llama 3.1-8B: Requires at least 8GB of VRAM, which is fully supported by our Medium, Large, Large Pro, and Ultra plans.
Llama 3.1-70B: Requires approximately 70-75GB of VRAM. Unfortunately, this exceeds the capacity of even our Ultra plan, which provides 48GB VRAM.
Llama 3.1-405B: Requires extremely high VRAM and hardware resources, around 400-450GB VRAM, which is currently beyond the scope of what we offer.
So, the best Llama 3.1 version that our Ultra plan can support is the Llama 3.1-8B model.

If you have any further questions, feel free to ask!

Share
Helpful?
Log in to join the conversation