Can AI\u002DToolkit be used to train or fine\u002Dtune LLMs like Phi or Mistral on a MiniPC, or does it only support LoRA training?

Thank you for your inquiry regarding the AI\u002DToolkit and its functionality for training or fine\u002Dtuning large language models (LLMs).\u000a\u000aI would like to clarify that the AI\u002DToolkit is exclusively designed for LoRA (Low\u002DRank Adaptation) training. Therefore, it does not support the direct training or fine\u002Dtuning of models like Phi or Mistral outside of the LoRA framework.

AI-Toolkit for Text to text LLM Model fine-tune? | MimicPC

rrenteriaPLUS

Dec 27, 2024

Q: AI-Toolkit for Text to text LLM Model fine-tune?

Can AI-Toolkit be used to train or fine-tune LLMs like Phi or Mistral on a MiniPC, or does it only support LoRA training?

Founder Team

Claire_MimicPC

Dec 30, 2024

A: Thank you for your inquiry regarding the AI-Toolkit and its functionality for training or fine-tuning large language models (LLMs).

I would like to clarify that the AI-Toolkit is exclusively designed for LoRA (Low-Rank Adaptation) training. Therefore, it does not support the direct training or fine-tuning of models like Phi or Mistral outside of the LoRA framework.

Helpful?

rrenteriaPLUS

Verified purchaser

Do you have any plans to include something to train LLMs not only LoRAs?

MimicPC

Share MimicPC

Related questions