Q: Installing Local LLM?

Greetings.

Wondering how complicated it is to install one of the Local LLMs.
Could you please comment on this or point us to an online walkthrough?

What is the main advantage of using a Local LLM? Is it mainly an issue of privacy?
What if one of the Local LLMs has been updated, does Socrates notify us about this?

When a Local LLM is installed on a computer can it only be used with Socrates or can it also be used outside of Socrates AI?

Thanks for your assistance.

hashitaPLUSDec 3, 2024
Founder Team
Jon_Socrates

Jon_Socrates

Dec 3, 2024

A: Hello, please find more information here: https://roadmap.asksocrates.app/p/local-models-info-IUuzNQ

Yes, it's mainly privacy, and the Local Models page will be updated with the latest and greatest.

You can use downloaded models outside Socrates -- the path to the model is located in the link above.

Share
Helpful?
Log in to join the conversation