How-to Run Your Own AI LLM For Free & Locally

Описание к видео How-to Run Your Own AI LLM For Free & Locally

In this video I will get into how to install and run your own open source and free AI model on a Windows computer. Note while the video is long, I tried to make it as simple as possible so anyone coming in should be able to run with it.

Note I forgot to mention, if you want a good LLM (AI brain). Ask on reddit for what useful LLM. There is a number of LLM communities and many will go out of their way to help you.

Links in the video:

Python: https://www.python.org/downloads/
LM Studio: https://lmstudio.ai/
Autogen: https://github.com/microsoft/autogen/...
Document on autogen: https://microsoft.github.io/autogen/d...
Example of multiple bots talking to each other: https://github.com/microsoft/autogen/...
Memgpt: https://github.com/cpacker/MemGPT
7B vs 13B vs 70B: https://replicate.com/blog/all-the-ll...

Timestamp
0:00 - Intro and general info you should know
2:24 - Python
2:56 - LM Studio
4:40 - 7B vs 13B vs 70B
13:46 - The code


●▬▬▬▬๑۩۩๑▬▬▬▬▬●
What I used to make my videos:
● My fav VPN: https://www.privateinternetaccess.com...
● Microphone: http://amzn.to/2yF8dUy
● Pop filter: http://amzn.to/2ArPIQu
● Webcam: http://amzn.to/2ydEvSf
● Video editing software: http://amzn.to/2Aq3nrj
● Starter light kit: http://amzn.to/2m3dr6J
● Color light: http://amzn.to/2zqYWhS
● Desk Light: http://amzn.to/2yG7K4j

👉 I am a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to amazon.com (Same with PIA)
●▬▬▬▬๑۩۩๑▬▬▬▬▬●

Donate: https://www.paypal.com/cgi-bin/webscr...
●▬▬▬▬๑۩۩๑▬▬▬▬▬●

Комментарии

Информация по комментариям в разработке