Can you run an AI LLM on an old server?

Описание к видео Can you run an AI LLM on an old server?

Old servers are cheap, especially the memory meaning you can get a lot of RAM at a low cost. Does this make it viable to run AI language models at a low cost?

Ollama:
https://github.com/jmorganca/ollama

Issue relating to AVX:
https://github.com/jmorganca/ollama/i...

PDF for the server I have:
https://www.bargainhardware.co.uk/med...

Комментарии

Информация по комментариям в разработке