Using Llama-3.1-405B as a Coding Assistant with Continue.Dev, Ollama, and NVIDIA GH200 Superchip

Описание к видео Using Llama-3.1-405B as a Coding Assistant with Continue.Dev, Ollama, and NVIDIA GH200 Superchip

Running Llama-3.1-405B in just 2u of rackspace, under 3kW, with an industry standard server, the HPE ProLiant DL384 Gen12: https://www.hpe.com/ca/en/compute/pro...
Featuring 2x NVIDIA Grace Hopper GH200 superchips inside
Continue.Dev VSCode Plugin for coding assistance: https://continue.dev/
Ollama for model serving: https://ollama.com/
Open-WebUI for the chat frontend: https://openwebui.com/

Комментарии

Информация по комментариям в разработке

Похожие видео