Running Dolphin Phi 2 in Google Colab

Описание к видео Running Dolphin Phi 2 in Google Colab

Link to Google Colab Notebook: https://colab.research.google.com/dri...

Dolphin Phi-2 is the Phi-2.0 model but completely unrestricted. You will want to run the model in CUDA, though you do not have to. Token generation is super slow if you run it in CPU only mode. This model takes more GPU than a Quantized 7B which is always interesting. Removing the guardrails also surprisingly, or unsurprisingly, cleans up a lot of the issues that the base model has. This model is so much better to work with.

Комментарии

Информация по комментариям в разработке

Похожие видео