Running MPT-30B on CPU - You DON"T Need a GPU

In this video, I will show you how to run a MPT-30B model with 8K context window on a CPU without the need of a Powerful GPU. We will be utilizing the GGML 4-bit quantized models with ctransformers package.

Subscribe if you found this helpful!

▬▬▬▬▬▬▬▬▬▬▬▬▬▬ CONNECT ▬▬▬▬▬▬▬▬▬▬▬
☕ Buy me a Coffee: https://ko-fi.com/promptengineering
|🔴 Support my work on Patreon: Patreon.com/PromptEngineering
🦾 Discord:   / discord  
▶️️ Subscribe: https://www.youtube.com/@engineerprom...
📧 Business Contact: [email protected]
💼Consulting: https://calendly.com/engineerprompt/c...
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
LINKS:
MPT-30B Github: https://github.com/abacaj/mpt-30B-inf...
The Bloke HF Repo: https://huggingface.co/TheBloke/mpt-3...
LocalGPT:    • LocalGPT: OFFLINE CHAT FOR YOUR FILES...  
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
All Interesting Videos:
Everything LangChain:    • LangChain  

Everything LLM:    • Large Language Models  

Everything Midjourney:    • MidJourney Tutorials  

AI Image Generation:    • AI Image Generation Tutorials