Qwen QwQ 2.5 32B Ollama Local AI Server Benchmarked w/ Cuda vs Apple M4 MLX

The new Qwen with Questions aka QwQ LLM fine tune based off the popular Qwen 2.5 32B base is a unique step in chain of though and reasoning which really is impressive! I was lucky enough to find some stats from a X poster about their Apple Q8 M4 Max Tokens per second also to compare against for all those who have been asking. This is must watch and frankly a fascinating model demonstrating some behaviors in its search for providing the best answers that are surprisingly human. Highly recommend pull this Ollama local Ai server model https://ollama.com/library/qwq

AI Home Server Quad 3090 Build    • INSANE Ollama AI Home Server - Quad 3...  
AI Playlist    • AI Rigs, Testing, Reviews, Use Cases ...  

QUAD 3090 AI SERVER BUILD
GPU Rack Frame https://geni.us/GPU_Rack_Frame
RTX 3090 24GB GPU (x4) https://geni.us/GPU3090
Gigabyte MZ32-AR0 Motherboard https://geni.us/mz32-ar0_motherboard
Supermicro H12ssl-i Motherboard https://geni.us/MBD_H12SSL-I-O
Kritical Thermal GPU Pads https://geni.us/Kritical-Thermal-Pads
256GB (8x32GB) DDR4 2400 RAM https://geni.us/256GB_DDR4_RAM
PCIe4 Risers (x4) https://geni.us/PCIe4_Riser_Cable
AMD EPYC 7702p https://geni.us/EPYC_7702p
iCUE H170i ELITE CAPELLIX https://geni.us/iCUE_H170i_Capellix
(sTRX4 fits SP3 and retention kit comes with the CAPELLIX)
ARCTIC MX4 Thermal Paste https://geni.us/Arctic_ThermalPaste
CORSAIR HX1500i PSU https://geni.us/Corsair_HX1500iPSU
4i SFF-8654 to 4i SFF-8654 (x4) https://geni.us/SFF8654_to_SFF8654
HDD Rack Screws for Fans https://geni.us/HDD_RackScrews

Article on Qwen with Questions
https://qwenlm.github.io/blog/qwq-32b...

Be sure to 👍✅Subscribe✅👍 for more content like this!

Join this channel    / @digitalspaceport  

Digital Spaceport Website https://digitalspaceport.com

Patreon   / digitalspaceport  
Buy Me a Coffee https://buymeacoffee.com/digitalspace...

Please share this video to help spread the word and drop a comment below with your thoughts or questions. Thanks for watching!


*****
As an Amazon Associate I earn from qualifying purchases.

When you click on links to various merchants on this site and make a purchase, this can result in this site earning a commission. Affiliate programs and affiliations include, but are not limited to, the eBay Partner Network.
*****