Скачать или смотреть Change this setting in LM Studio to run MoE LLMs faster.

I changed 2 settings in LM Studio and I increased my t/s by about 4x. My 8gb gpu (rtx 4060) now runs GPT OSS 120b at 20t/s and 20b at 30t/s. You read that right - 120b parameter model at Q4 on an 8gb GPU! GPU poor no more!
Please Like and Subscribe to support the channel! ‪@LearnMetaAnalysis‬

Access state of the art LLMs all in one place with ChatLLM – My 6 month review of ChatLLM:    • The best LLM service I know of is ChatLLM....  

Check out our LLM Peer Reviewer Prompt: https://learnmetaanalysis.etsy.com/ Promo Code for 30% off!: IDONTPAY4NOTHIN

Tutorials and how-to guides:

Meta-Analysis and Systematic Review Tutorials:
A complete ‘how-to’ meta-analysis workshop for free:    • How to do your first meta-analysis from st...  
Meta-analysis in JASP:    • JASP Meta-Analysis Tutorials  
Conventional meta-analysis:    • Tutorial: Meta-Analysis in R with metafor  
Three-level meta-analysis:    • Tutorial: Three-level Meta-analysis in R  
Three-level meta-analysis with correlated and hierarchical effects and robust variance estimation:    • Tutorial: Three-Level Meta-analysis with C...  

LLMs and PC Stuff:
Linux for Academics:    • Linux for Academics  
Build a custom research assistant yourself with no coding and for free:    • How to Connect Zotero to Mistral for a Fre...  
Connect a LLM to your Zotero (or any other local folder):    • How to connect a LLM to Zotero for a priva...  
Install OpenWebUI (it’s free and no coding!):    • Getting Started with Open WebUI for Local ...  

Free Software and Books
Tired of manually extracting data for systematic review and meta-analysis? Check out AI-Assisted Data Extraction, a free package for R!    • AI-Assisted Data Extraction with Large Lan...  
Full-text finder:    • Let me save you hours with a free tool tha...  
Free ebook on meta-analysis in R (no download required): https://noah-schroeder.github.io/revi...

Visit our website at https://learnmeta-analysis.com/

0:00 Intro and Settings
2:35 OSS 120b with OBS Running (slow)
3:30 OSS 120b without OBS Running (fast!)
6:54 LM Studio Warning About Big Models