Chat Fine tuning

ADVANCED Fine-tuning Repository Access
1. Unsupervised + Supervised Fine-tuning Notebooks
2. Q&A Dataset Preparation + Cleaning Scripts
3. Scripts to create and use Embeddings
4. Quantization Scripts
Learn more at: https://trelis.com/advanced-fine-tuni...

Chat fine-tuning Script
Buy Access Here: https://buy.stripe.com/5kAaFq4pLbe3bQ...

Resources:
- Presentation Slides: https://tinyurl.com/4dxty3n8
- Runpod Affiliate Link: (supports Trelis) https://tinyurl.com/yjxbdc9w
- Llama 2 instruction fine-tuning dataset: https://huggingface.co/datasets/Treli...

Relevant Videos:
- Tiny Llama (run a GGUF model on your laptop):    • Tiny Llama  

0:00 LLM instruction fine-tuning
0:07 Why do instruction fine-tuning?
1:10 Understanding special tokens and stop tokens
4:20 Instruction fine-tuning format
5:51 Guanaco instruction fine-tuning
6:05 Llama 2 prompt format
6:55 chatml prompt format
9:16 Instruction fine-tuning datasets
11:36 Fine-tuning a model for chat (in Jupyter lab)
16:00 Chat fine-tuning results
17:41 Pro tips