funsloth-train

SKILL.md

| Model | unsloth/llama-3.1-8b-unsloth-bnb-4bit | Good balance | | Max seq length | 2048 | Covers most use cases | | Load in 4-bit | True | 70% VRAM reduction | | LoRA rank | 16 | Good trade-off | | Batch size | 2 | Works on 8GB+ VRAM | | Gradient accumulation | 4 | Effective batch of 8 | | Learning rate | 2e-4 | Unsloth recommended |

Ask questions in order. See MODELSELECTION.md for model options and TRAININGMETHODS.md for technique details.

Generate a notebook with interactive configuration widgets. Users select options at runtime.

Unsloth 교육 노트북 및 스크립트를 생성합니다. 사용자가 교육 노트북을 생성하거나, 미세 조정 매개변수를 구성하거나, SFT/DPO/GRPO 교육을 설정하려는 경우에 사용합니다. 출처: chrisvoncsefalvay/funsloth.

원본 보기