view post Post 1058 remember boys and girls, always keep all your data, its never a waste of time! 👀 2 2 🧠 1 1 👍 1 1 + Reply
view post Post Full fine-tuning of Microsoft's Phi2 on a single 4090 is now supported in axolotl. Thanks to @abacaj and @vikhyatk for their help with gradient checkpointing and flash attention fixes. alpaca finetune: openaccess-ai-collective/phi2-alpacawandb: https://wandb.ai/oaaic/phi2/runs/00pc4ugb?workspace=user-wing-lianmerged PR: https://github.com/OpenAccess-AI-Collective/axolotl/pull/1058 8 replies · 👍 15 15 ❤️ 8 8 + Reply