axolotl-ai-internal/gpumode-py2triton-reasoning-v2-filtered Viewer • Updated May 15, 2025 • 8.21k • 9 • 1
axolotl-ai-internal/gpumode-py2triton-reasoning-v2-filtered Viewer • Updated May 15, 2025 • 8.21k • 9 • 1
view post Post Full fine-tuning of Microsoft's Phi2 on a single 4090 is now supported in axolotl. Thanks to @abacaj and @vikhyatk for their help with gradient checkpointing and flash attention fixes. alpaca finetune: openaccess-ai-collective/phi2-alpacawandb: https://wandb.ai/oaaic/phi2/runs/00pc4ugb?workspace=user-wing-lianmerged PR: https://github.com/OpenAccess-AI-Collective/axolotl/pull/1058 8 replies · 👍 15 15 ❤️ 8 8 + Reply