axolotl-ai-internal/gpumode-py2triton-reasoning-v2-filtered
Viewer
•
Updated
•
8.21k
•
9
•
1
Axolotl AI Internal Models
community
AI & ML interests
None defined yet.
winglian
updated
a
dataset
8 months ago
winglian
published
2
datasets
8 months ago
winglian
updated
a
dataset
8 months ago
winglian
updated
a
model
9 months ago
winglian
published
a
model
9 months ago
winglian
updated
a
dataset
9 months ago
winglian
published
a
dataset
9 months ago
Post
Full fine-tuning of Microsoft's Phi2 on a single 4090 is now supported in axolotl. Thanks to
@abacaj
and
@vikhyatk
for their help with gradient checkpointing and flash attention fixes.
alpaca finetune: openaccess-ai-collective/phi2-alpaca
wandb: https://wandb.ai/oaaic/phi2/runs/00pc4ugb?workspace=user-wing-lian
merged PR: https://github.com/OpenAccess-AI-Collective/axolotl/pull/1058
alpaca finetune: openaccess-ai-collective/phi2-alpaca
wandb: https://wandb.ai/oaaic/phi2/runs/00pc4ugb?workspace=user-wing-lian
merged PR: https://github.com/OpenAccess-AI-Collective/axolotl/pull/1058
-
- 8 replies