sxiong/MLR_structured_trajectory
Viewer • Updated • 12k • 87 • 1
How to use swadeshb/t5g2-4b4b-flat with PEFT:
from peft import PeftModel
from transformers import AutoModelForSeq2SeqLM
base_model = AutoModelForSeq2SeqLM.from_pretrained("google/t5gemma-2-4b-4b")
model = PeftModel.from_pretrained(base_model, "swadeshb/t5g2-4b4b-flat")Base model
google/t5gemma-2-4b-4b