How to use swadeshb/t5g2-4b4b-flat with PEFT:
from peft import PeftModel from transformers import AutoModelForSeq2SeqLM base_model = AutoModelForSeq2SeqLM.from_pretrained("google/t5gemma-2-4b-4b") model = PeftModel.from_pretrained(base_model, "swadeshb/t5g2-4b4b-flat")
The community tab is the place to discuss and collaborate with the HF community!
