metadata
library_name: transformers
tags: []
Model
- Base Model: google/gemma-2-9b-it
Dataset
- custom DPO dataset
For use
Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("ENERGY-DRINK-LOVE/gemma-2-9b_dpo-v4-hq")
model = AutoModelForCausalLM.from_pretrained("ENERGY-DRINK-LOVE/gemma-2-9b_dpo-v4-hq")