DEVCamiloSepulveda/00-LLAMA3SP-mesos-usergrid

LLAMA 3 Story Point Estimator - mesos - usergrid

This model is fine-tuned on issue descriptions from mesos and tested on usergrid for story point estimation.

Model Details

• Base Model: LLAMA 3.2 1B

• Training Project: mesos

• Test Project: usergrid

• Task: Story Point Estimation (Regression)

• Architecture: PEFT (LoRA)

• Input: Issue titles

• Output: Story point estimation (continuous value)

Usage

from transformers import AutoModelForSequenceClassification, AutoTokenizer
from peft import PeftConfig, PeftModel

# Load peft config model
config = PeftConfig.from_pretrained("DEVCamiloSepulveda/00-LLAMA3SP-mesos-usergrid")

# Load tokenizer and model
tokenizer = AutoTokenizer.from_pretrained("DEVCamiloSepulveda/00-LLAMA3SP-mesos-usergrid")
base_model = AutoModelForSequenceClassification.from_pretrained(
    config.base_model_name_or_path,
    num_labels=1,
    torch_dtype=torch.float16,
    device_map='auto'
)
model = PeftModel.from_pretrained(base_model, "DEVCamiloSepulveda/00-LLAMA3SP-mesos-usergrid")

# Prepare input text
text = "Your issue description here"
inputs = tokenizer(text, return_tensors="pt", truncation=True, max_length=20, padding="max_length")

# Get prediction
outputs = model(**inputs)
story_points = outputs.logits.item()

Training Details

• Fine-tuning method: LoRA (Low-Rank Adaptation)
• Sequence length: 20 tokens
• Best training epoch: 8 / 20 epochs
• Batch size: 32
• Training time: 456.599 seconds
• Mean Absolute Error (MAE): 1.386
• Median Absolute Error (MdAE): 1.067

Framework versions

• PEFT 0.14.0