README.md

metadata

base_model:
  - Undi95/Llama3-Unholy-8B-OAS
  - ChaoticNeutrals/T-900-8B
library_name: transformers
tags:
  - mergekit
  - peft

T900-r64-LoRA

This is a LoRA extracted from a language model. It was extracted using mergekit.

LoRA Details

This LoRA adapter was extracted from ChaoticNeutrals/T-900-8B and uses Undi95/Llama3-Unholy-8B-OAS as a base.

Parameters

The following command was used to extract this LoRA adapter:

mergekit-extract-lora ChaoticNeutrals/T-900-8B Undi95/Llama3-Unholy-8B-OAS OUTPUT_PATH --no-lazy-unpickle --skip-undecomposable --rank=64 --extend-vocab --model_name=T900-r64-LoRA --verbose