MFANN3bv0.6 / README.md
netcat420's picture
Update README.md
3e0389e verified
|
raw
history blame
684 Bytes
metadata
library_name: transformers
license: apache-2.0
datasets:
  - netcat420/MFANN
pipeline_tag: text-classification

MFANN 3b version 0.6

image/png

fine-tuned on the MFANN dataset as it stands on 5/2/2024 as it is an ever changing and expaning dataset.

WHY IS MY 8B MODEL FAILING BENCHMARKS HUGGINGFACE!!!!!!!!!!!!!!!!!!!!!!!!!

benchmark results for this 3b model:

64.34 <-- Average 62.63 <-- Arc 77.1 <-- HellaSwag 58.43 <-- MMLU 51.71 <-- TruthfulQA 74.66 <-- Winogrande 61.49 <-- GSM8K

currently the worlds best 2.78B parameter model!!!!!!!!!!! as of 5/2/2024