crestf411's picture
Update README.md
82c7576 verified
|
raw
history blame
1.31 kB
metadata
license: llama3
license_name: llama3
license_link: LICENSE
library_name: transformers
tags:
  - not-for-all-audiences

Daybreak (2024 May 24) v0.4 LoRA on top of https://huggingface.co/failspy/llama-3-70B-Instruct-abliterated

Beware, depraved. Not suitable for any audience.

Dataset curation to remove slop-perceived expressions continues. Unfortunately L3-Instruct (which this is merged on top of) is riddled with "barely audible"s and "couldn't help"s and "shivers down spines" etc.

The below regexes return 0 matches, but as noted above, there are still frequent occurrences of these in the base instruct merge. Bold entries are new since v0.3.

  • 'barely above a whisper',
  • 'barely audible',
  • 'shiver([s]?) down',
  • ' ministration',
  • 'audible (["'"]?)p[l]?op',
  • 'can't help but',
  • 'buck([s]?) my ',
  • 'buck([s]?) h[ei][rs] ',
  • '[Dd]espite h[ie][mr]self',
  • 'slick slit',
  • 'whatever it takes',
  • 'unlike anything (s?)he',
  • 'a mix([a-z]*) of',
  • 'wave after wave',
  • 'reckless abandon',
  • '[Mm]aybe, just maybe',
  • 'eyes gleaming',
  • 'mischievously',
  • "couldn't help but",

From testing so far, it feels like temperature 0.8-0.9 is a good starting point. I have mostly tested with everything neutralized. Please give feedback on which parameters work good for you.