byroneverson
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -20,7 +20,7 @@ tags:
|
|
20 |
|
21 |
# byroneverson/glm-4-9b-chat-abliterated-gguf
|
22 |
|
23 |
-
## Version 1.1 (Updated 9/1/2024): Layer
|
24 |
|
25 |
This model was converted to GGUF format from [`byroneverson/glm-4-9b-chat-abliterated`](https://huggingface.co/byroneverson/glm-4-9b-chat-abliterated) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
|
26 |
Refer to the [original model card](https://huggingface.co/byroneverson/glm-4-9b-chat-abliterated) for more details on the model.
|
|
|
20 |
|
21 |
# byroneverson/glm-4-9b-chat-abliterated-gguf
|
22 |
|
23 |
+
## Version 1.1 (Updated 9/1/2024): Layer 16 is used for abliteration instead of 20. Refusal mitigation tends to work better with this layer. PCA and cosine similarity tests seem to agree.
|
24 |
|
25 |
This model was converted to GGUF format from [`byroneverson/glm-4-9b-chat-abliterated`](https://huggingface.co/byroneverson/glm-4-9b-chat-abliterated) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
|
26 |
Refer to the [original model card](https://huggingface.co/byroneverson/glm-4-9b-chat-abliterated) for more details on the model.
|