Update README.md
Browse files
README.md
CHANGED
@@ -6,13 +6,32 @@ This is a llamafile for [WizardLM-2-7B](https://huggingface.co/microsoft/WizardL
|
|
6 |
|
7 |
Converted and tested on 4/15/2024. Safetensors came from microsoft's hf, quantized with llama.cpp, zipaligned with llamafile.
|
8 |
|
9 |
-
The q3-k-l sized quant is under 4gb if you want something to share with your windows-only users.
|
10 |
|
11 |
Instructions to run q3-k-l on Windows:
|
12 |
Just download, add '.exe' to the filename, and open it. Bypass all friendly Microsoft warnings about using your own computer. It doesn't need network access, completely local.
|
13 |
|
14 |
Put it on a keychain! Share with friends! Perfect gift for significant other!
|
15 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
16 |
|
17 |
-= Llamafile =-
|
18 |
|
|
|
6 |
|
7 |
Converted and tested on 4/15/2024. Safetensors came from microsoft's hf, quantized with llama.cpp, zipaligned with llamafile.
|
8 |
|
9 |
+
The q3-k-l sized quant is under 4gb if you want something to share with your windows-only users. Quality is higher than the average high school student.
|
10 |
|
11 |
Instructions to run q3-k-l on Windows:
|
12 |
Just download, add '.exe' to the filename, and open it. Bypass all friendly Microsoft warnings about using your own computer. It doesn't need network access, completely local.
|
13 |
|
14 |
Put it on a keychain! Share with friends! Perfect gift for significant other!
|
15 |
|
16 |
+
usage notes:
|
17 |
+
Anything larger than the q3-k-l is going to be over 4gb and won't run as an .exe in Windows.
|
18 |
+
You'll need to use WSL, or another operating system.
|
19 |
+
|
20 |
+
WSL: If you get the error about APE, and the recommended command
|
21 |
+
|
22 |
+
sudo sh -c 'echo -1 > /proc/sys/fs/binfmt_misc/WSLInterop'
|
23 |
+
|
24 |
+
doesn't work, the WSLInterop file might be named something else. I had success with
|
25 |
+
|
26 |
+
sudo sh -c 'echo -1 > /proc/sys/fs/binfmt_misc/WSLInterop-late'
|
27 |
+
|
28 |
+
If that fails too, just navigate to /proc/sys/fs/binfmt_msc and see what files look like WSLInterop and echo a -1 to whatever they're called by changing that part of the recommended command.
|
29 |
+
|
30 |
+
|
31 |
+
size note:
|
32 |
+
|
33 |
+
Use q8_0, it's good.
|
34 |
+
|
35 |
|
36 |
-= Llamafile =-
|
37 |
|